[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:08:15.738634 16779 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.98.254:34021
I20260709 12:08:15.740211 16779 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:08:15.741281 16779 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:15.758558 16788 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:15.758551 16785 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:15.759414 16779 server_base.cc:1061] running on GCE node
W20260709 12:08:15.758605 16786 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:16.981741 16779 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:16.981986 16779 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:16.982259 16779 hybrid_clock.cc:648] HybridClock initialized: now 1783598896982236 us; error 0 us; skew 500 ppm
I20260709 12:08:16.983212 16779 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:16.989105 16779 webserver.cc:533] Webserver started at http://127.16.98.254:44009/ using document root <none> and password file <none>
I20260709 12:08:16.990072 16779 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:16.990300 16779 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:16.990823 16779 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:16.996789 16779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895573690-16779-0/minicluster-data/master-0-root/instance:
uuid: "66f3a9991e43402ba1b4dc88e97c938a"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-9bv4"
I20260709 12:08:17.004805 16779 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.001s	sys 0.008s
I20260709 12:08:17.010401 16794 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.011647 16779 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.002s
I20260709 12:08:17.012038 16779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895573690-16779-0/minicluster-data/master-0-root
uuid: "66f3a9991e43402ba1b4dc88e97c938a"
format_stamp: "Formatted at 2026-07-09 12:08:16 on dist-test-slave-9bv4"
I20260709 12:08:17.012359 16779 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895573690-16779-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895573690-16779-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895573690-16779-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:17.105723 16779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:17.107299 16779 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:08:17.107791 16779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:17.182330 16779 rpc_server.cc:307] RPC server started. Bound to: 127.16.98.254:34021
I20260709 12:08:17.182423 16845 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.98.254:34021 every 8 connection(s)
I20260709 12:08:17.191339 16846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:17.213183 16846 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66f3a9991e43402ba1b4dc88e97c938a: Bootstrap starting.
I20260709 12:08:17.219229 16846 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 66f3a9991e43402ba1b4dc88e97c938a: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:17.221194 16846 log.cc:826] T 00000000000000000000000000000000 P 66f3a9991e43402ba1b4dc88e97c938a: Log is configured to *not* fsync() on all Append() calls
I20260709 12:08:17.225929 16846 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66f3a9991e43402ba1b4dc88e97c938a: No bootstrap required, opened a new log
I20260709 12:08:17.246570 16846 raft_consensus.cc:359] T 00000000000000000000000000000000 P 66f3a9991e43402ba1b4dc88e97c938a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66f3a9991e43402ba1b4dc88e97c938a" member_type: VOTER }
I20260709 12:08:17.247141 16846 raft_consensus.cc:385] T 00000000000000000000000000000000 P 66f3a9991e43402ba1b4dc88e97c938a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:17.247426 16846 raft_consensus.cc:740] T 00000000000000000000000000000000 P 66f3a9991e43402ba1b4dc88e97c938a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66f3a9991e43402ba1b4dc88e97c938a, State: Initialized, Role: FOLLOWER
I20260709 12:08:17.248454 16846 consensus_queue.cc:260] T 00000000000000000000000000000000 P 66f3a9991e43402ba1b4dc88e97c938a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66f3a9991e43402ba1b4dc88e97c938a" member_type: VOTER }
I20260709 12:08:17.248957 16846 raft_consensus.cc:399] T 00000000000000000000000000000000 P 66f3a9991e43402ba1b4dc88e97c938a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:08:17.249293 16846 raft_consensus.cc:493] T 00000000000000000000000000000000 P 66f3a9991e43402ba1b4dc88e97c938a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:08:17.249641 16846 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 66f3a9991e43402ba1b4dc88e97c938a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:17.256603 16846 raft_consensus.cc:515] T 00000000000000000000000000000000 P 66f3a9991e43402ba1b4dc88e97c938a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66f3a9991e43402ba1b4dc88e97c938a" member_type: VOTER }
I20260709 12:08:17.257608 16846 leader_election.cc:304] T 00000000000000000000000000000000 P 66f3a9991e43402ba1b4dc88e97c938a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66f3a9991e43402ba1b4dc88e97c938a; no voters: 
I20260709 12:08:17.259800 16846 leader_election.cc:290] T 00000000000000000000000000000000 P 66f3a9991e43402ba1b4dc88e97c938a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:08:17.260064 16849 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 66f3a9991e43402ba1b4dc88e97c938a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:17.262874 16849 raft_consensus.cc:697] T 00000000000000000000000000000000 P 66f3a9991e43402ba1b4dc88e97c938a [term 1 LEADER]: Becoming Leader. State: Replica: 66f3a9991e43402ba1b4dc88e97c938a, State: Running, Role: LEADER
I20260709 12:08:17.263782 16849 consensus_queue.cc:237] T 00000000000000000000000000000000 P 66f3a9991e43402ba1b4dc88e97c938a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66f3a9991e43402ba1b4dc88e97c938a" member_type: VOTER }
I20260709 12:08:17.265254 16846 sys_catalog.cc:565] T 00000000000000000000000000000000 P 66f3a9991e43402ba1b4dc88e97c938a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:08:17.274938 16851 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66f3a9991e43402ba1b4dc88e97c938a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 66f3a9991e43402ba1b4dc88e97c938a. Latest consensus state: current_term: 1 leader_uuid: "66f3a9991e43402ba1b4dc88e97c938a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66f3a9991e43402ba1b4dc88e97c938a" member_type: VOTER } }
I20260709 12:08:17.275411 16850 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66f3a9991e43402ba1b4dc88e97c938a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "66f3a9991e43402ba1b4dc88e97c938a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66f3a9991e43402ba1b4dc88e97c938a" member_type: VOTER } }
I20260709 12:08:17.275854 16851 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66f3a9991e43402ba1b4dc88e97c938a [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:17.276031 16850 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66f3a9991e43402ba1b4dc88e97c938a [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:17.279130 16857 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:08:17.291543 16857 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:08:17.295413 16779 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:08:17.310880 16857 catalog_manager.cc:1383] Generated new cluster ID: 5a11021ecbfd4afaaba345b7472e4376
I20260709 12:08:17.311174 16857 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:08:17.333019 16857 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:08:17.334751 16857 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:08:17.354705 16857 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 66f3a9991e43402ba1b4dc88e97c938a: Generated new TSK 0
I20260709 12:08:17.355863 16857 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:08:17.362396 16779 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:17.371025 16868 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:17.371793 16869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:17.375877 16871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:17.376732 16779 server_base.cc:1061] running on GCE node
I20260709 12:08:17.377523 16779 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:17.377707 16779 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:17.377899 16779 hybrid_clock.cc:648] HybridClock initialized: now 1783598897377886 us; error 0 us; skew 500 ppm
I20260709 12:08:17.378539 16779 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:17.382439 16779 webserver.cc:533] Webserver started at http://127.16.98.193:41449/ using document root <none> and password file <none>
I20260709 12:08:17.383055 16779 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:17.383261 16779 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:17.383572 16779 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:17.384687 16779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895573690-16779-0/minicluster-data/ts-0-root/instance:
uuid: "29490d1192b9423998b71cd2c90c0c1f"
format_stamp: "Formatted at 2026-07-09 12:08:17 on dist-test-slave-9bv4"
I20260709 12:08:17.390354 16779 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:08:17.394624 16876 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.395547 16779 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:08:17.395843 16779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895573690-16779-0/minicluster-data/ts-0-root
uuid: "29490d1192b9423998b71cd2c90c0c1f"
format_stamp: "Formatted at 2026-07-09 12:08:17 on dist-test-slave-9bv4"
I20260709 12:08:17.396162 16779 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895573690-16779-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895573690-16779-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895573690-16779-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:17.417377 16779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:17.418787 16779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:17.421599 16779 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:17.425833 16779 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:17.426113 16779 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.426388 16779 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:17.426590 16779 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.530474 16779 rpc_server.cc:307] RPC server started. Bound to: 127.16.98.193:44815
I20260709 12:08:17.530669 16938 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.98.193:44815 every 8 connection(s)
I20260709 12:08:17.537642 16779 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:17.547214 16943 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:17.549341 16944 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:17.553928 16946 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:17.558759 16779 server_base.cc:1061] running on GCE node
I20260709 12:08:17.559712 16779 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:17.559960 16779 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:17.560153 16779 hybrid_clock.cc:648] HybridClock initialized: now 1783598897560131 us; error 0 us; skew 500 ppm
I20260709 12:08:17.560736 16779 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:17.563721 16779 webserver.cc:533] Webserver started at http://127.16.98.194:34809/ using document root <none> and password file <none>
I20260709 12:08:17.564251 16779 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:17.564494 16779 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:17.564832 16779 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:17.566269 16779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895573690-16779-0/minicluster-data/ts-1-root/instance:
uuid: "ec82448eea8f4a3293bc13542f5930e7"
format_stamp: "Formatted at 2026-07-09 12:08:17 on dist-test-slave-9bv4"
I20260709 12:08:17.568825 16939 heartbeater.cc:344] Connected to a master server at 127.16.98.254:34021
I20260709 12:08:17.569312 16939 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:17.570526 16939 heartbeater.cc:507] Master 127.16.98.254:34021 requested a full tablet report, sending...
I20260709 12:08:17.572780 16779 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.002s	sys 0.003s
I20260709 12:08:17.573733 16811 ts_manager.cc:194] Registered new tserver with Master: 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193:44815)
I20260709 12:08:17.575944 16811 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40910
I20260709 12:08:17.579187 16951 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.580088 16779 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.002s
I20260709 12:08:17.580415 16779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895573690-16779-0/minicluster-data/ts-1-root
uuid: "ec82448eea8f4a3293bc13542f5930e7"
format_stamp: "Formatted at 2026-07-09 12:08:17 on dist-test-slave-9bv4"
I20260709 12:08:17.580765 16779 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895573690-16779-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895573690-16779-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895573690-16779-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:17.617437 16779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:17.618786 16779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:17.621470 16779 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:17.624352 16779 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:17.624536 16779 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.624825 16779 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:17.624965 16779 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.730226 16779 rpc_server.cc:307] RPC server started. Bound to: 127.16.98.194:37255
I20260709 12:08:17.730458 17013 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.98.194:37255 every 8 connection(s)
I20260709 12:08:17.739156 16779 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:17.748730 17018 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:17.752447 17014 heartbeater.cc:344] Connected to a master server at 127.16.98.254:34021
I20260709 12:08:17.752838 17014 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:17.753787 17014 heartbeater.cc:507] Master 127.16.98.254:34021 requested a full tablet report, sending...
I20260709 12:08:17.756157 16811 ts_manager.cc:194] Registered new tserver with Master: ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194:37255)
W20260709 12:08:17.757838 17017 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:17.758014 16811 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40924
I20260709 12:08:17.758344 16779 server_base.cc:1061] running on GCE node
W20260709 12:08:17.758735 17020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:17.759873 16779 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:17.760053 16779 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:17.760170 16779 hybrid_clock.cc:648] HybridClock initialized: now 1783598897760159 us; error 0 us; skew 500 ppm
I20260709 12:08:17.761673 16779 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:17.765877 16779 webserver.cc:533] Webserver started at http://127.16.98.195:36579/ using document root <none> and password file <none>
I20260709 12:08:17.766374 16779 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:17.766718 16779 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:17.766994 16779 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:17.768168 16779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895573690-16779-0/minicluster-data/ts-2-root/instance:
uuid: "c8e4344281b94506aeea8b84fc758bb8"
format_stamp: "Formatted at 2026-07-09 12:08:17 on dist-test-slave-9bv4"
I20260709 12:08:17.772765 16779 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:08:17.776134 17025 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.776978 16779 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:08:17.777236 16779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895573690-16779-0/minicluster-data/ts-2-root
uuid: "c8e4344281b94506aeea8b84fc758bb8"
format_stamp: "Formatted at 2026-07-09 12:08:17 on dist-test-slave-9bv4"
I20260709 12:08:17.777580 16779 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895573690-16779-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895573690-16779-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783598895573690-16779-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:17.791344 16779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:17.792589 16779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:17.795109 16779 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:17.797264 16779 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:17.797453 16779 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.797746 16779 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:17.797911 16779 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:17.899480 16779 rpc_server.cc:307] RPC server started. Bound to: 127.16.98.195:33695
I20260709 12:08:17.900122 17087 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.98.195:33695 every 8 connection(s)
I20260709 12:08:17.917646 17088 heartbeater.cc:344] Connected to a master server at 127.16.98.254:34021
I20260709 12:08:17.918052 17088 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:17.918905 17088 heartbeater.cc:507] Master 127.16.98.254:34021 requested a full tablet report, sending...
I20260709 12:08:17.920960 16811 ts_manager.cc:194] Registered new tserver with Master: c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195:33695)
I20260709 12:08:17.921132 16779 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016548741s
I20260709 12:08:17.922777 16811 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40926
I20260709 12:08:17.973968 16811 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40932:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:08:17.977771 16811 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:08:18.078778 16979 tablet_service.cc:1511] Processing CreateTablet for tablet ee85b0213f3c41b89c2d7185032dba59 (DEFAULT_TABLE table=test-workload [id=e135a892ef1c4f07aa952d538fe8b935]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:08:18.080343 16979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee85b0213f3c41b89c2d7185032dba59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.081319 16977 tablet_service.cc:1511] Processing CreateTablet for tablet 2d25aa5414ba4e06a06db53053ef0785 (DEFAULT_TABLE table=test-workload [id=e135a892ef1c4f07aa952d538fe8b935]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:08:18.078883 16978 tablet_service.cc:1511] Processing CreateTablet for tablet 276d1755922145c9ae61b09cd364feeb (DEFAULT_TABLE table=test-workload [id=e135a892ef1c4f07aa952d538fe8b935]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:08:18.082793 16977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d25aa5414ba4e06a06db53053ef0785. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.083513 16978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 276d1755922145c9ae61b09cd364feeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.087952 16976 tablet_service.cc:1511] Processing CreateTablet for tablet 1063d9c76f824514a53771146fb1605d (DEFAULT_TABLE table=test-workload [id=e135a892ef1c4f07aa952d538fe8b935]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:08:18.089301 16976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1063d9c76f824514a53771146fb1605d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.088974 16974 tablet_service.cc:1511] Processing CreateTablet for tablet a8e96f93f8824601adfe39584798017e (DEFAULT_TABLE table=test-workload [id=e135a892ef1c4f07aa952d538fe8b935]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:08:18.089480 16973 tablet_service.cc:1511] Processing CreateTablet for tablet c0f27eff5cd24050a606667e55c75601 (DEFAULT_TABLE table=test-workload [id=e135a892ef1c4f07aa952d538fe8b935]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:08:18.090333 16974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8e96f93f8824601adfe39584798017e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.092657 16972 tablet_service.cc:1511] Processing CreateTablet for tablet a80f4105a1ce4e47ab9a4089253973cf (DEFAULT_TABLE table=test-workload [id=e135a892ef1c4f07aa952d538fe8b935]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:08:18.094882 16973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0f27eff5cd24050a606667e55c75601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.097980 16971 tablet_service.cc:1511] Processing CreateTablet for tablet 7d8bd5c247434c4e94b353024ef7bc92 (DEFAULT_TABLE table=test-workload [id=e135a892ef1c4f07aa952d538fe8b935]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:08:18.098856 16975 tablet_service.cc:1511] Processing CreateTablet for tablet 99ca6528cae84361ac940d82bf10059d (DEFAULT_TABLE table=test-workload [id=e135a892ef1c4f07aa952d538fe8b935]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:08:18.103466 16972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a80f4105a1ce4e47ab9a4089253973cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.111999 16971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d8bd5c247434c4e94b353024ef7bc92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.118747 16975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99ca6528cae84361ac940d82bf10059d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.126637 16901 tablet_service.cc:1511] Processing CreateTablet for tablet 1063d9c76f824514a53771146fb1605d (DEFAULT_TABLE table=test-workload [id=e135a892ef1c4f07aa952d538fe8b935]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:08:18.127676 16904 tablet_service.cc:1511] Processing CreateTablet for tablet ee85b0213f3c41b89c2d7185032dba59 (DEFAULT_TABLE table=test-workload [id=e135a892ef1c4f07aa952d538fe8b935]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:08:18.129186 16900 tablet_service.cc:1511] Processing CreateTablet for tablet 99ca6528cae84361ac940d82bf10059d (DEFAULT_TABLE table=test-workload [id=e135a892ef1c4f07aa952d538fe8b935]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:08:18.123811 16902 tablet_service.cc:1511] Processing CreateTablet for tablet 2d25aa5414ba4e06a06db53053ef0785 (DEFAULT_TABLE table=test-workload [id=e135a892ef1c4f07aa952d538fe8b935]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:08:18.125649 16903 tablet_service.cc:1511] Processing CreateTablet for tablet 276d1755922145c9ae61b09cd364feeb (DEFAULT_TABLE table=test-workload [id=e135a892ef1c4f07aa952d538fe8b935]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:08:18.134802 16898 tablet_service.cc:1511] Processing CreateTablet for tablet c0f27eff5cd24050a606667e55c75601 (DEFAULT_TABLE table=test-workload [id=e135a892ef1c4f07aa952d538fe8b935]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:08:18.136879 16899 tablet_service.cc:1511] Processing CreateTablet for tablet a8e96f93f8824601adfe39584798017e (DEFAULT_TABLE table=test-workload [id=e135a892ef1c4f07aa952d538fe8b935]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:08:18.139199 16900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99ca6528cae84361ac940d82bf10059d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.148449 16897 tablet_service.cc:1511] Processing CreateTablet for tablet a80f4105a1ce4e47ab9a4089253973cf (DEFAULT_TABLE table=test-workload [id=e135a892ef1c4f07aa952d538fe8b935]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:08:18.153095 16904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee85b0213f3c41b89c2d7185032dba59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.154431 16896 tablet_service.cc:1511] Processing CreateTablet for tablet 7d8bd5c247434c4e94b353024ef7bc92 (DEFAULT_TABLE table=test-workload [id=e135a892ef1c4f07aa952d538fe8b935]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:08:18.157944 16897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a80f4105a1ce4e47ab9a4089253973cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.159145 16896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d8bd5c247434c4e94b353024ef7bc92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.161330 16899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8e96f93f8824601adfe39584798017e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.163975 16901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1063d9c76f824514a53771146fb1605d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.166568 16902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d25aa5414ba4e06a06db53053ef0785. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.170657 16903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 276d1755922145c9ae61b09cd364feeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.173048 16898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0f27eff5cd24050a606667e55c75601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.277442 17053 tablet_service.cc:1511] Processing CreateTablet for tablet ee85b0213f3c41b89c2d7185032dba59 (DEFAULT_TABLE table=test-workload [id=e135a892ef1c4f07aa952d538fe8b935]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:08:18.280061 17051 tablet_service.cc:1511] Processing CreateTablet for tablet 2d25aa5414ba4e06a06db53053ef0785 (DEFAULT_TABLE table=test-workload [id=e135a892ef1c4f07aa952d538fe8b935]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:08:18.281728 17051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d25aa5414ba4e06a06db53053ef0785. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.290084 17053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee85b0213f3c41b89c2d7185032dba59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.296869 17050 tablet_service.cc:1511] Processing CreateTablet for tablet 1063d9c76f824514a53771146fb1605d (DEFAULT_TABLE table=test-workload [id=e135a892ef1c4f07aa952d538fe8b935]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:08:18.286398 17052 tablet_service.cc:1511] Processing CreateTablet for tablet 276d1755922145c9ae61b09cd364feeb (DEFAULT_TABLE table=test-workload [id=e135a892ef1c4f07aa952d538fe8b935]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:08:18.302867 17049 tablet_service.cc:1511] Processing CreateTablet for tablet 99ca6528cae84361ac940d82bf10059d (DEFAULT_TABLE table=test-workload [id=e135a892ef1c4f07aa952d538fe8b935]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
W20260709 12:08:18.312855 16859 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:18.312222 17052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 276d1755922145c9ae61b09cd364feeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.313210 17105 tablet_bootstrap.cc:492] T a8e96f93f8824601adfe39584798017e P ec82448eea8f4a3293bc13542f5930e7: Bootstrap starting.
I20260709 12:08:18.305236 17048 tablet_service.cc:1511] Processing CreateTablet for tablet a8e96f93f8824601adfe39584798017e (DEFAULT_TABLE table=test-workload [id=e135a892ef1c4f07aa952d538fe8b935]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:08:18.312160 17047 tablet_service.cc:1511] Processing CreateTablet for tablet c0f27eff5cd24050a606667e55c75601 (DEFAULT_TABLE table=test-workload [id=e135a892ef1c4f07aa952d538fe8b935]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:08:18.316083 17046 tablet_service.cc:1511] Processing CreateTablet for tablet a80f4105a1ce4e47ab9a4089253973cf (DEFAULT_TABLE table=test-workload [id=e135a892ef1c4f07aa952d538fe8b935]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:08:18.319108 17049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99ca6528cae84361ac940d82bf10059d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.331823 17050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1063d9c76f824514a53771146fb1605d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.336212 17045 tablet_service.cc:1511] Processing CreateTablet for tablet 7d8bd5c247434c4e94b353024ef7bc92 (DEFAULT_TABLE table=test-workload [id=e135a892ef1c4f07aa952d538fe8b935]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:08:18.341328 17046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a80f4105a1ce4e47ab9a4089253973cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.348694 17045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d8bd5c247434c4e94b353024ef7bc92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.350813 17047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0f27eff5cd24050a606667e55c75601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.373593 17106 tablet_bootstrap.cc:492] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f: Bootstrap starting.
I20260709 12:08:18.373207 17048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8e96f93f8824601adfe39584798017e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:18.418701 17105 tablet_bootstrap.cc:654] T a8e96f93f8824601adfe39584798017e P ec82448eea8f4a3293bc13542f5930e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.422205 17107 tablet_bootstrap.cc:492] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8: Bootstrap starting.
I20260709 12:08:18.430099 17106 tablet_bootstrap.cc:654] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.442075 17105 tablet_bootstrap.cc:492] T a8e96f93f8824601adfe39584798017e P ec82448eea8f4a3293bc13542f5930e7: No bootstrap required, opened a new log
I20260709 12:08:18.442680 17105 ts_tablet_manager.cc:1403] T a8e96f93f8824601adfe39584798017e P ec82448eea8f4a3293bc13542f5930e7: Time spent bootstrapping tablet: real 0.137s	user 0.008s	sys 0.009s
I20260709 12:08:18.445607 17105 raft_consensus.cc:359] T a8e96f93f8824601adfe39584798017e P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.446288 17105 raft_consensus.cc:385] T a8e96f93f8824601adfe39584798017e P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.446548 17105 raft_consensus.cc:740] T a8e96f93f8824601adfe39584798017e P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec82448eea8f4a3293bc13542f5930e7, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.447463 17105 consensus_queue.cc:260] T a8e96f93f8824601adfe39584798017e P ec82448eea8f4a3293bc13542f5930e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.448516 17107 tablet_bootstrap.cc:654] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.459450 17014 heartbeater.cc:499] Master 127.16.98.254:34021 was elected leader, sending a full tablet report...
I20260709 12:08:18.460934 17105 ts_tablet_manager.cc:1434] T a8e96f93f8824601adfe39584798017e P ec82448eea8f4a3293bc13542f5930e7: Time spent starting tablet: real 0.018s	user 0.012s	sys 0.000s
I20260709 12:08:18.462381 17105 tablet_bootstrap.cc:492] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7: Bootstrap starting.
I20260709 12:08:18.472055 17105 tablet_bootstrap.cc:654] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.474922 17106 tablet_bootstrap.cc:492] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f: No bootstrap required, opened a new log
I20260709 12:08:18.475404 17106 ts_tablet_manager.cc:1403] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f: Time spent bootstrapping tablet: real 0.115s	user 0.010s	sys 0.008s
I20260709 12:08:18.478585 17106 raft_consensus.cc:359] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.479287 17107 tablet_bootstrap.cc:492] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8: No bootstrap required, opened a new log
I20260709 12:08:18.479334 17106 raft_consensus.cc:385] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.479770 17106 raft_consensus.cc:740] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29490d1192b9423998b71cd2c90c0c1f, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.480726 17106 consensus_queue.cc:260] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.479775 17107 ts_tablet_manager.cc:1403] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8: Time spent bootstrapping tablet: real 0.068s	user 0.011s	sys 0.024s
I20260709 12:08:18.484444 17105 tablet_bootstrap.cc:492] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7: No bootstrap required, opened a new log
I20260709 12:08:18.484894 17105 ts_tablet_manager.cc:1403] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7: Time spent bootstrapping tablet: real 0.023s	user 0.005s	sys 0.010s
I20260709 12:08:18.485971 17107 raft_consensus.cc:359] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.486737 17107 raft_consensus.cc:385] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.487026 17107 raft_consensus.cc:740] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e4344281b94506aeea8b84fc758bb8, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.487740 17107 consensus_queue.cc:260] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
W20260709 12:08:18.488267 17015 tablet.cc:2406] T a8e96f93f8824601adfe39584798017e P ec82448eea8f4a3293bc13542f5930e7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:08:18.488085 17105 raft_consensus.cc:359] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.488759 17105 raft_consensus.cc:385] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.489130 17105 raft_consensus.cc:740] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec82448eea8f4a3293bc13542f5930e7, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.490006 17105 consensus_queue.cc:260] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.493042 17105 ts_tablet_manager.cc:1434] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:08:18.494087 17105 tablet_bootstrap.cc:492] T ee85b0213f3c41b89c2d7185032dba59 P ec82448eea8f4a3293bc13542f5930e7: Bootstrap starting.
I20260709 12:08:18.499962 16939 heartbeater.cc:499] Master 127.16.98.254:34021 was elected leader, sending a full tablet report...
I20260709 12:08:18.500720 17088 heartbeater.cc:499] Master 127.16.98.254:34021 was elected leader, sending a full tablet report...
I20260709 12:08:18.503611 17105 tablet_bootstrap.cc:654] T ee85b0213f3c41b89c2d7185032dba59 P ec82448eea8f4a3293bc13542f5930e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.500429 17106 ts_tablet_manager.cc:1434] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.006s
I20260709 12:08:18.504882 17106 tablet_bootstrap.cc:492] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f: Bootstrap starting.
I20260709 12:08:18.512080 17106 tablet_bootstrap.cc:654] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.513230 17105 tablet_bootstrap.cc:492] T ee85b0213f3c41b89c2d7185032dba59 P ec82448eea8f4a3293bc13542f5930e7: No bootstrap required, opened a new log
I20260709 12:08:18.513702 17105 ts_tablet_manager.cc:1403] T ee85b0213f3c41b89c2d7185032dba59 P ec82448eea8f4a3293bc13542f5930e7: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.003s
I20260709 12:08:18.516279 17107 ts_tablet_manager.cc:1434] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.005s
I20260709 12:08:18.516607 17105 raft_consensus.cc:359] T ee85b0213f3c41b89c2d7185032dba59 P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.517174 17107 tablet_bootstrap.cc:492] T 276d1755922145c9ae61b09cd364feeb P c8e4344281b94506aeea8b84fc758bb8: Bootstrap starting.
I20260709 12:08:18.517310 17105 raft_consensus.cc:385] T ee85b0213f3c41b89c2d7185032dba59 P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.517628 17105 raft_consensus.cc:740] T ee85b0213f3c41b89c2d7185032dba59 P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec82448eea8f4a3293bc13542f5930e7, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.518536 17105 consensus_queue.cc:260] T ee85b0213f3c41b89c2d7185032dba59 P ec82448eea8f4a3293bc13542f5930e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.521454 17105 ts_tablet_manager.cc:1434] T ee85b0213f3c41b89c2d7185032dba59 P ec82448eea8f4a3293bc13542f5930e7: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 12:08:18.522392 17105 tablet_bootstrap.cc:492] T 2d25aa5414ba4e06a06db53053ef0785 P ec82448eea8f4a3293bc13542f5930e7: Bootstrap starting.
I20260709 12:08:18.523880 17107 tablet_bootstrap.cc:654] T 276d1755922145c9ae61b09cd364feeb P c8e4344281b94506aeea8b84fc758bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.530777 17105 tablet_bootstrap.cc:654] T 2d25aa5414ba4e06a06db53053ef0785 P ec82448eea8f4a3293bc13542f5930e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.539397 17107 tablet_bootstrap.cc:492] T 276d1755922145c9ae61b09cd364feeb P c8e4344281b94506aeea8b84fc758bb8: No bootstrap required, opened a new log
I20260709 12:08:18.541157 17105 tablet_bootstrap.cc:492] T 2d25aa5414ba4e06a06db53053ef0785 P ec82448eea8f4a3293bc13542f5930e7: No bootstrap required, opened a new log
I20260709 12:08:18.541579 17107 ts_tablet_manager.cc:1403] T 276d1755922145c9ae61b09cd364feeb P c8e4344281b94506aeea8b84fc758bb8: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.004s
I20260709 12:08:18.541699 17105 ts_tablet_manager.cc:1403] T 2d25aa5414ba4e06a06db53053ef0785 P ec82448eea8f4a3293bc13542f5930e7: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.004s
I20260709 12:08:18.544567 17105 raft_consensus.cc:359] T 2d25aa5414ba4e06a06db53053ef0785 P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.544792 17107 raft_consensus.cc:359] T 276d1755922145c9ae61b09cd364feeb P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.545287 17105 raft_consensus.cc:385] T 2d25aa5414ba4e06a06db53053ef0785 P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.545436 17107 raft_consensus.cc:385] T 276d1755922145c9ae61b09cd364feeb P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.545622 17105 raft_consensus.cc:740] T 2d25aa5414ba4e06a06db53053ef0785 P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec82448eea8f4a3293bc13542f5930e7, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.545758 17107 raft_consensus.cc:740] T 276d1755922145c9ae61b09cd364feeb P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e4344281b94506aeea8b84fc758bb8, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.541213 17106 tablet_bootstrap.cc:492] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f: No bootstrap required, opened a new log
I20260709 12:08:18.546962 17106 ts_tablet_manager.cc:1403] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.008s
I20260709 12:08:18.546514 17105 consensus_queue.cc:260] T 2d25aa5414ba4e06a06db53053ef0785 P ec82448eea8f4a3293bc13542f5930e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.549021 17105 ts_tablet_manager.cc:1434] T 2d25aa5414ba4e06a06db53053ef0785 P ec82448eea8f4a3293bc13542f5930e7: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 12:08:18.549942 17105 tablet_bootstrap.cc:492] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7: Bootstrap starting.
I20260709 12:08:18.549769 17106 raft_consensus.cc:359] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.550488 17106 raft_consensus.cc:385] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.550815 17106 raft_consensus.cc:740] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29490d1192b9423998b71cd2c90c0c1f, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.551524 17106 consensus_queue.cc:260] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.553638 17106 ts_tablet_manager.cc:1434] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:08:18.554584 17106 tablet_bootstrap.cc:492] T 7d8bd5c247434c4e94b353024ef7bc92 P 29490d1192b9423998b71cd2c90c0c1f: Bootstrap starting.
I20260709 12:08:18.556628 17110 raft_consensus.cc:493] T a8e96f93f8824601adfe39584798017e P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.557101 17110 raft_consensus.cc:515] T a8e96f93f8824601adfe39584798017e P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.561177 17106 tablet_bootstrap.cc:654] T 7d8bd5c247434c4e94b353024ef7bc92 P 29490d1192b9423998b71cd2c90c0c1f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.562834 17110 leader_election.cc:290] T a8e96f93f8824601adfe39584798017e P ec82448eea8f4a3293bc13542f5930e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193:44815), c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195:33695)
I20260709 12:08:18.546509 17107 consensus_queue.cc:260] T 276d1755922145c9ae61b09cd364feeb P c8e4344281b94506aeea8b84fc758bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.565411 17107 ts_tablet_manager.cc:1434] T 276d1755922145c9ae61b09cd364feeb P c8e4344281b94506aeea8b84fc758bb8: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 12:08:18.566766 17107 tablet_bootstrap.cc:492] T a8e96f93f8824601adfe39584798017e P c8e4344281b94506aeea8b84fc758bb8: Bootstrap starting.
I20260709 12:08:18.569173 17105 tablet_bootstrap.cc:654] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.574440 17107 tablet_bootstrap.cc:654] T a8e96f93f8824601adfe39584798017e P c8e4344281b94506aeea8b84fc758bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.585094 17107 tablet_bootstrap.cc:492] T a8e96f93f8824601adfe39584798017e P c8e4344281b94506aeea8b84fc758bb8: No bootstrap required, opened a new log
I20260709 12:08:18.585668 17107 ts_tablet_manager.cc:1403] T a8e96f93f8824601adfe39584798017e P c8e4344281b94506aeea8b84fc758bb8: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.004s
I20260709 12:08:18.588904 17105 tablet_bootstrap.cc:492] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7: No bootstrap required, opened a new log
I20260709 12:08:18.588717 17107 raft_consensus.cc:359] T a8e96f93f8824601adfe39584798017e P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.589377 17105 ts_tablet_manager.cc:1403] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7: Time spent bootstrapping tablet: real 0.040s	user 0.007s	sys 0.004s
I20260709 12:08:18.589440 17107 raft_consensus.cc:385] T a8e96f93f8824601adfe39584798017e P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.589795 17107 raft_consensus.cc:740] T a8e96f93f8824601adfe39584798017e P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e4344281b94506aeea8b84fc758bb8, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.590595 17107 consensus_queue.cc:260] T a8e96f93f8824601adfe39584798017e P c8e4344281b94506aeea8b84fc758bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.593009 17106 tablet_bootstrap.cc:492] T 7d8bd5c247434c4e94b353024ef7bc92 P 29490d1192b9423998b71cd2c90c0c1f: No bootstrap required, opened a new log
I20260709 12:08:18.593446 17106 ts_tablet_manager.cc:1403] T 7d8bd5c247434c4e94b353024ef7bc92 P 29490d1192b9423998b71cd2c90c0c1f: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.002s
I20260709 12:08:18.596366 17106 raft_consensus.cc:359] T 7d8bd5c247434c4e94b353024ef7bc92 P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.597079 17106 raft_consensus.cc:385] T 7d8bd5c247434c4e94b353024ef7bc92 P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.597383 17106 raft_consensus.cc:740] T 7d8bd5c247434c4e94b353024ef7bc92 P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29490d1192b9423998b71cd2c90c0c1f, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.598102 17106 consensus_queue.cc:260] T 7d8bd5c247434c4e94b353024ef7bc92 P 29490d1192b9423998b71cd2c90c0c1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.600629 17106 ts_tablet_manager.cc:1434] T 7d8bd5c247434c4e94b353024ef7bc92 P 29490d1192b9423998b71cd2c90c0c1f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:08:18.601586 17106 tablet_bootstrap.cc:492] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f: Bootstrap starting.
I20260709 12:08:18.605501 17107 ts_tablet_manager.cc:1434] T a8e96f93f8824601adfe39584798017e P c8e4344281b94506aeea8b84fc758bb8: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:08:18.606817 17107 tablet_bootstrap.cc:492] T 2d25aa5414ba4e06a06db53053ef0785 P c8e4344281b94506aeea8b84fc758bb8: Bootstrap starting.
I20260709 12:08:18.592283 17105 raft_consensus.cc:359] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.609597 17105 raft_consensus.cc:385] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.609920 17105 raft_consensus.cc:740] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec82448eea8f4a3293bc13542f5930e7, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.612954 17105 consensus_queue.cc:260] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.613569 17106 tablet_bootstrap.cc:654] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.616930 17063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e96f93f8824601adfe39584798017e" candidate_uuid: "ec82448eea8f4a3293bc13542f5930e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e4344281b94506aeea8b84fc758bb8" is_pre_election: true
I20260709 12:08:18.619328 17063 raft_consensus.cc:2468] T a8e96f93f8824601adfe39584798017e P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec82448eea8f4a3293bc13542f5930e7 in term 0.
I20260709 12:08:18.620720 17107 tablet_bootstrap.cc:654] T 2d25aa5414ba4e06a06db53053ef0785 P c8e4344281b94506aeea8b84fc758bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.620888 16953 leader_election.cc:304] T a8e96f93f8824601adfe39584798017e P ec82448eea8f4a3293bc13542f5930e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8e4344281b94506aeea8b84fc758bb8, ec82448eea8f4a3293bc13542f5930e7; no voters: 
I20260709 12:08:18.621809 17110 raft_consensus.cc:2804] T a8e96f93f8824601adfe39584798017e P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.622172 17110 raft_consensus.cc:493] T a8e96f93f8824601adfe39584798017e P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.622512 17110 raft_consensus.cc:3060] T a8e96f93f8824601adfe39584798017e P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.628569 17106 tablet_bootstrap.cc:492] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f: No bootstrap required, opened a new log
I20260709 12:08:18.629046 17106 ts_tablet_manager.cc:1403] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.004s
I20260709 12:08:18.629920 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e96f93f8824601adfe39584798017e" candidate_uuid: "ec82448eea8f4a3293bc13542f5930e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29490d1192b9423998b71cd2c90c0c1f" is_pre_election: true
I20260709 12:08:18.630523 17110 raft_consensus.cc:515] T a8e96f93f8824601adfe39584798017e P ec82448eea8f4a3293bc13542f5930e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.631954 17106 raft_consensus.cc:359] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
W20260709 12:08:18.632237 16953 leader_election.cc:343] T a8e96f93f8824601adfe39584798017e P ec82448eea8f4a3293bc13542f5930e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193:44815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.632676 17106 raft_consensus.cc:385] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.633013 17106 raft_consensus.cc:740] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29490d1192b9423998b71cd2c90c0c1f, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.633843 17106 consensus_queue.cc:260] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.634157 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e96f93f8824601adfe39584798017e" candidate_uuid: "ec82448eea8f4a3293bc13542f5930e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29490d1192b9423998b71cd2c90c0c1f"
I20260709 12:08:18.634564 17107 tablet_bootstrap.cc:492] T 2d25aa5414ba4e06a06db53053ef0785 P c8e4344281b94506aeea8b84fc758bb8: No bootstrap required, opened a new log
W20260709 12:08:18.635459 16953 leader_election.cc:343] T a8e96f93f8824601adfe39584798017e P ec82448eea8f4a3293bc13542f5930e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193:44815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.636322 17106 ts_tablet_manager.cc:1434] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:08:18.637007 17107 ts_tablet_manager.cc:1403] T 2d25aa5414ba4e06a06db53053ef0785 P c8e4344281b94506aeea8b84fc758bb8: Time spent bootstrapping tablet: real 0.031s	user 0.006s	sys 0.008s
I20260709 12:08:18.637247 17106 tablet_bootstrap.cc:492] T a8e96f93f8824601adfe39584798017e P 29490d1192b9423998b71cd2c90c0c1f: Bootstrap starting.
I20260709 12:08:18.639750 17107 raft_consensus.cc:359] T 2d25aa5414ba4e06a06db53053ef0785 P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.640432 17107 raft_consensus.cc:385] T 2d25aa5414ba4e06a06db53053ef0785 P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.640717 17107 raft_consensus.cc:740] T 2d25aa5414ba4e06a06db53053ef0785 P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e4344281b94506aeea8b84fc758bb8, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.641393 17107 consensus_queue.cc:260] T 2d25aa5414ba4e06a06db53053ef0785 P c8e4344281b94506aeea8b84fc758bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.644450 17106 tablet_bootstrap.cc:654] T a8e96f93f8824601adfe39584798017e P 29490d1192b9423998b71cd2c90c0c1f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.646404 17110 leader_election.cc:290] T a8e96f93f8824601adfe39584798017e P ec82448eea8f4a3293bc13542f5930e7 [CANDIDATE]: Term 1 election: Requested vote from peers 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193:44815), c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195:33695)
I20260709 12:08:18.647527 17063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e96f93f8824601adfe39584798017e" candidate_uuid: "ec82448eea8f4a3293bc13542f5930e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e4344281b94506aeea8b84fc758bb8"
I20260709 12:08:18.648559 17063 raft_consensus.cc:3060] T a8e96f93f8824601adfe39584798017e P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.652228 17105 ts_tablet_manager.cc:1434] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7: Time spent starting tablet: real 0.062s	user 0.011s	sys 0.001s
I20260709 12:08:18.653468 17105 tablet_bootstrap.cc:492] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7: Bootstrap starting.
I20260709 12:08:18.655637 17063 raft_consensus.cc:2468] T a8e96f93f8824601adfe39584798017e P c8e4344281b94506aeea8b84fc758bb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec82448eea8f4a3293bc13542f5930e7 in term 1.
I20260709 12:08:18.658670 16953 leader_election.cc:304] T a8e96f93f8824601adfe39584798017e P ec82448eea8f4a3293bc13542f5930e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8e4344281b94506aeea8b84fc758bb8, ec82448eea8f4a3293bc13542f5930e7; no voters: 29490d1192b9423998b71cd2c90c0c1f
I20260709 12:08:18.659596 17126 raft_consensus.cc:2804] T a8e96f93f8824601adfe39584798017e P ec82448eea8f4a3293bc13542f5930e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.660292 17126 raft_consensus.cc:697] T a8e96f93f8824601adfe39584798017e P ec82448eea8f4a3293bc13542f5930e7 [term 1 LEADER]: Becoming Leader. State: Replica: ec82448eea8f4a3293bc13542f5930e7, State: Running, Role: LEADER
I20260709 12:08:18.660730 17107 ts_tablet_manager.cc:1434] T 2d25aa5414ba4e06a06db53053ef0785 P c8e4344281b94506aeea8b84fc758bb8: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:08:18.661173 17126 consensus_queue.cc:237] T a8e96f93f8824601adfe39584798017e P ec82448eea8f4a3293bc13542f5930e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.656243 17106 tablet_bootstrap.cc:492] T a8e96f93f8824601adfe39584798017e P 29490d1192b9423998b71cd2c90c0c1f: No bootstrap required, opened a new log
I20260709 12:08:18.662999 17106 ts_tablet_manager.cc:1403] T a8e96f93f8824601adfe39584798017e P 29490d1192b9423998b71cd2c90c0c1f: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.000s
I20260709 12:08:18.663926 17107 tablet_bootstrap.cc:492] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8: Bootstrap starting.
I20260709 12:08:18.666111 17105 tablet_bootstrap.cc:654] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.670449 17107 tablet_bootstrap.cc:654] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.670604 17106 raft_consensus.cc:359] T a8e96f93f8824601adfe39584798017e P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.671566 17106 raft_consensus.cc:385] T a8e96f93f8824601adfe39584798017e P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.671924 17106 raft_consensus.cc:740] T a8e96f93f8824601adfe39584798017e P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29490d1192b9423998b71cd2c90c0c1f, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.672829 17106 consensus_queue.cc:260] T a8e96f93f8824601adfe39584798017e P 29490d1192b9423998b71cd2c90c0c1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.676352 17106 ts_tablet_manager.cc:1434] T a8e96f93f8824601adfe39584798017e P 29490d1192b9423998b71cd2c90c0c1f: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.005s
I20260709 12:08:18.677408 17106 tablet_bootstrap.cc:492] T 2d25aa5414ba4e06a06db53053ef0785 P 29490d1192b9423998b71cd2c90c0c1f: Bootstrap starting.
I20260709 12:08:18.680050 17105 tablet_bootstrap.cc:492] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7: No bootstrap required, opened a new log
I20260709 12:08:18.680496 17105 ts_tablet_manager.cc:1403] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.001s
I20260709 12:08:18.684100 17126 raft_consensus.cc:493] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.684566 17126 raft_consensus.cc:515] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.686728 17126 leader_election.cc:290] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193:44815), c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195:33695)
I20260709 12:08:18.687386 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0f27eff5cd24050a606667e55c75601" candidate_uuid: "ec82448eea8f4a3293bc13542f5930e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29490d1192b9423998b71cd2c90c0c1f" is_pre_election: true
I20260709 12:08:18.687368 17105 raft_consensus.cc:359] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.688191 17105 raft_consensus.cc:385] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.688510 17105 raft_consensus.cc:740] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec82448eea8f4a3293bc13542f5930e7, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.689368 17063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0f27eff5cd24050a606667e55c75601" candidate_uuid: "ec82448eea8f4a3293bc13542f5930e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e4344281b94506aeea8b84fc758bb8" is_pre_election: true
I20260709 12:08:18.689204 17105 consensus_queue.cc:260] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
W20260709 12:08:18.690981 16953 leader_election.cc:343] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193:44815): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:08:18.691584 16953 leader_election.cc:343] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.691656 17105 ts_tablet_manager.cc:1434] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 12:08:18.692000 16953 leader_election.cc:304] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec82448eea8f4a3293bc13542f5930e7; no voters: 29490d1192b9423998b71cd2c90c0c1f, c8e4344281b94506aeea8b84fc758bb8
I20260709 12:08:18.692701 17126 raft_consensus.cc:2749] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:18.692227 16808 catalog_manager.cc:5697] T a8e96f93f8824601adfe39584798017e P ec82448eea8f4a3293bc13542f5930e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194). New cstate: current_term: 1 leader_uuid: "ec82448eea8f4a3293bc13542f5930e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:18.693466 17105 tablet_bootstrap.cc:492] T a80f4105a1ce4e47ab9a4089253973cf P ec82448eea8f4a3293bc13542f5930e7: Bootstrap starting.
I20260709 12:08:18.694064 17107 tablet_bootstrap.cc:492] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8: No bootstrap required, opened a new log
I20260709 12:08:18.694546 17107 ts_tablet_manager.cc:1403] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.006s
I20260709 12:08:18.697391 17107 raft_consensus.cc:359] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.698189 17107 raft_consensus.cc:385] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.698524 17107 raft_consensus.cc:740] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e4344281b94506aeea8b84fc758bb8, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.699311 17107 consensus_queue.cc:260] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.700387 17105 tablet_bootstrap.cc:654] T a80f4105a1ce4e47ab9a4089253973cf P ec82448eea8f4a3293bc13542f5930e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.701722 17107 ts_tablet_manager.cc:1434] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:08:18.702709 17107 tablet_bootstrap.cc:492] T 7d8bd5c247434c4e94b353024ef7bc92 P c8e4344281b94506aeea8b84fc758bb8: Bootstrap starting.
I20260709 12:08:18.708693 17107 tablet_bootstrap.cc:654] T 7d8bd5c247434c4e94b353024ef7bc92 P c8e4344281b94506aeea8b84fc758bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.711705 17106 tablet_bootstrap.cc:654] T 2d25aa5414ba4e06a06db53053ef0785 P 29490d1192b9423998b71cd2c90c0c1f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.714843 17114 raft_consensus.cc:493] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.715318 17114 raft_consensus.cc:515] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.717815 17114 leader_election.cc:290] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193:44815), ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194:37255)
I20260709 12:08:18.729059 17105 tablet_bootstrap.cc:492] T a80f4105a1ce4e47ab9a4089253973cf P ec82448eea8f4a3293bc13542f5930e7: No bootstrap required, opened a new log
I20260709 12:08:18.729717 17105 ts_tablet_manager.cc:1403] T a80f4105a1ce4e47ab9a4089253973cf P ec82448eea8f4a3293bc13542f5930e7: Time spent bootstrapping tablet: real 0.037s	user 0.005s	sys 0.008s
I20260709 12:08:18.739912 17105 raft_consensus.cc:359] T a80f4105a1ce4e47ab9a4089253973cf P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.740931 17105 raft_consensus.cc:385] T a80f4105a1ce4e47ab9a4089253973cf P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.741285 17105 raft_consensus.cc:740] T a80f4105a1ce4e47ab9a4089253973cf P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec82448eea8f4a3293bc13542f5930e7, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.749918 17106 tablet_bootstrap.cc:492] T 2d25aa5414ba4e06a06db53053ef0785 P 29490d1192b9423998b71cd2c90c0c1f: No bootstrap required, opened a new log
I20260709 12:08:18.742235 17105 consensus_queue.cc:260] T a80f4105a1ce4e47ab9a4089253973cf P ec82448eea8f4a3293bc13542f5930e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.758087 17105 ts_tablet_manager.cc:1434] T a80f4105a1ce4e47ab9a4089253973cf P ec82448eea8f4a3293bc13542f5930e7: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.003s
I20260709 12:08:18.759104 17105 tablet_bootstrap.cc:492] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7: Bootstrap starting.
I20260709 12:08:18.765468 17105 tablet_bootstrap.cc:654] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.750859 17106 ts_tablet_manager.cc:1403] T 2d25aa5414ba4e06a06db53053ef0785 P 29490d1192b9423998b71cd2c90c0c1f: Time spent bootstrapping tablet: real 0.074s	user 0.021s	sys 0.023s
I20260709 12:08:18.768878 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1063d9c76f824514a53771146fb1605d" candidate_uuid: "c8e4344281b94506aeea8b84fc758bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29490d1192b9423998b71cd2c90c0c1f" is_pre_election: true
I20260709 12:08:18.768816 17106 raft_consensus.cc:359] T 2d25aa5414ba4e06a06db53053ef0785 P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.769588 17106 raft_consensus.cc:385] T 2d25aa5414ba4e06a06db53053ef0785 P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.769905 17106 raft_consensus.cc:740] T 2d25aa5414ba4e06a06db53053ef0785 P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29490d1192b9423998b71cd2c90c0c1f, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.770488 17107 tablet_bootstrap.cc:492] T 7d8bd5c247434c4e94b353024ef7bc92 P c8e4344281b94506aeea8b84fc758bb8: No bootstrap required, opened a new log
W20260709 12:08:18.770563 17027 leader_election.cc:343] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193:44815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.771040 17107 ts_tablet_manager.cc:1403] T 7d8bd5c247434c4e94b353024ef7bc92 P c8e4344281b94506aeea8b84fc758bb8: Time spent bootstrapping tablet: real 0.069s	user 0.015s	sys 0.004s
I20260709 12:08:18.770677 17106 consensus_queue.cc:260] T 2d25aa5414ba4e06a06db53053ef0785 P 29490d1192b9423998b71cd2c90c0c1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.773164 16989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1063d9c76f824514a53771146fb1605d" candidate_uuid: "c8e4344281b94506aeea8b84fc758bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec82448eea8f4a3293bc13542f5930e7" is_pre_election: true
I20260709 12:08:18.773840 16989 raft_consensus.cc:2468] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8e4344281b94506aeea8b84fc758bb8 in term 0.
I20260709 12:08:18.774791 17107 raft_consensus.cc:359] T 7d8bd5c247434c4e94b353024ef7bc92 P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.775148 17027 leader_election.cc:304] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8e4344281b94506aeea8b84fc758bb8, ec82448eea8f4a3293bc13542f5930e7; no voters: 29490d1192b9423998b71cd2c90c0c1f
I20260709 12:08:18.775511 17107 raft_consensus.cc:385] T 7d8bd5c247434c4e94b353024ef7bc92 P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.775859 17107 raft_consensus.cc:740] T 7d8bd5c247434c4e94b353024ef7bc92 P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e4344281b94506aeea8b84fc758bb8, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.776058 17114 raft_consensus.cc:2804] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.776423 17114 raft_consensus.cc:493] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.776750 17114 raft_consensus.cc:3060] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.776588 17107 consensus_queue.cc:260] T 7d8bd5c247434c4e94b353024ef7bc92 P c8e4344281b94506aeea8b84fc758bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.782294 17106 ts_tablet_manager.cc:1434] T 2d25aa5414ba4e06a06db53053ef0785 P 29490d1192b9423998b71cd2c90c0c1f: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:08:18.784264 17114 raft_consensus.cc:515] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.786276 17107 ts_tablet_manager.cc:1434] T 7d8bd5c247434c4e94b353024ef7bc92 P c8e4344281b94506aeea8b84fc758bb8: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.008s
I20260709 12:08:18.786864 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1063d9c76f824514a53771146fb1605d" candidate_uuid: "c8e4344281b94506aeea8b84fc758bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29490d1192b9423998b71cd2c90c0c1f"
I20260709 12:08:18.787259 17107 tablet_bootstrap.cc:492] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8: Bootstrap starting.
W20260709 12:08:18.788267 17027 leader_election.cc:343] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193:44815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.790349 16989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1063d9c76f824514a53771146fb1605d" candidate_uuid: "c8e4344281b94506aeea8b84fc758bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec82448eea8f4a3293bc13542f5930e7"
I20260709 12:08:18.790895 16989 raft_consensus.cc:3060] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.791601 17126 raft_consensus.cc:493] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.792048 17126 raft_consensus.cc:515] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.793752 17140 raft_consensus.cc:493] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.794082 17126 leader_election.cc:290] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193:44815), c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195:33695)
I20260709 12:08:18.794221 17140 raft_consensus.cc:515] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.795620 17063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "276d1755922145c9ae61b09cd364feeb" candidate_uuid: "ec82448eea8f4a3293bc13542f5930e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e4344281b94506aeea8b84fc758bb8" is_pre_election: true
I20260709 12:08:18.796247 17063 raft_consensus.cc:2468] T 276d1755922145c9ae61b09cd364feeb P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec82448eea8f4a3293bc13542f5930e7 in term 0.
I20260709 12:08:18.796460 17140 leader_election.cc:290] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194:37255), 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193:44815)
I20260709 12:08:18.797549 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "276d1755922145c9ae61b09cd364feeb" candidate_uuid: "ec82448eea8f4a3293bc13542f5930e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29490d1192b9423998b71cd2c90c0c1f" is_pre_election: true
I20260709 12:08:18.798151 16914 raft_consensus.cc:2468] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec82448eea8f4a3293bc13542f5930e7 in term 0.
I20260709 12:08:18.799365 17107 tablet_bootstrap.cc:654] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.799440 16953 leader_election.cc:304] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29490d1192b9423998b71cd2c90c0c1f, ec82448eea8f4a3293bc13542f5930e7; no voters: 
I20260709 12:08:18.800256 17126 raft_consensus.cc:2804] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.800597 17126 raft_consensus.cc:493] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.800968 17126 raft_consensus.cc:3060] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.801218 17113 raft_consensus.cc:493] T 2d25aa5414ba4e06a06db53053ef0785 P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.801687 17113 raft_consensus.cc:515] T 2d25aa5414ba4e06a06db53053ef0785 P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.802205 16988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee85b0213f3c41b89c2d7185032dba59" candidate_uuid: "c8e4344281b94506aeea8b84fc758bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec82448eea8f4a3293bc13542f5930e7" is_pre_election: true
I20260709 12:08:18.802907 16988 raft_consensus.cc:2468] T ee85b0213f3c41b89c2d7185032dba59 P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8e4344281b94506aeea8b84fc758bb8 in term 0.
I20260709 12:08:18.804888 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee85b0213f3c41b89c2d7185032dba59" candidate_uuid: "c8e4344281b94506aeea8b84fc758bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29490d1192b9423998b71cd2c90c0c1f" is_pre_election: true
I20260709 12:08:18.805042 17113 leader_election.cc:290] T 2d25aa5414ba4e06a06db53053ef0785 P 29490d1192b9423998b71cd2c90c0c1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194:37255), c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195:33695)
W20260709 12:08:18.807832 17027 leader_election.cc:343] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193:44815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.808337 17106 tablet_bootstrap.cc:492] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f: Bootstrap starting.
I20260709 12:08:18.808214 17126 raft_consensus.cc:515] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.809128 17027 leader_election.cc:304] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8e4344281b94506aeea8b84fc758bb8, ec82448eea8f4a3293bc13542f5930e7; no voters: 29490d1192b9423998b71cd2c90c0c1f
I20260709 12:08:18.810180 17126 leader_election.cc:290] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [CANDIDATE]: Term 1 election: Requested vote from peers 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193:44815), c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195:33695)
I20260709 12:08:18.811527 17063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "276d1755922145c9ae61b09cd364feeb" candidate_uuid: "ec82448eea8f4a3293bc13542f5930e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e4344281b94506aeea8b84fc758bb8"
I20260709 12:08:18.811968 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "276d1755922145c9ae61b09cd364feeb" candidate_uuid: "ec82448eea8f4a3293bc13542f5930e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29490d1192b9423998b71cd2c90c0c1f"
I20260709 12:08:18.813397 17105 tablet_bootstrap.cc:492] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7: No bootstrap required, opened a new log
I20260709 12:08:18.814534 17063 raft_consensus.cc:3060] T 276d1755922145c9ae61b09cd364feeb P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.814584 17140 raft_consensus.cc:2804] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.814883 16914 raft_consensus.cc:3060] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.815057 17105 ts_tablet_manager.cc:1403] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.003s
I20260709 12:08:18.815085 17140 raft_consensus.cc:493] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.815986 17140 raft_consensus.cc:3060] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.813895 17114 leader_election.cc:290] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [CANDIDATE]: Term 1 election: Requested vote from peers 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193:44815), ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194:37255)
I20260709 12:08:18.820909 17105 raft_consensus.cc:359] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.821542 17105 raft_consensus.cc:385] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.821764 17105 raft_consensus.cc:740] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec82448eea8f4a3293bc13542f5930e7, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.823629 16989 raft_consensus.cc:2468] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e4344281b94506aeea8b84fc758bb8 in term 1.
I20260709 12:08:18.823171 17105 consensus_queue.cc:260] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.830017 17105 ts_tablet_manager.cc:1434] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 12:08:18.831069 17105 tablet_bootstrap.cc:492] T 7d8bd5c247434c4e94b353024ef7bc92 P ec82448eea8f4a3293bc13542f5930e7: Bootstrap starting.
I20260709 12:08:18.841326 17105 tablet_bootstrap.cc:654] T 7d8bd5c247434c4e94b353024ef7bc92 P ec82448eea8f4a3293bc13542f5930e7: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.826881 16914 raft_consensus.cc:2468] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec82448eea8f4a3293bc13542f5930e7 in term 1.
I20260709 12:08:18.842090 17027 leader_election.cc:304] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8e4344281b94506aeea8b84fc758bb8, ec82448eea8f4a3293bc13542f5930e7; no voters: 29490d1192b9423998b71cd2c90c0c1f
I20260709 12:08:18.844285 16953 leader_election.cc:304] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29490d1192b9423998b71cd2c90c0c1f, ec82448eea8f4a3293bc13542f5930e7; no voters: 
I20260709 12:08:18.845551 17126 raft_consensus.cc:2804] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.847057 17114 raft_consensus.cc:2804] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.844339 17140 raft_consensus.cc:515] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.847323 17126 raft_consensus.cc:697] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [term 1 LEADER]: Becoming Leader. State: Replica: ec82448eea8f4a3293bc13542f5930e7, State: Running, Role: LEADER
I20260709 12:08:18.853659 17107 tablet_bootstrap.cc:492] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8: No bootstrap required, opened a new log
I20260709 12:08:18.853518 17126 consensus_queue.cc:237] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.854478 17107 ts_tablet_manager.cc:1403] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.005s
I20260709 12:08:18.880370 16989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee85b0213f3c41b89c2d7185032dba59" candidate_uuid: "c8e4344281b94506aeea8b84fc758bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec82448eea8f4a3293bc13542f5930e7"
I20260709 12:08:18.872320 17106 tablet_bootstrap.cc:654] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.879613 17140 leader_election.cc:290] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8 [CANDIDATE]: Term 1 election: Requested vote from peers ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194:37255), 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193:44815)
I20260709 12:08:18.885427 17063 raft_consensus.cc:2468] T 276d1755922145c9ae61b09cd364feeb P c8e4344281b94506aeea8b84fc758bb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec82448eea8f4a3293bc13542f5930e7 in term 1.
I20260709 12:08:18.885581 16989 raft_consensus.cc:3060] T ee85b0213f3c41b89c2d7185032dba59 P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.884244 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee85b0213f3c41b89c2d7185032dba59" candidate_uuid: "c8e4344281b94506aeea8b84fc758bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29490d1192b9423998b71cd2c90c0c1f"
W20260709 12:08:18.889075 17027 leader_election.cc:343] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193:44815): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:18.891862 17114 raft_consensus.cc:697] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [term 1 LEADER]: Becoming Leader. State: Replica: c8e4344281b94506aeea8b84fc758bb8, State: Running, Role: LEADER
I20260709 12:08:18.893138 17114 consensus_queue.cc:237] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.897775 17113 raft_consensus.cc:493] T a8e96f93f8824601adfe39584798017e P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.898736 17107 raft_consensus.cc:359] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.899464 17107 raft_consensus.cc:385] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.899085 17113 raft_consensus.cc:515] T a8e96f93f8824601adfe39584798017e P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.899773 17107 raft_consensus.cc:740] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e4344281b94506aeea8b84fc758bb8, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.900532 17107 consensus_queue.cc:260] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.902025 17113 leader_election.cc:290] T a8e96f93f8824601adfe39584798017e P 29490d1192b9423998b71cd2c90c0c1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194:37255), c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195:33695)
I20260709 12:08:18.902822 17107 ts_tablet_manager.cc:1434] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8: Time spent starting tablet: real 0.048s	user 0.012s	sys 0.020s
I20260709 12:08:18.902889 17113 raft_consensus.cc:493] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:18.904173 17107 tablet_bootstrap.cc:492] T a80f4105a1ce4e47ab9a4089253973cf P c8e4344281b94506aeea8b84fc758bb8: Bootstrap starting.
I20260709 12:08:18.903720 17113 raft_consensus.cc:515] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.906764 17113 leader_election.cc:290] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194:37255), c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195:33695)
I20260709 12:08:18.907940 16989 raft_consensus.cc:2468] T ee85b0213f3c41b89c2d7185032dba59 P ec82448eea8f4a3293bc13542f5930e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e4344281b94506aeea8b84fc758bb8 in term 1.
I20260709 12:08:18.909685 17027 leader_election.cc:304] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8e4344281b94506aeea8b84fc758bb8, ec82448eea8f4a3293bc13542f5930e7; no voters: 29490d1192b9423998b71cd2c90c0c1f
I20260709 12:08:18.918810 17145 raft_consensus.cc:2804] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:18.922706 17105 tablet_bootstrap.cc:492] T 7d8bd5c247434c4e94b353024ef7bc92 P ec82448eea8f4a3293bc13542f5930e7: No bootstrap required, opened a new log
I20260709 12:08:18.923310 17105 ts_tablet_manager.cc:1403] T 7d8bd5c247434c4e94b353024ef7bc92 P ec82448eea8f4a3293bc13542f5930e7: Time spent bootstrapping tablet: real 0.092s	user 0.012s	sys 0.024s
I20260709 12:08:18.922940 17145 raft_consensus.cc:697] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8 [term 1 LEADER]: Becoming Leader. State: Replica: c8e4344281b94506aeea8b84fc758bb8, State: Running, Role: LEADER
I20260709 12:08:18.930336 17063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d25aa5414ba4e06a06db53053ef0785" candidate_uuid: "29490d1192b9423998b71cd2c90c0c1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e4344281b94506aeea8b84fc758bb8" is_pre_election: true
I20260709 12:08:18.930476 16989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d25aa5414ba4e06a06db53053ef0785" candidate_uuid: "29490d1192b9423998b71cd2c90c0c1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec82448eea8f4a3293bc13542f5930e7" is_pre_election: true
I20260709 12:08:18.933313 17105 raft_consensus.cc:359] T 7d8bd5c247434c4e94b353024ef7bc92 P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.933863 17105 raft_consensus.cc:385] T 7d8bd5c247434c4e94b353024ef7bc92 P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.934063 17105 raft_consensus.cc:740] T 7d8bd5c247434c4e94b353024ef7bc92 P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec82448eea8f4a3293bc13542f5930e7, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.932593 16988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e96f93f8824601adfe39584798017e" candidate_uuid: "29490d1192b9423998b71cd2c90c0c1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec82448eea8f4a3293bc13542f5930e7" is_pre_election: true
I20260709 12:08:18.936151 17105 consensus_queue.cc:260] T 7d8bd5c247434c4e94b353024ef7bc92 P ec82448eea8f4a3293bc13542f5930e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.934751 16989 raft_consensus.cc:2468] T 2d25aa5414ba4e06a06db53053ef0785 P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29490d1192b9423998b71cd2c90c0c1f in term 0.
I20260709 12:08:18.927666 17145 consensus_queue.cc:237] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.935475 17063 raft_consensus.cc:2468] T 2d25aa5414ba4e06a06db53053ef0785 P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29490d1192b9423998b71cd2c90c0c1f in term 0.
I20260709 12:08:18.945652 17105 ts_tablet_manager.cc:1434] T 7d8bd5c247434c4e94b353024ef7bc92 P ec82448eea8f4a3293bc13542f5930e7: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 12:08:18.943707 17062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e96f93f8824601adfe39584798017e" candidate_uuid: "29490d1192b9423998b71cd2c90c0c1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e4344281b94506aeea8b84fc758bb8" is_pre_election: true
I20260709 12:08:18.948438 17062 raft_consensus.cc:2393] T a8e96f93f8824601adfe39584798017e P c8e4344281b94506aeea8b84fc758bb8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29490d1192b9423998b71cd2c90c0c1f in current term 1: Already voted for candidate ec82448eea8f4a3293bc13542f5930e7 in this term.
I20260709 12:08:18.943799 17061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ca6528cae84361ac940d82bf10059d" candidate_uuid: "29490d1192b9423998b71cd2c90c0c1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e4344281b94506aeea8b84fc758bb8" is_pre_election: true
I20260709 12:08:18.952910 17061 raft_consensus.cc:2468] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29490d1192b9423998b71cd2c90c0c1f in term 0.
I20260709 12:08:18.947108 16987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ca6528cae84361ac940d82bf10059d" candidate_uuid: "29490d1192b9423998b71cd2c90c0c1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec82448eea8f4a3293bc13542f5930e7" is_pre_election: true
I20260709 12:08:18.957610 16987 raft_consensus.cc:2468] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29490d1192b9423998b71cd2c90c0c1f in term 0.
I20260709 12:08:18.959259 16878 leader_election.cc:304] T 2d25aa5414ba4e06a06db53053ef0785 P 29490d1192b9423998b71cd2c90c0c1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29490d1192b9423998b71cd2c90c0c1f, ec82448eea8f4a3293bc13542f5930e7; no voters: 
I20260709 12:08:18.962739 17147 raft_consensus.cc:2804] T 2d25aa5414ba4e06a06db53053ef0785 P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:18.967157 17147 raft_consensus.cc:493] T 2d25aa5414ba4e06a06db53053ef0785 P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:18.968573 17147 raft_consensus.cc:3060] T 2d25aa5414ba4e06a06db53053ef0785 P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:18.971217 17106 tablet_bootstrap.cc:492] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f: No bootstrap required, opened a new log
I20260709 12:08:18.971639 17106 ts_tablet_manager.cc:1403] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f: Time spent bootstrapping tablet: real 0.164s	user 0.019s	sys 0.025s
I20260709 12:08:18.974259 17106 raft_consensus.cc:359] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.974949 17106 raft_consensus.cc:385] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:18.975257 17106 raft_consensus.cc:740] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29490d1192b9423998b71cd2c90c0c1f, State: Initialized, Role: FOLLOWER
I20260709 12:08:18.976058 17106 consensus_queue.cc:260] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.976998 17147 raft_consensus.cc:515] T 2d25aa5414ba4e06a06db53053ef0785 P 29490d1192b9423998b71cd2c90c0c1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:18.979122 16878 leader_election.cc:304] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29490d1192b9423998b71cd2c90c0c1f, ec82448eea8f4a3293bc13542f5930e7; no voters: 
I20260709 12:08:18.981707 17106 ts_tablet_manager.cc:1434] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 12:08:18.983098 17106 tablet_bootstrap.cc:492] T ee85b0213f3c41b89c2d7185032dba59 P 29490d1192b9423998b71cd2c90c0c1f: Bootstrap starting.
I20260709 12:08:18.983289 17107 tablet_bootstrap.cc:654] T a80f4105a1ce4e47ab9a4089253973cf P c8e4344281b94506aeea8b84fc758bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.982765 16807 catalog_manager.cc:5697] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194). New cstate: current_term: 1 leader_uuid: "ec82448eea8f4a3293bc13542f5930e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:18.990566 17106 tablet_bootstrap.cc:654] T ee85b0213f3c41b89c2d7185032dba59 P 29490d1192b9423998b71cd2c90c0c1f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:18.990548 16811 catalog_manager.cc:5697] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "c8e4344281b94506aeea8b84fc758bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:19.016022 17106 tablet_bootstrap.cc:492] T ee85b0213f3c41b89c2d7185032dba59 P 29490d1192b9423998b71cd2c90c0c1f: No bootstrap required, opened a new log
I20260709 12:08:19.016665 17106 ts_tablet_manager.cc:1403] T ee85b0213f3c41b89c2d7185032dba59 P 29490d1192b9423998b71cd2c90c0c1f: Time spent bootstrapping tablet: real 0.034s	user 0.019s	sys 0.013s
I20260709 12:08:19.020119 17106 raft_consensus.cc:359] T ee85b0213f3c41b89c2d7185032dba59 P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:19.021200 17113 raft_consensus.cc:2804] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:19.021685 17113 raft_consensus.cc:493] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:19.022018 17147 leader_election.cc:290] T 2d25aa5414ba4e06a06db53053ef0785 P 29490d1192b9423998b71cd2c90c0c1f [CANDIDATE]: Term 1 election: Requested vote from peers ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194:37255), c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195:33695)
I20260709 12:08:19.022116 17113 raft_consensus.cc:3060] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.022619 17147 raft_consensus.cc:493] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.023231 17147 raft_consensus.cc:515] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:19.025753 17147 leader_election.cc:290] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194:37255), c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195:33695)
I20260709 12:08:19.028614 16878 leader_election.cc:304] T a8e96f93f8824601adfe39584798017e P 29490d1192b9423998b71cd2c90c0c1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29490d1192b9423998b71cd2c90c0c1f; no voters: c8e4344281b94506aeea8b84fc758bb8, ec82448eea8f4a3293bc13542f5930e7
I20260709 12:08:19.031711 16987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d25aa5414ba4e06a06db53053ef0785" candidate_uuid: "29490d1192b9423998b71cd2c90c0c1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec82448eea8f4a3293bc13542f5930e7"
I20260709 12:08:19.032299 16987 raft_consensus.cc:3060] T 2d25aa5414ba4e06a06db53053ef0785 P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.031929 17113 raft_consensus.cc:515] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:19.034615 17113 leader_election.cc:290] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f [CANDIDATE]: Term 1 election: Requested vote from peers ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194:37255), c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195:33695)
I20260709 12:08:19.035352 17113 raft_consensus.cc:3060] T a8e96f93f8824601adfe39584798017e P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.038718 17106 raft_consensus.cc:385] T ee85b0213f3c41b89c2d7185032dba59 P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.039141 17106 raft_consensus.cc:740] T ee85b0213f3c41b89c2d7185032dba59 P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29490d1192b9423998b71cd2c90c0c1f, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.040062 17106 consensus_queue.cc:260] T ee85b0213f3c41b89c2d7185032dba59 P 29490d1192b9423998b71cd2c90c0c1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:19.040876 16987 raft_consensus.cc:2468] T 2d25aa5414ba4e06a06db53053ef0785 P ec82448eea8f4a3293bc13542f5930e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29490d1192b9423998b71cd2c90c0c1f in term 1.
I20260709 12:08:19.042851 17106 ts_tablet_manager.cc:1434] T ee85b0213f3c41b89c2d7185032dba59 P 29490d1192b9423998b71cd2c90c0c1f: Time spent starting tablet: real 0.026s	user 0.010s	sys 0.000s
I20260709 12:08:19.043008 17063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d25aa5414ba4e06a06db53053ef0785" candidate_uuid: "29490d1192b9423998b71cd2c90c0c1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e4344281b94506aeea8b84fc758bb8"
I20260709 12:08:19.043581 17063 raft_consensus.cc:3060] T 2d25aa5414ba4e06a06db53053ef0785 P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.043973 17106 tablet_bootstrap.cc:492] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f: Bootstrap starting.
I20260709 12:08:19.052556 17106 tablet_bootstrap.cc:654] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.057842 17063 raft_consensus.cc:2468] T 2d25aa5414ba4e06a06db53053ef0785 P c8e4344281b94506aeea8b84fc758bb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29490d1192b9423998b71cd2c90c0c1f in term 1.
I20260709 12:08:19.059101 17114 raft_consensus.cc:493] T 7d8bd5c247434c4e94b353024ef7bc92 P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.059484 17113 raft_consensus.cc:2749] T a8e96f93f8824601adfe39584798017e P 29490d1192b9423998b71cd2c90c0c1f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:19.059567 17114 raft_consensus.cc:515] T 7d8bd5c247434c4e94b353024ef7bc92 P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:19.060122 16988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a80f4105a1ce4e47ab9a4089253973cf" candidate_uuid: "29490d1192b9423998b71cd2c90c0c1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec82448eea8f4a3293bc13542f5930e7" is_pre_election: true
I20260709 12:08:19.060637 17113 raft_consensus.cc:493] T 7d8bd5c247434c4e94b353024ef7bc92 P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.060707 16988 raft_consensus.cc:2468] T a80f4105a1ce4e47ab9a4089253973cf P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29490d1192b9423998b71cd2c90c0c1f in term 0.
I20260709 12:08:19.061751 17114 leader_election.cc:290] T 7d8bd5c247434c4e94b353024ef7bc92 P c8e4344281b94506aeea8b84fc758bb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193:44815), ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194:37255)
I20260709 12:08:19.061374 17113 raft_consensus.cc:515] T 7d8bd5c247434c4e94b353024ef7bc92 P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:19.063861 17113 leader_election.cc:290] T 7d8bd5c247434c4e94b353024ef7bc92 P 29490d1192b9423998b71cd2c90c0c1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194:37255), c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195:33695)
I20260709 12:08:19.064184 16988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bd5c247434c4e94b353024ef7bc92" candidate_uuid: "c8e4344281b94506aeea8b84fc758bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec82448eea8f4a3293bc13542f5930e7" is_pre_election: true
I20260709 12:08:19.064801 16988 raft_consensus.cc:2468] T 7d8bd5c247434c4e94b353024ef7bc92 P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8e4344281b94506aeea8b84fc758bb8 in term 0.
I20260709 12:08:19.063872 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bd5c247434c4e94b353024ef7bc92" candidate_uuid: "c8e4344281b94506aeea8b84fc758bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29490d1192b9423998b71cd2c90c0c1f" is_pre_election: true
I20260709 12:08:19.065881 16914 raft_consensus.cc:2468] T 7d8bd5c247434c4e94b353024ef7bc92 P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8e4344281b94506aeea8b84fc758bb8 in term 0.
I20260709 12:08:19.067235 17027 leader_election.cc:304] T 7d8bd5c247434c4e94b353024ef7bc92 P c8e4344281b94506aeea8b84fc758bb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29490d1192b9423998b71cd2c90c0c1f, c8e4344281b94506aeea8b84fc758bb8; no voters: 
I20260709 12:08:19.068974 17114 raft_consensus.cc:2804] T 7d8bd5c247434c4e94b353024ef7bc92 P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:19.069319 17114 raft_consensus.cc:493] T 7d8bd5c247434c4e94b353024ef7bc92 P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:19.069684 17063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a80f4105a1ce4e47ab9a4089253973cf" candidate_uuid: "29490d1192b9423998b71cd2c90c0c1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e4344281b94506aeea8b84fc758bb8" is_pre_election: true
I20260709 12:08:19.069898 17114 raft_consensus.cc:3060] T 7d8bd5c247434c4e94b353024ef7bc92 P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.072144 16987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ca6528cae84361ac940d82bf10059d" candidate_uuid: "29490d1192b9423998b71cd2c90c0c1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec82448eea8f4a3293bc13542f5930e7"
I20260709 12:08:19.072676 16987 raft_consensus.cc:3060] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.076274 17114 raft_consensus.cc:515] T 7d8bd5c247434c4e94b353024ef7bc92 P c8e4344281b94506aeea8b84fc758bb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:19.077840 16988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bd5c247434c4e94b353024ef7bc92" candidate_uuid: "29490d1192b9423998b71cd2c90c0c1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec82448eea8f4a3293bc13542f5930e7" is_pre_election: true
I20260709 12:08:19.078403 16988 raft_consensus.cc:2468] T 7d8bd5c247434c4e94b353024ef7bc92 P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29490d1192b9423998b71cd2c90c0c1f in term 0.
I20260709 12:08:19.078920 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bd5c247434c4e94b353024ef7bc92" candidate_uuid: "c8e4344281b94506aeea8b84fc758bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29490d1192b9423998b71cd2c90c0c1f"
I20260709 12:08:19.079471 16914 raft_consensus.cc:3060] T 7d8bd5c247434c4e94b353024ef7bc92 P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.076296 17063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ca6528cae84361ac940d82bf10059d" candidate_uuid: "29490d1192b9423998b71cd2c90c0c1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e4344281b94506aeea8b84fc758bb8"
I20260709 12:08:19.080042 17063 raft_consensus.cc:3060] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.082508 17061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bd5c247434c4e94b353024ef7bc92" candidate_uuid: "29490d1192b9423998b71cd2c90c0c1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e4344281b94506aeea8b84fc758bb8" is_pre_election: true
I20260709 12:08:19.082594 16878 leader_election.cc:304] T 2d25aa5414ba4e06a06db53053ef0785 P 29490d1192b9423998b71cd2c90c0c1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29490d1192b9423998b71cd2c90c0c1f, c8e4344281b94506aeea8b84fc758bb8; no voters: 
I20260709 12:08:19.083310 17061 raft_consensus.cc:2393] T 7d8bd5c247434c4e94b353024ef7bc92 P c8e4344281b94506aeea8b84fc758bb8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29490d1192b9423998b71cd2c90c0c1f in current term 1: Already voted for candidate c8e4344281b94506aeea8b84fc758bb8 in this term.
I20260709 12:08:19.083464 17147 raft_consensus.cc:2804] T 2d25aa5414ba4e06a06db53053ef0785 P 29490d1192b9423998b71cd2c90c0c1f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:19.083952 17147 raft_consensus.cc:697] T 2d25aa5414ba4e06a06db53053ef0785 P 29490d1192b9423998b71cd2c90c0c1f [term 1 LEADER]: Becoming Leader. State: Replica: 29490d1192b9423998b71cd2c90c0c1f, State: Running, Role: LEADER
I20260709 12:08:19.084756 17147 consensus_queue.cc:237] T 2d25aa5414ba4e06a06db53053ef0785 P 29490d1192b9423998b71cd2c90c0c1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
W20260709 12:08:19.087291 16878 leader_election.cc:343] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195:33695): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:19.088146 16914 raft_consensus.cc:2468] T 7d8bd5c247434c4e94b353024ef7bc92 P 29490d1192b9423998b71cd2c90c0c1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e4344281b94506aeea8b84fc758bb8 in term 1.
I20260709 12:08:19.088709 16878 leader_election.cc:304] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29490d1192b9423998b71cd2c90c0c1f, ec82448eea8f4a3293bc13542f5930e7; no voters: c8e4344281b94506aeea8b84fc758bb8
I20260709 12:08:19.089210 17027 leader_election.cc:304] T 7d8bd5c247434c4e94b353024ef7bc92 P c8e4344281b94506aeea8b84fc758bb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29490d1192b9423998b71cd2c90c0c1f, c8e4344281b94506aeea8b84fc758bb8; no voters: 
I20260709 12:08:19.090354 17145 raft_consensus.cc:2804] T 7d8bd5c247434c4e94b353024ef7bc92 P c8e4344281b94506aeea8b84fc758bb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:19.091495 17114 leader_election.cc:290] T 7d8bd5c247434c4e94b353024ef7bc92 P c8e4344281b94506aeea8b84fc758bb8 [CANDIDATE]: Term 1 election: Requested vote from peers 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193:44815), ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194:37255)
I20260709 12:08:19.091697 16988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8bd5c247434c4e94b353024ef7bc92" candidate_uuid: "c8e4344281b94506aeea8b84fc758bb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec82448eea8f4a3293bc13542f5930e7"
I20260709 12:08:19.093727 17107 tablet_bootstrap.cc:492] T a80f4105a1ce4e47ab9a4089253973cf P c8e4344281b94506aeea8b84fc758bb8: No bootstrap required, opened a new log
I20260709 12:08:19.094280 17126 consensus_queue.cc:1048] T a8e96f93f8824601adfe39584798017e P ec82448eea8f4a3293bc13542f5930e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.094630 16988 raft_consensus.cc:3060] T 7d8bd5c247434c4e94b353024ef7bc92 P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.094843 17107 ts_tablet_manager.cc:1403] T a80f4105a1ce4e47ab9a4089253973cf P c8e4344281b94506aeea8b84fc758bb8: Time spent bootstrapping tablet: real 0.191s	user 0.018s	sys 0.023s
I20260709 12:08:19.094684 17145 raft_consensus.cc:697] T 7d8bd5c247434c4e94b353024ef7bc92 P c8e4344281b94506aeea8b84fc758bb8 [term 1 LEADER]: Becoming Leader. State: Replica: c8e4344281b94506aeea8b84fc758bb8, State: Running, Role: LEADER
I20260709 12:08:19.097568 17107 raft_consensus.cc:359] T a80f4105a1ce4e47ab9a4089253973cf P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:19.098515 17107 raft_consensus.cc:385] T a80f4105a1ce4e47ab9a4089253973cf P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.097973 17145 consensus_queue.cc:237] T 7d8bd5c247434c4e94b353024ef7bc92 P c8e4344281b94506aeea8b84fc758bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:19.098832 17107 raft_consensus.cc:740] T a80f4105a1ce4e47ab9a4089253973cf P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e4344281b94506aeea8b84fc758bb8, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.099649 17107 consensus_queue.cc:260] T a80f4105a1ce4e47ab9a4089253973cf P c8e4344281b94506aeea8b84fc758bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:19.101672 16988 raft_consensus.cc:2468] T 7d8bd5c247434c4e94b353024ef7bc92 P ec82448eea8f4a3293bc13542f5930e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e4344281b94506aeea8b84fc758bb8 in term 1.
I20260709 12:08:19.102066 17107 ts_tablet_manager.cc:1434] T a80f4105a1ce4e47ab9a4089253973cf P c8e4344281b94506aeea8b84fc758bb8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:08:19.102980 17107 tablet_bootstrap.cc:492] T c0f27eff5cd24050a606667e55c75601 P c8e4344281b94506aeea8b84fc758bb8: Bootstrap starting.
I20260709 12:08:19.109031 17154 raft_consensus.cc:2804] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:19.109400 17154 raft_consensus.cc:493] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:19.109721 17154 raft_consensus.cc:3060] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.112864 17107 tablet_bootstrap.cc:654] T c0f27eff5cd24050a606667e55c75601 P c8e4344281b94506aeea8b84fc758bb8: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:19.113430 17126 consensus_queue.cc:1048] T a8e96f93f8824601adfe39584798017e P ec82448eea8f4a3293bc13542f5930e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:19.116901 17154 raft_consensus.cc:515] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:19.119192 16878 leader_election.cc:304] T 7d8bd5c247434c4e94b353024ef7bc92 P 29490d1192b9423998b71cd2c90c0c1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 29490d1192b9423998b71cd2c90c0c1f, ec82448eea8f4a3293bc13542f5930e7; no voters: c8e4344281b94506aeea8b84fc758bb8
I20260709 12:08:19.120067 17113 raft_consensus.cc:2764] T 7d8bd5c247434c4e94b353024ef7bc92 P 29490d1192b9423998b71cd2c90c0c1f [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:08:19.121212 16989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a80f4105a1ce4e47ab9a4089253973cf" candidate_uuid: "29490d1192b9423998b71cd2c90c0c1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec82448eea8f4a3293bc13542f5930e7"
I20260709 12:08:19.121770 16989 raft_consensus.cc:3060] T a80f4105a1ce4e47ab9a4089253973cf P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.123976 16987 raft_consensus.cc:2468] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29490d1192b9423998b71cd2c90c0c1f in term 1.
I20260709 12:08:19.126472 16878 leader_election.cc:304] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29490d1192b9423998b71cd2c90c0c1f, ec82448eea8f4a3293bc13542f5930e7; no voters: 
I20260709 12:08:19.128084 16989 raft_consensus.cc:2468] T a80f4105a1ce4e47ab9a4089253973cf P ec82448eea8f4a3293bc13542f5930e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29490d1192b9423998b71cd2c90c0c1f in term 1.
I20260709 12:08:19.128728 17063 raft_consensus.cc:2468] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29490d1192b9423998b71cd2c90c0c1f in term 1.
I20260709 12:08:19.131917 17113 raft_consensus.cc:2804] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:19.135845 17113 raft_consensus.cc:697] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f [term 1 LEADER]: Becoming Leader. State: Replica: 29490d1192b9423998b71cd2c90c0c1f, State: Running, Role: LEADER
I20260709 12:08:19.136741 17113 consensus_queue.cc:237] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:19.138003 17107 tablet_bootstrap.cc:492] T c0f27eff5cd24050a606667e55c75601 P c8e4344281b94506aeea8b84fc758bb8: No bootstrap required, opened a new log
I20260709 12:08:19.136914 16808 catalog_manager.cc:5697] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "c8e4344281b94506aeea8b84fc758bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:19.138533 17107 ts_tablet_manager.cc:1403] T c0f27eff5cd24050a606667e55c75601 P c8e4344281b94506aeea8b84fc758bb8: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.000s
I20260709 12:08:19.141429 17107 raft_consensus.cc:359] T c0f27eff5cd24050a606667e55c75601 P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:19.142059 17107 raft_consensus.cc:385] T c0f27eff5cd24050a606667e55c75601 P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.142325 17107 raft_consensus.cc:740] T c0f27eff5cd24050a606667e55c75601 P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8e4344281b94506aeea8b84fc758bb8, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.142982 17107 consensus_queue.cc:260] T c0f27eff5cd24050a606667e55c75601 P c8e4344281b94506aeea8b84fc758bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:19.144951 17107 ts_tablet_manager.cc:1434] T c0f27eff5cd24050a606667e55c75601 P c8e4344281b94506aeea8b84fc758bb8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:08:19.145193 16811 catalog_manager.cc:5697] T 2d25aa5414ba4e06a06db53053ef0785 P 29490d1192b9423998b71cd2c90c0c1f reported cstate change: term changed from 0 to 1, leader changed from <none> to 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193). New cstate: current_term: 1 leader_uuid: "29490d1192b9423998b71cd2c90c0c1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.150664 16878 leader_election.cc:304] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29490d1192b9423998b71cd2c90c0c1f, ec82448eea8f4a3293bc13542f5930e7; no voters: 
I20260709 12:08:19.152491 17147 raft_consensus.cc:2804] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:19.152957 17147 raft_consensus.cc:697] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f [term 1 LEADER]: Becoming Leader. State: Replica: 29490d1192b9423998b71cd2c90c0c1f, State: Running, Role: LEADER
I20260709 12:08:19.153801 17147 consensus_queue.cc:237] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:19.158871 17154 leader_election.cc:290] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f [CANDIDATE]: Term 1 election: Requested vote from peers ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194:37255), c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195:33695)
I20260709 12:08:19.160272 17063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a80f4105a1ce4e47ab9a4089253973cf" candidate_uuid: "29490d1192b9423998b71cd2c90c0c1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e4344281b94506aeea8b84fc758bb8"
I20260709 12:08:19.162248 17063 raft_consensus.cc:3060] T a80f4105a1ce4e47ab9a4089253973cf P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.180124 17106 tablet_bootstrap.cc:492] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f: No bootstrap required, opened a new log
I20260709 12:08:19.180563 17106 ts_tablet_manager.cc:1403] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f: Time spent bootstrapping tablet: real 0.137s	user 0.026s	sys 0.025s
I20260709 12:08:19.183198 17063 raft_consensus.cc:2468] T a80f4105a1ce4e47ab9a4089253973cf P c8e4344281b94506aeea8b84fc758bb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29490d1192b9423998b71cd2c90c0c1f in term 1.
I20260709 12:08:19.190973 17106 raft_consensus.cc:359] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:19.191722 17106 raft_consensus.cc:385] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:19.192026 17106 raft_consensus.cc:740] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29490d1192b9423998b71cd2c90c0c1f, State: Initialized, Role: FOLLOWER
I20260709 12:08:19.192646 17106 consensus_queue.cc:260] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:19.194872 17106 ts_tablet_manager.cc:1434] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 12:08:19.191082 16811 catalog_manager.cc:5697] T 7d8bd5c247434c4e94b353024ef7bc92 P c8e4344281b94506aeea8b84fc758bb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "c8e4344281b94506aeea8b84fc758bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:19.200001 17147 raft_consensus.cc:493] T ee85b0213f3c41b89c2d7185032dba59 P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.200475 17147 raft_consensus.cc:515] T ee85b0213f3c41b89c2d7185032dba59 P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:19.202505 17147 leader_election.cc:290] T ee85b0213f3c41b89c2d7185032dba59 P 29490d1192b9423998b71cd2c90c0c1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194:37255), c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195:33695)
I20260709 12:08:19.203658 16989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee85b0213f3c41b89c2d7185032dba59" candidate_uuid: "29490d1192b9423998b71cd2c90c0c1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec82448eea8f4a3293bc13542f5930e7" is_pre_election: true
I20260709 12:08:19.204303 16989 raft_consensus.cc:2393] T ee85b0213f3c41b89c2d7185032dba59 P ec82448eea8f4a3293bc13542f5930e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 29490d1192b9423998b71cd2c90c0c1f in current term 1: Already voted for candidate c8e4344281b94506aeea8b84fc758bb8 in this term.
I20260709 12:08:19.205483 17063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee85b0213f3c41b89c2d7185032dba59" candidate_uuid: "29490d1192b9423998b71cd2c90c0c1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e4344281b94506aeea8b84fc758bb8" is_pre_election: true
I20260709 12:08:19.206786 16878 leader_election.cc:304] T ee85b0213f3c41b89c2d7185032dba59 P 29490d1192b9423998b71cd2c90c0c1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 29490d1192b9423998b71cd2c90c0c1f; no voters: c8e4344281b94506aeea8b84fc758bb8, ec82448eea8f4a3293bc13542f5930e7
I20260709 12:08:19.207790 17147 raft_consensus.cc:3060] T ee85b0213f3c41b89c2d7185032dba59 P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.208459 16807 catalog_manager.cc:5697] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f reported cstate change: term changed from 0 to 1, leader changed from <none> to 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193). New cstate: current_term: 1 leader_uuid: "29490d1192b9423998b71cd2c90c0c1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.210958 16807 catalog_manager.cc:5697] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f reported cstate change: term changed from 0 to 1, leader changed from <none> to 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193). New cstate: current_term: 1 leader_uuid: "29490d1192b9423998b71cd2c90c0c1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.214541 17147 raft_consensus.cc:2749] T ee85b0213f3c41b89c2d7185032dba59 P 29490d1192b9423998b71cd2c90c0c1f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:19.291379 16914 raft_consensus.cc:3060] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.299734 17145 consensus_queue.cc:1048] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.305979 17147 raft_consensus.cc:493] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:19.306435 17147 raft_consensus.cc:515] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:19.308342 17147 leader_election.cc:290] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194:37255), c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195:33695)
I20260709 12:08:19.310050 17063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0f27eff5cd24050a606667e55c75601" candidate_uuid: "29490d1192b9423998b71cd2c90c0c1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e4344281b94506aeea8b84fc758bb8" is_pre_election: true
I20260709 12:08:19.310634 17063 raft_consensus.cc:2468] T c0f27eff5cd24050a606667e55c75601 P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29490d1192b9423998b71cd2c90c0c1f in term 0.
I20260709 12:08:19.310755 16989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0f27eff5cd24050a606667e55c75601" candidate_uuid: "29490d1192b9423998b71cd2c90c0c1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec82448eea8f4a3293bc13542f5930e7" is_pre_election: true
I20260709 12:08:19.311429 16989 raft_consensus.cc:2468] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 29490d1192b9423998b71cd2c90c0c1f in term 0.
I20260709 12:08:19.312100 16878 leader_election.cc:304] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29490d1192b9423998b71cd2c90c0c1f, c8e4344281b94506aeea8b84fc758bb8; no voters: 
I20260709 12:08:19.313855 17147 raft_consensus.cc:2804] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:19.314208 17147 raft_consensus.cc:493] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:19.314553 17147 raft_consensus.cc:3060] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.316809 17145 consensus_queue.cc:1048] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:08:19.321429 16859 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:19.322134 17147 raft_consensus.cc:515] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:19.325208 17147 leader_election.cc:290] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f [CANDIDATE]: Term 1 election: Requested vote from peers ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194:37255), c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195:33695)
I20260709 12:08:19.325593 17063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0f27eff5cd24050a606667e55c75601" candidate_uuid: "29490d1192b9423998b71cd2c90c0c1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8e4344281b94506aeea8b84fc758bb8"
I20260709 12:08:19.326138 17063 raft_consensus.cc:3060] T c0f27eff5cd24050a606667e55c75601 P c8e4344281b94506aeea8b84fc758bb8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.327616 16987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0f27eff5cd24050a606667e55c75601" candidate_uuid: "29490d1192b9423998b71cd2c90c0c1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec82448eea8f4a3293bc13542f5930e7"
I20260709 12:08:19.328203 16987 raft_consensus.cc:3060] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:19.332868 17063 raft_consensus.cc:2468] T c0f27eff5cd24050a606667e55c75601 P c8e4344281b94506aeea8b84fc758bb8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29490d1192b9423998b71cd2c90c0c1f in term 1.
I20260709 12:08:19.334008 16878 leader_election.cc:304] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29490d1192b9423998b71cd2c90c0c1f, c8e4344281b94506aeea8b84fc758bb8; no voters: 
I20260709 12:08:19.334820 17147 raft_consensus.cc:2804] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:19.334889 16987 raft_consensus.cc:2468] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29490d1192b9423998b71cd2c90c0c1f in term 1.
I20260709 12:08:19.335318 17147 raft_consensus.cc:697] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f [term 1 LEADER]: Becoming Leader. State: Replica: 29490d1192b9423998b71cd2c90c0c1f, State: Running, Role: LEADER
I20260709 12:08:19.336153 17147 consensus_queue.cc:237] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:19.344579 16807 catalog_manager.cc:5697] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f reported cstate change: term changed from 0 to 1, leader changed from <none> to 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193). New cstate: current_term: 1 leader_uuid: "29490d1192b9423998b71cd2c90c0c1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.401353 17110 consensus_queue.cc:1048] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.414435 17110 consensus_queue.cc:1048] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.453157 17145 consensus_queue.cc:1048] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.476872 17114 consensus_queue.cc:1048] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.484126 17114 consensus_queue.cc:1048] T 7d8bd5c247434c4e94b353024ef7bc92 P c8e4344281b94506aeea8b84fc758bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.497443 17140 consensus_queue.cc:1048] T 7d8bd5c247434c4e94b353024ef7bc92 P c8e4344281b94506aeea8b84fc758bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.508124 17063 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee85b0213f3c41b89c2d7185032dba59"
dest_uuid: "c8e4344281b94506aeea8b84fc758bb8"
mode: GRACEFUL
new_leader_uuid: "29490d1192b9423998b71cd2c90c0c1f"
 from {username='slave'} at 127.0.0.1:34884
I20260709 12:08:19.508803 17063 raft_consensus.cc:606] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8 [term 1 LEADER]: Received request to transfer leadership to TS 29490d1192b9423998b71cd2c90c0c1f
I20260709 12:08:19.532980 16989 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "276d1755922145c9ae61b09cd364feeb"
dest_uuid: "ec82448eea8f4a3293bc13542f5930e7"
mode: GRACEFUL
new_leader_uuid: "29490d1192b9423998b71cd2c90c0c1f"
 from {username='slave'} at 127.0.0.1:53490
I20260709 12:08:19.533591 16989 raft_consensus.cc:606] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [term 1 LEADER]: Received request to transfer leadership to TS 29490d1192b9423998b71cd2c90c0c1f
I20260709 12:08:19.541344 17063 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1063d9c76f824514a53771146fb1605d"
dest_uuid: "c8e4344281b94506aeea8b84fc758bb8"
mode: GRACEFUL
new_leader_uuid: "29490d1192b9423998b71cd2c90c0c1f"
 from {username='slave'} at 127.0.0.1:34884
I20260709 12:08:19.541873 17063 raft_consensus.cc:606] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [term 1 LEADER]: Received request to transfer leadership to TS 29490d1192b9423998b71cd2c90c0c1f
I20260709 12:08:19.554706 16913 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99ca6528cae84361ac940d82bf10059d"
dest_uuid: "29490d1192b9423998b71cd2c90c0c1f"
mode: GRACEFUL
new_leader_uuid: "ec82448eea8f4a3293bc13542f5930e7"
 from {username='slave'} at 127.0.0.1:46890
I20260709 12:08:19.555330 16913 raft_consensus.cc:606] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f [term 1 LEADER]: Received request to transfer leadership to TS ec82448eea8f4a3293bc13542f5930e7
I20260709 12:08:19.562863 16913 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0f27eff5cd24050a606667e55c75601"
dest_uuid: "29490d1192b9423998b71cd2c90c0c1f"
mode: GRACEFUL
new_leader_uuid: "ec82448eea8f4a3293bc13542f5930e7"
 from {username='slave'} at 127.0.0.1:46890
I20260709 12:08:19.563444 16913 raft_consensus.cc:606] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f [term 1 LEADER]: Received request to transfer leadership to TS ec82448eea8f4a3293bc13542f5930e7
I20260709 12:08:19.568408 16913 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a80f4105a1ce4e47ab9a4089253973cf"
dest_uuid: "29490d1192b9423998b71cd2c90c0c1f"
mode: GRACEFUL
new_leader_uuid: "ec82448eea8f4a3293bc13542f5930e7"
 from {username='slave'} at 127.0.0.1:46890
I20260709 12:08:19.568976 16913 raft_consensus.cc:606] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f [term 1 LEADER]: Received request to transfer leadership to TS ec82448eea8f4a3293bc13542f5930e7
I20260709 12:08:19.598495 17147 consensus_queue.cc:1048] T 2d25aa5414ba4e06a06db53053ef0785 P 29490d1192b9423998b71cd2c90c0c1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:19.602427 17154 consensus_queue.cc:1048] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:08:19.616140 17154 consensus_queue.cc:1048] T 2d25aa5414ba4e06a06db53053ef0785 P 29490d1192b9423998b71cd2c90c0c1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.636116 17147 consensus_queue.cc:1048] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.645164 17113 raft_consensus.cc:993] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f: : Instructing follower ec82448eea8f4a3293bc13542f5930e7 to start an election
I20260709 12:08:19.645617 17113 raft_consensus.cc:1081] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f [term 1 LEADER]: Signalling peer ec82448eea8f4a3293bc13542f5930e7 to start an election
I20260709 12:08:19.647609 16989 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a80f4105a1ce4e47ab9a4089253973cf"
dest_uuid: "ec82448eea8f4a3293bc13542f5930e7"
 from {username='slave'} at 127.0.0.1:53474
I20260709 12:08:19.648216 16989 raft_consensus.cc:493] T a80f4105a1ce4e47ab9a4089253973cf P ec82448eea8f4a3293bc13542f5930e7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.648540 16989 raft_consensus.cc:3060] T a80f4105a1ce4e47ab9a4089253973cf P ec82448eea8f4a3293bc13542f5930e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.653311 17113 consensus_queue.cc:1048] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.654335 16989 raft_consensus.cc:515] T a80f4105a1ce4e47ab9a4089253973cf P ec82448eea8f4a3293bc13542f5930e7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:19.658581 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a80f4105a1ce4e47ab9a4089253973cf" candidate_uuid: "ec82448eea8f4a3293bc13542f5930e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29490d1192b9423998b71cd2c90c0c1f"
I20260709 12:08:19.658691 16989 leader_election.cc:290] T a80f4105a1ce4e47ab9a4089253973cf P ec82448eea8f4a3293bc13542f5930e7 [CANDIDATE]: Term 2 election: Requested vote from peers 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193:44815), c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195:33695)
I20260709 12:08:19.658902 17063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a80f4105a1ce4e47ab9a4089253973cf" candidate_uuid: "ec82448eea8f4a3293bc13542f5930e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8e4344281b94506aeea8b84fc758bb8"
I20260709 12:08:19.659227 16913 raft_consensus.cc:3055] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.659492 17063 raft_consensus.cc:3060] T a80f4105a1ce4e47ab9a4089253973cf P c8e4344281b94506aeea8b84fc758bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.659585 16913 raft_consensus.cc:740] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29490d1192b9423998b71cd2c90c0c1f, State: Running, Role: LEADER
I20260709 12:08:19.660485 16913 consensus_queue.cc:260] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:19.661792 16913 raft_consensus.cc:3060] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.664291 17063 raft_consensus.cc:2468] T a80f4105a1ce4e47ab9a4089253973cf P c8e4344281b94506aeea8b84fc758bb8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec82448eea8f4a3293bc13542f5930e7 in term 2.
I20260709 12:08:19.665421 16953 leader_election.cc:304] T a80f4105a1ce4e47ab9a4089253973cf P ec82448eea8f4a3293bc13542f5930e7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8e4344281b94506aeea8b84fc758bb8, ec82448eea8f4a3293bc13542f5930e7; no voters: 
I20260709 12:08:19.666424 17172 raft_consensus.cc:2804] T a80f4105a1ce4e47ab9a4089253973cf P ec82448eea8f4a3293bc13542f5930e7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.667038 17172 raft_consensus.cc:697] T a80f4105a1ce4e47ab9a4089253973cf P ec82448eea8f4a3293bc13542f5930e7 [term 2 LEADER]: Becoming Leader. State: Replica: ec82448eea8f4a3293bc13542f5930e7, State: Running, Role: LEADER
I20260709 12:08:19.668078 17172 consensus_queue.cc:237] T a80f4105a1ce4e47ab9a4089253973cf P ec82448eea8f4a3293bc13542f5930e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:19.671540 16913 raft_consensus.cc:2468] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec82448eea8f4a3293bc13542f5930e7 in term 2.
I20260709 12:08:19.683423 17163 raft_consensus.cc:993] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f: : Instructing follower ec82448eea8f4a3293bc13542f5930e7 to start an election
I20260709 12:08:19.683866 17163 raft_consensus.cc:1081] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f [term 1 LEADER]: Signalling peer ec82448eea8f4a3293bc13542f5930e7 to start an election
I20260709 12:08:19.685235 16808 catalog_manager.cc:5697] T a80f4105a1ce4e47ab9a4089253973cf P ec82448eea8f4a3293bc13542f5930e7 reported cstate change: term changed from 1 to 2, leader changed from 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193) to ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194). New cstate: current_term: 2 leader_uuid: "ec82448eea8f4a3293bc13542f5930e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.687317 16989 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99ca6528cae84361ac940d82bf10059d"
dest_uuid: "ec82448eea8f4a3293bc13542f5930e7"
 from {username='slave'} at 127.0.0.1:53474
I20260709 12:08:19.687885 16989 raft_consensus.cc:493] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.688258 16989 raft_consensus.cc:3060] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.690150 17163 consensus_queue.cc:1048] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.694825 16989 raft_consensus.cc:515] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:19.697616 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ca6528cae84361ac940d82bf10059d" candidate_uuid: "ec82448eea8f4a3293bc13542f5930e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29490d1192b9423998b71cd2c90c0c1f"
I20260709 12:08:19.698206 16913 raft_consensus.cc:3055] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.698520 16913 raft_consensus.cc:740] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29490d1192b9423998b71cd2c90c0c1f, State: Running, Role: LEADER
I20260709 12:08:19.699321 16913 consensus_queue.cc:260] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:19.700208 16913 raft_consensus.cc:3060] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.702193 16987 raft_consensus.cc:1240] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [term 2 FOLLOWER]: Rejecting Update request from peer 29490d1192b9423998b71cd2c90c0c1f for earlier term 1. Current term is 2. Ops: []
I20260709 12:08:19.708055 17145 raft_consensus.cc:993] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8: : Instructing follower 29490d1192b9423998b71cd2c90c0c1f to start an election
I20260709 12:08:19.708484 17145 raft_consensus.cc:1081] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [term 1 LEADER]: Signalling peer 29490d1192b9423998b71cd2c90c0c1f to start an election
I20260709 12:08:19.709148 16989 leader_election.cc:290] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [CANDIDATE]: Term 2 election: Requested vote from peers 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193:44815), c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195:33695)
I20260709 12:08:19.707924 16913 raft_consensus.cc:2468] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec82448eea8f4a3293bc13542f5930e7 in term 2.
I20260709 12:08:19.710332 17063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ca6528cae84361ac940d82bf10059d" candidate_uuid: "ec82448eea8f4a3293bc13542f5930e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8e4344281b94506aeea8b84fc758bb8"
I20260709 12:08:19.710722 16953 leader_election.cc:304] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29490d1192b9423998b71cd2c90c0c1f, ec82448eea8f4a3293bc13542f5930e7; no voters: 
I20260709 12:08:19.710929 17063 raft_consensus.cc:3060] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.711519 17172 raft_consensus.cc:2804] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.711970 17172 raft_consensus.cc:697] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [term 2 LEADER]: Becoming Leader. State: Replica: ec82448eea8f4a3293bc13542f5930e7, State: Running, Role: LEADER
I20260709 12:08:19.712782 17172 consensus_queue.cc:237] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:19.716004 16914 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1063d9c76f824514a53771146fb1605d"
dest_uuid: "29490d1192b9423998b71cd2c90c0c1f"
 from {username='slave'} at 127.0.0.1:46874
I20260709 12:08:19.716534 16914 raft_consensus.cc:493] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.716899 16914 raft_consensus.cc:3060] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.717870 17063 raft_consensus.cc:2468] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec82448eea8f4a3293bc13542f5930e7 in term 2.
I20260709 12:08:19.722256 16809 catalog_manager.cc:5697] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 reported cstate change: term changed from 1 to 2, leader changed from 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193) to ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194). New cstate: current_term: 2 leader_uuid: "ec82448eea8f4a3293bc13542f5930e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.723464 16914 raft_consensus.cc:515] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:19.725348 16914 leader_election.cc:290] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f [CANDIDATE]: Term 2 election: Requested vote from peers ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194:37255), c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195:33695)
I20260709 12:08:19.725919 16989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1063d9c76f824514a53771146fb1605d" candidate_uuid: "29490d1192b9423998b71cd2c90c0c1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec82448eea8f4a3293bc13542f5930e7"
I20260709 12:08:19.726460 16989 raft_consensus.cc:3060] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.727929 17063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1063d9c76f824514a53771146fb1605d" candidate_uuid: "29490d1192b9423998b71cd2c90c0c1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8e4344281b94506aeea8b84fc758bb8"
I20260709 12:08:19.728529 17063 raft_consensus.cc:3055] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.728906 17063 raft_consensus.cc:740] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c8e4344281b94506aeea8b84fc758bb8, State: Running, Role: LEADER
I20260709 12:08:19.729836 17063 consensus_queue.cc:260] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:19.731108 17063 raft_consensus.cc:3060] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.732903 16989 raft_consensus.cc:2468] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29490d1192b9423998b71cd2c90c0c1f in term 2.
I20260709 12:08:19.734028 16878 leader_election.cc:304] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29490d1192b9423998b71cd2c90c0c1f, ec82448eea8f4a3293bc13542f5930e7; no voters: 
I20260709 12:08:19.734895 17113 raft_consensus.cc:2804] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.735351 17113 raft_consensus.cc:697] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f [term 2 LEADER]: Becoming Leader. State: Replica: 29490d1192b9423998b71cd2c90c0c1f, State: Running, Role: LEADER
I20260709 12:08:19.736153 17113 consensus_queue.cc:237] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:19.737932 17063 raft_consensus.cc:2468] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29490d1192b9423998b71cd2c90c0c1f in term 2.
I20260709 12:08:19.741415 17113 consensus_queue.cc:1048] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.744611 16809 catalog_manager.cc:5697] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f reported cstate change: term changed from 1 to 2, leader changed from c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195) to 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193). New cstate: current_term: 2 leader_uuid: "29490d1192b9423998b71cd2c90c0c1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.753829 17147 consensus_queue.cc:1048] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:19.766602 17113 raft_consensus.cc:993] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f: : Instructing follower ec82448eea8f4a3293bc13542f5930e7 to start an election
I20260709 12:08:19.767130 17154 raft_consensus.cc:1081] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f [term 1 LEADER]: Signalling peer ec82448eea8f4a3293bc13542f5930e7 to start an election
I20260709 12:08:19.768676 16989 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c0f27eff5cd24050a606667e55c75601"
dest_uuid: "ec82448eea8f4a3293bc13542f5930e7"
 from {username='slave'} at 127.0.0.1:53474
I20260709 12:08:19.769151 16989 raft_consensus.cc:493] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.769467 16989 raft_consensus.cc:3060] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.773761 16989 raft_consensus.cc:515] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:19.775563 16989 leader_election.cc:290] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7 [CANDIDATE]: Term 2 election: Requested vote from peers 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193:44815), c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195:33695)
I20260709 12:08:19.776652 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0f27eff5cd24050a606667e55c75601" candidate_uuid: "ec82448eea8f4a3293bc13542f5930e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29490d1192b9423998b71cd2c90c0c1f"
I20260709 12:08:19.777061 17063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0f27eff5cd24050a606667e55c75601" candidate_uuid: "ec82448eea8f4a3293bc13542f5930e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8e4344281b94506aeea8b84fc758bb8"
I20260709 12:08:19.777263 16914 raft_consensus.cc:3055] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.777585 16914 raft_consensus.cc:740] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29490d1192b9423998b71cd2c90c0c1f, State: Running, Role: LEADER
I20260709 12:08:19.777595 17063 raft_consensus.cc:3060] T c0f27eff5cd24050a606667e55c75601 P c8e4344281b94506aeea8b84fc758bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.778379 16914 consensus_queue.cc:260] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:19.781873 16914 raft_consensus.cc:3060] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.784225 17063 raft_consensus.cc:2468] T c0f27eff5cd24050a606667e55c75601 P c8e4344281b94506aeea8b84fc758bb8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec82448eea8f4a3293bc13542f5930e7 in term 2.
I20260709 12:08:19.785188 16953 leader_election.cc:304] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8e4344281b94506aeea8b84fc758bb8, ec82448eea8f4a3293bc13542f5930e7; no voters: 
I20260709 12:08:19.785852 17172 raft_consensus.cc:2804] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.786281 17172 raft_consensus.cc:697] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7 [term 2 LEADER]: Becoming Leader. State: Replica: ec82448eea8f4a3293bc13542f5930e7, State: Running, Role: LEADER
I20260709 12:08:19.787117 17172 consensus_queue.cc:237] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:19.788115 16914 raft_consensus.cc:2468] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec82448eea8f4a3293bc13542f5930e7 in term 2.
I20260709 12:08:19.794478 16809 catalog_manager.cc:5697] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7 reported cstate change: term changed from 1 to 2, leader changed from 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193) to ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194). New cstate: current_term: 2 leader_uuid: "ec82448eea8f4a3293bc13542f5930e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:19.926270 17190 raft_consensus.cc:993] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7: : Instructing follower 29490d1192b9423998b71cd2c90c0c1f to start an election
I20260709 12:08:19.926795 17110 raft_consensus.cc:1081] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [term 1 LEADER]: Signalling peer 29490d1192b9423998b71cd2c90c0c1f to start an election
I20260709 12:08:19.928364 16914 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "276d1755922145c9ae61b09cd364feeb"
dest_uuid: "29490d1192b9423998b71cd2c90c0c1f"
 from {username='slave'} at 127.0.0.1:33176
I20260709 12:08:19.928946 16914 raft_consensus.cc:493] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:19.929330 16914 raft_consensus.cc:3060] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.933748 16914 raft_consensus.cc:515] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:19.935551 16914 leader_election.cc:290] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f [CANDIDATE]: Term 2 election: Requested vote from peers ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194:37255), c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195:33695)
I20260709 12:08:19.936573 16989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "276d1755922145c9ae61b09cd364feeb" candidate_uuid: "29490d1192b9423998b71cd2c90c0c1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec82448eea8f4a3293bc13542f5930e7"
I20260709 12:08:19.937160 16989 raft_consensus.cc:3055] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:19.937475 16989 raft_consensus.cc:740] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ec82448eea8f4a3293bc13542f5930e7, State: Running, Role: LEADER
I20260709 12:08:19.937609 17063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "276d1755922145c9ae61b09cd364feeb" candidate_uuid: "29490d1192b9423998b71cd2c90c0c1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8e4344281b94506aeea8b84fc758bb8"
I20260709 12:08:19.938154 17063 raft_consensus.cc:3060] T 276d1755922145c9ae61b09cd364feeb P c8e4344281b94506aeea8b84fc758bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.938205 16989 consensus_queue.cc:260] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:19.939311 16989 raft_consensus.cc:3060] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:19.943468 16989 raft_consensus.cc:2468] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29490d1192b9423998b71cd2c90c0c1f in term 2.
I20260709 12:08:19.944550 16878 leader_election.cc:304] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29490d1192b9423998b71cd2c90c0c1f, ec82448eea8f4a3293bc13542f5930e7; no voters: 
I20260709 12:08:19.944658 17063 raft_consensus.cc:2468] T 276d1755922145c9ae61b09cd364feeb P c8e4344281b94506aeea8b84fc758bb8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29490d1192b9423998b71cd2c90c0c1f in term 2.
I20260709 12:08:19.945278 17113 raft_consensus.cc:2804] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:19.945794 17113 raft_consensus.cc:697] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f [term 2 LEADER]: Becoming Leader. State: Replica: 29490d1192b9423998b71cd2c90c0c1f, State: Running, Role: LEADER
I20260709 12:08:19.946446 17113 consensus_queue.cc:237] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:19.952373 16809 catalog_manager.cc:5697] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f reported cstate change: term changed from 1 to 2, leader changed from ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194) to 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193). New cstate: current_term: 2 leader_uuid: "29490d1192b9423998b71cd2c90c0c1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:20.086366 17145 raft_consensus.cc:993] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8: : Instructing follower 29490d1192b9423998b71cd2c90c0c1f to start an election
I20260709 12:08:20.086866 17140 raft_consensus.cc:1081] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8 [term 1 LEADER]: Signalling peer 29490d1192b9423998b71cd2c90c0c1f to start an election
I20260709 12:08:20.088598 16914 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee85b0213f3c41b89c2d7185032dba59"
dest_uuid: "29490d1192b9423998b71cd2c90c0c1f"
 from {username='slave'} at 127.0.0.1:46874
I20260709 12:08:20.089218 16914 raft_consensus.cc:493] T ee85b0213f3c41b89c2d7185032dba59 P 29490d1192b9423998b71cd2c90c0c1f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:20.089671 16914 raft_consensus.cc:3060] T ee85b0213f3c41b89c2d7185032dba59 P 29490d1192b9423998b71cd2c90c0c1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.095678 16914 raft_consensus.cc:515] T ee85b0213f3c41b89c2d7185032dba59 P 29490d1192b9423998b71cd2c90c0c1f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:20.097165 16914 leader_election.cc:290] T ee85b0213f3c41b89c2d7185032dba59 P 29490d1192b9423998b71cd2c90c0c1f [CANDIDATE]: Term 2 election: Requested vote from peers ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194:37255), c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195:33695)
I20260709 12:08:20.098091 16989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee85b0213f3c41b89c2d7185032dba59" candidate_uuid: "29490d1192b9423998b71cd2c90c0c1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec82448eea8f4a3293bc13542f5930e7"
I20260709 12:08:20.098337 17063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee85b0213f3c41b89c2d7185032dba59" candidate_uuid: "29490d1192b9423998b71cd2c90c0c1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8e4344281b94506aeea8b84fc758bb8"
I20260709 12:08:20.098732 16989 raft_consensus.cc:3060] T ee85b0213f3c41b89c2d7185032dba59 P ec82448eea8f4a3293bc13542f5930e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.098990 17063 raft_consensus.cc:3055] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:20.099363 17063 raft_consensus.cc:740] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c8e4344281b94506aeea8b84fc758bb8, State: Running, Role: LEADER
I20260709 12:08:20.100164 17063 consensus_queue.cc:260] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:20.101406 17063 raft_consensus.cc:3060] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:20.102074 16914 raft_consensus.cc:1275] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f [term 2 FOLLOWER]: Refusing update from remote peer ec82448eea8f4a3293bc13542f5930e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.103577 17110 consensus_queue.cc:1048] T a80f4105a1ce4e47ab9a4089253973cf P ec82448eea8f4a3293bc13542f5930e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.107448 16989 raft_consensus.cc:2468] T ee85b0213f3c41b89c2d7185032dba59 P ec82448eea8f4a3293bc13542f5930e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29490d1192b9423998b71cd2c90c0c1f in term 2.
I20260709 12:08:20.109099 17063 raft_consensus.cc:2468] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29490d1192b9423998b71cd2c90c0c1f in term 2.
I20260709 12:08:20.110839 16878 leader_election.cc:304] T ee85b0213f3c41b89c2d7185032dba59 P 29490d1192b9423998b71cd2c90c0c1f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29490d1192b9423998b71cd2c90c0c1f, c8e4344281b94506aeea8b84fc758bb8; no voters: 
I20260709 12:08:20.112494 17113 raft_consensus.cc:2804] T ee85b0213f3c41b89c2d7185032dba59 P 29490d1192b9423998b71cd2c90c0c1f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:20.112955 17113 raft_consensus.cc:697] T ee85b0213f3c41b89c2d7185032dba59 P 29490d1192b9423998b71cd2c90c0c1f [term 2 LEADER]: Becoming Leader. State: Replica: 29490d1192b9423998b71cd2c90c0c1f, State: Running, Role: LEADER
I20260709 12:08:20.113767 17113 consensus_queue.cc:237] T ee85b0213f3c41b89c2d7185032dba59 P 29490d1192b9423998b71cd2c90c0c1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:20.122700 17063 raft_consensus.cc:1275] T a80f4105a1ce4e47ab9a4089253973cf P c8e4344281b94506aeea8b84fc758bb8 [term 2 FOLLOWER]: Refusing update from remote peer ec82448eea8f4a3293bc13542f5930e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.124176 17190 consensus_queue.cc:1048] T a80f4105a1ce4e47ab9a4089253973cf P ec82448eea8f4a3293bc13542f5930e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.127561 16811 catalog_manager.cc:5697] T ee85b0213f3c41b89c2d7185032dba59 P 29490d1192b9423998b71cd2c90c0c1f reported cstate change: term changed from 1 to 2, leader changed from c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195) to 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193). New cstate: current_term: 2 leader_uuid: "29490d1192b9423998b71cd2c90c0c1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:20.144656 17063 raft_consensus.cc:1275] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [term 2 FOLLOWER]: Refusing update from remote peer 29490d1192b9423998b71cd2c90c0c1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.145813 17113 consensus_queue.cc:1048] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.155041 16989 raft_consensus.cc:1275] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7 [term 2 FOLLOWER]: Refusing update from remote peer 29490d1192b9423998b71cd2c90c0c1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.156399 17163 consensus_queue.cc:1048] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.247900 16914 raft_consensus.cc:1275] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f [term 2 FOLLOWER]: Refusing update from remote peer ec82448eea8f4a3293bc13542f5930e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.249081 17172 consensus_queue.cc:1048] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.257730 17063 raft_consensus.cc:1275] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [term 2 FOLLOWER]: Refusing update from remote peer ec82448eea8f4a3293bc13542f5930e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.259102 17172 consensus_queue.cc:1048] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.315423 16914 raft_consensus.cc:1275] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f [term 2 FOLLOWER]: Refusing update from remote peer ec82448eea8f4a3293bc13542f5930e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.316643 17172 consensus_queue.cc:1048] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.325327 17063 raft_consensus.cc:1275] T c0f27eff5cd24050a606667e55c75601 P c8e4344281b94506aeea8b84fc758bb8 [term 2 FOLLOWER]: Refusing update from remote peer ec82448eea8f4a3293bc13542f5930e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.326879 17110 consensus_queue.cc:1048] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.337270 16989 raft_consensus.cc:1275] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [term 2 FOLLOWER]: Refusing update from remote peer 29490d1192b9423998b71cd2c90c0c1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.338635 17163 consensus_queue.cc:1048] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.347922 17063 raft_consensus.cc:1275] T 276d1755922145c9ae61b09cd364feeb P c8e4344281b94506aeea8b84fc758bb8 [term 2 FOLLOWER]: Refusing update from remote peer 29490d1192b9423998b71cd2c90c0c1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.349129 17113 consensus_queue.cc:1048] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:20.580258 16989 raft_consensus.cc:1275] T ee85b0213f3c41b89c2d7185032dba59 P ec82448eea8f4a3293bc13542f5930e7 [term 2 FOLLOWER]: Refusing update from remote peer 29490d1192b9423998b71cd2c90c0c1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.581519 17113 consensus_queue.cc:1048] T ee85b0213f3c41b89c2d7185032dba59 P 29490d1192b9423998b71cd2c90c0c1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:08:20.590144 17063 raft_consensus.cc:1275] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8 [term 2 FOLLOWER]: Refusing update from remote peer 29490d1192b9423998b71cd2c90c0c1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:20.591674 17113 consensus_queue.cc:1048] T ee85b0213f3c41b89c2d7185032dba59 P 29490d1192b9423998b71cd2c90c0c1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:22.600215 16779 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:08:22.600971 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:22.621095 16914 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1063d9c76f824514a53771146fb1605d"
dest_uuid: "29490d1192b9423998b71cd2c90c0c1f"
mode: GRACEFUL
new_leader_uuid: "c8e4344281b94506aeea8b84fc758bb8"
 from {username='slave'} at 127.0.0.1:46896
I20260709 12:08:22.621558 16914 raft_consensus.cc:606] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f [term 2 LEADER]: Received request to transfer leadership to TS c8e4344281b94506aeea8b84fc758bb8
I20260709 12:08:22.631347 16989 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99ca6528cae84361ac940d82bf10059d"
dest_uuid: "ec82448eea8f4a3293bc13542f5930e7"
mode: GRACEFUL
new_leader_uuid: "c8e4344281b94506aeea8b84fc758bb8"
 from {username='slave'} at 127.0.0.1:53494
I20260709 12:08:22.631812 16989 raft_consensus.cc:606] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [term 2 LEADER]: Received request to transfer leadership to TS c8e4344281b94506aeea8b84fc758bb8
I20260709 12:08:22.632846 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:08:22.633275 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:22.931166 17113 raft_consensus.cc:993] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f: : Instructing follower c8e4344281b94506aeea8b84fc758bb8 to start an election
I20260709 12:08:22.931604 17196 raft_consensus.cc:1081] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f [term 2 LEADER]: Signalling peer c8e4344281b94506aeea8b84fc758bb8 to start an election
I20260709 12:08:22.933039 17063 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1063d9c76f824514a53771146fb1605d"
dest_uuid: "c8e4344281b94506aeea8b84fc758bb8"
 from {username='slave'} at 127.0.0.1:34870
I20260709 12:08:22.933416 17063 raft_consensus.cc:493] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:22.933640 17063 raft_consensus.cc:3060] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:22.937216 17063 raft_consensus.cc:515] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:22.938571 17063 leader_election.cc:290] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [CANDIDATE]: Term 3 election: Requested vote from peers 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193:44815), ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194:37255)
I20260709 12:08:22.939427 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1063d9c76f824514a53771146fb1605d" candidate_uuid: "c8e4344281b94506aeea8b84fc758bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "29490d1192b9423998b71cd2c90c0c1f"
I20260709 12:08:22.939579 16989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1063d9c76f824514a53771146fb1605d" candidate_uuid: "c8e4344281b94506aeea8b84fc758bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ec82448eea8f4a3293bc13542f5930e7"
I20260709 12:08:22.940053 16914 raft_consensus.cc:3055] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:22.940116 16989 raft_consensus.cc:3060] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:22.940366 16914 raft_consensus.cc:740] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 29490d1192b9423998b71cd2c90c0c1f, State: Running, Role: LEADER
I20260709 12:08:22.941186 16914 consensus_queue.cc:260] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:22.942363 16914 raft_consensus.cc:3060] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:22.944968 16989 raft_consensus.cc:2468] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e4344281b94506aeea8b84fc758bb8 in term 3.
I20260709 12:08:22.946022 17027 leader_election.cc:304] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8e4344281b94506aeea8b84fc758bb8, ec82448eea8f4a3293bc13542f5930e7; no voters: 
I20260709 12:08:22.946678 17114 raft_consensus.cc:2804] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:22.947817 17114 raft_consensus.cc:697] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [term 3 LEADER]: Becoming Leader. State: Replica: c8e4344281b94506aeea8b84fc758bb8, State: Running, Role: LEADER
I20260709 12:08:22.948695 16914 raft_consensus.cc:2468] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e4344281b94506aeea8b84fc758bb8 in term 3.
I20260709 12:08:22.948673 17114 consensus_queue.cc:237] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:22.957023 16811 catalog_manager.cc:5697] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 reported cstate change: term changed from 2 to 3, leader changed from 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193) to c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195). New cstate: current_term: 3 leader_uuid: "c8e4344281b94506aeea8b84fc758bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:23.123632 17203 raft_consensus.cc:993] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7: : Instructing follower c8e4344281b94506aeea8b84fc758bb8 to start an election
I20260709 12:08:23.124045 17172 raft_consensus.cc:1081] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [term 2 LEADER]: Signalling peer c8e4344281b94506aeea8b84fc758bb8 to start an election
I20260709 12:08:23.125348 17063 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99ca6528cae84361ac940d82bf10059d"
dest_uuid: "c8e4344281b94506aeea8b84fc758bb8"
 from {username='slave'} at 127.0.0.1:44714
I20260709 12:08:23.125783 17063 raft_consensus.cc:493] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:23.126078 17063 raft_consensus.cc:3060] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:23.146865 17063 raft_consensus.cc:515] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:23.148430 17063 leader_election.cc:290] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [CANDIDATE]: Term 3 election: Requested vote from peers 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193:44815), ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194:37255)
I20260709 12:08:23.149380 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ca6528cae84361ac940d82bf10059d" candidate_uuid: "c8e4344281b94506aeea8b84fc758bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "29490d1192b9423998b71cd2c90c0c1f"
I20260709 12:08:23.149485 16989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ca6528cae84361ac940d82bf10059d" candidate_uuid: "c8e4344281b94506aeea8b84fc758bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ec82448eea8f4a3293bc13542f5930e7"
I20260709 12:08:23.150030 16989 raft_consensus.cc:3055] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:23.149996 16914 raft_consensus.cc:3060] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:23.150429 16989 raft_consensus.cc:740] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ec82448eea8f4a3293bc13542f5930e7, State: Running, Role: LEADER
I20260709 12:08:23.151113 16989 consensus_queue.cc:260] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:23.151892 16989 raft_consensus.cc:3060] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:23.201234 16989 raft_consensus.cc:2468] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e4344281b94506aeea8b84fc758bb8 in term 3.
I20260709 12:08:23.201234 16914 raft_consensus.cc:2468] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e4344281b94506aeea8b84fc758bb8 in term 3.
I20260709 12:08:23.202447 17027 leader_election.cc:304] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8e4344281b94506aeea8b84fc758bb8, ec82448eea8f4a3293bc13542f5930e7; no voters: 
I20260709 12:08:23.203259 17114 raft_consensus.cc:2804] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:23.203824 17114 raft_consensus.cc:697] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [term 3 LEADER]: Becoming Leader. State: Replica: c8e4344281b94506aeea8b84fc758bb8, State: Running, Role: LEADER
I20260709 12:08:23.204520 17114 consensus_queue.cc:237] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:23.211151 16811 catalog_manager.cc:5697] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 reported cstate change: term changed from 2 to 3, leader changed from ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194) to c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195). New cstate: current_term: 3 leader_uuid: "c8e4344281b94506aeea8b84fc758bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:23.492596 16989 raft_consensus.cc:1275] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7 [term 3 FOLLOWER]: Refusing update from remote peer c8e4344281b94506aeea8b84fc758bb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:23.493714 17114 consensus_queue.cc:1048] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:23.504165 16914 raft_consensus.cc:1275] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f [term 3 FOLLOWER]: Refusing update from remote peer c8e4344281b94506aeea8b84fc758bb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:23.505546 17114 consensus_queue.cc:1048] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:23.634191 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:23.638995 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:23.639312 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:23.761112 16989 raft_consensus.cc:1275] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [term 3 FOLLOWER]: Refusing update from remote peer c8e4344281b94506aeea8b84fc758bb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:23.762203 17114 consensus_queue.cc:1048] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:23.770221 16914 raft_consensus.cc:1275] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f [term 3 FOLLOWER]: Refusing update from remote peer c8e4344281b94506aeea8b84fc758bb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:23.771929 17207 consensus_queue.cc:1048] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:24.640190 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:24.645483 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:24.645838 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:25.646871 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:25.651763 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:25.652101 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:26.653164 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:26.658121 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:26.658476 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:27.659355 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:27.663910 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:27.664223 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:28.665117 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:28.669997 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:28.670336 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:29.671098 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:29.675601 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:29.675904 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:30.676680 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:30.681483 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:30.681875 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:31.682889 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:31.688089 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:31.688480 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:32.713439 16779 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:08:32.717561 16913 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee85b0213f3c41b89c2d7185032dba59"
dest_uuid: "29490d1192b9423998b71cd2c90c0c1f"
mode: GRACEFUL
new_leader_uuid: "ec82448eea8f4a3293bc13542f5930e7"
 from {username='slave'} at 127.0.0.1:46890
I20260709 12:08:32.718329 16913 raft_consensus.cc:606] T ee85b0213f3c41b89c2d7185032dba59 P 29490d1192b9423998b71cd2c90c0c1f [term 2 LEADER]: Received request to transfer leadership to TS ec82448eea8f4a3293bc13542f5930e7
I20260709 12:08:32.722934 16913 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "276d1755922145c9ae61b09cd364feeb"
dest_uuid: "29490d1192b9423998b71cd2c90c0c1f"
mode: GRACEFUL
new_leader_uuid: "ec82448eea8f4a3293bc13542f5930e7"
 from {username='slave'} at 127.0.0.1:46890
I20260709 12:08:32.723311 16913 raft_consensus.cc:606] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f [term 2 LEADER]: Received request to transfer leadership to TS ec82448eea8f4a3293bc13542f5930e7
I20260709 12:08:32.727460 16913 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d25aa5414ba4e06a06db53053ef0785"
dest_uuid: "29490d1192b9423998b71cd2c90c0c1f"
mode: GRACEFUL
new_leader_uuid: "ec82448eea8f4a3293bc13542f5930e7"
 from {username='slave'} at 127.0.0.1:46890
I20260709 12:08:32.727942 16913 raft_consensus.cc:606] T 2d25aa5414ba4e06a06db53053ef0785 P 29490d1192b9423998b71cd2c90c0c1f [term 1 LEADER]: Received request to transfer leadership to TS ec82448eea8f4a3293bc13542f5930e7
I20260709 12:08:32.732146 17063 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1063d9c76f824514a53771146fb1605d"
dest_uuid: "c8e4344281b94506aeea8b84fc758bb8"
mode: GRACEFUL
new_leader_uuid: "ec82448eea8f4a3293bc13542f5930e7"
 from {username='slave'} at 127.0.0.1:34884
I20260709 12:08:32.732491 17063 raft_consensus.cc:606] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [term 3 LEADER]: Received request to transfer leadership to TS ec82448eea8f4a3293bc13542f5930e7
I20260709 12:08:32.736771 17063 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99ca6528cae84361ac940d82bf10059d"
dest_uuid: "c8e4344281b94506aeea8b84fc758bb8"
mode: GRACEFUL
new_leader_uuid: "ec82448eea8f4a3293bc13542f5930e7"
 from {username='slave'} at 127.0.0.1:34884
I20260709 12:08:32.737128 17063 raft_consensus.cc:606] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [term 3 LEADER]: Received request to transfer leadership to TS ec82448eea8f4a3293bc13542f5930e7
I20260709 12:08:32.752959 17216 raft_consensus.cc:993] T 2d25aa5414ba4e06a06db53053ef0785 P 29490d1192b9423998b71cd2c90c0c1f: : Instructing follower ec82448eea8f4a3293bc13542f5930e7 to start an election
I20260709 12:08:32.753475 17219 raft_consensus.cc:1081] T 2d25aa5414ba4e06a06db53053ef0785 P 29490d1192b9423998b71cd2c90c0c1f [term 1 LEADER]: Signalling peer ec82448eea8f4a3293bc13542f5930e7 to start an election
I20260709 12:08:32.754895 16989 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d25aa5414ba4e06a06db53053ef0785"
dest_uuid: "ec82448eea8f4a3293bc13542f5930e7"
 from {username='slave'} at 127.0.0.1:53474
I20260709 12:08:32.755312 16989 raft_consensus.cc:493] T 2d25aa5414ba4e06a06db53053ef0785 P ec82448eea8f4a3293bc13542f5930e7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:32.755623 16989 raft_consensus.cc:3060] T 2d25aa5414ba4e06a06db53053ef0785 P ec82448eea8f4a3293bc13542f5930e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:32.760403 16989 raft_consensus.cc:515] T 2d25aa5414ba4e06a06db53053ef0785 P ec82448eea8f4a3293bc13542f5930e7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:32.761861 16989 leader_election.cc:290] T 2d25aa5414ba4e06a06db53053ef0785 P ec82448eea8f4a3293bc13542f5930e7 [CANDIDATE]: Term 2 election: Requested vote from peers 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193:44815), c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195:33695)
I20260709 12:08:32.762732 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d25aa5414ba4e06a06db53053ef0785" candidate_uuid: "ec82448eea8f4a3293bc13542f5930e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "29490d1192b9423998b71cd2c90c0c1f"
I20260709 12:08:32.762897 17063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d25aa5414ba4e06a06db53053ef0785" candidate_uuid: "ec82448eea8f4a3293bc13542f5930e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c8e4344281b94506aeea8b84fc758bb8"
I20260709 12:08:32.763403 16913 raft_consensus.cc:3055] T 2d25aa5414ba4e06a06db53053ef0785 P 29490d1192b9423998b71cd2c90c0c1f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:32.763437 17063 raft_consensus.cc:3060] T 2d25aa5414ba4e06a06db53053ef0785 P c8e4344281b94506aeea8b84fc758bb8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:32.763738 16913 raft_consensus.cc:740] T 2d25aa5414ba4e06a06db53053ef0785 P 29490d1192b9423998b71cd2c90c0c1f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 29490d1192b9423998b71cd2c90c0c1f, State: Running, Role: LEADER
I20260709 12:08:32.764369 16913 consensus_queue.cc:260] T 2d25aa5414ba4e06a06db53053ef0785 P 29490d1192b9423998b71cd2c90c0c1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:32.765413 16913 raft_consensus.cc:3060] T 2d25aa5414ba4e06a06db53053ef0785 P 29490d1192b9423998b71cd2c90c0c1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:32.767807 17063 raft_consensus.cc:2468] T 2d25aa5414ba4e06a06db53053ef0785 P c8e4344281b94506aeea8b84fc758bb8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec82448eea8f4a3293bc13542f5930e7 in term 2.
I20260709 12:08:32.768959 16953 leader_election.cc:304] T 2d25aa5414ba4e06a06db53053ef0785 P ec82448eea8f4a3293bc13542f5930e7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8e4344281b94506aeea8b84fc758bb8, ec82448eea8f4a3293bc13542f5930e7; no voters: 
I20260709 12:08:32.769881 17172 raft_consensus.cc:2804] T 2d25aa5414ba4e06a06db53053ef0785 P ec82448eea8f4a3293bc13542f5930e7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:32.771030 17172 raft_consensus.cc:697] T 2d25aa5414ba4e06a06db53053ef0785 P ec82448eea8f4a3293bc13542f5930e7 [term 2 LEADER]: Becoming Leader. State: Replica: ec82448eea8f4a3293bc13542f5930e7, State: Running, Role: LEADER
I20260709 12:08:32.770995 16913 raft_consensus.cc:2468] T 2d25aa5414ba4e06a06db53053ef0785 P 29490d1192b9423998b71cd2c90c0c1f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec82448eea8f4a3293bc13542f5930e7 in term 2.
I20260709 12:08:32.772356 17216 raft_consensus.cc:993] T ee85b0213f3c41b89c2d7185032dba59 P 29490d1192b9423998b71cd2c90c0c1f: : Instructing follower ec82448eea8f4a3293bc13542f5930e7 to start an election
I20260709 12:08:32.772115 17172 consensus_queue.cc:237] T 2d25aa5414ba4e06a06db53053ef0785 P ec82448eea8f4a3293bc13542f5930e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:32.773275 17216 raft_consensus.cc:1081] T ee85b0213f3c41b89c2d7185032dba59 P 29490d1192b9423998b71cd2c90c0c1f [term 2 LEADER]: Signalling peer ec82448eea8f4a3293bc13542f5930e7 to start an election
I20260709 12:08:32.774708 16989 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee85b0213f3c41b89c2d7185032dba59"
dest_uuid: "ec82448eea8f4a3293bc13542f5930e7"
 from {username='slave'} at 127.0.0.1:53474
I20260709 12:08:32.775218 16989 raft_consensus.cc:493] T ee85b0213f3c41b89c2d7185032dba59 P ec82448eea8f4a3293bc13542f5930e7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:32.775646 16989 raft_consensus.cc:3060] T ee85b0213f3c41b89c2d7185032dba59 P ec82448eea8f4a3293bc13542f5930e7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:32.779075 16808 catalog_manager.cc:5697] T 2d25aa5414ba4e06a06db53053ef0785 P ec82448eea8f4a3293bc13542f5930e7 reported cstate change: term changed from 1 to 2, leader changed from 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193) to ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194). New cstate: current_term: 2 leader_uuid: "ec82448eea8f4a3293bc13542f5930e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:32.780581 16989 raft_consensus.cc:515] T ee85b0213f3c41b89c2d7185032dba59 P ec82448eea8f4a3293bc13542f5930e7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:32.782837 16989 leader_election.cc:290] T ee85b0213f3c41b89c2d7185032dba59 P ec82448eea8f4a3293bc13542f5930e7 [CANDIDATE]: Term 3 election: Requested vote from peers 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193:44815), c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195:33695)
I20260709 12:08:32.783074 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee85b0213f3c41b89c2d7185032dba59" candidate_uuid: "ec82448eea8f4a3293bc13542f5930e7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "29490d1192b9423998b71cd2c90c0c1f"
I20260709 12:08:32.783699 16913 raft_consensus.cc:3055] T ee85b0213f3c41b89c2d7185032dba59 P 29490d1192b9423998b71cd2c90c0c1f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:32.783895 17063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee85b0213f3c41b89c2d7185032dba59" candidate_uuid: "ec82448eea8f4a3293bc13542f5930e7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c8e4344281b94506aeea8b84fc758bb8"
I20260709 12:08:32.784080 16913 raft_consensus.cc:740] T ee85b0213f3c41b89c2d7185032dba59 P 29490d1192b9423998b71cd2c90c0c1f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 29490d1192b9423998b71cd2c90c0c1f, State: Running, Role: LEADER
I20260709 12:08:32.784480 17063 raft_consensus.cc:3060] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:32.784907 16913 consensus_queue.cc:260] T ee85b0213f3c41b89c2d7185032dba59 P 29490d1192b9423998b71cd2c90c0c1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:32.786110 16913 raft_consensus.cc:3060] T ee85b0213f3c41b89c2d7185032dba59 P 29490d1192b9423998b71cd2c90c0c1f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:32.790720 17063 raft_consensus.cc:2468] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec82448eea8f4a3293bc13542f5930e7 in term 3.
I20260709 12:08:32.791810 16953 leader_election.cc:304] T ee85b0213f3c41b89c2d7185032dba59 P ec82448eea8f4a3293bc13542f5930e7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8e4344281b94506aeea8b84fc758bb8, ec82448eea8f4a3293bc13542f5930e7; no voters: 
I20260709 12:08:32.792680 17172 raft_consensus.cc:2804] T ee85b0213f3c41b89c2d7185032dba59 P ec82448eea8f4a3293bc13542f5930e7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:32.792742 16913 raft_consensus.cc:2468] T ee85b0213f3c41b89c2d7185032dba59 P 29490d1192b9423998b71cd2c90c0c1f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec82448eea8f4a3293bc13542f5930e7 in term 3.
I20260709 12:08:32.793484 17172 raft_consensus.cc:697] T ee85b0213f3c41b89c2d7185032dba59 P ec82448eea8f4a3293bc13542f5930e7 [term 3 LEADER]: Becoming Leader. State: Replica: ec82448eea8f4a3293bc13542f5930e7, State: Running, Role: LEADER
I20260709 12:08:32.794413 17172 consensus_queue.cc:237] T ee85b0213f3c41b89c2d7185032dba59 P ec82448eea8f4a3293bc13542f5930e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:32.800674 16808 catalog_manager.cc:5697] T ee85b0213f3c41b89c2d7185032dba59 P ec82448eea8f4a3293bc13542f5930e7 reported cstate change: term changed from 2 to 3, leader changed from 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193) to ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194). New cstate: current_term: 3 leader_uuid: "ec82448eea8f4a3293bc13542f5930e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:32.965368 17219 raft_consensus.cc:993] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f: : Instructing follower ec82448eea8f4a3293bc13542f5930e7 to start an election
I20260709 12:08:32.965871 17216 raft_consensus.cc:1081] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f [term 2 LEADER]: Signalling peer ec82448eea8f4a3293bc13542f5930e7 to start an election
I20260709 12:08:32.967235 16989 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "276d1755922145c9ae61b09cd364feeb"
dest_uuid: "ec82448eea8f4a3293bc13542f5930e7"
 from {username='slave'} at 127.0.0.1:53474
I20260709 12:08:32.967666 16989 raft_consensus.cc:493] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:32.967949 16989 raft_consensus.cc:3060] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:32.968514 17228 raft_consensus.cc:993] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8: : Instructing follower ec82448eea8f4a3293bc13542f5930e7 to start an election
I20260709 12:08:32.969046 17197 raft_consensus.cc:1081] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [term 3 LEADER]: Signalling peer ec82448eea8f4a3293bc13542f5930e7 to start an election
I20260709 12:08:32.970551 16987 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1063d9c76f824514a53771146fb1605d"
dest_uuid: "ec82448eea8f4a3293bc13542f5930e7"
 from {username='slave'} at 127.0.0.1:53464
I20260709 12:08:32.971066 16987 raft_consensus.cc:493] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:32.971364 16987 raft_consensus.cc:3060] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:32.972698 16989 raft_consensus.cc:515] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:32.974225 16989 leader_election.cc:290] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [CANDIDATE]: Term 3 election: Requested vote from peers 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193:44815), c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195:33695)
I20260709 12:08:32.975639 17063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "276d1755922145c9ae61b09cd364feeb" candidate_uuid: "ec82448eea8f4a3293bc13542f5930e7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c8e4344281b94506aeea8b84fc758bb8"
I20260709 12:08:32.975696 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "276d1755922145c9ae61b09cd364feeb" candidate_uuid: "ec82448eea8f4a3293bc13542f5930e7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "29490d1192b9423998b71cd2c90c0c1f"
I20260709 12:08:32.976214 17063 raft_consensus.cc:3060] T 276d1755922145c9ae61b09cd364feeb P c8e4344281b94506aeea8b84fc758bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:32.976336 16913 raft_consensus.cc:3055] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:32.976706 16913 raft_consensus.cc:740] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 29490d1192b9423998b71cd2c90c0c1f, State: Running, Role: LEADER
I20260709 12:08:32.977365 16987 raft_consensus.cc:515] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:32.977421 16913 consensus_queue.cc:260] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:32.978682 16913 raft_consensus.cc:3060] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:32.979209 16987 leader_election.cc:290] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7 [CANDIDATE]: Term 4 election: Requested vote from peers 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193:44815), c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195:33695)
I20260709 12:08:32.979902 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1063d9c76f824514a53771146fb1605d" candidate_uuid: "ec82448eea8f4a3293bc13542f5930e7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "29490d1192b9423998b71cd2c90c0c1f"
I20260709 12:08:32.980515 16914 raft_consensus.cc:3060] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:32.980453 17061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1063d9c76f824514a53771146fb1605d" candidate_uuid: "ec82448eea8f4a3293bc13542f5930e7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c8e4344281b94506aeea8b84fc758bb8"
I20260709 12:08:32.981107 17061 raft_consensus.cc:3055] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:32.981408 17061 raft_consensus.cc:740] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c8e4344281b94506aeea8b84fc758bb8, State: Running, Role: LEADER
I20260709 12:08:32.982259 17061 consensus_queue.cc:260] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:32.983431 17061 raft_consensus.cc:3060] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:32.985476 16914 raft_consensus.cc:2468] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec82448eea8f4a3293bc13542f5930e7 in term 4.
I20260709 12:08:32.985637 16913 raft_consensus.cc:2468] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec82448eea8f4a3293bc13542f5930e7 in term 3.
I20260709 12:08:32.986460 16953 leader_election.cc:304] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29490d1192b9423998b71cd2c90c0c1f, ec82448eea8f4a3293bc13542f5930e7; no voters: 
I20260709 12:08:32.983464 17063 raft_consensus.cc:2468] T 276d1755922145c9ae61b09cd364feeb P c8e4344281b94506aeea8b84fc758bb8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec82448eea8f4a3293bc13542f5930e7 in term 3.
I20260709 12:08:32.987280 17172 raft_consensus.cc:2804] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:32.987425 16953 leader_election.cc:304] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29490d1192b9423998b71cd2c90c0c1f, ec82448eea8f4a3293bc13542f5930e7; no voters: 
I20260709 12:08:32.987741 17172 raft_consensus.cc:697] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7 [term 4 LEADER]: Becoming Leader. State: Replica: ec82448eea8f4a3293bc13542f5930e7, State: Running, Role: LEADER
I20260709 12:08:32.988309 17220 raft_consensus.cc:2804] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:32.988507 17172 consensus_queue.cc:237] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:32.989677 17220 raft_consensus.cc:697] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [term 3 LEADER]: Becoming Leader. State: Replica: ec82448eea8f4a3293bc13542f5930e7, State: Running, Role: LEADER
I20260709 12:08:32.990831 17061 raft_consensus.cc:2468] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec82448eea8f4a3293bc13542f5930e7 in term 4.
I20260709 12:08:32.990576 17220 consensus_queue.cc:237] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:32.996300 16808 catalog_manager.cc:5697] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7 reported cstate change: term changed from 3 to 4, leader changed from c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195) to ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194). New cstate: current_term: 4 leader_uuid: "ec82448eea8f4a3293bc13542f5930e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:33.006170 16808 catalog_manager.cc:5697] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 reported cstate change: term changed from 2 to 3, leader changed from 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193) to ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194). New cstate: current_term: 3 leader_uuid: "ec82448eea8f4a3293bc13542f5930e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:33.109540 17228 raft_consensus.cc:993] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8: : Instructing follower ec82448eea8f4a3293bc13542f5930e7 to start an election
I20260709 12:08:33.110073 17228 raft_consensus.cc:1081] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [term 3 LEADER]: Signalling peer ec82448eea8f4a3293bc13542f5930e7 to start an election
I20260709 12:08:33.111464 16987 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99ca6528cae84361ac940d82bf10059d"
dest_uuid: "ec82448eea8f4a3293bc13542f5930e7"
 from {username='slave'} at 127.0.0.1:53464
I20260709 12:08:33.111865 16987 raft_consensus.cc:493] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:33.112105 16987 raft_consensus.cc:3060] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:33.116274 16987 raft_consensus.cc:515] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:33.117790 16987 leader_election.cc:290] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [CANDIDATE]: Term 4 election: Requested vote from peers 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193:44815), c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195:33695)
I20260709 12:08:33.118477 16913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ca6528cae84361ac940d82bf10059d" candidate_uuid: "ec82448eea8f4a3293bc13542f5930e7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "29490d1192b9423998b71cd2c90c0c1f"
I20260709 12:08:33.118671 17061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ca6528cae84361ac940d82bf10059d" candidate_uuid: "ec82448eea8f4a3293bc13542f5930e7" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c8e4344281b94506aeea8b84fc758bb8"
I20260709 12:08:33.119122 16913 raft_consensus.cc:3060] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:33.119196 17061 raft_consensus.cc:3055] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:33.119555 17061 raft_consensus.cc:740] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c8e4344281b94506aeea8b84fc758bb8, State: Running, Role: LEADER
I20260709 12:08:33.120165 17061 consensus_queue.cc:260] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:33.121008 17061 raft_consensus.cc:3060] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:33.124394 16913 raft_consensus.cc:2468] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec82448eea8f4a3293bc13542f5930e7 in term 4.
I20260709 12:08:33.125231 17061 raft_consensus.cc:2468] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec82448eea8f4a3293bc13542f5930e7 in term 4.
I20260709 12:08:33.125264 16953 leader_election.cc:304] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29490d1192b9423998b71cd2c90c0c1f, ec82448eea8f4a3293bc13542f5930e7; no voters: 
I20260709 12:08:33.126003 17220 raft_consensus.cc:2804] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:33.126447 17220 raft_consensus.cc:697] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [term 4 LEADER]: Becoming Leader. State: Replica: ec82448eea8f4a3293bc13542f5930e7, State: Running, Role: LEADER
I20260709 12:08:33.127180 17220 consensus_queue.cc:237] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:33.133096 16808 catalog_manager.cc:5697] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 reported cstate change: term changed from 3 to 4, leader changed from c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195) to ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194). New cstate: current_term: 4 leader_uuid: "ec82448eea8f4a3293bc13542f5930e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:33.178788 16913 raft_consensus.cc:1275] T 2d25aa5414ba4e06a06db53053ef0785 P 29490d1192b9423998b71cd2c90c0c1f [term 2 FOLLOWER]: Refusing update from remote peer ec82448eea8f4a3293bc13542f5930e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:33.180002 17220 consensus_queue.cc:1048] T 2d25aa5414ba4e06a06db53053ef0785 P ec82448eea8f4a3293bc13542f5930e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:33.189244 17061 raft_consensus.cc:1275] T 2d25aa5414ba4e06a06db53053ef0785 P c8e4344281b94506aeea8b84fc758bb8 [term 2 FOLLOWER]: Refusing update from remote peer ec82448eea8f4a3293bc13542f5930e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:33.190768 17172 consensus_queue.cc:1048] T 2d25aa5414ba4e06a06db53053ef0785 P ec82448eea8f4a3293bc13542f5930e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:33.351339 17061 raft_consensus.cc:1275] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8 [term 3 FOLLOWER]: Refusing update from remote peer ec82448eea8f4a3293bc13542f5930e7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:33.352447 17172 consensus_queue.cc:1048] T ee85b0213f3c41b89c2d7185032dba59 P ec82448eea8f4a3293bc13542f5930e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:33.361972 16913 raft_consensus.cc:1275] T ee85b0213f3c41b89c2d7185032dba59 P 29490d1192b9423998b71cd2c90c0c1f [term 3 FOLLOWER]: Refusing update from remote peer ec82448eea8f4a3293bc13542f5930e7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:33.364156 17172 consensus_queue.cc:1048] T ee85b0213f3c41b89c2d7185032dba59 P ec82448eea8f4a3293bc13542f5930e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:33.391631 17061 raft_consensus.cc:1275] T 276d1755922145c9ae61b09cd364feeb P c8e4344281b94506aeea8b84fc758bb8 [term 3 FOLLOWER]: Refusing update from remote peer ec82448eea8f4a3293bc13542f5930e7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:33.392707 17172 consensus_queue.cc:1048] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:33.401738 16913 raft_consensus.cc:1275] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f [term 3 FOLLOWER]: Refusing update from remote peer ec82448eea8f4a3293bc13542f5930e7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:33.403990 17172 consensus_queue.cc:1048] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:33.440243 16913 raft_consensus.cc:1275] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f [term 4 FOLLOWER]: Refusing update from remote peer ec82448eea8f4a3293bc13542f5930e7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:33.441239 17172 consensus_queue.cc:1048] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:33.449539 17061 raft_consensus.cc:1275] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [term 4 FOLLOWER]: Refusing update from remote peer ec82448eea8f4a3293bc13542f5930e7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:33.451917 17172 consensus_queue.cc:1048] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:33.563337 16913 raft_consensus.cc:1275] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f [term 4 FOLLOWER]: Refusing update from remote peer ec82448eea8f4a3293bc13542f5930e7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:33.564513 17172 consensus_queue.cc:1048] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:33.572443 17061 raft_consensus.cc:1275] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [term 4 FOLLOWER]: Refusing update from remote peer ec82448eea8f4a3293bc13542f5930e7: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:33.573926 17239 consensus_queue.cc:1048] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:35.771364 16779 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:08:35.772143 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:35.779398 16987 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1063d9c76f824514a53771146fb1605d"
dest_uuid: "ec82448eea8f4a3293bc13542f5930e7"
mode: GRACEFUL
new_leader_uuid: "29490d1192b9423998b71cd2c90c0c1f"
 from {username='slave'} at 127.0.0.1:53494
I20260709 12:08:35.779995 16987 raft_consensus.cc:606] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7 [term 4 LEADER]: Received request to transfer leadership to TS 29490d1192b9423998b71cd2c90c0c1f
I20260709 12:08:35.782464 16987 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "276d1755922145c9ae61b09cd364feeb"
dest_uuid: "ec82448eea8f4a3293bc13542f5930e7"
mode: GRACEFUL
new_leader_uuid: "29490d1192b9423998b71cd2c90c0c1f"
 from {username='slave'} at 127.0.0.1:53494
I20260709 12:08:35.782971 16987 raft_consensus.cc:606] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [term 3 LEADER]: Received request to transfer leadership to TS 29490d1192b9423998b71cd2c90c0c1f
I20260709 12:08:35.784958 16987 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99ca6528cae84361ac940d82bf10059d"
dest_uuid: "ec82448eea8f4a3293bc13542f5930e7"
mode: GRACEFUL
new_leader_uuid: "c8e4344281b94506aeea8b84fc758bb8"
 from {username='slave'} at 127.0.0.1:53494
I20260709 12:08:35.785387 16987 raft_consensus.cc:606] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [term 4 LEADER]: Received request to transfer leadership to TS c8e4344281b94506aeea8b84fc758bb8
I20260709 12:08:35.806459 16987 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a80f4105a1ce4e47ab9a4089253973cf"
dest_uuid: "ec82448eea8f4a3293bc13542f5930e7"
mode: GRACEFUL
new_leader_uuid: "c8e4344281b94506aeea8b84fc758bb8"
 from {username='slave'} at 127.0.0.1:53494
I20260709 12:08:35.807734 16987 raft_consensus.cc:606] T a80f4105a1ce4e47ab9a4089253973cf P ec82448eea8f4a3293bc13542f5930e7 [term 2 LEADER]: Received request to transfer leadership to TS c8e4344281b94506aeea8b84fc758bb8
I20260709 12:08:35.810783 16987 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0f27eff5cd24050a606667e55c75601"
dest_uuid: "ec82448eea8f4a3293bc13542f5930e7"
mode: GRACEFUL
new_leader_uuid: "29490d1192b9423998b71cd2c90c0c1f"
 from {username='slave'} at 127.0.0.1:53494
I20260709 12:08:35.811298 16987 raft_consensus.cc:606] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7 [term 2 LEADER]: Received request to transfer leadership to TS 29490d1192b9423998b71cd2c90c0c1f
I20260709 12:08:35.812387 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:08:35.813184 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:35.832805 17248 raft_consensus.cc:993] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7: : Instructing follower 29490d1192b9423998b71cd2c90c0c1f to start an election
I20260709 12:08:35.833338 17239 raft_consensus.cc:1081] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7 [term 4 LEADER]: Signalling peer 29490d1192b9423998b71cd2c90c0c1f to start an election
I20260709 12:08:35.834738 16914 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1063d9c76f824514a53771146fb1605d"
dest_uuid: "29490d1192b9423998b71cd2c90c0c1f"
 from {username='slave'} at 127.0.0.1:33176
I20260709 12:08:35.835191 16914 raft_consensus.cc:493] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:35.835448 16914 raft_consensus.cc:3060] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:35.840435 16914 raft_consensus.cc:515] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:35.842299 16914 leader_election.cc:290] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f [CANDIDATE]: Term 5 election: Requested vote from peers ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194:37255), c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195:33695)
I20260709 12:08:35.843528 16987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1063d9c76f824514a53771146fb1605d" candidate_uuid: "29490d1192b9423998b71cd2c90c0c1f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "ec82448eea8f4a3293bc13542f5930e7"
I20260709 12:08:35.844215 16987 raft_consensus.cc:3055] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:08:35.844339 17063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1063d9c76f824514a53771146fb1605d" candidate_uuid: "29490d1192b9423998b71cd2c90c0c1f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "c8e4344281b94506aeea8b84fc758bb8"
I20260709 12:08:35.844507 16987 raft_consensus.cc:740] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ec82448eea8f4a3293bc13542f5930e7, State: Running, Role: LEADER
I20260709 12:08:35.844950 17063 raft_consensus.cc:3060] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:35.845425 16987 consensus_queue.cc:260] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:35.846539 16987 raft_consensus.cc:3060] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:35.849483 17063 raft_consensus.cc:2468] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29490d1192b9423998b71cd2c90c0c1f in term 5.
I20260709 12:08:35.850764 16878 leader_election.cc:304] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29490d1192b9423998b71cd2c90c0c1f, c8e4344281b94506aeea8b84fc758bb8; no voters: 
I20260709 12:08:35.851497 16987 raft_consensus.cc:2468] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29490d1192b9423998b71cd2c90c0c1f in term 5.
I20260709 12:08:35.852523 17250 raft_consensus.cc:2804] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:08:35.853340 17250 raft_consensus.cc:697] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f [term 5 LEADER]: Becoming Leader. State: Replica: 29490d1192b9423998b71cd2c90c0c1f, State: Running, Role: LEADER
I20260709 12:08:35.854218 17250 consensus_queue.cc:237] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:35.863416 16811 catalog_manager.cc:5697] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f reported cstate change: term changed from 4 to 5, leader changed from ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194) to 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193). New cstate: current_term: 5 leader_uuid: "29490d1192b9423998b71cd2c90c0c1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:35.974560 17239 raft_consensus.cc:993] T a80f4105a1ce4e47ab9a4089253973cf P ec82448eea8f4a3293bc13542f5930e7: : Instructing follower c8e4344281b94506aeea8b84fc758bb8 to start an election
I20260709 12:08:35.975046 17248 raft_consensus.cc:1081] T a80f4105a1ce4e47ab9a4089253973cf P ec82448eea8f4a3293bc13542f5930e7 [term 2 LEADER]: Signalling peer c8e4344281b94506aeea8b84fc758bb8 to start an election
I20260709 12:08:35.976358 17063 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a80f4105a1ce4e47ab9a4089253973cf"
dest_uuid: "c8e4344281b94506aeea8b84fc758bb8"
 from {username='slave'} at 127.0.0.1:44714
I20260709 12:08:35.976778 17063 raft_consensus.cc:493] T a80f4105a1ce4e47ab9a4089253973cf P c8e4344281b94506aeea8b84fc758bb8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:35.977057 17063 raft_consensus.cc:3060] T a80f4105a1ce4e47ab9a4089253973cf P c8e4344281b94506aeea8b84fc758bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.981199 17063 raft_consensus.cc:515] T a80f4105a1ce4e47ab9a4089253973cf P c8e4344281b94506aeea8b84fc758bb8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:35.983125 17063 leader_election.cc:290] T a80f4105a1ce4e47ab9a4089253973cf P c8e4344281b94506aeea8b84fc758bb8 [CANDIDATE]: Term 3 election: Requested vote from peers 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193:44815), ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194:37255)
I20260709 12:08:35.983721 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a80f4105a1ce4e47ab9a4089253973cf" candidate_uuid: "c8e4344281b94506aeea8b84fc758bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "29490d1192b9423998b71cd2c90c0c1f"
I20260709 12:08:35.984313 16914 raft_consensus.cc:3060] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.984278 16987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a80f4105a1ce4e47ab9a4089253973cf" candidate_uuid: "c8e4344281b94506aeea8b84fc758bb8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ec82448eea8f4a3293bc13542f5930e7"
I20260709 12:08:35.984905 16987 raft_consensus.cc:3055] T a80f4105a1ce4e47ab9a4089253973cf P ec82448eea8f4a3293bc13542f5930e7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:35.985127 16987 raft_consensus.cc:740] T a80f4105a1ce4e47ab9a4089253973cf P ec82448eea8f4a3293bc13542f5930e7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ec82448eea8f4a3293bc13542f5930e7, State: Running, Role: LEADER
I20260709 12:08:35.985795 16987 consensus_queue.cc:260] T a80f4105a1ce4e47ab9a4089253973cf P ec82448eea8f4a3293bc13542f5930e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:35.986851 16987 raft_consensus.cc:3060] T a80f4105a1ce4e47ab9a4089253973cf P ec82448eea8f4a3293bc13542f5930e7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:35.988440 16914 raft_consensus.cc:2468] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e4344281b94506aeea8b84fc758bb8 in term 3.
I20260709 12:08:35.989467 17027 leader_election.cc:304] T a80f4105a1ce4e47ab9a4089253973cf P c8e4344281b94506aeea8b84fc758bb8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29490d1192b9423998b71cd2c90c0c1f, c8e4344281b94506aeea8b84fc758bb8; no voters: 
I20260709 12:08:35.990160 17197 raft_consensus.cc:2804] T a80f4105a1ce4e47ab9a4089253973cf P c8e4344281b94506aeea8b84fc758bb8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:35.991079 16987 raft_consensus.cc:2468] T a80f4105a1ce4e47ab9a4089253973cf P ec82448eea8f4a3293bc13542f5930e7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e4344281b94506aeea8b84fc758bb8 in term 3.
I20260709 12:08:35.991297 17197 raft_consensus.cc:697] T a80f4105a1ce4e47ab9a4089253973cf P c8e4344281b94506aeea8b84fc758bb8 [term 3 LEADER]: Becoming Leader. State: Replica: c8e4344281b94506aeea8b84fc758bb8, State: Running, Role: LEADER
I20260709 12:08:35.992231 17197 consensus_queue.cc:237] T a80f4105a1ce4e47ab9a4089253973cf P c8e4344281b94506aeea8b84fc758bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:35.999101 16811 catalog_manager.cc:5697] T a80f4105a1ce4e47ab9a4089253973cf P c8e4344281b94506aeea8b84fc758bb8 reported cstate change: term changed from 2 to 3, leader changed from ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194) to c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195). New cstate: current_term: 3 leader_uuid: "c8e4344281b94506aeea8b84fc758bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:36.243486 17239 raft_consensus.cc:993] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7: : Instructing follower c8e4344281b94506aeea8b84fc758bb8 to start an election
I20260709 12:08:36.243996 17248 raft_consensus.cc:1081] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [term 4 LEADER]: Signalling peer c8e4344281b94506aeea8b84fc758bb8 to start an election
I20260709 12:08:36.245571 17063 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99ca6528cae84361ac940d82bf10059d"
dest_uuid: "c8e4344281b94506aeea8b84fc758bb8"
 from {username='slave'} at 127.0.0.1:44714
I20260709 12:08:36.246021 17063 raft_consensus.cc:493] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:36.246276 17063 raft_consensus.cc:3060] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:36.250154 17063 raft_consensus.cc:515] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:36.251739 17063 leader_election.cc:290] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [CANDIDATE]: Term 5 election: Requested vote from peers 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193:44815), ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194:37255)
I20260709 12:08:36.252882 16987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ca6528cae84361ac940d82bf10059d" candidate_uuid: "c8e4344281b94506aeea8b84fc758bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "ec82448eea8f4a3293bc13542f5930e7"
I20260709 12:08:36.252882 16914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99ca6528cae84361ac940d82bf10059d" candidate_uuid: "c8e4344281b94506aeea8b84fc758bb8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "29490d1192b9423998b71cd2c90c0c1f"
I20260709 12:08:36.253573 16987 raft_consensus.cc:3055] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:08:36.253713 16914 raft_consensus.cc:3060] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:36.253976 16987 raft_consensus.cc:740] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ec82448eea8f4a3293bc13542f5930e7, State: Running, Role: LEADER
I20260709 12:08:36.254879 16987 consensus_queue.cc:260] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:36.255908 16987 raft_consensus.cc:3060] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:08:36.259517 16914 raft_consensus.cc:2468] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e4344281b94506aeea8b84fc758bb8 in term 5.
I20260709 12:08:36.260361 17027 leader_election.cc:304] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29490d1192b9423998b71cd2c90c0c1f, c8e4344281b94506aeea8b84fc758bb8; no voters: 
I20260709 12:08:36.260998 17197 raft_consensus.cc:2804] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:08:36.261427 17197 raft_consensus.cc:697] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [term 5 LEADER]: Becoming Leader. State: Replica: c8e4344281b94506aeea8b84fc758bb8, State: Running, Role: LEADER
I20260709 12:08:36.262321 16987 raft_consensus.cc:2468] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8e4344281b94506aeea8b84fc758bb8 in term 5.
I20260709 12:08:36.262246 17197 consensus_queue.cc:237] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:36.268378 16811 catalog_manager.cc:5697] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 reported cstate change: term changed from 4 to 5, leader changed from ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194) to c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195). New cstate: current_term: 5 leader_uuid: "c8e4344281b94506aeea8b84fc758bb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:36.302619 17248 raft_consensus.cc:993] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7: : Instructing follower 29490d1192b9423998b71cd2c90c0c1f to start an election
I20260709 12:08:36.303072 17239 raft_consensus.cc:1081] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7 [term 2 LEADER]: Signalling peer 29490d1192b9423998b71cd2c90c0c1f to start an election
I20260709 12:08:36.304445 16913 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c0f27eff5cd24050a606667e55c75601"
dest_uuid: "29490d1192b9423998b71cd2c90c0c1f"
 from {username='slave'} at 127.0.0.1:33176
I20260709 12:08:36.304904 16913 raft_consensus.cc:493] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:36.305190 16913 raft_consensus.cc:3060] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:36.309175 16913 raft_consensus.cc:515] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:36.310488 16913 leader_election.cc:290] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f [CANDIDATE]: Term 3 election: Requested vote from peers ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194:37255), c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195:33695)
I20260709 12:08:36.311321 16987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0f27eff5cd24050a606667e55c75601" candidate_uuid: "29490d1192b9423998b71cd2c90c0c1f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ec82448eea8f4a3293bc13542f5930e7"
I20260709 12:08:36.311566 17063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0f27eff5cd24050a606667e55c75601" candidate_uuid: "29490d1192b9423998b71cd2c90c0c1f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c8e4344281b94506aeea8b84fc758bb8"
I20260709 12:08:36.311822 16987 raft_consensus.cc:3055] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:36.312104 17063 raft_consensus.cc:3060] T c0f27eff5cd24050a606667e55c75601 P c8e4344281b94506aeea8b84fc758bb8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:36.312165 16987 raft_consensus.cc:740] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ec82448eea8f4a3293bc13542f5930e7, State: Running, Role: LEADER
I20260709 12:08:36.313002 16987 consensus_queue.cc:260] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:36.313881 16987 raft_consensus.cc:3060] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:36.316090 17063 raft_consensus.cc:2468] T c0f27eff5cd24050a606667e55c75601 P c8e4344281b94506aeea8b84fc758bb8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29490d1192b9423998b71cd2c90c0c1f in term 3.
I20260709 12:08:36.316936 16878 leader_election.cc:304] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29490d1192b9423998b71cd2c90c0c1f, c8e4344281b94506aeea8b84fc758bb8; no voters: 
I20260709 12:08:36.317625 17250 raft_consensus.cc:2804] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:36.317999 17250 raft_consensus.cc:697] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f [term 3 LEADER]: Becoming Leader. State: Replica: 29490d1192b9423998b71cd2c90c0c1f, State: Running, Role: LEADER
I20260709 12:08:36.318621 16987 raft_consensus.cc:2468] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29490d1192b9423998b71cd2c90c0c1f in term 3.
I20260709 12:08:36.318797 17250 consensus_queue.cc:237] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:36.325191 16811 catalog_manager.cc:5697] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f reported cstate change: term changed from 2 to 3, leader changed from ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194) to 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193). New cstate: current_term: 3 leader_uuid: "29490d1192b9423998b71cd2c90c0c1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:36.348143 16987 raft_consensus.cc:1275] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7 [term 5 FOLLOWER]: Refusing update from remote peer 29490d1192b9423998b71cd2c90c0c1f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:08:36.349310 17250 consensus_queue.cc:1048] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:08:36.355566 17248 raft_consensus.cc:993] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7: : Instructing follower 29490d1192b9423998b71cd2c90c0c1f to start an election
I20260709 12:08:36.356101 17239 raft_consensus.cc:1081] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [term 3 LEADER]: Signalling peer 29490d1192b9423998b71cd2c90c0c1f to start an election
I20260709 12:08:36.356930 17063 raft_consensus.cc:1275] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [term 5 FOLLOWER]: Refusing update from remote peer 29490d1192b9423998b71cd2c90c0c1f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:08:36.358799 17250 consensus_queue.cc:1048] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:08:36.360270 16913 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "276d1755922145c9ae61b09cd364feeb"
dest_uuid: "29490d1192b9423998b71cd2c90c0c1f"
 from {username='slave'} at 127.0.0.1:33176
I20260709 12:08:36.360752 16913 raft_consensus.cc:493] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:36.361096 16913 raft_consensus.cc:3060] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:36.367053 16913 raft_consensus.cc:515] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:36.371132 16913 leader_election.cc:290] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f [CANDIDATE]: Term 4 election: Requested vote from peers ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194:37255), c8e4344281b94506aeea8b84fc758bb8 (127.16.98.195:33695)
I20260709 12:08:36.372243 17063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "276d1755922145c9ae61b09cd364feeb" candidate_uuid: "29490d1192b9423998b71cd2c90c0c1f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c8e4344281b94506aeea8b84fc758bb8"
I20260709 12:08:36.372575 16988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "276d1755922145c9ae61b09cd364feeb" candidate_uuid: "29490d1192b9423998b71cd2c90c0c1f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ec82448eea8f4a3293bc13542f5930e7"
I20260709 12:08:36.373170 16988 raft_consensus.cc:3055] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:08:36.373503 16988 raft_consensus.cc:740] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ec82448eea8f4a3293bc13542f5930e7, State: Running, Role: LEADER
I20260709 12:08:36.372756 17063 raft_consensus.cc:3060] T 276d1755922145c9ae61b09cd364feeb P c8e4344281b94506aeea8b84fc758bb8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:36.374306 16988 consensus_queue.cc:260] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:36.375560 16988 raft_consensus.cc:3060] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:08:36.379621 17063 raft_consensus.cc:2468] T 276d1755922145c9ae61b09cd364feeb P c8e4344281b94506aeea8b84fc758bb8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29490d1192b9423998b71cd2c90c0c1f in term 4.
I20260709 12:08:36.380529 16878 leader_election.cc:304] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29490d1192b9423998b71cd2c90c0c1f, c8e4344281b94506aeea8b84fc758bb8; no voters: 
I20260709 12:08:36.381542 17251 raft_consensus.cc:2804] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:08:36.383711 16988 raft_consensus.cc:2468] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 29490d1192b9423998b71cd2c90c0c1f in term 4.
I20260709 12:08:36.384980 17251 raft_consensus.cc:697] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f [term 4 LEADER]: Becoming Leader. State: Replica: 29490d1192b9423998b71cd2c90c0c1f, State: Running, Role: LEADER
I20260709 12:08:36.385941 17251 consensus_queue.cc:237] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } }
I20260709 12:08:36.393656 16808 catalog_manager.cc:5697] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f reported cstate change: term changed from 3 to 4, leader changed from ec82448eea8f4a3293bc13542f5930e7 (127.16.98.194) to 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193). New cstate: current_term: 4 leader_uuid: "29490d1192b9423998b71cd2c90c0c1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:36.527118 16913 raft_consensus.cc:1275] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f [term 3 FOLLOWER]: Refusing update from remote peer c8e4344281b94506aeea8b84fc758bb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:36.528270 17197 consensus_queue.cc:1048] T a80f4105a1ce4e47ab9a4089253973cf P c8e4344281b94506aeea8b84fc758bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:36.536849 16988 raft_consensus.cc:1275] T a80f4105a1ce4e47ab9a4089253973cf P ec82448eea8f4a3293bc13542f5930e7 [term 3 FOLLOWER]: Refusing update from remote peer c8e4344281b94506aeea8b84fc758bb8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:36.538849 17197 consensus_queue.cc:1048] T a80f4105a1ce4e47ab9a4089253973cf P c8e4344281b94506aeea8b84fc758bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:36.724105 17063 raft_consensus.cc:1275] T c0f27eff5cd24050a606667e55c75601 P c8e4344281b94506aeea8b84fc758bb8 [term 3 FOLLOWER]: Refusing update from remote peer 29490d1192b9423998b71cd2c90c0c1f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:36.725157 17251 consensus_queue.cc:1048] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:36.732584 16913 raft_consensus.cc:1275] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f [term 5 FOLLOWER]: Refusing update from remote peer c8e4344281b94506aeea8b84fc758bb8: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:08:36.734193 17197 consensus_queue.cc:1048] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29490d1192b9423998b71cd2c90c0c1f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:08:36.734519 16988 raft_consensus.cc:1275] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7 [term 3 FOLLOWER]: Refusing update from remote peer 29490d1192b9423998b71cd2c90c0c1f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:36.737656 17267 consensus_queue.cc:1048] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:36.746407 16988 raft_consensus.cc:1275] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [term 5 FOLLOWER]: Refusing update from remote peer c8e4344281b94506aeea8b84fc758bb8: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:08:36.747848 17257 consensus_queue.cc:1048] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:08:36.770336 17063 raft_consensus.cc:1275] T 276d1755922145c9ae61b09cd364feeb P c8e4344281b94506aeea8b84fc758bb8 [term 4 FOLLOWER]: Refusing update from remote peer 29490d1192b9423998b71cd2c90c0c1f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:36.771328 17267 consensus_queue.cc:1048] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8e4344281b94506aeea8b84fc758bb8" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 33695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:36.779299 16987 raft_consensus.cc:1275] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [term 4 FOLLOWER]: Refusing update from remote peer 29490d1192b9423998b71cd2c90c0c1f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:08:36.781104 17251 consensus_queue.cc:1048] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec82448eea8f4a3293bc13542f5930e7" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 37255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:08:36.814402 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:36.819463 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:36.819826 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:37.820729 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:37.825435 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:37.825845 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:38.826805 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:38.831645 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:38.832062 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:39.833036 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:39.837733 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:39.838126 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:40.839147 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:40.843994 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:40.844403 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:41.845377 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:41.850069 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:41.850476 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:42.851461 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:42.856125 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:42.856570 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:43.857517 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:43.862422 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:43.862808 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:44.863727 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:44.868700 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:44.869037 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:45.897074 16779 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:08:45.898110 16779 tablet_server.cc:179] TabletServer@127.16.98.193:0 shutting down...
I20260709 12:08:45.926311 16779 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:08:45.927471 16779 tablet_replica.cc:333] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f: stopping tablet replica
I20260709 12:08:45.928501 16779 raft_consensus.cc:2243] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:08:45.929738 16779 raft_consensus.cc:2272] T 1063d9c76f824514a53771146fb1605d P 29490d1192b9423998b71cd2c90c0c1f [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.932228 16779 tablet_replica.cc:333] T ee85b0213f3c41b89c2d7185032dba59 P 29490d1192b9423998b71cd2c90c0c1f: stopping tablet replica
I20260709 12:08:45.932826 16779 raft_consensus.cc:2243] T ee85b0213f3c41b89c2d7185032dba59 P 29490d1192b9423998b71cd2c90c0c1f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.933300 16779 raft_consensus.cc:2272] T ee85b0213f3c41b89c2d7185032dba59 P 29490d1192b9423998b71cd2c90c0c1f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.935257 16779 tablet_replica.cc:333] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f: stopping tablet replica
I20260709 12:08:45.935812 16779 raft_consensus.cc:2243] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:08:45.936861 16779 raft_consensus.cc:2272] T c0f27eff5cd24050a606667e55c75601 P 29490d1192b9423998b71cd2c90c0c1f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.938548 16779 tablet_replica.cc:333] T 2d25aa5414ba4e06a06db53053ef0785 P 29490d1192b9423998b71cd2c90c0c1f: stopping tablet replica
I20260709 12:08:45.939162 16779 raft_consensus.cc:2243] T 2d25aa5414ba4e06a06db53053ef0785 P 29490d1192b9423998b71cd2c90c0c1f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.939621 16779 raft_consensus.cc:2272] T 2d25aa5414ba4e06a06db53053ef0785 P 29490d1192b9423998b71cd2c90c0c1f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.942513 16779 tablet_replica.cc:333] T a8e96f93f8824601adfe39584798017e P 29490d1192b9423998b71cd2c90c0c1f: stopping tablet replica
I20260709 12:08:45.943382 16779 raft_consensus.cc:2243] T a8e96f93f8824601adfe39584798017e P 29490d1192b9423998b71cd2c90c0c1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.944195 16779 raft_consensus.cc:2272] T a8e96f93f8824601adfe39584798017e P 29490d1192b9423998b71cd2c90c0c1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.946478 16779 tablet_replica.cc:333] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f: stopping tablet replica
I20260709 12:08:45.947058 16779 raft_consensus.cc:2243] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.947872 16779 raft_consensus.cc:2272] T a80f4105a1ce4e47ab9a4089253973cf P 29490d1192b9423998b71cd2c90c0c1f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.949518 16779 tablet_replica.cc:333] T 7d8bd5c247434c4e94b353024ef7bc92 P 29490d1192b9423998b71cd2c90c0c1f: stopping tablet replica
I20260709 12:08:45.949965 16779 raft_consensus.cc:2243] T 7d8bd5c247434c4e94b353024ef7bc92 P 29490d1192b9423998b71cd2c90c0c1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.950337 16779 raft_consensus.cc:2272] T 7d8bd5c247434c4e94b353024ef7bc92 P 29490d1192b9423998b71cd2c90c0c1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.951854 16779 tablet_replica.cc:333] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f: stopping tablet replica
I20260709 12:08:45.952241 16779 raft_consensus.cc:2243] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:45.952728 16779 raft_consensus.cc:2272] T 99ca6528cae84361ac940d82bf10059d P 29490d1192b9423998b71cd2c90c0c1f [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:45.954227 16779 tablet_replica.cc:333] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f: stopping tablet replica
I20260709 12:08:45.954604 16779 raft_consensus.cc:2243] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:08:45.955401 16779 raft_consensus.cc:2272] T 276d1755922145c9ae61b09cd364feeb P 29490d1192b9423998b71cd2c90c0c1f [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:08:45.969882 17027 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:08:46.032778 17027 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:44815, user_credentials={real_user=slave}} blocked reactor thread for 62980.7us
I20260709 12:08:46.051231 16779 tablet_server.cc:196] TabletServer@127.16.98.193:0 shutdown complete.
W20260709 12:08:46.051169 17027 consensus_peers.cc:597] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 -> Peer 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193:44815): Couldn't send request to peer 29490d1192b9423998b71cd2c90c0c1f. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:44815: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:08:46.051795 17027 consensus_peers.cc:597] T a80f4105a1ce4e47ab9a4089253973cf P c8e4344281b94506aeea8b84fc758bb8 -> Peer 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193:44815): Couldn't send request to peer 29490d1192b9423998b71cd2c90c0c1f. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:44815: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:08:46.053359 16953 consensus_peers.cc:597] T a8e96f93f8824601adfe39584798017e P ec82448eea8f4a3293bc13542f5930e7 -> Peer 29490d1192b9423998b71cd2c90c0c1f (127.16.98.193:44815): Couldn't send request to peer 29490d1192b9423998b71cd2c90c0c1f. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:44815: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:08:46.071434 16779 tablet_server.cc:179] TabletServer@127.16.98.194:0 shutting down...
I20260709 12:08:46.098832 16779 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:08:46.099454 16779 tablet_replica.cc:333] T 7d8bd5c247434c4e94b353024ef7bc92 P ec82448eea8f4a3293bc13542f5930e7: stopping tablet replica
I20260709 12:08:46.100884 16779 raft_consensus.cc:2243] T 7d8bd5c247434c4e94b353024ef7bc92 P ec82448eea8f4a3293bc13542f5930e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.101425 16779 raft_consensus.cc:2272] T 7d8bd5c247434c4e94b353024ef7bc92 P ec82448eea8f4a3293bc13542f5930e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.103223 16779 tablet_replica.cc:333] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7: stopping tablet replica
I20260709 12:08:46.103706 16779 raft_consensus.cc:2243] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.104108 16779 raft_consensus.cc:2272] T 99ca6528cae84361ac940d82bf10059d P ec82448eea8f4a3293bc13542f5930e7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.105667 16779 tablet_replica.cc:333] T a80f4105a1ce4e47ab9a4089253973cf P ec82448eea8f4a3293bc13542f5930e7: stopping tablet replica
I20260709 12:08:46.106141 16779 raft_consensus.cc:2243] T a80f4105a1ce4e47ab9a4089253973cf P ec82448eea8f4a3293bc13542f5930e7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.106555 16779 raft_consensus.cc:2272] T a80f4105a1ce4e47ab9a4089253973cf P ec82448eea8f4a3293bc13542f5930e7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.108112 16779 tablet_replica.cc:333] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7: stopping tablet replica
I20260709 12:08:46.108608 16779 raft_consensus.cc:2243] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.109064 16779 raft_consensus.cc:2272] T 1063d9c76f824514a53771146fb1605d P ec82448eea8f4a3293bc13542f5930e7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.110807 16779 tablet_replica.cc:333] T 2d25aa5414ba4e06a06db53053ef0785 P ec82448eea8f4a3293bc13542f5930e7: stopping tablet replica
I20260709 12:08:46.111261 16779 raft_consensus.cc:2243] T 2d25aa5414ba4e06a06db53053ef0785 P ec82448eea8f4a3293bc13542f5930e7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:08:46.112035 16779 raft_consensus.cc:2272] T 2d25aa5414ba4e06a06db53053ef0785 P ec82448eea8f4a3293bc13542f5930e7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.113545 16779 tablet_replica.cc:333] T ee85b0213f3c41b89c2d7185032dba59 P ec82448eea8f4a3293bc13542f5930e7: stopping tablet replica
I20260709 12:08:46.114037 16779 raft_consensus.cc:2243] T ee85b0213f3c41b89c2d7185032dba59 P ec82448eea8f4a3293bc13542f5930e7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:08:46.114887 16779 raft_consensus.cc:2272] T ee85b0213f3c41b89c2d7185032dba59 P ec82448eea8f4a3293bc13542f5930e7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.116482 16779 tablet_replica.cc:333] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7: stopping tablet replica
I20260709 12:08:46.117219 16779 raft_consensus.cc:2243] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.117697 16779 raft_consensus.cc:2272] T 276d1755922145c9ae61b09cd364feeb P ec82448eea8f4a3293bc13542f5930e7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.119321 16779 tablet_replica.cc:333] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7: stopping tablet replica
I20260709 12:08:46.119757 16779 raft_consensus.cc:2243] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.120232 16779 raft_consensus.cc:2272] T c0f27eff5cd24050a606667e55c75601 P ec82448eea8f4a3293bc13542f5930e7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.121690 16779 tablet_replica.cc:333] T a8e96f93f8824601adfe39584798017e P ec82448eea8f4a3293bc13542f5930e7: stopping tablet replica
I20260709 12:08:46.122107 16779 raft_consensus.cc:2243] T a8e96f93f8824601adfe39584798017e P ec82448eea8f4a3293bc13542f5930e7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:08:46.122848 16779 raft_consensus.cc:2272] T a8e96f93f8824601adfe39584798017e P ec82448eea8f4a3293bc13542f5930e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.150139 16779 tablet_server.cc:196] TabletServer@127.16.98.194:0 shutdown complete.
I20260709 12:08:46.167052 16779 tablet_server.cc:179] TabletServer@127.16.98.195:0 shutting down...
I20260709 12:08:46.192356 16779 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:08:46.193197 16779 tablet_replica.cc:333] T c0f27eff5cd24050a606667e55c75601 P c8e4344281b94506aeea8b84fc758bb8: stopping tablet replica
I20260709 12:08:46.194079 16779 raft_consensus.cc:2243] T c0f27eff5cd24050a606667e55c75601 P c8e4344281b94506aeea8b84fc758bb8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.194506 16779 raft_consensus.cc:2272] T c0f27eff5cd24050a606667e55c75601 P c8e4344281b94506aeea8b84fc758bb8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.196215 16779 tablet_replica.cc:333] T a80f4105a1ce4e47ab9a4089253973cf P c8e4344281b94506aeea8b84fc758bb8: stopping tablet replica
I20260709 12:08:46.196651 16779 raft_consensus.cc:2243] T a80f4105a1ce4e47ab9a4089253973cf P c8e4344281b94506aeea8b84fc758bb8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:08:46.197340 16779 raft_consensus.cc:2272] T a80f4105a1ce4e47ab9a4089253973cf P c8e4344281b94506aeea8b84fc758bb8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.199136 16779 tablet_replica.cc:333] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8: stopping tablet replica
I20260709 12:08:46.199576 16779 raft_consensus.cc:2243] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:08:46.200220 16779 raft_consensus.cc:2272] T 99ca6528cae84361ac940d82bf10059d P c8e4344281b94506aeea8b84fc758bb8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.201785 16779 tablet_replica.cc:333] T 7d8bd5c247434c4e94b353024ef7bc92 P c8e4344281b94506aeea8b84fc758bb8: stopping tablet replica
I20260709 12:08:46.202261 16779 raft_consensus.cc:2243] T 7d8bd5c247434c4e94b353024ef7bc92 P c8e4344281b94506aeea8b84fc758bb8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:08:46.203104 16779 raft_consensus.cc:2272] T 7d8bd5c247434c4e94b353024ef7bc92 P c8e4344281b94506aeea8b84fc758bb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.205369 16779 tablet_replica.cc:333] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8: stopping tablet replica
I20260709 12:08:46.206159 16779 raft_consensus.cc:2243] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.206799 16779 raft_consensus.cc:2272] T 1063d9c76f824514a53771146fb1605d P c8e4344281b94506aeea8b84fc758bb8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.209048 16779 tablet_replica.cc:333] T 2d25aa5414ba4e06a06db53053ef0785 P c8e4344281b94506aeea8b84fc758bb8: stopping tablet replica
I20260709 12:08:46.209558 16779 raft_consensus.cc:2243] T 2d25aa5414ba4e06a06db53053ef0785 P c8e4344281b94506aeea8b84fc758bb8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.210048 16779 raft_consensus.cc:2272] T 2d25aa5414ba4e06a06db53053ef0785 P c8e4344281b94506aeea8b84fc758bb8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.212088 16779 tablet_replica.cc:333] T a8e96f93f8824601adfe39584798017e P c8e4344281b94506aeea8b84fc758bb8: stopping tablet replica
I20260709 12:08:46.212772 16779 raft_consensus.cc:2243] T a8e96f93f8824601adfe39584798017e P c8e4344281b94506aeea8b84fc758bb8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.213276 16779 raft_consensus.cc:2272] T a8e96f93f8824601adfe39584798017e P c8e4344281b94506aeea8b84fc758bb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.215018 16779 tablet_replica.cc:333] T 276d1755922145c9ae61b09cd364feeb P c8e4344281b94506aeea8b84fc758bb8: stopping tablet replica
I20260709 12:08:46.215473 16779 raft_consensus.cc:2243] T 276d1755922145c9ae61b09cd364feeb P c8e4344281b94506aeea8b84fc758bb8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.215871 16779 raft_consensus.cc:2272] T 276d1755922145c9ae61b09cd364feeb P c8e4344281b94506aeea8b84fc758bb8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.217373 16779 tablet_replica.cc:333] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8: stopping tablet replica
I20260709 12:08:46.217787 16779 raft_consensus.cc:2243] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:08:46.218211 16779 raft_consensus.cc:2272] T ee85b0213f3c41b89c2d7185032dba59 P c8e4344281b94506aeea8b84fc758bb8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.243988 16779 tablet_server.cc:196] TabletServer@127.16.98.195:0 shutdown complete.
I20260709 12:08:46.260731 16779 master.cc:562] Master@127.16.98.254:34021 shutting down...
I20260709 12:08:46.362929 16779 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 66f3a9991e43402ba1b4dc88e97c938a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:08:46.363569 16779 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 66f3a9991e43402ba1b4dc88e97c938a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:08:46.363906 16779 tablet_replica.cc:333] T 00000000000000000000000000000000 P 66f3a9991e43402ba1b4dc88e97c938a: stopping tablet replica
I20260709 12:08:46.383528 16779 master.cc:584] Master@127.16.98.254:34021 shutdown complete.
29490d1192b9423998b71cd2c90c0c1f  4
c8e4344281b94506aeea8b84fc758bb8  1
ec82448eea8f4a3293bc13542f5930e7  4
29490d1192b9423998b71cd2c90c0c1f  3
c8e4344281b94506aeea8b84fc758bb8  3
ec82448eea8f4a3293bc13542f5930e7  3
29490d1192b9423998b71cd2c90c0c1f  0
c8e4344281b94506aeea8b84fc758bb8  1
ec82448eea8f4a3293bc13542f5930e7  8
29490d1192b9423998b71cd2c90c0c1f  3
c8e4344281b94506aeea8b84fc758bb8  3
ec82448eea8f4a3293bc13542f5930e7  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (30687 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:08:46.423166 16779 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.98.254:39263
I20260709 12:08:46.424238 16779 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:46.429337 17285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:46.429833 17286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:46.430868 17288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:46.431941 16779 server_base.cc:1061] running on GCE node
I20260709 12:08:46.432693 16779 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:46.432927 16779 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:46.433045 16779 hybrid_clock.cc:648] HybridClock initialized: now 1783598926433034 us; error 0 us; skew 500 ppm
I20260709 12:08:46.433466 16779 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:46.435631 16779 webserver.cc:533] Webserver started at http://127.16.98.254:44417/ using document root <none> and password file <none>
I20260709 12:08:46.436058 16779 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:46.436208 16779 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:46.436414 16779 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:46.437422 16779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895573690-16779-0/minicluster-data/master-0-root/instance:
uuid: "a924c8c29f604e19b20e24a7d12e2383"
format_stamp: "Formatted at 2026-07-09 12:08:46 on dist-test-slave-9bv4"
I20260709 12:08:46.441689 16779 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:08:46.444773 17293 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.445472 16779 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:08:46.445739 16779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895573690-16779-0/minicluster-data/master-0-root
uuid: "a924c8c29f604e19b20e24a7d12e2383"
format_stamp: "Formatted at 2026-07-09 12:08:46 on dist-test-slave-9bv4"
I20260709 12:08:46.445994 16779 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895573690-16779-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895573690-16779-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895573690-16779-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:46.481953 16779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:46.483162 16779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:46.519731 16779 rpc_server.cc:307] RPC server started. Bound to: 127.16.98.254:39263
I20260709 12:08:46.519814 17344 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.98.254:39263 every 8 connection(s)
I20260709 12:08:46.523532 17345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:46.532523 17345 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a924c8c29f604e19b20e24a7d12e2383: Bootstrap starting.
I20260709 12:08:46.536966 17345 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a924c8c29f604e19b20e24a7d12e2383: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:46.540766 17345 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a924c8c29f604e19b20e24a7d12e2383: No bootstrap required, opened a new log
I20260709 12:08:46.543005 17345 raft_consensus.cc:359] T 00000000000000000000000000000000 P a924c8c29f604e19b20e24a7d12e2383 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a924c8c29f604e19b20e24a7d12e2383" member_type: VOTER }
I20260709 12:08:46.543394 17345 raft_consensus.cc:385] T 00000000000000000000000000000000 P a924c8c29f604e19b20e24a7d12e2383 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:46.543581 17345 raft_consensus.cc:740] T 00000000000000000000000000000000 P a924c8c29f604e19b20e24a7d12e2383 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a924c8c29f604e19b20e24a7d12e2383, State: Initialized, Role: FOLLOWER
I20260709 12:08:46.544044 17345 consensus_queue.cc:260] T 00000000000000000000000000000000 P a924c8c29f604e19b20e24a7d12e2383 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a924c8c29f604e19b20e24a7d12e2383" member_type: VOTER }
I20260709 12:08:46.544435 17345 raft_consensus.cc:399] T 00000000000000000000000000000000 P a924c8c29f604e19b20e24a7d12e2383 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:08:46.544633 17345 raft_consensus.cc:493] T 00000000000000000000000000000000 P a924c8c29f604e19b20e24a7d12e2383 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:08:46.544838 17345 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a924c8c29f604e19b20e24a7d12e2383 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:46.548447 17345 raft_consensus.cc:515] T 00000000000000000000000000000000 P a924c8c29f604e19b20e24a7d12e2383 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a924c8c29f604e19b20e24a7d12e2383" member_type: VOTER }
I20260709 12:08:46.548892 17345 leader_election.cc:304] T 00000000000000000000000000000000 P a924c8c29f604e19b20e24a7d12e2383 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a924c8c29f604e19b20e24a7d12e2383; no voters: 
I20260709 12:08:46.549857 17345 leader_election.cc:290] T 00000000000000000000000000000000 P a924c8c29f604e19b20e24a7d12e2383 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:08:46.550271 17348 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a924c8c29f604e19b20e24a7d12e2383 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:46.551649 17348 raft_consensus.cc:697] T 00000000000000000000000000000000 P a924c8c29f604e19b20e24a7d12e2383 [term 1 LEADER]: Becoming Leader. State: Replica: a924c8c29f604e19b20e24a7d12e2383, State: Running, Role: LEADER
I20260709 12:08:46.552278 17348 consensus_queue.cc:237] T 00000000000000000000000000000000 P a924c8c29f604e19b20e24a7d12e2383 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a924c8c29f604e19b20e24a7d12e2383" member_type: VOTER }
I20260709 12:08:46.552809 17345 sys_catalog.cc:565] T 00000000000000000000000000000000 P a924c8c29f604e19b20e24a7d12e2383 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:08:46.557372 17349 sys_catalog.cc:455] T 00000000000000000000000000000000 P a924c8c29f604e19b20e24a7d12e2383 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a924c8c29f604e19b20e24a7d12e2383" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a924c8c29f604e19b20e24a7d12e2383" member_type: VOTER } }
I20260709 12:08:46.558106 17349 sys_catalog.cc:458] T 00000000000000000000000000000000 P a924c8c29f604e19b20e24a7d12e2383 [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:46.559144 17350 sys_catalog.cc:455] T 00000000000000000000000000000000 P a924c8c29f604e19b20e24a7d12e2383 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a924c8c29f604e19b20e24a7d12e2383. Latest consensus state: current_term: 1 leader_uuid: "a924c8c29f604e19b20e24a7d12e2383" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a924c8c29f604e19b20e24a7d12e2383" member_type: VOTER } }
I20260709 12:08:46.559923 17350 sys_catalog.cc:458] T 00000000000000000000000000000000 P a924c8c29f604e19b20e24a7d12e2383 [sys.catalog]: This master's current role is: LEADER
I20260709 12:08:46.560321 17356 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:08:46.565490 17356 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:08:46.567852 16779 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:08:46.574527 17356 catalog_manager.cc:1383] Generated new cluster ID: 980a1c1d56c04a9084fa9355d4d20769
I20260709 12:08:46.574832 17356 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:08:46.594851 17356 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:08:46.596068 17356 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:08:46.610728 17356 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a924c8c29f604e19b20e24a7d12e2383: Generated new TSK 0
I20260709 12:08:46.611310 17356 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:08:46.634053 16779 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:46.639720 17366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:46.641207 17367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:46.645211 16779 server_base.cc:1061] running on GCE node
W20260709 12:08:46.645321 17369 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:46.646333 16779 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:46.646517 16779 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:46.646688 16779 hybrid_clock.cc:648] HybridClock initialized: now 1783598926646627 us; error 0 us; skew 500 ppm
I20260709 12:08:46.647156 16779 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:46.649580 16779 webserver.cc:533] Webserver started at http://127.16.98.193:43371/ using document root <none> and password file <none>
I20260709 12:08:46.650022 16779 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:46.650187 16779 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:46.650391 16779 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:46.651451 16779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895573690-16779-0/minicluster-data/ts-0-root/instance:
uuid: "854572a3bda640e7950a027df5378cdd"
format_stamp: "Formatted at 2026-07-09 12:08:46 on dist-test-slave-9bv4"
I20260709 12:08:46.655656 16779 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:08:46.658742 17374 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.659442 16779 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:08:46.659727 16779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895573690-16779-0/minicluster-data/ts-0-root
uuid: "854572a3bda640e7950a027df5378cdd"
format_stamp: "Formatted at 2026-07-09 12:08:46 on dist-test-slave-9bv4"
I20260709 12:08:46.659994 16779 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895573690-16779-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895573690-16779-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895573690-16779-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:46.680109 16779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:46.681304 16779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:46.682794 16779 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:46.684926 16779 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:46.685091 16779 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.685380 16779 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:46.685546 16779 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.724409 16779 rpc_server.cc:307] RPC server started. Bound to: 127.16.98.193:37181
I20260709 12:08:46.724496 17436 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.98.193:37181 every 8 connection(s)
I20260709 12:08:46.729297 16779 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:46.736195 17441 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:46.737447 17442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:46.739172 16779 server_base.cc:1061] running on GCE node
W20260709 12:08:46.740899 17444 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:46.742085 16779 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:46.742300 16779 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:46.742493 16779 hybrid_clock.cc:648] HybridClock initialized: now 1783598926742476 us; error 0 us; skew 500 ppm
I20260709 12:08:46.742508 17437 heartbeater.cc:344] Connected to a master server at 127.16.98.254:39263
I20260709 12:08:46.743016 17437 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:46.743305 16779 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:46.743814 17437 heartbeater.cc:507] Master 127.16.98.254:39263 requested a full tablet report, sending...
I20260709 12:08:46.746019 17310 ts_manager.cc:194] Registered new tserver with Master: 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181)
I20260709 12:08:46.746421 16779 webserver.cc:533] Webserver started at http://127.16.98.194:38207/ using document root <none> and password file <none>
I20260709 12:08:46.746959 16779 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:46.747176 16779 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:46.747463 16779 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:46.747996 17310 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36490
I20260709 12:08:46.748672 16779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895573690-16779-0/minicluster-data/ts-1-root/instance:
uuid: "2148f2bf702c4738a23fadb9df5f8e99"
format_stamp: "Formatted at 2026-07-09 12:08:46 on dist-test-slave-9bv4"
I20260709 12:08:46.753077 16779 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:08:46.756359 17449 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.757268 16779 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:08:46.757498 16779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895573690-16779-0/minicluster-data/ts-1-root
uuid: "2148f2bf702c4738a23fadb9df5f8e99"
format_stamp: "Formatted at 2026-07-09 12:08:46 on dist-test-slave-9bv4"
I20260709 12:08:46.757802 16779 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895573690-16779-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895573690-16779-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895573690-16779-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:46.788244 16779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:46.789378 16779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:46.790746 16779 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:46.792798 16779 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:46.792994 16779 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.793257 16779 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:46.793419 16779 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.830546 16779 rpc_server.cc:307] RPC server started. Bound to: 127.16.98.194:45635
I20260709 12:08:46.830667 17511 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.98.194:45635 every 8 connection(s)
I20260709 12:08:46.835129 16779 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:08:46.841940 17515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:46.843627 17516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:08:46.844692 17518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:08:46.845295 16779 server_base.cc:1061] running on GCE node
I20260709 12:08:46.846186 16779 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:08:46.846416 16779 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:08:46.846590 16779 hybrid_clock.cc:648] HybridClock initialized: now 1783598926846572 us; error 0 us; skew 500 ppm
I20260709 12:08:46.847111 17512 heartbeater.cc:344] Connected to a master server at 127.16.98.254:39263
I20260709 12:08:46.847349 16779 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:08:46.847506 17512 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:46.848419 17512 heartbeater.cc:507] Master 127.16.98.254:39263 requested a full tablet report, sending...
I20260709 12:08:46.850024 16779 webserver.cc:533] Webserver started at http://127.16.98.195:33931/ using document root <none> and password file <none>
I20260709 12:08:46.850538 16779 fs_manager.cc:362] Metadata directory not provided
I20260709 12:08:46.850553 17310 ts_manager.cc:194] Registered new tserver with Master: 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635)
I20260709 12:08:46.850879 16779 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:08:46.851235 16779 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:08:46.852100 17310 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36494
I20260709 12:08:46.852389 16779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895573690-16779-0/minicluster-data/ts-2-root/instance:
uuid: "290dc05c27f24fdf9873533e9b0f6445"
format_stamp: "Formatted at 2026-07-09 12:08:46 on dist-test-slave-9bv4"
I20260709 12:08:46.856776 16779 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:08:46.859866 17523 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.860635 16779 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:08:46.860925 16779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895573690-16779-0/minicluster-data/ts-2-root
uuid: "290dc05c27f24fdf9873533e9b0f6445"
format_stamp: "Formatted at 2026-07-09 12:08:46 on dist-test-slave-9bv4"
I20260709 12:08:46.861210 16779 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895573690-16779-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895573690-16779-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783598895573690-16779-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:08:46.882480 16779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:08:46.883657 16779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:08:46.884948 16779 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:08:46.887004 16779 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:08:46.887202 16779 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.887456 16779 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:08:46.887627 16779 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:08:46.925249 16779 rpc_server.cc:307] RPC server started. Bound to: 127.16.98.195:37765
I20260709 12:08:46.925360 17585 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.98.195:37765 every 8 connection(s)
I20260709 12:08:46.938557 17586 heartbeater.cc:344] Connected to a master server at 127.16.98.254:39263
I20260709 12:08:46.938896 17586 heartbeater.cc:461] Registering TS with master...
I20260709 12:08:46.939536 17586 heartbeater.cc:507] Master 127.16.98.254:39263 requested a full tablet report, sending...
I20260709 12:08:46.941246 17310 ts_manager.cc:194] Registered new tserver with Master: 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195:37765)
I20260709 12:08:46.941629 16779 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013293293s
I20260709 12:08:46.942901 17310 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36496
I20260709 12:08:46.966248 17310 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36500:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:08:46.968995 17310 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:08:47.032572 17477 tablet_service.cc:1511] Processing CreateTablet for tablet abc0445a2776423098f7ba93cfe3e7f2 (DEFAULT_TABLE table=test-workload [id=5421fb2b9b38489fb351d1cd7b99c571]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:08:47.034006 17477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abc0445a2776423098f7ba93cfe3e7f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.036952 17551 tablet_service.cc:1511] Processing CreateTablet for tablet abc0445a2776423098f7ba93cfe3e7f2 (DEFAULT_TABLE table=test-workload [id=5421fb2b9b38489fb351d1cd7b99c571]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:08:47.038295 17551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abc0445a2776423098f7ba93cfe3e7f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.038111 17476 tablet_service.cc:1511] Processing CreateTablet for tablet f854f3e731a84e6e9ade0adcad9a7e10 (DEFAULT_TABLE table=test-workload [id=5421fb2b9b38489fb351d1cd7b99c571]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:08:47.039485 17476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f854f3e731a84e6e9ade0adcad9a7e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.041219 17475 tablet_service.cc:1511] Processing CreateTablet for tablet 349c94cc3eb84c8dbcf13222e8d85105 (DEFAULT_TABLE table=test-workload [id=5421fb2b9b38489fb351d1cd7b99c571]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:08:47.041262 17550 tablet_service.cc:1511] Processing CreateTablet for tablet f854f3e731a84e6e9ade0adcad9a7e10 (DEFAULT_TABLE table=test-workload [id=5421fb2b9b38489fb351d1cd7b99c571]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:08:47.042723 17475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 349c94cc3eb84c8dbcf13222e8d85105. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.043375 17550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f854f3e731a84e6e9ade0adcad9a7e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.047545 17549 tablet_service.cc:1511] Processing CreateTablet for tablet 349c94cc3eb84c8dbcf13222e8d85105 (DEFAULT_TABLE table=test-workload [id=5421fb2b9b38489fb351d1cd7b99c571]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:08:47.048919 17549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 349c94cc3eb84c8dbcf13222e8d85105. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.052873 17548 tablet_service.cc:1511] Processing CreateTablet for tablet 04e015de4bdc40b893cb59db8d999cbd (DEFAULT_TABLE table=test-workload [id=5421fb2b9b38489fb351d1cd7b99c571]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:08:47.054165 17548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04e015de4bdc40b893cb59db8d999cbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.055789 17474 tablet_service.cc:1511] Processing CreateTablet for tablet 04e015de4bdc40b893cb59db8d999cbd (DEFAULT_TABLE table=test-workload [id=5421fb2b9b38489fb351d1cd7b99c571]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:08:47.057257 17474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04e015de4bdc40b893cb59db8d999cbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.058279 17473 tablet_service.cc:1511] Processing CreateTablet for tablet ce29ffec4f0245cf8ebfd905f615b11d (DEFAULT_TABLE table=test-workload [id=5421fb2b9b38489fb351d1cd7b99c571]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:08:47.061197 17547 tablet_service.cc:1511] Processing CreateTablet for tablet ce29ffec4f0245cf8ebfd905f615b11d (DEFAULT_TABLE table=test-workload [id=5421fb2b9b38489fb351d1cd7b99c571]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:08:47.061774 17473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce29ffec4f0245cf8ebfd905f615b11d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.062482 17547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce29ffec4f0245cf8ebfd905f615b11d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.071177 17472 tablet_service.cc:1511] Processing CreateTablet for tablet a81d098aae2c4871a507e0a1c48e006d (DEFAULT_TABLE table=test-workload [id=5421fb2b9b38489fb351d1cd7b99c571]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:08:47.072429 17472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a81d098aae2c4871a507e0a1c48e006d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.074887 17546 tablet_service.cc:1511] Processing CreateTablet for tablet a81d098aae2c4871a507e0a1c48e006d (DEFAULT_TABLE table=test-workload [id=5421fb2b9b38489fb351d1cd7b99c571]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:08:47.076102 17546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a81d098aae2c4871a507e0a1c48e006d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.080852 17401 tablet_service.cc:1511] Processing CreateTablet for tablet f854f3e731a84e6e9ade0adcad9a7e10 (DEFAULT_TABLE table=test-workload [id=5421fb2b9b38489fb351d1cd7b99c571]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:08:47.082134 17401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f854f3e731a84e6e9ade0adcad9a7e10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.083832 17402 tablet_service.cc:1511] Processing CreateTablet for tablet abc0445a2776423098f7ba93cfe3e7f2 (DEFAULT_TABLE table=test-workload [id=5421fb2b9b38489fb351d1cd7b99c571]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:08:47.085078 17402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abc0445a2776423098f7ba93cfe3e7f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.087831 17400 tablet_service.cc:1511] Processing CreateTablet for tablet 349c94cc3eb84c8dbcf13222e8d85105 (DEFAULT_TABLE table=test-workload [id=5421fb2b9b38489fb351d1cd7b99c571]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:08:47.089088 17400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 349c94cc3eb84c8dbcf13222e8d85105. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.091799 17399 tablet_service.cc:1511] Processing CreateTablet for tablet 04e015de4bdc40b893cb59db8d999cbd (DEFAULT_TABLE table=test-workload [id=5421fb2b9b38489fb351d1cd7b99c571]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:08:47.093009 17399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04e015de4bdc40b893cb59db8d999cbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.095350 17398 tablet_service.cc:1511] Processing CreateTablet for tablet ce29ffec4f0245cf8ebfd905f615b11d (DEFAULT_TABLE table=test-workload [id=5421fb2b9b38489fb351d1cd7b99c571]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:08:47.096580 17398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce29ffec4f0245cf8ebfd905f615b11d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.100126 17396 tablet_service.cc:1511] Processing CreateTablet for tablet 556c7c2480ef40c5adfaa946e5d95c8b (DEFAULT_TABLE table=test-workload [id=5421fb2b9b38489fb351d1cd7b99c571]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:08:47.100736 17476 tablet_service.cc:1511] Processing CreateTablet for tablet 8eadcb8f48ad471599f2fe5c00f9c5fa (DEFAULT_TABLE table=test-workload [id=5421fb2b9b38489fb351d1cd7b99c571]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:08:47.101398 17396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 556c7c2480ef40c5adfaa946e5d95c8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.101967 17476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eadcb8f48ad471599f2fe5c00f9c5fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.103747 17395 tablet_service.cc:1511] Processing CreateTablet for tablet 8eadcb8f48ad471599f2fe5c00f9c5fa (DEFAULT_TABLE table=test-workload [id=5421fb2b9b38489fb351d1cd7b99c571]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:08:47.104943 17395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eadcb8f48ad471599f2fe5c00f9c5fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.108347 17397 tablet_service.cc:1511] Processing CreateTablet for tablet a81d098aae2c4871a507e0a1c48e006d (DEFAULT_TABLE table=test-workload [id=5421fb2b9b38489fb351d1cd7b99c571]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:08:47.109539 17397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a81d098aae2c4871a507e0a1c48e006d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.135586 17474 tablet_service.cc:1511] Processing CreateTablet for tablet 556c7c2480ef40c5adfaa946e5d95c8b (DEFAULT_TABLE table=test-workload [id=5421fb2b9b38489fb351d1cd7b99c571]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:08:47.136936 17474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 556c7c2480ef40c5adfaa946e5d95c8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.137161 17551 tablet_service.cc:1511] Processing CreateTablet for tablet 556c7c2480ef40c5adfaa946e5d95c8b (DEFAULT_TABLE table=test-workload [id=5421fb2b9b38489fb351d1cd7b99c571]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:08:47.149520 17601 tablet_bootstrap.cc:492] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99: Bootstrap starting.
I20260709 12:08:47.155470 17601 tablet_bootstrap.cc:654] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.155715 17602 tablet_bootstrap.cc:492] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445: Bootstrap starting.
I20260709 12:08:47.163347 17603 tablet_bootstrap.cc:492] T f854f3e731a84e6e9ade0adcad9a7e10 P 854572a3bda640e7950a027df5378cdd: Bootstrap starting.
I20260709 12:08:47.164283 17602 tablet_bootstrap.cc:654] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.167692 17551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 556c7c2480ef40c5adfaa946e5d95c8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.177058 17475 tablet_service.cc:1511] Processing CreateTablet for tablet 6fdffb55b864444ba1e3539a24b9f729 (DEFAULT_TABLE table=test-workload [id=5421fb2b9b38489fb351d1cd7b99c571]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:08:47.180219 17399 tablet_service.cc:1511] Processing CreateTablet for tablet b4f614b23b964d519944544229c1cf98 (DEFAULT_TABLE table=test-workload [id=5421fb2b9b38489fb351d1cd7b99c571]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:08:47.187974 17397 tablet_service.cc:1511] Processing CreateTablet for tablet 6fdffb55b864444ba1e3539a24b9f729 (DEFAULT_TABLE table=test-workload [id=5421fb2b9b38489fb351d1cd7b99c571]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:08:47.191378 17399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4f614b23b964d519944544229c1cf98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.191987 17397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fdffb55b864444ba1e3539a24b9f729. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.182416 17603 tablet_bootstrap.cc:654] T f854f3e731a84e6e9ade0adcad9a7e10 P 854572a3bda640e7950a027df5378cdd: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.187161 17475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fdffb55b864444ba1e3539a24b9f729. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.195595 17549 tablet_service.cc:1511] Processing CreateTablet for tablet b4f614b23b964d519944544229c1cf98 (DEFAULT_TABLE table=test-workload [id=5421fb2b9b38489fb351d1cd7b99c571]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:08:47.196719 17549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4f614b23b964d519944544229c1cf98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.187311 17550 tablet_service.cc:1511] Processing CreateTablet for tablet 8eadcb8f48ad471599f2fe5c00f9c5fa (DEFAULT_TABLE table=test-workload [id=5421fb2b9b38489fb351d1cd7b99c571]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:08:47.204447 17550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eadcb8f48ad471599f2fe5c00f9c5fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.207101 17472 tablet_service.cc:1511] Processing CreateTablet for tablet b4f614b23b964d519944544229c1cf98 (DEFAULT_TABLE table=test-workload [id=5421fb2b9b38489fb351d1cd7b99c571]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:08:47.208266 17546 tablet_service.cc:1511] Processing CreateTablet for tablet 6fdffb55b864444ba1e3539a24b9f729 (DEFAULT_TABLE table=test-workload [id=5421fb2b9b38489fb351d1cd7b99c571]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:08:47.212612 17601 tablet_bootstrap.cc:492] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99: No bootstrap required, opened a new log
I20260709 12:08:47.221431 17601 ts_tablet_manager.cc:1403] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99: Time spent bootstrapping tablet: real 0.072s	user 0.024s	sys 0.017s
I20260709 12:08:47.221669 17472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4f614b23b964d519944544229c1cf98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.224247 17601 raft_consensus.cc:359] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.224962 17601 raft_consensus.cc:385] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.225255 17601 raft_consensus.cc:740] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2148f2bf702c4738a23fadb9df5f8e99, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.226174 17601 consensus_queue.cc:260] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.230338 17602 tablet_bootstrap.cc:492] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445: No bootstrap required, opened a new log
I20260709 12:08:47.230808 17602 ts_tablet_manager.cc:1403] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445: Time spent bootstrapping tablet: real 0.075s	user 0.006s	sys 0.007s
I20260709 12:08:47.232786 17546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fdffb55b864444ba1e3539a24b9f729. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:08:47.233543 17602 raft_consensus.cc:359] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.234238 17602 raft_consensus.cc:385] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.234519 17602 raft_consensus.cc:740] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 290dc05c27f24fdf9873533e9b0f6445, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.235666 17602 consensus_queue.cc:260] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.241178 17603 tablet_bootstrap.cc:492] T f854f3e731a84e6e9ade0adcad9a7e10 P 854572a3bda640e7950a027df5378cdd: No bootstrap required, opened a new log
I20260709 12:08:47.241690 17603 ts_tablet_manager.cc:1403] T f854f3e731a84e6e9ade0adcad9a7e10 P 854572a3bda640e7950a027df5378cdd: Time spent bootstrapping tablet: real 0.079s	user 0.012s	sys 0.000s
I20260709 12:08:47.243861 17603 raft_consensus.cc:359] T f854f3e731a84e6e9ade0adcad9a7e10 P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.244388 17512 heartbeater.cc:499] Master 127.16.98.254:39263 was elected leader, sending a full tablet report...
I20260709 12:08:47.244532 17603 raft_consensus.cc:385] T f854f3e731a84e6e9ade0adcad9a7e10 P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.244856 17603 raft_consensus.cc:740] T f854f3e731a84e6e9ade0adcad9a7e10 P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 854572a3bda640e7950a027df5378cdd, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.245173 17586 heartbeater.cc:499] Master 127.16.98.254:39263 was elected leader, sending a full tablet report...
I20260709 12:08:47.245726 17603 consensus_queue.cc:260] T f854f3e731a84e6e9ade0adcad9a7e10 P 854572a3bda640e7950a027df5378cdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.248852 17601 ts_tablet_manager.cc:1434] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.003s
I20260709 12:08:47.249020 17602 ts_tablet_manager.cc:1434] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.002s
I20260709 12:08:47.249820 17601 tablet_bootstrap.cc:492] T f854f3e731a84e6e9ade0adcad9a7e10 P 2148f2bf702c4738a23fadb9df5f8e99: Bootstrap starting.
I20260709 12:08:47.250140 17602 tablet_bootstrap.cc:492] T abc0445a2776423098f7ba93cfe3e7f2 P 290dc05c27f24fdf9873533e9b0f6445: Bootstrap starting.
I20260709 12:08:47.256057 17602 tablet_bootstrap.cc:654] T abc0445a2776423098f7ba93cfe3e7f2 P 290dc05c27f24fdf9873533e9b0f6445: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.256776 17601 tablet_bootstrap.cc:654] T f854f3e731a84e6e9ade0adcad9a7e10 P 2148f2bf702c4738a23fadb9df5f8e99: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.258433 17437 heartbeater.cc:499] Master 127.16.98.254:39263 was elected leader, sending a full tablet report...
I20260709 12:08:47.259737 17603 ts_tablet_manager.cc:1434] T f854f3e731a84e6e9ade0adcad9a7e10 P 854572a3bda640e7950a027df5378cdd: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:08:47.260932 17603 tablet_bootstrap.cc:492] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd: Bootstrap starting.
I20260709 12:08:47.269659 17603 tablet_bootstrap.cc:654] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.273722 17601 tablet_bootstrap.cc:492] T f854f3e731a84e6e9ade0adcad9a7e10 P 2148f2bf702c4738a23fadb9df5f8e99: No bootstrap required, opened a new log
I20260709 12:08:47.274166 17601 ts_tablet_manager.cc:1403] T f854f3e731a84e6e9ade0adcad9a7e10 P 2148f2bf702c4738a23fadb9df5f8e99: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.010s
I20260709 12:08:47.274727 17602 tablet_bootstrap.cc:492] T abc0445a2776423098f7ba93cfe3e7f2 P 290dc05c27f24fdf9873533e9b0f6445: No bootstrap required, opened a new log
I20260709 12:08:47.275178 17602 ts_tablet_manager.cc:1403] T abc0445a2776423098f7ba93cfe3e7f2 P 290dc05c27f24fdf9873533e9b0f6445: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.003s
I20260709 12:08:47.276896 17601 raft_consensus.cc:359] T f854f3e731a84e6e9ade0adcad9a7e10 P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.277608 17601 raft_consensus.cc:385] T f854f3e731a84e6e9ade0adcad9a7e10 P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.277935 17601 raft_consensus.cc:740] T f854f3e731a84e6e9ade0adcad9a7e10 P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2148f2bf702c4738a23fadb9df5f8e99, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.277791 17602 raft_consensus.cc:359] T abc0445a2776423098f7ba93cfe3e7f2 P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } } peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } }
I20260709 12:08:47.278496 17602 raft_consensus.cc:385] T abc0445a2776423098f7ba93cfe3e7f2 P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.278815 17602 raft_consensus.cc:740] T abc0445a2776423098f7ba93cfe3e7f2 P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 290dc05c27f24fdf9873533e9b0f6445, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.278832 17601 consensus_queue.cc:260] T f854f3e731a84e6e9ade0adcad9a7e10 P 2148f2bf702c4738a23fadb9df5f8e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.279614 17602 consensus_queue.cc:260] T abc0445a2776423098f7ba93cfe3e7f2 P 290dc05c27f24fdf9873533e9b0f6445 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } } peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } }
I20260709 12:08:47.281404 17601 ts_tablet_manager.cc:1434] T f854f3e731a84e6e9ade0adcad9a7e10 P 2148f2bf702c4738a23fadb9df5f8e99: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:08:47.281915 17602 ts_tablet_manager.cc:1434] T abc0445a2776423098f7ba93cfe3e7f2 P 290dc05c27f24fdf9873533e9b0f6445: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:08:47.282277 17601 tablet_bootstrap.cc:492] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99: Bootstrap starting.
I20260709 12:08:47.282771 17602 tablet_bootstrap.cc:492] T f854f3e731a84e6e9ade0adcad9a7e10 P 290dc05c27f24fdf9873533e9b0f6445: Bootstrap starting.
I20260709 12:08:47.288851 17601 tablet_bootstrap.cc:654] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.288856 17602 tablet_bootstrap.cc:654] T f854f3e731a84e6e9ade0adcad9a7e10 P 290dc05c27f24fdf9873533e9b0f6445: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.305301 17601 tablet_bootstrap.cc:492] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99: No bootstrap required, opened a new log
I20260709 12:08:47.305809 17601 ts_tablet_manager.cc:1403] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99: Time spent bootstrapping tablet: real 0.024s	user 0.005s	sys 0.009s
I20260709 12:08:47.307020 17603 tablet_bootstrap.cc:492] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd: No bootstrap required, opened a new log
I20260709 12:08:47.307471 17603 ts_tablet_manager.cc:1403] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.023s
I20260709 12:08:47.308579 17601 raft_consensus.cc:359] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.309288 17601 raft_consensus.cc:385] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.309599 17601 raft_consensus.cc:740] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2148f2bf702c4738a23fadb9df5f8e99, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.310068 17603 raft_consensus.cc:359] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.310745 17603 raft_consensus.cc:385] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.311026 17603 raft_consensus.cc:740] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 854572a3bda640e7950a027df5378cdd, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.311404 17601 consensus_queue.cc:260] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.311712 17603 consensus_queue.cc:260] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.312906 17602 tablet_bootstrap.cc:492] T f854f3e731a84e6e9ade0adcad9a7e10 P 290dc05c27f24fdf9873533e9b0f6445: No bootstrap required, opened a new log
I20260709 12:08:47.313339 17602 ts_tablet_manager.cc:1403] T f854f3e731a84e6e9ade0adcad9a7e10 P 290dc05c27f24fdf9873533e9b0f6445: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.006s
I20260709 12:08:47.313829 17601 ts_tablet_manager.cc:1434] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.006s
I20260709 12:08:47.314770 17601 tablet_bootstrap.cc:492] T abc0445a2776423098f7ba93cfe3e7f2 P 2148f2bf702c4738a23fadb9df5f8e99: Bootstrap starting.
I20260709 12:08:47.315378 17603 ts_tablet_manager.cc:1434] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 12:08:47.316262 17603 tablet_bootstrap.cc:492] T 04e015de4bdc40b893cb59db8d999cbd P 854572a3bda640e7950a027df5378cdd: Bootstrap starting.
I20260709 12:08:47.315986 17602 raft_consensus.cc:359] T f854f3e731a84e6e9ade0adcad9a7e10 P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.316691 17602 raft_consensus.cc:385] T f854f3e731a84e6e9ade0adcad9a7e10 P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.316998 17602 raft_consensus.cc:740] T f854f3e731a84e6e9ade0adcad9a7e10 P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 290dc05c27f24fdf9873533e9b0f6445, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.317732 17602 consensus_queue.cc:260] T f854f3e731a84e6e9ade0adcad9a7e10 P 290dc05c27f24fdf9873533e9b0f6445 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.319824 17602 ts_tablet_manager.cc:1434] T f854f3e731a84e6e9ade0adcad9a7e10 P 290dc05c27f24fdf9873533e9b0f6445: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:08:47.320716 17602 tablet_bootstrap.cc:492] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445: Bootstrap starting.
I20260709 12:08:47.321244 17601 tablet_bootstrap.cc:654] T abc0445a2776423098f7ba93cfe3e7f2 P 2148f2bf702c4738a23fadb9df5f8e99: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.326077 17608 raft_consensus.cc:493] T f854f3e731a84e6e9ade0adcad9a7e10 P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.326969 17602 tablet_bootstrap.cc:654] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.326541 17608 raft_consensus.cc:515] T f854f3e731a84e6e9ade0adcad9a7e10 P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.328233 17603 tablet_bootstrap.cc:654] T 04e015de4bdc40b893cb59db8d999cbd P 854572a3bda640e7950a027df5378cdd: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.339691 17603 tablet_bootstrap.cc:492] T 04e015de4bdc40b893cb59db8d999cbd P 854572a3bda640e7950a027df5378cdd: No bootstrap required, opened a new log
I20260709 12:08:47.340174 17603 ts_tablet_manager.cc:1403] T 04e015de4bdc40b893cb59db8d999cbd P 854572a3bda640e7950a027df5378cdd: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.004s
I20260709 12:08:47.343066 17603 raft_consensus.cc:359] T 04e015de4bdc40b893cb59db8d999cbd P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.343721 17603 raft_consensus.cc:385] T 04e015de4bdc40b893cb59db8d999cbd P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.344012 17603 raft_consensus.cc:740] T 04e015de4bdc40b893cb59db8d999cbd P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 854572a3bda640e7950a027df5378cdd, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.344811 17603 consensus_queue.cc:260] T 04e015de4bdc40b893cb59db8d999cbd P 854572a3bda640e7950a027df5378cdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.347398 17603 ts_tablet_manager.cc:1434] T 04e015de4bdc40b893cb59db8d999cbd P 854572a3bda640e7950a027df5378cdd: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:08:47.348450 17603 tablet_bootstrap.cc:492] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd: Bootstrap starting.
I20260709 12:08:47.349797 17608 leader_election.cc:290] T f854f3e731a84e6e9ade0adcad9a7e10 P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181), 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635)
I20260709 12:08:47.353418 17487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f854f3e731a84e6e9ade0adcad9a7e10" candidate_uuid: "290dc05c27f24fdf9873533e9b0f6445" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99" is_pre_election: true
I20260709 12:08:47.354137 17487 raft_consensus.cc:2468] T f854f3e731a84e6e9ade0adcad9a7e10 P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 290dc05c27f24fdf9873533e9b0f6445 in term 0.
I20260709 12:08:47.354511 17603 tablet_bootstrap.cc:654] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.355625 17526 leader_election.cc:304] T f854f3e731a84e6e9ade0adcad9a7e10 P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2148f2bf702c4738a23fadb9df5f8e99, 290dc05c27f24fdf9873533e9b0f6445; no voters: 
I20260709 12:08:47.356503 17608 raft_consensus.cc:2804] T f854f3e731a84e6e9ade0adcad9a7e10 P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:47.356853 17608 raft_consensus.cc:493] T f854f3e731a84e6e9ade0adcad9a7e10 P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:47.357226 17608 raft_consensus.cc:3060] T f854f3e731a84e6e9ade0adcad9a7e10 P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.363528 17602 tablet_bootstrap.cc:492] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445: No bootstrap required, opened a new log
I20260709 12:08:47.364132 17602 ts_tablet_manager.cc:1403] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445: Time spent bootstrapping tablet: real 0.044s	user 0.025s	sys 0.017s
I20260709 12:08:47.365927 17603 tablet_bootstrap.cc:492] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd: No bootstrap required, opened a new log
I20260709 12:08:47.366454 17603 ts_tablet_manager.cc:1403] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.007s
I20260709 12:08:47.367710 17602 raft_consensus.cc:359] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.368444 17602 raft_consensus.cc:385] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.368759 17602 raft_consensus.cc:740] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 290dc05c27f24fdf9873533e9b0f6445, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.369194 17603 raft_consensus.cc:359] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.369918 17601 tablet_bootstrap.cc:492] T abc0445a2776423098f7ba93cfe3e7f2 P 2148f2bf702c4738a23fadb9df5f8e99: No bootstrap required, opened a new log
I20260709 12:08:47.369503 17602 consensus_queue.cc:260] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.370107 17603 raft_consensus.cc:385] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.370556 17603 raft_consensus.cc:740] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 854572a3bda640e7950a027df5378cdd, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.370644 17601 ts_tablet_manager.cc:1403] T abc0445a2776423098f7ba93cfe3e7f2 P 2148f2bf702c4738a23fadb9df5f8e99: Time spent bootstrapping tablet: real 0.056s	user 0.009s	sys 0.009s
I20260709 12:08:47.371459 17603 consensus_queue.cc:260] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.374698 17601 raft_consensus.cc:359] T abc0445a2776423098f7ba93cfe3e7f2 P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } } peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } }
I20260709 12:08:47.378417 17603 ts_tablet_manager.cc:1434] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:08:47.375803 17601 raft_consensus.cc:385] T abc0445a2776423098f7ba93cfe3e7f2 P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.379222 17601 raft_consensus.cc:740] T abc0445a2776423098f7ba93cfe3e7f2 P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2148f2bf702c4738a23fadb9df5f8e99, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.379560 17603 tablet_bootstrap.cc:492] T abc0445a2776423098f7ba93cfe3e7f2 P 854572a3bda640e7950a027df5378cdd: Bootstrap starting.
I20260709 12:08:47.380470 17601 consensus_queue.cc:260] T abc0445a2776423098f7ba93cfe3e7f2 P 2148f2bf702c4738a23fadb9df5f8e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } } peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } }
I20260709 12:08:47.385990 17603 tablet_bootstrap.cc:654] T abc0445a2776423098f7ba93cfe3e7f2 P 854572a3bda640e7950a027df5378cdd: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.388497 17608 raft_consensus.cc:515] T f854f3e731a84e6e9ade0adcad9a7e10 P 290dc05c27f24fdf9873533e9b0f6445 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.392357 17601 ts_tablet_manager.cc:1434] T abc0445a2776423098f7ba93cfe3e7f2 P 2148f2bf702c4738a23fadb9df5f8e99: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 12:08:47.394634 17412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f854f3e731a84e6e9ade0adcad9a7e10" candidate_uuid: "290dc05c27f24fdf9873533e9b0f6445" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "854572a3bda640e7950a027df5378cdd" is_pre_election: true
I20260709 12:08:47.395545 17412 raft_consensus.cc:2468] T f854f3e731a84e6e9ade0adcad9a7e10 P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 290dc05c27f24fdf9873533e9b0f6445 in term 0.
I20260709 12:08:47.399654 17601 tablet_bootstrap.cc:492] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99: Bootstrap starting.
I20260709 12:08:47.402595 17412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f854f3e731a84e6e9ade0adcad9a7e10" candidate_uuid: "290dc05c27f24fdf9873533e9b0f6445" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "854572a3bda640e7950a027df5378cdd"
I20260709 12:08:47.403342 17412 raft_consensus.cc:3060] T f854f3e731a84e6e9ade0adcad9a7e10 P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.409874 17601 tablet_bootstrap.cc:654] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.412714 17412 raft_consensus.cc:2468] T f854f3e731a84e6e9ade0adcad9a7e10 P 854572a3bda640e7950a027df5378cdd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 290dc05c27f24fdf9873533e9b0f6445 in term 1.
I20260709 12:08:47.413098 17603 tablet_bootstrap.cc:492] T abc0445a2776423098f7ba93cfe3e7f2 P 854572a3bda640e7950a027df5378cdd: No bootstrap required, opened a new log
I20260709 12:08:47.413537 17603 ts_tablet_manager.cc:1403] T abc0445a2776423098f7ba93cfe3e7f2 P 854572a3bda640e7950a027df5378cdd: Time spent bootstrapping tablet: real 0.034s	user 0.023s	sys 0.009s
I20260709 12:08:47.414073 17527 leader_election.cc:304] T f854f3e731a84e6e9ade0adcad9a7e10 P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 290dc05c27f24fdf9873533e9b0f6445, 854572a3bda640e7950a027df5378cdd; no voters: 
I20260709 12:08:47.416420 17603 raft_consensus.cc:359] T abc0445a2776423098f7ba93cfe3e7f2 P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } } peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } }
I20260709 12:08:47.416738 17487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f854f3e731a84e6e9ade0adcad9a7e10" candidate_uuid: "290dc05c27f24fdf9873533e9b0f6445" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99"
I20260709 12:08:47.419301 17602 ts_tablet_manager.cc:1434] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445: Time spent starting tablet: real 0.055s	user 0.021s	sys 0.035s
I20260709 12:08:47.422528 17603 raft_consensus.cc:385] T abc0445a2776423098f7ba93cfe3e7f2 P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.418416 17620 raft_consensus.cc:2804] T f854f3e731a84e6e9ade0adcad9a7e10 P 290dc05c27f24fdf9873533e9b0f6445 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:47.423020 17603 raft_consensus.cc:740] T abc0445a2776423098f7ba93cfe3e7f2 P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 854572a3bda640e7950a027df5378cdd, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.423604 17602 tablet_bootstrap.cc:492] T a81d098aae2c4871a507e0a1c48e006d P 290dc05c27f24fdf9873533e9b0f6445: Bootstrap starting.
I20260709 12:08:47.417291 17487 raft_consensus.cc:3060] T f854f3e731a84e6e9ade0adcad9a7e10 P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.430425 17602 tablet_bootstrap.cc:654] T a81d098aae2c4871a507e0a1c48e006d P 290dc05c27f24fdf9873533e9b0f6445: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.417259 17608 leader_election.cc:290] T f854f3e731a84e6e9ade0adcad9a7e10 P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 1 election: Requested vote from peers 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181), 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635)
I20260709 12:08:47.430991 17603 consensus_queue.cc:260] T abc0445a2776423098f7ba93cfe3e7f2 P 854572a3bda640e7950a027df5378cdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } } peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } }
I20260709 12:08:47.438753 17601 tablet_bootstrap.cc:492] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99: No bootstrap required, opened a new log
I20260709 12:08:47.439443 17601 ts_tablet_manager.cc:1403] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.005s
I20260709 12:08:47.442094 17602 tablet_bootstrap.cc:492] T a81d098aae2c4871a507e0a1c48e006d P 290dc05c27f24fdf9873533e9b0f6445: No bootstrap required, opened a new log
I20260709 12:08:47.442548 17602 ts_tablet_manager.cc:1403] T a81d098aae2c4871a507e0a1c48e006d P 290dc05c27f24fdf9873533e9b0f6445: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.007s
I20260709 12:08:47.442698 17603 ts_tablet_manager.cc:1434] T abc0445a2776423098f7ba93cfe3e7f2 P 854572a3bda640e7950a027df5378cdd: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 12:08:47.442878 17601 raft_consensus.cc:359] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.443769 17601 raft_consensus.cc:385] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.444140 17601 raft_consensus.cc:740] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2148f2bf702c4738a23fadb9df5f8e99, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.445050 17601 consensus_queue.cc:260] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.445436 17602 raft_consensus.cc:359] T a81d098aae2c4871a507e0a1c48e006d P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.446102 17602 raft_consensus.cc:385] T a81d098aae2c4871a507e0a1c48e006d P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.446398 17602 raft_consensus.cc:740] T a81d098aae2c4871a507e0a1c48e006d P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 290dc05c27f24fdf9873533e9b0f6445, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.447124 17602 consensus_queue.cc:260] T a81d098aae2c4871a507e0a1c48e006d P 290dc05c27f24fdf9873533e9b0f6445 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.449327 17602 ts_tablet_manager.cc:1434] T a81d098aae2c4871a507e0a1c48e006d P 290dc05c27f24fdf9873533e9b0f6445: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:08:47.449751 17603 tablet_bootstrap.cc:492] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 854572a3bda640e7950a027df5378cdd: Bootstrap starting.
I20260709 12:08:47.450232 17602 tablet_bootstrap.cc:492] T b4f614b23b964d519944544229c1cf98 P 290dc05c27f24fdf9873533e9b0f6445: Bootstrap starting.
I20260709 12:08:47.453086 17601 ts_tablet_manager.cc:1434] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:08:47.453527 17487 raft_consensus.cc:2468] T f854f3e731a84e6e9ade0adcad9a7e10 P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 290dc05c27f24fdf9873533e9b0f6445 in term 1.
I20260709 12:08:47.454356 17601 tablet_bootstrap.cc:492] T ce29ffec4f0245cf8ebfd905f615b11d P 2148f2bf702c4738a23fadb9df5f8e99: Bootstrap starting.
I20260709 12:08:47.457175 17602 tablet_bootstrap.cc:654] T b4f614b23b964d519944544229c1cf98 P 290dc05c27f24fdf9873533e9b0f6445: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.459363 17620 raft_consensus.cc:697] T f854f3e731a84e6e9ade0adcad9a7e10 P 290dc05c27f24fdf9873533e9b0f6445 [term 1 LEADER]: Becoming Leader. State: Replica: 290dc05c27f24fdf9873533e9b0f6445, State: Running, Role: LEADER
I20260709 12:08:47.461678 17601 tablet_bootstrap.cc:654] T ce29ffec4f0245cf8ebfd905f615b11d P 2148f2bf702c4738a23fadb9df5f8e99: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.461359 17620 consensus_queue.cc:237] T f854f3e731a84e6e9ade0adcad9a7e10 P 290dc05c27f24fdf9873533e9b0f6445 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.463187 17603 tablet_bootstrap.cc:654] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 854572a3bda640e7950a027df5378cdd: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.463961 17607 raft_consensus.cc:493] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.464387 17607 raft_consensus.cc:515] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.472368 17607 leader_election.cc:290] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181), 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195:37765)
I20260709 12:08:47.472847 17602 tablet_bootstrap.cc:492] T b4f614b23b964d519944544229c1cf98 P 290dc05c27f24fdf9873533e9b0f6445: No bootstrap required, opened a new log
I20260709 12:08:47.473397 17602 ts_tablet_manager.cc:1403] T b4f614b23b964d519944544229c1cf98 P 290dc05c27f24fdf9873533e9b0f6445: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.000s
I20260709 12:08:47.475955 17601 tablet_bootstrap.cc:492] T ce29ffec4f0245cf8ebfd905f615b11d P 2148f2bf702c4738a23fadb9df5f8e99: No bootstrap required, opened a new log
I20260709 12:08:47.476408 17601 ts_tablet_manager.cc:1403] T ce29ffec4f0245cf8ebfd905f615b11d P 2148f2bf702c4738a23fadb9df5f8e99: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.011s
I20260709 12:08:47.476543 17602 raft_consensus.cc:359] T b4f614b23b964d519944544229c1cf98 P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.477489 17602 raft_consensus.cc:385] T b4f614b23b964d519944544229c1cf98 P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.477849 17602 raft_consensus.cc:740] T b4f614b23b964d519944544229c1cf98 P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 290dc05c27f24fdf9873533e9b0f6445, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.478780 17602 consensus_queue.cc:260] T b4f614b23b964d519944544229c1cf98 P 290dc05c27f24fdf9873533e9b0f6445 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.479408 17601 raft_consensus.cc:359] T ce29ffec4f0245cf8ebfd905f615b11d P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.479024 17310 catalog_manager.cc:5697] T f854f3e731a84e6e9ade0adcad9a7e10 P 290dc05c27f24fdf9873533e9b0f6445 reported cstate change: term changed from 0 to 1, leader changed from <none> to 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "290dc05c27f24fdf9873533e9b0f6445" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:47.480079 17601 raft_consensus.cc:385] T ce29ffec4f0245cf8ebfd905f615b11d P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.480381 17601 raft_consensus.cc:740] T ce29ffec4f0245cf8ebfd905f615b11d P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2148f2bf702c4738a23fadb9df5f8e99, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.482287 17602 ts_tablet_manager.cc:1434] T b4f614b23b964d519944544229c1cf98 P 290dc05c27f24fdf9873533e9b0f6445: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:08:47.483682 17602 tablet_bootstrap.cc:492] T 04e015de4bdc40b893cb59db8d999cbd P 290dc05c27f24fdf9873533e9b0f6445: Bootstrap starting.
I20260709 12:08:47.487381 17601 consensus_queue.cc:260] T ce29ffec4f0245cf8ebfd905f615b11d P 2148f2bf702c4738a23fadb9df5f8e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.493429 17602 tablet_bootstrap.cc:654] T 04e015de4bdc40b893cb59db8d999cbd P 290dc05c27f24fdf9873533e9b0f6445: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.494040 17601 ts_tablet_manager.cc:1434] T ce29ffec4f0245cf8ebfd905f615b11d P 2148f2bf702c4738a23fadb9df5f8e99: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:08:47.494977 17601 tablet_bootstrap.cc:492] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99: Bootstrap starting.
I20260709 12:08:47.499320 17620 raft_consensus.cc:493] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.499931 17620 raft_consensus.cc:515] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.501209 17601 tablet_bootstrap.cc:654] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.502746 17620 leader_election.cc:290] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181), 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635)
I20260709 12:08:47.503829 17487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce29ffec4f0245cf8ebfd905f615b11d" candidate_uuid: "290dc05c27f24fdf9873533e9b0f6445" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99" is_pre_election: true
I20260709 12:08:47.504199 17412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce29ffec4f0245cf8ebfd905f615b11d" candidate_uuid: "290dc05c27f24fdf9873533e9b0f6445" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "854572a3bda640e7950a027df5378cdd" is_pre_election: true
I20260709 12:08:47.504463 17487 raft_consensus.cc:2468] T ce29ffec4f0245cf8ebfd905f615b11d P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 290dc05c27f24fdf9873533e9b0f6445 in term 0.
W20260709 12:08:47.505508 17527 leader_election.cc:343] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.506075 17526 leader_election.cc:304] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2148f2bf702c4738a23fadb9df5f8e99, 290dc05c27f24fdf9873533e9b0f6445; no voters: 854572a3bda640e7950a027df5378cdd
I20260709 12:08:47.508376 17561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eadcb8f48ad471599f2fe5c00f9c5fa" candidate_uuid: "2148f2bf702c4738a23fadb9df5f8e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "290dc05c27f24fdf9873533e9b0f6445" is_pre_election: true
I20260709 12:08:47.510061 17620 raft_consensus.cc:2804] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:08:47.510159 17450 leader_election.cc:343] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.510672 17620 raft_consensus.cc:493] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:47.512660 17620 raft_consensus.cc:3060] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.524500 17624 raft_consensus.cc:493] T b4f614b23b964d519944544229c1cf98 P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.525159 17624 raft_consensus.cc:515] T b4f614b23b964d519944544229c1cf98 P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.526298 17620 raft_consensus.cc:515] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.529224 17412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f614b23b964d519944544229c1cf98" candidate_uuid: "290dc05c27f24fdf9873533e9b0f6445" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "854572a3bda640e7950a027df5378cdd" is_pre_election: true
I20260709 12:08:47.530059 17411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce29ffec4f0245cf8ebfd905f615b11d" candidate_uuid: "290dc05c27f24fdf9873533e9b0f6445" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "854572a3bda640e7950a027df5378cdd"
W20260709 12:08:47.532452 17527 leader_election.cc:343] T b4f614b23b964d519944544229c1cf98 P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:08:47.534230 17527 leader_election.cc:343] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.534718 17487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce29ffec4f0245cf8ebfd905f615b11d" candidate_uuid: "290dc05c27f24fdf9873533e9b0f6445" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99"
I20260709 12:08:47.535264 17487 raft_consensus.cc:3060] T ce29ffec4f0245cf8ebfd905f615b11d P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.536247 17603 tablet_bootstrap.cc:492] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 854572a3bda640e7950a027df5378cdd: No bootstrap required, opened a new log
I20260709 12:08:47.536183 17624 leader_election.cc:290] T b4f614b23b964d519944544229c1cf98 P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181), 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635)
I20260709 12:08:47.536818 17603 ts_tablet_manager.cc:1403] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 854572a3bda640e7950a027df5378cdd: Time spent bootstrapping tablet: real 0.087s	user 0.010s	sys 0.028s
I20260709 12:08:47.539358 17602 tablet_bootstrap.cc:492] T 04e015de4bdc40b893cb59db8d999cbd P 290dc05c27f24fdf9873533e9b0f6445: No bootstrap required, opened a new log
I20260709 12:08:47.539346 17601 tablet_bootstrap.cc:492] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99: No bootstrap required, opened a new log
I20260709 12:08:47.539901 17486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f614b23b964d519944544229c1cf98" candidate_uuid: "290dc05c27f24fdf9873533e9b0f6445" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99" is_pre_election: true
I20260709 12:08:47.540004 17602 ts_tablet_manager.cc:1403] T 04e015de4bdc40b893cb59db8d999cbd P 290dc05c27f24fdf9873533e9b0f6445: Time spent bootstrapping tablet: real 0.057s	user 0.013s	sys 0.030s
I20260709 12:08:47.540004 17601 ts_tablet_manager.cc:1403] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99: Time spent bootstrapping tablet: real 0.045s	user 0.022s	sys 0.019s
I20260709 12:08:47.540454 17620 leader_election.cc:290] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 1 election: Requested vote from peers 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181), 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635)
I20260709 12:08:47.539752 17603 raft_consensus.cc:359] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.541047 17603 raft_consensus.cc:385] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:08:47.541260 17526 leader_election.cc:343] T b4f614b23b964d519944544229c1cf98 P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.541363 17603 raft_consensus.cc:740] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 854572a3bda640e7950a027df5378cdd, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.541720 17526 leader_election.cc:304] T b4f614b23b964d519944544229c1cf98 P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 290dc05c27f24fdf9873533e9b0f6445; no voters: 2148f2bf702c4738a23fadb9df5f8e99, 854572a3bda640e7950a027df5378cdd
I20260709 12:08:47.535008 17411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eadcb8f48ad471599f2fe5c00f9c5fa" candidate_uuid: "2148f2bf702c4738a23fadb9df5f8e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "854572a3bda640e7950a027df5378cdd" is_pre_election: true
I20260709 12:08:47.542133 17603 consensus_queue.cc:260] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 854572a3bda640e7950a027df5378cdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.542939 17602 raft_consensus.cc:359] T 04e015de4bdc40b893cb59db8d999cbd P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.543215 17411 raft_consensus.cc:2468] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2148f2bf702c4738a23fadb9df5f8e99 in term 0.
I20260709 12:08:47.543668 17602 raft_consensus.cc:385] T 04e015de4bdc40b893cb59db8d999cbd P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.544029 17624 raft_consensus.cc:2749] T b4f614b23b964d519944544229c1cf98 P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:47.543607 17601 raft_consensus.cc:359] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.544118 17602 raft_consensus.cc:740] T 04e015de4bdc40b893cb59db8d999cbd P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 290dc05c27f24fdf9873533e9b0f6445, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.544580 17453 leader_election.cc:304] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2148f2bf702c4738a23fadb9df5f8e99, 854572a3bda640e7950a027df5378cdd; no voters: 290dc05c27f24fdf9873533e9b0f6445
I20260709 12:08:47.544719 17624 raft_consensus.cc:493] T abc0445a2776423098f7ba93cfe3e7f2 P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.544667 17601 raft_consensus.cc:385] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.545030 17602 consensus_queue.cc:260] T 04e015de4bdc40b893cb59db8d999cbd P 290dc05c27f24fdf9873533e9b0f6445 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.545281 17624 raft_consensus.cc:515] T abc0445a2776423098f7ba93cfe3e7f2 P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } } peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } }
I20260709 12:08:47.545400 17601 raft_consensus.cc:740] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2148f2bf702c4738a23fadb9df5f8e99, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.545687 17607 raft_consensus.cc:2804] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:47.546144 17607 raft_consensus.cc:493] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:47.546481 17607 raft_consensus.cc:3060] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.547433 17624 leader_election.cc:290] T abc0445a2776423098f7ba93cfe3e7f2 P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635), 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181)
I20260709 12:08:47.548238 17486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc0445a2776423098f7ba93cfe3e7f2" candidate_uuid: "290dc05c27f24fdf9873533e9b0f6445" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99" is_pre_election: true
I20260709 12:08:47.548837 17486 raft_consensus.cc:2468] T abc0445a2776423098f7ba93cfe3e7f2 P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 290dc05c27f24fdf9873533e9b0f6445 in term 0.
I20260709 12:08:47.550057 17526 leader_election.cc:304] T abc0445a2776423098f7ba93cfe3e7f2 P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2148f2bf702c4738a23fadb9df5f8e99, 290dc05c27f24fdf9873533e9b0f6445; no voters: 
I20260709 12:08:47.551021 17411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc0445a2776423098f7ba93cfe3e7f2" candidate_uuid: "290dc05c27f24fdf9873533e9b0f6445" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "854572a3bda640e7950a027df5378cdd" is_pre_election: true
I20260709 12:08:47.551218 17487 raft_consensus.cc:2468] T ce29ffec4f0245cf8ebfd905f615b11d P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 290dc05c27f24fdf9873533e9b0f6445 in term 1.
I20260709 12:08:47.551623 17411 raft_consensus.cc:2468] T abc0445a2776423098f7ba93cfe3e7f2 P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 290dc05c27f24fdf9873533e9b0f6445 in term 0.
I20260709 12:08:47.552040 17602 ts_tablet_manager.cc:1434] T 04e015de4bdc40b893cb59db8d999cbd P 290dc05c27f24fdf9873533e9b0f6445: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:08:47.553007 17602 tablet_bootstrap.cc:492] T 556c7c2480ef40c5adfaa946e5d95c8b P 290dc05c27f24fdf9873533e9b0f6445: Bootstrap starting.
I20260709 12:08:47.553637 17609 raft_consensus.cc:493] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.553856 17607 raft_consensus.cc:515] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.555032 17526 leader_election.cc:304] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2148f2bf702c4738a23fadb9df5f8e99, 290dc05c27f24fdf9873533e9b0f6445; no voters: 854572a3bda640e7950a027df5378cdd
I20260709 12:08:47.554080 17609 raft_consensus.cc:515] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.556056 17601 consensus_queue.cc:260] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.557974 17607 leader_election.cc:290] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [CANDIDATE]: Term 1 election: Requested vote from peers 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181), 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195:37765)
I20260709 12:08:47.559362 17602 tablet_bootstrap.cc:654] T 556c7c2480ef40c5adfaa946e5d95c8b P 290dc05c27f24fdf9873533e9b0f6445: Neither blocks nor log segments found. Creating new log.
W20260709 12:08:47.563184 17358 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:08:47.564783 17609 leader_election.cc:290] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635), 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195:37765)
I20260709 12:08:47.566128 17622 raft_consensus.cc:2804] T abc0445a2776423098f7ba93cfe3e7f2 P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:47.567549 17622 raft_consensus.cc:493] T abc0445a2776423098f7ba93cfe3e7f2 P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:47.567813 17624 raft_consensus.cc:2804] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:47.567935 17622 raft_consensus.cc:3060] T abc0445a2776423098f7ba93cfe3e7f2 P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.568332 17624 raft_consensus.cc:697] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [term 1 LEADER]: Becoming Leader. State: Replica: 290dc05c27f24fdf9873533e9b0f6445, State: Running, Role: LEADER
I20260709 12:08:47.569204 17624 consensus_queue.cc:237] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.575084 17561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eadcb8f48ad471599f2fe5c00f9c5fa" candidate_uuid: "2148f2bf702c4738a23fadb9df5f8e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "290dc05c27f24fdf9873533e9b0f6445"
W20260709 12:08:47.576579 17450 leader_election.cc:343] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195:37765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.578513 17622 raft_consensus.cc:515] T abc0445a2776423098f7ba93cfe3e7f2 P 290dc05c27f24fdf9873533e9b0f6445 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } } peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } }
I20260709 12:08:47.581961 17487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc0445a2776423098f7ba93cfe3e7f2" candidate_uuid: "290dc05c27f24fdf9873533e9b0f6445" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99"
I20260709 12:08:47.582661 17487 raft_consensus.cc:3060] T abc0445a2776423098f7ba93cfe3e7f2 P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.587684 17603 ts_tablet_manager.cc:1434] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 854572a3bda640e7950a027df5378cdd: Time spent starting tablet: real 0.051s	user 0.011s	sys 0.000s
I20260709 12:08:47.588653 17603 tablet_bootstrap.cc:492] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd: Bootstrap starting.
I20260709 12:08:47.589108 17622 leader_election.cc:290] T abc0445a2776423098f7ba93cfe3e7f2 P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 1 election: Requested vote from peers 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635), 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181)
I20260709 12:08:47.591791 17308 catalog_manager.cc:5697] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 reported cstate change: term changed from 0 to 1, leader changed from <none> to 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "290dc05c27f24fdf9873533e9b0f6445" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:47.597604 17609 raft_consensus.cc:493] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.597980 17411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc0445a2776423098f7ba93cfe3e7f2" candidate_uuid: "290dc05c27f24fdf9873533e9b0f6445" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "854572a3bda640e7950a027df5378cdd"
I20260709 12:08:47.598065 17609 raft_consensus.cc:515] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.598613 17411 raft_consensus.cc:3060] T abc0445a2776423098f7ba93cfe3e7f2 P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.600121 17609 leader_election.cc:290] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635), 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195:37765)
I20260709 12:08:47.601217 17487 raft_consensus.cc:2468] T abc0445a2776423098f7ba93cfe3e7f2 P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 290dc05c27f24fdf9873533e9b0f6445 in term 1.
I20260709 12:08:47.602358 17526 leader_election.cc:304] T abc0445a2776423098f7ba93cfe3e7f2 P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2148f2bf702c4738a23fadb9df5f8e99, 290dc05c27f24fdf9873533e9b0f6445; no voters: 
I20260709 12:08:47.603217 17622 raft_consensus.cc:2804] T abc0445a2776423098f7ba93cfe3e7f2 P 290dc05c27f24fdf9873533e9b0f6445 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:47.603681 17622 raft_consensus.cc:697] T abc0445a2776423098f7ba93cfe3e7f2 P 290dc05c27f24fdf9873533e9b0f6445 [term 1 LEADER]: Becoming Leader. State: Replica: 290dc05c27f24fdf9873533e9b0f6445, State: Running, Role: LEADER
I20260709 12:08:47.604449 17622 consensus_queue.cc:237] T abc0445a2776423098f7ba93cfe3e7f2 P 290dc05c27f24fdf9873533e9b0f6445 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } } peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } }
I20260709 12:08:47.605569 17411 raft_consensus.cc:2468] T abc0445a2776423098f7ba93cfe3e7f2 P 854572a3bda640e7950a027df5378cdd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 290dc05c27f24fdf9873533e9b0f6445 in term 1.
I20260709 12:08:47.622864 17411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eadcb8f48ad471599f2fe5c00f9c5fa" candidate_uuid: "2148f2bf702c4738a23fadb9df5f8e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "854572a3bda640e7950a027df5378cdd"
I20260709 12:08:47.623513 17411 raft_consensus.cc:3060] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.627171 17607 raft_consensus.cc:493] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.627652 17607 raft_consensus.cc:515] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.629607 17607 leader_election.cc:290] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181), 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195:37765)
I20260709 12:08:47.630081 17607 raft_consensus.cc:493] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.630116 17411 raft_consensus.cc:2468] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 854572a3bda640e7950a027df5378cdd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2148f2bf702c4738a23fadb9df5f8e99 in term 1.
I20260709 12:08:47.632725 17561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e015de4bdc40b893cb59db8d999cbd" candidate_uuid: "2148f2bf702c4738a23fadb9df5f8e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "290dc05c27f24fdf9873533e9b0f6445" is_pre_election: true
I20260709 12:08:47.633450 17601 ts_tablet_manager.cc:1434] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99: Time spent starting tablet: real 0.093s	user 0.012s	sys 0.031s
I20260709 12:08:47.633388 17561 raft_consensus.cc:2468] T 04e015de4bdc40b893cb59db8d999cbd P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2148f2bf702c4738a23fadb9df5f8e99 in term 0.
I20260709 12:08:47.633292 17310 catalog_manager.cc:5697] T abc0445a2776423098f7ba93cfe3e7f2 P 290dc05c27f24fdf9873533e9b0f6445 reported cstate change: term changed from 0 to 1, leader changed from <none> to 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "290dc05c27f24fdf9873533e9b0f6445" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:47.630587 17607 raft_consensus.cc:515] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.635270 17450 leader_election.cc:304] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2148f2bf702c4738a23fadb9df5f8e99, 290dc05c27f24fdf9873533e9b0f6445; no voters: 
I20260709 12:08:47.635443 17412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e015de4bdc40b893cb59db8d999cbd" candidate_uuid: "2148f2bf702c4738a23fadb9df5f8e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "854572a3bda640e7950a027df5378cdd" is_pre_election: true
I20260709 12:08:47.636626 17412 raft_consensus.cc:2468] T 04e015de4bdc40b893cb59db8d999cbd P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2148f2bf702c4738a23fadb9df5f8e99 in term 0.
I20260709 12:08:47.636940 17607 leader_election.cc:290] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181), 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195:37765)
I20260709 12:08:47.637437 17607 raft_consensus.cc:2804] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:47.637764 17607 raft_consensus.cc:493] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:47.638069 17607 raft_consensus.cc:3060] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.641571 17603 tablet_bootstrap.cc:654] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.645237 17561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "349c94cc3eb84c8dbcf13222e8d85105" candidate_uuid: "2148f2bf702c4738a23fadb9df5f8e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "290dc05c27f24fdf9873533e9b0f6445" is_pre_election: true
I20260709 12:08:47.646027 17561 raft_consensus.cc:2468] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2148f2bf702c4738a23fadb9df5f8e99 in term 0.
I20260709 12:08:47.646123 17453 leader_election.cc:304] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2148f2bf702c4738a23fadb9df5f8e99, 854572a3bda640e7950a027df5378cdd; no voters: 290dc05c27f24fdf9873533e9b0f6445
I20260709 12:08:47.647156 17412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "349c94cc3eb84c8dbcf13222e8d85105" candidate_uuid: "2148f2bf702c4738a23fadb9df5f8e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "854572a3bda640e7950a027df5378cdd" is_pre_election: true
I20260709 12:08:47.647406 17635 raft_consensus.cc:2804] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:47.648922 17450 leader_election.cc:304] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2148f2bf702c4738a23fadb9df5f8e99, 290dc05c27f24fdf9873533e9b0f6445; no voters: 
I20260709 12:08:47.649199 17602 tablet_bootstrap.cc:492] T 556c7c2480ef40c5adfaa946e5d95c8b P 290dc05c27f24fdf9873533e9b0f6445: No bootstrap required, opened a new log
I20260709 12:08:47.649690 17602 ts_tablet_manager.cc:1403] T 556c7c2480ef40c5adfaa946e5d95c8b P 290dc05c27f24fdf9873533e9b0f6445: Time spent bootstrapping tablet: real 0.097s	user 0.032s	sys 0.063s
W20260709 12:08:47.651497 17453 leader_election.cc:343] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.652216 17602 raft_consensus.cc:359] T 556c7c2480ef40c5adfaa946e5d95c8b P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.652738 17601 tablet_bootstrap.cc:492] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99: Bootstrap starting.
I20260709 12:08:47.652910 17602 raft_consensus.cc:385] T 556c7c2480ef40c5adfaa946e5d95c8b P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.653214 17602 raft_consensus.cc:740] T 556c7c2480ef40c5adfaa946e5d95c8b P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 290dc05c27f24fdf9873533e9b0f6445, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.654054 17602 consensus_queue.cc:260] T 556c7c2480ef40c5adfaa946e5d95c8b P 290dc05c27f24fdf9873533e9b0f6445 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.654543 17642 raft_consensus.cc:2804] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:47.656050 17602 ts_tablet_manager.cc:1434] T 556c7c2480ef40c5adfaa946e5d95c8b P 290dc05c27f24fdf9873533e9b0f6445: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:08:47.658216 17602 tablet_bootstrap.cc:492] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 290dc05c27f24fdf9873533e9b0f6445: Bootstrap starting.
I20260709 12:08:47.659981 17601 tablet_bootstrap.cc:654] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.654996 17642 raft_consensus.cc:493] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:47.662560 17642 raft_consensus.cc:3060] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.663938 17602 tablet_bootstrap.cc:654] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 290dc05c27f24fdf9873533e9b0f6445: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.671968 17607 raft_consensus.cc:515] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.672456 17561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d098aae2c4871a507e0a1c48e006d" candidate_uuid: "854572a3bda640e7950a027df5378cdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "290dc05c27f24fdf9873533e9b0f6445" is_pre_election: true
I20260709 12:08:47.673039 17561 raft_consensus.cc:2468] T a81d098aae2c4871a507e0a1c48e006d P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 854572a3bda640e7950a027df5378cdd in term 0.
I20260709 12:08:47.674137 17560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556c7c2480ef40c5adfaa946e5d95c8b" candidate_uuid: "854572a3bda640e7950a027df5378cdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "290dc05c27f24fdf9873533e9b0f6445" is_pre_election: true
I20260709 12:08:47.674798 17560 raft_consensus.cc:2468] T 556c7c2480ef40c5adfaa946e5d95c8b P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 854572a3bda640e7950a027df5378cdd in term 0.
I20260709 12:08:47.676697 17607 leader_election.cc:290] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99 [CANDIDATE]: Term 1 election: Requested vote from peers 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181), 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195:37765)
I20260709 12:08:47.677361 17486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556c7c2480ef40c5adfaa946e5d95c8b" candidate_uuid: "854572a3bda640e7950a027df5378cdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99" is_pre_election: true
I20260709 12:08:47.678532 17487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d098aae2c4871a507e0a1c48e006d" candidate_uuid: "854572a3bda640e7950a027df5378cdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99" is_pre_election: true
W20260709 12:08:47.678869 17377 leader_election.cc:343] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.679180 17487 raft_consensus.cc:2468] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 854572a3bda640e7950a027df5378cdd in term 0.
I20260709 12:08:47.679487 17601 tablet_bootstrap.cc:492] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99: No bootstrap required, opened a new log
I20260709 12:08:47.680099 17560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e015de4bdc40b893cb59db8d999cbd" candidate_uuid: "2148f2bf702c4738a23fadb9df5f8e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "290dc05c27f24fdf9873533e9b0f6445"
I20260709 12:08:47.680171 17601 ts_tablet_manager.cc:1403] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.008s
I20260709 12:08:47.680312 17377 leader_election.cc:304] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2148f2bf702c4738a23fadb9df5f8e99, 854572a3bda640e7950a027df5378cdd; no voters: 
I20260709 12:08:47.680706 17560 raft_consensus.cc:3060] T 04e015de4bdc40b893cb59db8d999cbd P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.681497 17609 raft_consensus.cc:2804] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:47.681870 17609 raft_consensus.cc:493] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:47.682214 17609 raft_consensus.cc:3060] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.683418 17601 raft_consensus.cc:359] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.684347 17601 raft_consensus.cc:385] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.685946 17601 raft_consensus.cc:740] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2148f2bf702c4738a23fadb9df5f8e99, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.687208 17602 tablet_bootstrap.cc:492] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 290dc05c27f24fdf9873533e9b0f6445: No bootstrap required, opened a new log
I20260709 12:08:47.686797 17601 consensus_queue.cc:260] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.687659 17602 ts_tablet_manager.cc:1403] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 290dc05c27f24fdf9873533e9b0f6445: Time spent bootstrapping tablet: real 0.030s	user 0.021s	sys 0.004s
I20260709 12:08:47.687547 17375 leader_election.cc:304] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 290dc05c27f24fdf9873533e9b0f6445, 854572a3bda640e7950a027df5378cdd; no voters: 2148f2bf702c4738a23fadb9df5f8e99
I20260709 12:08:47.688913 17601 ts_tablet_manager.cc:1434] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:08:47.689738 17601 tablet_bootstrap.cc:492] T 6fdffb55b864444ba1e3539a24b9f729 P 2148f2bf702c4738a23fadb9df5f8e99: Bootstrap starting.
I20260709 12:08:47.689429 17609 raft_consensus.cc:515] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.690131 17602 raft_consensus.cc:359] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.690788 17602 raft_consensus.cc:385] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.691054 17602 raft_consensus.cc:740] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 290dc05c27f24fdf9873533e9b0f6445, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.691655 17560 raft_consensus.cc:2468] T 04e015de4bdc40b893cb59db8d999cbd P 290dc05c27f24fdf9873533e9b0f6445 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2148f2bf702c4738a23fadb9df5f8e99 in term 1.
I20260709 12:08:47.691773 17602 consensus_queue.cc:260] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 290dc05c27f24fdf9873533e9b0f6445 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.692713 17487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d098aae2c4871a507e0a1c48e006d" candidate_uuid: "854572a3bda640e7950a027df5378cdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99"
I20260709 12:08:47.692813 17450 leader_election.cc:304] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2148f2bf702c4738a23fadb9df5f8e99, 290dc05c27f24fdf9873533e9b0f6445; no voters: 
I20260709 12:08:47.693288 17487 raft_consensus.cc:3060] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.693758 17641 raft_consensus.cc:2804] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:47.693984 17602 ts_tablet_manager.cc:1434] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 290dc05c27f24fdf9873533e9b0f6445: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:08:47.694267 17641 raft_consensus.cc:697] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 LEADER]: Becoming Leader. State: Replica: 2148f2bf702c4738a23fadb9df5f8e99, State: Running, Role: LEADER
I20260709 12:08:47.694846 17602 tablet_bootstrap.cc:492] T 6fdffb55b864444ba1e3539a24b9f729 P 290dc05c27f24fdf9873533e9b0f6445: Bootstrap starting.
I20260709 12:08:47.695120 17641 consensus_queue.cc:237] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.697434 17635 raft_consensus.cc:697] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 LEADER]: Becoming Leader. State: Replica: 2148f2bf702c4738a23fadb9df5f8e99, State: Running, Role: LEADER
I20260709 12:08:47.698060 17607 raft_consensus.cc:493] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.699070 17601 tablet_bootstrap.cc:654] T 6fdffb55b864444ba1e3539a24b9f729 P 2148f2bf702c4738a23fadb9df5f8e99: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.700111 17487 raft_consensus.cc:2468] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 854572a3bda640e7950a027df5378cdd in term 1.
I20260709 12:08:47.698729 17607 raft_consensus.cc:515] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.700476 17602 tablet_bootstrap.cc:654] T 6fdffb55b864444ba1e3539a24b9f729 P 290dc05c27f24fdf9873533e9b0f6445: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.700238 17635 consensus_queue.cc:237] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.701273 17377 leader_election.cc:304] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2148f2bf702c4738a23fadb9df5f8e99, 854572a3bda640e7950a027df5378cdd; no voters: 
I20260709 12:08:47.702368 17607 leader_election.cc:290] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181), 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195:37765)
I20260709 12:08:47.703580 17561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556c7c2480ef40c5adfaa946e5d95c8b" candidate_uuid: "2148f2bf702c4738a23fadb9df5f8e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "290dc05c27f24fdf9873533e9b0f6445" is_pre_election: true
I20260709 12:08:47.704342 17561 raft_consensus.cc:2468] T 556c7c2480ef40c5adfaa946e5d95c8b P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2148f2bf702c4738a23fadb9df5f8e99 in term 0.
I20260709 12:08:47.705518 17450 leader_election.cc:304] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2148f2bf702c4738a23fadb9df5f8e99, 290dc05c27f24fdf9873533e9b0f6445; no voters: 
I20260709 12:08:47.706295 17607 raft_consensus.cc:2804] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:47.706815 17607 raft_consensus.cc:493] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:47.707290 17607 raft_consensus.cc:3060] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.709187 17609 leader_election.cc:290] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [CANDIDATE]: Term 1 election: Requested vote from peers 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635), 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195:37765)
I20260709 12:08:47.709740 17609 raft_consensus.cc:2804] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:47.710088 17609 raft_consensus.cc:493] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:47.710412 17609 raft_consensus.cc:3060] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.716565 17411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e015de4bdc40b893cb59db8d999cbd" candidate_uuid: "2148f2bf702c4738a23fadb9df5f8e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "854572a3bda640e7950a027df5378cdd"
I20260709 12:08:47.717150 17411 raft_consensus.cc:3060] T 04e015de4bdc40b893cb59db8d999cbd P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.719405 17412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556c7c2480ef40c5adfaa946e5d95c8b" candidate_uuid: "2148f2bf702c4738a23fadb9df5f8e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "854572a3bda640e7950a027df5378cdd" is_pre_election: true
I20260709 12:08:47.722975 17607 raft_consensus.cc:515] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.722973 17560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d098aae2c4871a507e0a1c48e006d" candidate_uuid: "854572a3bda640e7950a027df5378cdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "290dc05c27f24fdf9873533e9b0f6445"
I20260709 12:08:47.724732 17609 raft_consensus.cc:515] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.725349 17411 raft_consensus.cc:2468] T 04e015de4bdc40b893cb59db8d999cbd P 854572a3bda640e7950a027df5378cdd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2148f2bf702c4738a23fadb9df5f8e99 in term 1.
I20260709 12:08:47.725682 17560 raft_consensus.cc:3060] T a81d098aae2c4871a507e0a1c48e006d P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.726051 17412 raft_consensus.cc:2393] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2148f2bf702c4738a23fadb9df5f8e99 in current term 1: Already voted for candidate 854572a3bda640e7950a027df5378cdd in this term.
I20260709 12:08:47.670840 17603 tablet_bootstrap.cc:492] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd: No bootstrap required, opened a new log
I20260709 12:08:47.729794 17603 ts_tablet_manager.cc:1403] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd: Time spent bootstrapping tablet: real 0.141s	user 0.015s	sys 0.000s
I20260709 12:08:47.731742 17487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556c7c2480ef40c5adfaa946e5d95c8b" candidate_uuid: "854572a3bda640e7950a027df5378cdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99"
I20260709 12:08:47.732513 17487 raft_consensus.cc:2393] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 854572a3bda640e7950a027df5378cdd in current term 1: Already voted for candidate 2148f2bf702c4738a23fadb9df5f8e99 in this term.
I20260709 12:08:47.732478 17412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556c7c2480ef40c5adfaa946e5d95c8b" candidate_uuid: "2148f2bf702c4738a23fadb9df5f8e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "854572a3bda640e7950a027df5378cdd"
I20260709 12:08:47.733273 17412 raft_consensus.cc:2393] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2148f2bf702c4738a23fadb9df5f8e99 in current term 1: Already voted for candidate 854572a3bda640e7950a027df5378cdd in this term.
I20260709 12:08:47.730814 17645 raft_consensus.cc:2804] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:47.734297 17645 raft_consensus.cc:697] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [term 1 LEADER]: Becoming Leader. State: Replica: 854572a3bda640e7950a027df5378cdd, State: Running, Role: LEADER
I20260709 12:08:47.734864 17609 leader_election.cc:290] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [CANDIDATE]: Term 1 election: Requested vote from peers 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635), 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195:37765)
I20260709 12:08:47.736286 17607 leader_election.cc:290] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 [CANDIDATE]: Term 1 election: Requested vote from peers 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181), 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195:37765)
I20260709 12:08:47.736609 17561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556c7c2480ef40c5adfaa946e5d95c8b" candidate_uuid: "854572a3bda640e7950a027df5378cdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "290dc05c27f24fdf9873533e9b0f6445"
I20260709 12:08:47.737051 17561 raft_consensus.cc:3060] T 556c7c2480ef40c5adfaa946e5d95c8b P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.735163 17645 consensus_queue.cc:237] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.738750 17559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556c7c2480ef40c5adfaa946e5d95c8b" candidate_uuid: "2148f2bf702c4738a23fadb9df5f8e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "290dc05c27f24fdf9873533e9b0f6445"
I20260709 12:08:47.741250 17450 leader_election.cc:304] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2148f2bf702c4738a23fadb9df5f8e99; no voters: 290dc05c27f24fdf9873533e9b0f6445, 854572a3bda640e7950a027df5378cdd
I20260709 12:08:47.742307 17607 raft_consensus.cc:2749] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:08:47.749976 17310 catalog_manager.cc:5697] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194). New cstate: current_term: 1 leader_uuid: "2148f2bf702c4738a23fadb9df5f8e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:47.751446 17561 raft_consensus.cc:2468] T 556c7c2480ef40c5adfaa946e5d95c8b P 290dc05c27f24fdf9873533e9b0f6445 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 854572a3bda640e7950a027df5378cdd in term 1.
I20260709 12:08:47.751995 17601 tablet_bootstrap.cc:492] T 6fdffb55b864444ba1e3539a24b9f729 P 2148f2bf702c4738a23fadb9df5f8e99: No bootstrap required, opened a new log
I20260709 12:08:47.752434 17601 ts_tablet_manager.cc:1403] T 6fdffb55b864444ba1e3539a24b9f729 P 2148f2bf702c4738a23fadb9df5f8e99: Time spent bootstrapping tablet: real 0.063s	user 0.018s	sys 0.013s
I20260709 12:08:47.754317 17601 raft_consensus.cc:359] T 6fdffb55b864444ba1e3539a24b9f729 P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.758126 17601 raft_consensus.cc:385] T 6fdffb55b864444ba1e3539a24b9f729 P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.758302 17601 raft_consensus.cc:740] T 6fdffb55b864444ba1e3539a24b9f729 P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2148f2bf702c4738a23fadb9df5f8e99, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.759081 17601 consensus_queue.cc:260] T 6fdffb55b864444ba1e3539a24b9f729 P 2148f2bf702c4738a23fadb9df5f8e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.761891 17601 ts_tablet_manager.cc:1434] T 6fdffb55b864444ba1e3539a24b9f729 P 2148f2bf702c4738a23fadb9df5f8e99: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:08:47.762882 17601 tablet_bootstrap.cc:492] T b4f614b23b964d519944544229c1cf98 P 2148f2bf702c4738a23fadb9df5f8e99: Bootstrap starting.
I20260709 12:08:47.762348 17375 leader_election.cc:304] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 290dc05c27f24fdf9873533e9b0f6445, 854572a3bda640e7950a027df5378cdd; no voters: 2148f2bf702c4738a23fadb9df5f8e99
I20260709 12:08:47.763862 17646 raft_consensus.cc:2804] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:47.764462 17646 raft_consensus.cc:697] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [term 1 LEADER]: Becoming Leader. State: Replica: 854572a3bda640e7950a027df5378cdd, State: Running, Role: LEADER
I20260709 12:08:47.749383 17603 raft_consensus.cc:359] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.770602 17601 tablet_bootstrap.cc:654] T b4f614b23b964d519944544229c1cf98 P 2148f2bf702c4738a23fadb9df5f8e99: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.771059 17603 raft_consensus.cc:385] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.771426 17603 raft_consensus.cc:740] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 854572a3bda640e7950a027df5378cdd, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.772212 17603 consensus_queue.cc:260] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.774616 17603 ts_tablet_manager.cc:1434] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd: Time spent starting tablet: real 0.045s	user 0.004s	sys 0.000s
I20260709 12:08:47.775599 17603 tablet_bootstrap.cc:492] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd: Bootstrap starting.
I20260709 12:08:47.776834 17602 tablet_bootstrap.cc:492] T 6fdffb55b864444ba1e3539a24b9f729 P 290dc05c27f24fdf9873533e9b0f6445: No bootstrap required, opened a new log
I20260709 12:08:47.777441 17602 ts_tablet_manager.cc:1403] T 6fdffb55b864444ba1e3539a24b9f729 P 290dc05c27f24fdf9873533e9b0f6445: Time spent bootstrapping tablet: real 0.083s	user 0.019s	sys 0.035s
I20260709 12:08:47.765507 17646 consensus_queue.cc:237] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.778751 17310 catalog_manager.cc:5697] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194). New cstate: current_term: 1 leader_uuid: "2148f2bf702c4738a23fadb9df5f8e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:47.784580 17602 raft_consensus.cc:359] T 6fdffb55b864444ba1e3539a24b9f729 P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.785626 17602 raft_consensus.cc:385] T 6fdffb55b864444ba1e3539a24b9f729 P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.786031 17602 raft_consensus.cc:740] T 6fdffb55b864444ba1e3539a24b9f729 P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 290dc05c27f24fdf9873533e9b0f6445, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.787081 17602 consensus_queue.cc:260] T 6fdffb55b864444ba1e3539a24b9f729 P 290dc05c27f24fdf9873533e9b0f6445 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.787607 17308 catalog_manager.cc:5697] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd reported cstate change: term changed from 0 to 1, leader changed from <none> to 854572a3bda640e7950a027df5378cdd (127.16.98.193). New cstate: current_term: 1 leader_uuid: "854572a3bda640e7950a027df5378cdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:47.756062 17642 raft_consensus.cc:515] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.789801 17602 ts_tablet_manager.cc:1434] T 6fdffb55b864444ba1e3539a24b9f729 P 290dc05c27f24fdf9873533e9b0f6445: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:08:47.790746 17560 raft_consensus.cc:2468] T a81d098aae2c4871a507e0a1c48e006d P 290dc05c27f24fdf9873533e9b0f6445 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 854572a3bda640e7950a027df5378cdd in term 1.
I20260709 12:08:47.791951 17411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "349c94cc3eb84c8dbcf13222e8d85105" candidate_uuid: "2148f2bf702c4738a23fadb9df5f8e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "854572a3bda640e7950a027df5378cdd"
I20260709 12:08:47.792702 17622 raft_consensus.cc:493] T 6fdffb55b864444ba1e3539a24b9f729 P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.793198 17622 raft_consensus.cc:515] T 6fdffb55b864444ba1e3539a24b9f729 P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.795369 17622 leader_election.cc:290] T 6fdffb55b864444ba1e3539a24b9f729 P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181), 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635)
I20260709 12:08:47.796378 17487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fdffb55b864444ba1e3539a24b9f729" candidate_uuid: "290dc05c27f24fdf9873533e9b0f6445" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99" is_pre_election: true
I20260709 12:08:47.796726 17412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fdffb55b864444ba1e3539a24b9f729" candidate_uuid: "290dc05c27f24fdf9873533e9b0f6445" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "854572a3bda640e7950a027df5378cdd" is_pre_election: true
I20260709 12:08:47.796979 17487 raft_consensus.cc:2468] T 6fdffb55b864444ba1e3539a24b9f729 P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 290dc05c27f24fdf9873533e9b0f6445 in term 0.
I20260709 12:08:47.797343 17642 leader_election.cc:290] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99 [CANDIDATE]: Term 1 election: Requested vote from peers 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181), 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195:37765)
W20260709 12:08:47.798996 17527 leader_election.cc:343] T 6fdffb55b864444ba1e3539a24b9f729 P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.799404 17560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "349c94cc3eb84c8dbcf13222e8d85105" candidate_uuid: "2148f2bf702c4738a23fadb9df5f8e99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "290dc05c27f24fdf9873533e9b0f6445"
I20260709 12:08:47.800058 17560 raft_consensus.cc:3060] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:08:47.800563 17453 leader_election.cc:343] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.799901 17526 leader_election.cc:304] T 6fdffb55b864444ba1e3539a24b9f729 P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2148f2bf702c4738a23fadb9df5f8e99, 290dc05c27f24fdf9873533e9b0f6445; no voters: 854572a3bda640e7950a027df5378cdd
I20260709 12:08:47.802855 17603 tablet_bootstrap.cc:654] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.806808 17622 raft_consensus.cc:2804] T 6fdffb55b864444ba1e3539a24b9f729 P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:47.809062 17622 raft_consensus.cc:493] T 6fdffb55b864444ba1e3539a24b9f729 P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:47.809410 17622 raft_consensus.cc:3060] T 6fdffb55b864444ba1e3539a24b9f729 P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.809922 17601 tablet_bootstrap.cc:492] T b4f614b23b964d519944544229c1cf98 P 2148f2bf702c4738a23fadb9df5f8e99: No bootstrap required, opened a new log
I20260709 12:08:47.810359 17601 ts_tablet_manager.cc:1403] T b4f614b23b964d519944544229c1cf98 P 2148f2bf702c4738a23fadb9df5f8e99: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.018s
I20260709 12:08:47.807547 17560 raft_consensus.cc:2468] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2148f2bf702c4738a23fadb9df5f8e99 in term 1.
I20260709 12:08:47.811576 17450 leader_election.cc:304] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2148f2bf702c4738a23fadb9df5f8e99, 290dc05c27f24fdf9873533e9b0f6445; no voters: 854572a3bda640e7950a027df5378cdd
I20260709 12:08:47.811101 17310 catalog_manager.cc:5697] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd reported cstate change: term changed from 0 to 1, leader changed from <none> to 854572a3bda640e7950a027df5378cdd (127.16.98.193). New cstate: current_term: 1 leader_uuid: "854572a3bda640e7950a027df5378cdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:47.812685 17642 raft_consensus.cc:2804] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:47.813125 17642 raft_consensus.cc:697] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 LEADER]: Becoming Leader. State: Replica: 2148f2bf702c4738a23fadb9df5f8e99, State: Running, Role: LEADER
I20260709 12:08:47.812939 17601 raft_consensus.cc:359] T b4f614b23b964d519944544229c1cf98 P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.813582 17601 raft_consensus.cc:385] T b4f614b23b964d519944544229c1cf98 P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.813841 17601 raft_consensus.cc:740] T b4f614b23b964d519944544229c1cf98 P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2148f2bf702c4738a23fadb9df5f8e99, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.813894 17642 consensus_queue.cc:237] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.814616 17601 consensus_queue.cc:260] T b4f614b23b964d519944544229c1cf98 P 2148f2bf702c4738a23fadb9df5f8e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.815845 17622 raft_consensus.cc:515] T 6fdffb55b864444ba1e3539a24b9f729 P 290dc05c27f24fdf9873533e9b0f6445 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.817610 17601 ts_tablet_manager.cc:1434] T b4f614b23b964d519944544229c1cf98 P 2148f2bf702c4738a23fadb9df5f8e99: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:08:47.817809 17622 leader_election.cc:290] T 6fdffb55b864444ba1e3539a24b9f729 P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 1 election: Requested vote from peers 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181), 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635)
I20260709 12:08:47.818470 17411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fdffb55b864444ba1e3539a24b9f729" candidate_uuid: "290dc05c27f24fdf9873533e9b0f6445" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "854572a3bda640e7950a027df5378cdd"
W20260709 12:08:47.819896 17527 leader_election.cc:343] T 6fdffb55b864444ba1e3539a24b9f729 P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:08:47.820964 17603 tablet_bootstrap.cc:492] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd: No bootstrap required, opened a new log
I20260709 12:08:47.821075 17487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fdffb55b864444ba1e3539a24b9f729" candidate_uuid: "290dc05c27f24fdf9873533e9b0f6445" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99"
I20260709 12:08:47.821400 17603 ts_tablet_manager.cc:1403] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd: Time spent bootstrapping tablet: real 0.046s	user 0.006s	sys 0.007s
I20260709 12:08:47.821591 17487 raft_consensus.cc:3060] T 6fdffb55b864444ba1e3539a24b9f729 P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.824896 17603 raft_consensus.cc:359] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.825534 17603 raft_consensus.cc:385] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.825809 17603 raft_consensus.cc:740] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 854572a3bda640e7950a027df5378cdd, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.826457 17603 consensus_queue.cc:260] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.828359 17603 ts_tablet_manager.cc:1434] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:08:47.829008 17487 raft_consensus.cc:2468] T 6fdffb55b864444ba1e3539a24b9f729 P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 290dc05c27f24fdf9873533e9b0f6445 in term 1.
I20260709 12:08:47.829267 17603 tablet_bootstrap.cc:492] T b4f614b23b964d519944544229c1cf98 P 854572a3bda640e7950a027df5378cdd: Bootstrap starting.
I20260709 12:08:47.829082 17310 catalog_manager.cc:5697] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194). New cstate: current_term: 1 leader_uuid: "2148f2bf702c4738a23fadb9df5f8e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:47.830789 17526 leader_election.cc:304] T 6fdffb55b864444ba1e3539a24b9f729 P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2148f2bf702c4738a23fadb9df5f8e99, 290dc05c27f24fdf9873533e9b0f6445; no voters: 854572a3bda640e7950a027df5378cdd
I20260709 12:08:47.831533 17622 raft_consensus.cc:2804] T 6fdffb55b864444ba1e3539a24b9f729 P 290dc05c27f24fdf9873533e9b0f6445 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:47.831977 17622 raft_consensus.cc:697] T 6fdffb55b864444ba1e3539a24b9f729 P 290dc05c27f24fdf9873533e9b0f6445 [term 1 LEADER]: Becoming Leader. State: Replica: 290dc05c27f24fdf9873533e9b0f6445, State: Running, Role: LEADER
I20260709 12:08:47.832717 17622 consensus_queue.cc:237] T 6fdffb55b864444ba1e3539a24b9f729 P 290dc05c27f24fdf9873533e9b0f6445 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.835884 17603 tablet_bootstrap.cc:654] T b4f614b23b964d519944544229c1cf98 P 854572a3bda640e7950a027df5378cdd: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.840513 17646 raft_consensus.cc:493] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:47.840956 17603 tablet_bootstrap.cc:492] T b4f614b23b964d519944544229c1cf98 P 854572a3bda640e7950a027df5378cdd: No bootstrap required, opened a new log
I20260709 12:08:47.841459 17603 ts_tablet_manager.cc:1403] T b4f614b23b964d519944544229c1cf98 P 854572a3bda640e7950a027df5378cdd: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:08:47.841079 17308 catalog_manager.cc:5697] T 6fdffb55b864444ba1e3539a24b9f729 P 290dc05c27f24fdf9873533e9b0f6445 reported cstate change: term changed from 0 to 1, leader changed from <none> to 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "290dc05c27f24fdf9873533e9b0f6445" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:47.841010 17646 raft_consensus.cc:515] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.843971 17646 leader_election.cc:290] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635), 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195:37765)
I20260709 12:08:47.844347 17603 raft_consensus.cc:359] T b4f614b23b964d519944544229c1cf98 P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.844981 17603 raft_consensus.cc:385] T b4f614b23b964d519944544229c1cf98 P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.845238 17603 raft_consensus.cc:740] T b4f614b23b964d519944544229c1cf98 P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 854572a3bda640e7950a027df5378cdd, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.845330 17487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce29ffec4f0245cf8ebfd905f615b11d" candidate_uuid: "854572a3bda640e7950a027df5378cdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99" is_pre_election: true
I20260709 12:08:47.846325 17603 consensus_queue.cc:260] T b4f614b23b964d519944544229c1cf98 P 854572a3bda640e7950a027df5378cdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.846899 17560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce29ffec4f0245cf8ebfd905f615b11d" candidate_uuid: "854572a3bda640e7950a027df5378cdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "290dc05c27f24fdf9873533e9b0f6445" is_pre_election: true
I20260709 12:08:47.848418 17603 ts_tablet_manager.cc:1434] T b4f614b23b964d519944544229c1cf98 P 854572a3bda640e7950a027df5378cdd: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:08:47.846107 17487 raft_consensus.cc:2393] T ce29ffec4f0245cf8ebfd905f615b11d P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 854572a3bda640e7950a027df5378cdd in current term 1: Already voted for candidate 290dc05c27f24fdf9873533e9b0f6445 in this term.
I20260709 12:08:47.849316 17603 tablet_bootstrap.cc:492] T 6fdffb55b864444ba1e3539a24b9f729 P 854572a3bda640e7950a027df5378cdd: Bootstrap starting.
I20260709 12:08:47.849745 17377 leader_election.cc:304] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 854572a3bda640e7950a027df5378cdd; no voters: 2148f2bf702c4738a23fadb9df5f8e99, 290dc05c27f24fdf9873533e9b0f6445
I20260709 12:08:47.851089 17645 raft_consensus.cc:3060] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:47.855635 17603 tablet_bootstrap.cc:654] T 6fdffb55b864444ba1e3539a24b9f729 P 854572a3bda640e7950a027df5378cdd: Neither blocks nor log segments found. Creating new log.
I20260709 12:08:47.861241 17645 raft_consensus.cc:2749] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:47.863428 17603 tablet_bootstrap.cc:492] T 6fdffb55b864444ba1e3539a24b9f729 P 854572a3bda640e7950a027df5378cdd: No bootstrap required, opened a new log
I20260709 12:08:47.863665 17622 consensus_queue.cc:1048] T f854f3e731a84e6e9ade0adcad9a7e10 P 290dc05c27f24fdf9873533e9b0f6445 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:47.863869 17603 ts_tablet_manager.cc:1403] T 6fdffb55b864444ba1e3539a24b9f729 P 854572a3bda640e7950a027df5378cdd: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 12:08:47.866343 17603 raft_consensus.cc:359] T 6fdffb55b864444ba1e3539a24b9f729 P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.866897 17603 raft_consensus.cc:385] T 6fdffb55b864444ba1e3539a24b9f729 P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:08:47.867172 17603 raft_consensus.cc:740] T 6fdffb55b864444ba1e3539a24b9f729 P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 854572a3bda640e7950a027df5378cdd, State: Initialized, Role: FOLLOWER
I20260709 12:08:47.867810 17603 consensus_queue.cc:260] T 6fdffb55b864444ba1e3539a24b9f729 P 854572a3bda640e7950a027df5378cdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:47.869818 17603 ts_tablet_manager.cc:1434] T 6fdffb55b864444ba1e3539a24b9f729 P 854572a3bda640e7950a027df5378cdd: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
I20260709 12:08:47.885794 17624 consensus_queue.cc:1048] T f854f3e731a84e6e9ade0adcad9a7e10 P 290dc05c27f24fdf9873533e9b0f6445 [LEADER]: Connected to new peer: Peer: permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:47.985045 17624 consensus_queue.cc:1048] T abc0445a2776423098f7ba93cfe3e7f2 P 290dc05c27f24fdf9873533e9b0f6445 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:47.987617 17624 consensus_queue.cc:1048] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [LEADER]: Connected to new peer: Peer: permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:47.997416 17620 consensus_queue.cc:1048] T abc0445a2776423098f7ba93cfe3e7f2 P 290dc05c27f24fdf9873533e9b0f6445 [LEADER]: Connected to new peer: Peer: permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.011129 17608 raft_consensus.cc:493] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.011775 17608 raft_consensus.cc:515] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:48.015388 17411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eadcb8f48ad471599f2fe5c00f9c5fa" candidate_uuid: "290dc05c27f24fdf9873533e9b0f6445" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "854572a3bda640e7950a027df5378cdd" is_pre_election: true
I20260709 12:08:48.016142 17411 raft_consensus.cc:2393] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 854572a3bda640e7950a027df5378cdd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 290dc05c27f24fdf9873533e9b0f6445 in current term 1: Already voted for candidate 2148f2bf702c4738a23fadb9df5f8e99 in this term.
I20260709 12:08:48.016227 17608 leader_election.cc:290] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181), 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635)
I20260709 12:08:48.016909 17487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eadcb8f48ad471599f2fe5c00f9c5fa" candidate_uuid: "290dc05c27f24fdf9873533e9b0f6445" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99" is_pre_election: true
I20260709 12:08:48.018167 17526 leader_election.cc:304] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 290dc05c27f24fdf9873533e9b0f6445; no voters: 2148f2bf702c4738a23fadb9df5f8e99, 854572a3bda640e7950a027df5378cdd
I20260709 12:08:48.018931 17620 raft_consensus.cc:3060] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.020388 17622 consensus_queue.cc:1048] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.026049 17620 raft_consensus.cc:2749] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 290dc05c27f24fdf9873533e9b0f6445 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:48.227890 17645 raft_consensus.cc:493] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.228376 17645 raft_consensus.cc:515] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:48.230123 17645 leader_election.cc:290] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635), 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195:37765)
I20260709 12:08:48.230921 17486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "349c94cc3eb84c8dbcf13222e8d85105" candidate_uuid: "854572a3bda640e7950a027df5378cdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99" is_pre_election: true
I20260709 12:08:48.231168 17560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "349c94cc3eb84c8dbcf13222e8d85105" candidate_uuid: "854572a3bda640e7950a027df5378cdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "290dc05c27f24fdf9873533e9b0f6445" is_pre_election: true
I20260709 12:08:48.231881 17560 raft_consensus.cc:2393] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 854572a3bda640e7950a027df5378cdd in current term 1: Already voted for candidate 2148f2bf702c4738a23fadb9df5f8e99 in this term.
I20260709 12:08:48.232710 17375 leader_election.cc:304] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 854572a3bda640e7950a027df5378cdd; no voters: 2148f2bf702c4738a23fadb9df5f8e99, 290dc05c27f24fdf9873533e9b0f6445
I20260709 12:08:48.233336 17645 raft_consensus.cc:3060] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.237993 17645 raft_consensus.cc:2749] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:48.260238 17642 consensus_queue.cc:1048] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.267407 17645 raft_consensus.cc:493] T b4f614b23b964d519944544229c1cf98 P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.267998 17645 raft_consensus.cc:515] T b4f614b23b964d519944544229c1cf98 P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:48.269964 17645 leader_election.cc:290] T b4f614b23b964d519944544229c1cf98 P 854572a3bda640e7950a027df5378cdd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635), 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195:37765)
I20260709 12:08:48.270128 17635 consensus_queue.cc:1048] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.272315 17486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f614b23b964d519944544229c1cf98" candidate_uuid: "854572a3bda640e7950a027df5378cdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99" is_pre_election: true
I20260709 12:08:48.272917 17486 raft_consensus.cc:2468] T b4f614b23b964d519944544229c1cf98 P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 854572a3bda640e7950a027df5378cdd in term 0.
I20260709 12:08:48.274082 17377 leader_election.cc:304] T b4f614b23b964d519944544229c1cf98 P 854572a3bda640e7950a027df5378cdd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2148f2bf702c4738a23fadb9df5f8e99, 854572a3bda640e7950a027df5378cdd; no voters: 
I20260709 12:08:48.274935 17645 raft_consensus.cc:2804] T b4f614b23b964d519944544229c1cf98 P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:08:48.275048 17560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f614b23b964d519944544229c1cf98" candidate_uuid: "854572a3bda640e7950a027df5378cdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "290dc05c27f24fdf9873533e9b0f6445" is_pre_election: true
I20260709 12:08:48.275341 17645 raft_consensus.cc:493] T b4f614b23b964d519944544229c1cf98 P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:08:48.275720 17645 raft_consensus.cc:3060] T b4f614b23b964d519944544229c1cf98 P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.275816 17560 raft_consensus.cc:2468] T b4f614b23b964d519944544229c1cf98 P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 854572a3bda640e7950a027df5378cdd in term 0.
I20260709 12:08:48.282677 17646 raft_consensus.cc:493] T 6fdffb55b864444ba1e3539a24b9f729 P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:08:48.283159 17646 raft_consensus.cc:515] T 6fdffb55b864444ba1e3539a24b9f729 P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:48.284691 17645 raft_consensus.cc:515] T b4f614b23b964d519944544229c1cf98 P 854572a3bda640e7950a027df5378cdd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:48.285172 17646 leader_election.cc:290] T 6fdffb55b864444ba1e3539a24b9f729 P 854572a3bda640e7950a027df5378cdd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635), 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195:37765)
I20260709 12:08:48.286187 17560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fdffb55b864444ba1e3539a24b9f729" candidate_uuid: "854572a3bda640e7950a027df5378cdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "290dc05c27f24fdf9873533e9b0f6445" is_pre_election: true
I20260709 12:08:48.286706 17645 leader_election.cc:290] T b4f614b23b964d519944544229c1cf98 P 854572a3bda640e7950a027df5378cdd [CANDIDATE]: Term 1 election: Requested vote from peers 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635), 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195:37765)
I20260709 12:08:48.287565 17486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fdffb55b864444ba1e3539a24b9f729" candidate_uuid: "854572a3bda640e7950a027df5378cdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99" is_pre_election: true
I20260709 12:08:48.287824 17487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f614b23b964d519944544229c1cf98" candidate_uuid: "854572a3bda640e7950a027df5378cdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99"
I20260709 12:08:48.287998 17560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f614b23b964d519944544229c1cf98" candidate_uuid: "854572a3bda640e7950a027df5378cdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "290dc05c27f24fdf9873533e9b0f6445"
I20260709 12:08:48.288293 17486 raft_consensus.cc:2393] T 6fdffb55b864444ba1e3539a24b9f729 P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 854572a3bda640e7950a027df5378cdd in current term 1: Already voted for candidate 290dc05c27f24fdf9873533e9b0f6445 in this term.
I20260709 12:08:48.288398 17487 raft_consensus.cc:3060] T b4f614b23b964d519944544229c1cf98 P 2148f2bf702c4738a23fadb9df5f8e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.288456 17560 raft_consensus.cc:3060] T b4f614b23b964d519944544229c1cf98 P 290dc05c27f24fdf9873533e9b0f6445 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.291355 17377 leader_election.cc:304] T 6fdffb55b864444ba1e3539a24b9f729 P 854572a3bda640e7950a027df5378cdd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 854572a3bda640e7950a027df5378cdd; no voters: 2148f2bf702c4738a23fadb9df5f8e99, 290dc05c27f24fdf9873533e9b0f6445
I20260709 12:08:48.292446 17645 raft_consensus.cc:3060] T 6fdffb55b864444ba1e3539a24b9f729 P 854572a3bda640e7950a027df5378cdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:08:48.296720 17560 raft_consensus.cc:2468] T b4f614b23b964d519944544229c1cf98 P 290dc05c27f24fdf9873533e9b0f6445 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 854572a3bda640e7950a027df5378cdd in term 1.
I20260709 12:08:48.297960 17375 leader_election.cc:304] T b4f614b23b964d519944544229c1cf98 P 854572a3bda640e7950a027df5378cdd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 290dc05c27f24fdf9873533e9b0f6445, 854572a3bda640e7950a027df5378cdd; no voters: 
I20260709 12:08:48.298260 17635 consensus_queue.cc:1048] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.299103 17645 raft_consensus.cc:2749] T 6fdffb55b864444ba1e3539a24b9f729 P 854572a3bda640e7950a027df5378cdd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:08:48.299176 17646 raft_consensus.cc:2804] T b4f614b23b964d519944544229c1cf98 P 854572a3bda640e7950a027df5378cdd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:08:48.300555 17646 raft_consensus.cc:697] T b4f614b23b964d519944544229c1cf98 P 854572a3bda640e7950a027df5378cdd [term 1 LEADER]: Becoming Leader. State: Replica: 854572a3bda640e7950a027df5378cdd, State: Running, Role: LEADER
I20260709 12:08:48.301357 17646 consensus_queue.cc:237] T b4f614b23b964d519944544229c1cf98 P 854572a3bda640e7950a027df5378cdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:48.301653 17487 raft_consensus.cc:2468] T b4f614b23b964d519944544229c1cf98 P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 854572a3bda640e7950a027df5378cdd in term 1.
I20260709 12:08:48.303882 17641 consensus_queue.cc:1048] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.304527 17635 consensus_queue.cc:1048] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.317258 17308 catalog_manager.cc:5697] T b4f614b23b964d519944544229c1cf98 P 854572a3bda640e7950a027df5378cdd reported cstate change: term changed from 0 to 1, leader changed from <none> to 854572a3bda640e7950a027df5378cdd (127.16.98.193). New cstate: current_term: 1 leader_uuid: "854572a3bda640e7950a027df5378cdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.327067 17642 consensus_queue.cc:1048] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.343537 17645 consensus_queue.cc:1048] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.345283 17645 consensus_queue.cc:1048] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.364534 17645 consensus_queue.cc:1048] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:08:48.379688 17645 consensus_queue.cc:1048] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.418085 17560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "abc0445a2776423098f7ba93cfe3e7f2"
dest_uuid: "290dc05c27f24fdf9873533e9b0f6445"
mode: GRACEFUL
new_leader_uuid: "854572a3bda640e7950a027df5378cdd"
 from {username='slave'} at 127.0.0.1:60222
I20260709 12:08:48.418601 17560 raft_consensus.cc:606] T abc0445a2776423098f7ba93cfe3e7f2 P 290dc05c27f24fdf9873533e9b0f6445 [term 1 LEADER]: Received request to transfer leadership to TS 854572a3bda640e7950a027df5378cdd
I20260709 12:08:48.423362 17560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f854f3e731a84e6e9ade0adcad9a7e10"
dest_uuid: "290dc05c27f24fdf9873533e9b0f6445"
mode: GRACEFUL
new_leader_uuid: "854572a3bda640e7950a027df5378cdd"
 from {username='slave'} at 127.0.0.1:60222
I20260709 12:08:48.423784 17560 raft_consensus.cc:606] T f854f3e731a84e6e9ade0adcad9a7e10 P 290dc05c27f24fdf9873533e9b0f6445 [term 1 LEADER]: Received request to transfer leadership to TS 854572a3bda640e7950a027df5378cdd
I20260709 12:08:48.435379 17487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "349c94cc3eb84c8dbcf13222e8d85105"
dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99"
mode: GRACEFUL
new_leader_uuid: "854572a3bda640e7950a027df5378cdd"
 from {username='slave'} at 127.0.0.1:54476
I20260709 12:08:48.435806 17487 raft_consensus.cc:606] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 LEADER]: Received request to transfer leadership to TS 854572a3bda640e7950a027df5378cdd
I20260709 12:08:48.440274 17487 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04e015de4bdc40b893cb59db8d999cbd"
dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99"
mode: GRACEFUL
new_leader_uuid: "854572a3bda640e7950a027df5378cdd"
 from {username='slave'} at 127.0.0.1:54476
I20260709 12:08:48.440712 17487 raft_consensus.cc:606] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 LEADER]: Received request to transfer leadership to TS 854572a3bda640e7950a027df5378cdd
I20260709 12:08:48.445324 17560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce29ffec4f0245cf8ebfd905f615b11d"
dest_uuid: "290dc05c27f24fdf9873533e9b0f6445"
mode: GRACEFUL
new_leader_uuid: "854572a3bda640e7950a027df5378cdd"
 from {username='slave'} at 127.0.0.1:60222
I20260709 12:08:48.445946 17624 consensus_queue.cc:1048] T 6fdffb55b864444ba1e3539a24b9f729 P 290dc05c27f24fdf9873533e9b0f6445 [LEADER]: Connected to new peer: Peer: permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.446262 17560 raft_consensus.cc:606] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [term 1 LEADER]: Received request to transfer leadership to TS 854572a3bda640e7950a027df5378cdd
I20260709 12:08:48.447362 17624 consensus_queue.cc:1048] T 6fdffb55b864444ba1e3539a24b9f729 P 290dc05c27f24fdf9873533e9b0f6445 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.481329 17411 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a81d098aae2c4871a507e0a1c48e006d"
dest_uuid: "854572a3bda640e7950a027df5378cdd"
mode: GRACEFUL
new_leader_uuid: "2148f2bf702c4738a23fadb9df5f8e99"
 from {username='slave'} at 127.0.0.1:41134
I20260709 12:08:48.481950 17411 raft_consensus.cc:606] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [term 1 LEADER]: Received request to transfer leadership to TS 2148f2bf702c4738a23fadb9df5f8e99
I20260709 12:08:48.487059 17411 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "556c7c2480ef40c5adfaa946e5d95c8b"
dest_uuid: "854572a3bda640e7950a027df5378cdd"
mode: GRACEFUL
new_leader_uuid: "2148f2bf702c4738a23fadb9df5f8e99"
 from {username='slave'} at 127.0.0.1:41134
I20260709 12:08:48.487522 17411 raft_consensus.cc:606] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [term 1 LEADER]: Received request to transfer leadership to TS 2148f2bf702c4738a23fadb9df5f8e99
I20260709 12:08:48.493979 17560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6fdffb55b864444ba1e3539a24b9f729"
dest_uuid: "290dc05c27f24fdf9873533e9b0f6445"
mode: GRACEFUL
new_leader_uuid: "2148f2bf702c4738a23fadb9df5f8e99"
 from {username='slave'} at 127.0.0.1:60222
I20260709 12:08:48.494410 17560 raft_consensus.cc:606] T 6fdffb55b864444ba1e3539a24b9f729 P 290dc05c27f24fdf9873533e9b0f6445 [term 1 LEADER]: Received request to transfer leadership to TS 2148f2bf702c4738a23fadb9df5f8e99
I20260709 12:08:48.498544 17411 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4f614b23b964d519944544229c1cf98"
dest_uuid: "854572a3bda640e7950a027df5378cdd"
mode: GRACEFUL
new_leader_uuid: "290dc05c27f24fdf9873533e9b0f6445"
 from {username='slave'} at 127.0.0.1:41134
I20260709 12:08:48.499051 17411 raft_consensus.cc:606] T b4f614b23b964d519944544229c1cf98 P 854572a3bda640e7950a027df5378cdd [term 1 LEADER]: Received request to transfer leadership to TS 290dc05c27f24fdf9873533e9b0f6445
I20260709 12:08:48.510746 17622 raft_consensus.cc:993] T abc0445a2776423098f7ba93cfe3e7f2 P 290dc05c27f24fdf9873533e9b0f6445: : Instructing follower 854572a3bda640e7950a027df5378cdd to start an election
I20260709 12:08:48.511243 17624 raft_consensus.cc:1081] T abc0445a2776423098f7ba93cfe3e7f2 P 290dc05c27f24fdf9873533e9b0f6445 [term 1 LEADER]: Signalling peer 854572a3bda640e7950a027df5378cdd to start an election
I20260709 12:08:48.512651 17411 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "abc0445a2776423098f7ba93cfe3e7f2"
dest_uuid: "854572a3bda640e7950a027df5378cdd"
 from {username='slave'} at 127.0.0.1:41116
I20260709 12:08:48.513128 17411 raft_consensus.cc:493] T abc0445a2776423098f7ba93cfe3e7f2 P 854572a3bda640e7950a027df5378cdd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:48.513427 17411 raft_consensus.cc:3060] T abc0445a2776423098f7ba93cfe3e7f2 P 854572a3bda640e7950a027df5378cdd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.517910 17411 raft_consensus.cc:515] T abc0445a2776423098f7ba93cfe3e7f2 P 854572a3bda640e7950a027df5378cdd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } } peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } }
I20260709 12:08:48.519484 17411 leader_election.cc:290] T abc0445a2776423098f7ba93cfe3e7f2 P 854572a3bda640e7950a027df5378cdd [CANDIDATE]: Term 2 election: Requested vote from peers 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635), 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195:37765)
I20260709 12:08:48.520121 17486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc0445a2776423098f7ba93cfe3e7f2" candidate_uuid: "854572a3bda640e7950a027df5378cdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99"
I20260709 12:08:48.520419 17560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abc0445a2776423098f7ba93cfe3e7f2" candidate_uuid: "854572a3bda640e7950a027df5378cdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "290dc05c27f24fdf9873533e9b0f6445"
I20260709 12:08:48.520700 17486 raft_consensus.cc:3060] T abc0445a2776423098f7ba93cfe3e7f2 P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.520967 17560 raft_consensus.cc:3055] T abc0445a2776423098f7ba93cfe3e7f2 P 290dc05c27f24fdf9873533e9b0f6445 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:48.521310 17560 raft_consensus.cc:740] T abc0445a2776423098f7ba93cfe3e7f2 P 290dc05c27f24fdf9873533e9b0f6445 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 290dc05c27f24fdf9873533e9b0f6445, State: Running, Role: LEADER
I20260709 12:08:48.522081 17560 consensus_queue.cc:260] T abc0445a2776423098f7ba93cfe3e7f2 P 290dc05c27f24fdf9873533e9b0f6445 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } } peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } }
I20260709 12:08:48.523288 17560 raft_consensus.cc:3060] T abc0445a2776423098f7ba93cfe3e7f2 P 290dc05c27f24fdf9873533e9b0f6445 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.527369 17486 raft_consensus.cc:2468] T abc0445a2776423098f7ba93cfe3e7f2 P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 854572a3bda640e7950a027df5378cdd in term 2.
I20260709 12:08:48.528561 17377 leader_election.cc:304] T abc0445a2776423098f7ba93cfe3e7f2 P 854572a3bda640e7950a027df5378cdd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2148f2bf702c4738a23fadb9df5f8e99, 854572a3bda640e7950a027df5378cdd; no voters: 
I20260709 12:08:48.529212 17679 raft_consensus.cc:2804] T abc0445a2776423098f7ba93cfe3e7f2 P 854572a3bda640e7950a027df5378cdd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:48.529305 17560 raft_consensus.cc:2468] T abc0445a2776423098f7ba93cfe3e7f2 P 290dc05c27f24fdf9873533e9b0f6445 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 854572a3bda640e7950a027df5378cdd in term 2.
I20260709 12:08:48.529609 17679 raft_consensus.cc:697] T abc0445a2776423098f7ba93cfe3e7f2 P 854572a3bda640e7950a027df5378cdd [term 2 LEADER]: Becoming Leader. State: Replica: 854572a3bda640e7950a027df5378cdd, State: Running, Role: LEADER
I20260709 12:08:48.530454 17679 consensus_queue.cc:237] T abc0445a2776423098f7ba93cfe3e7f2 P 854572a3bda640e7950a027df5378cdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } } peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } }
I20260709 12:08:48.536913 17307 catalog_manager.cc:5697] T abc0445a2776423098f7ba93cfe3e7f2 P 854572a3bda640e7950a027df5378cdd reported cstate change: term changed from 1 to 2, leader changed from 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195) to 854572a3bda640e7950a027df5378cdd (127.16.98.193). New cstate: current_term: 2 leader_uuid: "854572a3bda640e7950a027df5378cdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:48.600409 17622 raft_consensus.cc:993] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445: : Instructing follower 854572a3bda640e7950a027df5378cdd to start an election
I20260709 12:08:48.600863 17624 raft_consensus.cc:1081] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [term 1 LEADER]: Signalling peer 854572a3bda640e7950a027df5378cdd to start an election
I20260709 12:08:48.602180 17411 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce29ffec4f0245cf8ebfd905f615b11d"
dest_uuid: "854572a3bda640e7950a027df5378cdd"
 from {username='slave'} at 127.0.0.1:41116
I20260709 12:08:48.602669 17411 raft_consensus.cc:493] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:48.602973 17411 raft_consensus.cc:3060] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.607313 17411 raft_consensus.cc:515] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:48.608930 17411 leader_election.cc:290] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [CANDIDATE]: Term 2 election: Requested vote from peers 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635), 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195:37765)
I20260709 12:08:48.609788 17486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce29ffec4f0245cf8ebfd905f615b11d" candidate_uuid: "854572a3bda640e7950a027df5378cdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99"
I20260709 12:08:48.610028 17560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce29ffec4f0245cf8ebfd905f615b11d" candidate_uuid: "854572a3bda640e7950a027df5378cdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "290dc05c27f24fdf9873533e9b0f6445"
I20260709 12:08:48.610284 17486 raft_consensus.cc:3060] T ce29ffec4f0245cf8ebfd905f615b11d P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.610592 17560 raft_consensus.cc:3055] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:48.610939 17560 raft_consensus.cc:740] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 290dc05c27f24fdf9873533e9b0f6445, State: Running, Role: LEADER
I20260709 12:08:48.611642 17560 consensus_queue.cc:260] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:48.612495 17560 raft_consensus.cc:3060] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.614850 17486 raft_consensus.cc:2468] T ce29ffec4f0245cf8ebfd905f615b11d P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 854572a3bda640e7950a027df5378cdd in term 2.
I20260709 12:08:48.615819 17377 leader_election.cc:304] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2148f2bf702c4738a23fadb9df5f8e99, 854572a3bda640e7950a027df5378cdd; no voters: 
I20260709 12:08:48.616590 17679 raft_consensus.cc:2804] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:48.616999 17679 raft_consensus.cc:697] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [term 2 LEADER]: Becoming Leader. State: Replica: 854572a3bda640e7950a027df5378cdd, State: Running, Role: LEADER
I20260709 12:08:48.617216 17560 raft_consensus.cc:2468] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 854572a3bda640e7950a027df5378cdd in term 2.
I20260709 12:08:48.617801 17679 consensus_queue.cc:237] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:48.624400 17307 catalog_manager.cc:5697] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd reported cstate change: term changed from 1 to 2, leader changed from 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195) to 854572a3bda640e7950a027df5378cdd (127.16.98.193). New cstate: current_term: 2 leader_uuid: "854572a3bda640e7950a027df5378cdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.712319 17622 raft_consensus.cc:993] T f854f3e731a84e6e9ade0adcad9a7e10 P 290dc05c27f24fdf9873533e9b0f6445: : Instructing follower 854572a3bda640e7950a027df5378cdd to start an election
I20260709 12:08:48.712757 17624 raft_consensus.cc:1081] T f854f3e731a84e6e9ade0adcad9a7e10 P 290dc05c27f24fdf9873533e9b0f6445 [term 1 LEADER]: Signalling peer 854572a3bda640e7950a027df5378cdd to start an election
I20260709 12:08:48.714032 17411 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f854f3e731a84e6e9ade0adcad9a7e10"
dest_uuid: "854572a3bda640e7950a027df5378cdd"
 from {username='slave'} at 127.0.0.1:41116
I20260709 12:08:48.714511 17411 raft_consensus.cc:493] T f854f3e731a84e6e9ade0adcad9a7e10 P 854572a3bda640e7950a027df5378cdd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:48.714872 17411 raft_consensus.cc:3060] T f854f3e731a84e6e9ade0adcad9a7e10 P 854572a3bda640e7950a027df5378cdd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.719365 17411 raft_consensus.cc:515] T f854f3e731a84e6e9ade0adcad9a7e10 P 854572a3bda640e7950a027df5378cdd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:48.720846 17411 leader_election.cc:290] T f854f3e731a84e6e9ade0adcad9a7e10 P 854572a3bda640e7950a027df5378cdd [CANDIDATE]: Term 2 election: Requested vote from peers 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635), 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195:37765)
I20260709 12:08:48.721704 17486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f854f3e731a84e6e9ade0adcad9a7e10" candidate_uuid: "854572a3bda640e7950a027df5378cdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99"
I20260709 12:08:48.721877 17560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f854f3e731a84e6e9ade0adcad9a7e10" candidate_uuid: "854572a3bda640e7950a027df5378cdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "290dc05c27f24fdf9873533e9b0f6445"
I20260709 12:08:48.722296 17486 raft_consensus.cc:3060] T f854f3e731a84e6e9ade0adcad9a7e10 P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.722350 17560 raft_consensus.cc:3055] T f854f3e731a84e6e9ade0adcad9a7e10 P 290dc05c27f24fdf9873533e9b0f6445 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:48.722851 17560 raft_consensus.cc:740] T f854f3e731a84e6e9ade0adcad9a7e10 P 290dc05c27f24fdf9873533e9b0f6445 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 290dc05c27f24fdf9873533e9b0f6445, State: Running, Role: LEADER
I20260709 12:08:48.723769 17560 consensus_queue.cc:260] T f854f3e731a84e6e9ade0adcad9a7e10 P 290dc05c27f24fdf9873533e9b0f6445 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:48.725077 17560 raft_consensus.cc:3060] T f854f3e731a84e6e9ade0adcad9a7e10 P 290dc05c27f24fdf9873533e9b0f6445 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.730260 17486 raft_consensus.cc:2468] T f854f3e731a84e6e9ade0adcad9a7e10 P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 854572a3bda640e7950a027df5378cdd in term 2.
I20260709 12:08:48.731384 17560 raft_consensus.cc:2468] T f854f3e731a84e6e9ade0adcad9a7e10 P 290dc05c27f24fdf9873533e9b0f6445 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 854572a3bda640e7950a027df5378cdd in term 2.
I20260709 12:08:48.731417 17377 leader_election.cc:304] T f854f3e731a84e6e9ade0adcad9a7e10 P 854572a3bda640e7950a027df5378cdd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2148f2bf702c4738a23fadb9df5f8e99, 854572a3bda640e7950a027df5378cdd; no voters: 
I20260709 12:08:48.732218 17679 raft_consensus.cc:2804] T f854f3e731a84e6e9ade0adcad9a7e10 P 854572a3bda640e7950a027df5378cdd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:48.732678 17679 raft_consensus.cc:697] T f854f3e731a84e6e9ade0adcad9a7e10 P 854572a3bda640e7950a027df5378cdd [term 2 LEADER]: Becoming Leader. State: Replica: 854572a3bda640e7950a027df5378cdd, State: Running, Role: LEADER
I20260709 12:08:48.733361 17679 consensus_queue.cc:237] T f854f3e731a84e6e9ade0adcad9a7e10 P 854572a3bda640e7950a027df5378cdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:48.739334 17307 catalog_manager.cc:5697] T f854f3e731a84e6e9ade0adcad9a7e10 P 854572a3bda640e7950a027df5378cdd reported cstate change: term changed from 1 to 2, leader changed from 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195) to 854572a3bda640e7950a027df5378cdd (127.16.98.193). New cstate: current_term: 2 leader_uuid: "854572a3bda640e7950a027df5378cdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.759927 17679 consensus_queue.cc:1048] T b4f614b23b964d519944544229c1cf98 P 854572a3bda640e7950a027df5378cdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.771183 17646 consensus_queue.cc:1048] T b4f614b23b964d519944544229c1cf98 P 854572a3bda640e7950a027df5378cdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:08:48.779875 17645 raft_consensus.cc:993] T b4f614b23b964d519944544229c1cf98 P 854572a3bda640e7950a027df5378cdd: : Instructing follower 290dc05c27f24fdf9873533e9b0f6445 to start an election
I20260709 12:08:48.780372 17646 raft_consensus.cc:1081] T b4f614b23b964d519944544229c1cf98 P 854572a3bda640e7950a027df5378cdd [term 1 LEADER]: Signalling peer 290dc05c27f24fdf9873533e9b0f6445 to start an election
I20260709 12:08:48.781862 17561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4f614b23b964d519944544229c1cf98"
dest_uuid: "290dc05c27f24fdf9873533e9b0f6445"
 from {username='slave'} at 127.0.0.1:60214
I20260709 12:08:48.782310 17561 raft_consensus.cc:493] T b4f614b23b964d519944544229c1cf98 P 290dc05c27f24fdf9873533e9b0f6445 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:48.782612 17561 raft_consensus.cc:3060] T b4f614b23b964d519944544229c1cf98 P 290dc05c27f24fdf9873533e9b0f6445 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.787190 17645 raft_consensus.cc:993] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd: : Instructing follower 2148f2bf702c4738a23fadb9df5f8e99 to start an election
I20260709 12:08:48.787597 17646 raft_consensus.cc:1081] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [term 1 LEADER]: Signalling peer 2148f2bf702c4738a23fadb9df5f8e99 to start an election
I20260709 12:08:48.787731 17561 raft_consensus.cc:515] T b4f614b23b964d519944544229c1cf98 P 290dc05c27f24fdf9873533e9b0f6445 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:48.789101 17486 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "556c7c2480ef40c5adfaa946e5d95c8b"
dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99"
 from {username='slave'} at 127.0.0.1:54470
I20260709 12:08:48.789546 17486 raft_consensus.cc:493] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:48.789877 17486 raft_consensus.cc:3060] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.790494 17411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f614b23b964d519944544229c1cf98" candidate_uuid: "290dc05c27f24fdf9873533e9b0f6445" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "854572a3bda640e7950a027df5378cdd"
I20260709 12:08:48.791098 17411 raft_consensus.cc:3055] T b4f614b23b964d519944544229c1cf98 P 854572a3bda640e7950a027df5378cdd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:48.791186 17487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4f614b23b964d519944544229c1cf98" candidate_uuid: "290dc05c27f24fdf9873533e9b0f6445" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99"
I20260709 12:08:48.791442 17411 raft_consensus.cc:740] T b4f614b23b964d519944544229c1cf98 P 854572a3bda640e7950a027df5378cdd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 854572a3bda640e7950a027df5378cdd, State: Running, Role: LEADER
I20260709 12:08:48.791764 17487 raft_consensus.cc:3060] T b4f614b23b964d519944544229c1cf98 P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.792207 17411 consensus_queue.cc:260] T b4f614b23b964d519944544229c1cf98 P 854572a3bda640e7950a027df5378cdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:48.793274 17411 raft_consensus.cc:3060] T b4f614b23b964d519944544229c1cf98 P 854572a3bda640e7950a027df5378cdd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.796536 17486 raft_consensus.cc:515] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:48.798677 17486 leader_election.cc:290] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 [CANDIDATE]: Term 2 election: Requested vote from peers 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181), 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195:37765)
I20260709 12:08:48.801190 17559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556c7c2480ef40c5adfaa946e5d95c8b" candidate_uuid: "2148f2bf702c4738a23fadb9df5f8e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "290dc05c27f24fdf9873533e9b0f6445"
I20260709 12:08:48.801553 17411 raft_consensus.cc:2468] T b4f614b23b964d519944544229c1cf98 P 854572a3bda640e7950a027df5378cdd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 290dc05c27f24fdf9873533e9b0f6445 in term 2.
I20260709 12:08:48.801777 17559 raft_consensus.cc:3060] T 556c7c2480ef40c5adfaa946e5d95c8b P 290dc05c27f24fdf9873533e9b0f6445 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.803340 17527 leader_election.cc:304] T b4f614b23b964d519944544229c1cf98 P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 290dc05c27f24fdf9873533e9b0f6445, 854572a3bda640e7950a027df5378cdd; no voters: 
I20260709 12:08:48.803949 17624 raft_consensus.cc:2804] T b4f614b23b964d519944544229c1cf98 P 290dc05c27f24fdf9873533e9b0f6445 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:48.804327 17624 raft_consensus.cc:697] T b4f614b23b964d519944544229c1cf98 P 290dc05c27f24fdf9873533e9b0f6445 [term 2 LEADER]: Becoming Leader. State: Replica: 290dc05c27f24fdf9873533e9b0f6445, State: Running, Role: LEADER
I20260709 12:08:48.805063 17624 consensus_queue.cc:237] T b4f614b23b964d519944544229c1cf98 P 290dc05c27f24fdf9873533e9b0f6445 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:48.808439 17411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556c7c2480ef40c5adfaa946e5d95c8b" candidate_uuid: "2148f2bf702c4738a23fadb9df5f8e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "854572a3bda640e7950a027df5378cdd"
I20260709 12:08:48.809016 17411 raft_consensus.cc:3055] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:48.809331 17411 raft_consensus.cc:740] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 854572a3bda640e7950a027df5378cdd, State: Running, Role: LEADER
I20260709 12:08:48.810101 17411 consensus_queue.cc:260] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:48.811327 17411 raft_consensus.cc:3060] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.811796 17675 raft_consensus.cc:993] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99: : Instructing follower 854572a3bda640e7950a027df5378cdd to start an election
I20260709 12:08:48.812227 17675 raft_consensus.cc:1081] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 LEADER]: Signalling peer 854572a3bda640e7950a027df5378cdd to start an election
I20260709 12:08:48.812888 17635 raft_consensus.cc:993] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99: : Instructing follower 854572a3bda640e7950a027df5378cdd to start an election
I20260709 12:08:48.813289 17635 raft_consensus.cc:1081] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 LEADER]: Signalling peer 854572a3bda640e7950a027df5378cdd to start an election
I20260709 12:08:48.812224 17307 catalog_manager.cc:5697] T b4f614b23b964d519944544229c1cf98 P 290dc05c27f24fdf9873533e9b0f6445 reported cstate change: term changed from 1 to 2, leader changed from 854572a3bda640e7950a027df5378cdd (127.16.98.193) to 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195). New cstate: current_term: 2 leader_uuid: "290dc05c27f24fdf9873533e9b0f6445" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:48.815150 17410 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04e015de4bdc40b893cb59db8d999cbd"
dest_uuid: "854572a3bda640e7950a027df5378cdd"
 from {username='slave'} at 127.0.0.1:41118
I20260709 12:08:48.815459 17412 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "349c94cc3eb84c8dbcf13222e8d85105"
dest_uuid: "854572a3bda640e7950a027df5378cdd"
 from {username='slave'} at 127.0.0.1:41118
I20260709 12:08:48.815686 17410 raft_consensus.cc:493] T 04e015de4bdc40b893cb59db8d999cbd P 854572a3bda640e7950a027df5378cdd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:48.815975 17412 raft_consensus.cc:493] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:48.816039 17410 raft_consensus.cc:3060] T 04e015de4bdc40b893cb59db8d999cbd P 854572a3bda640e7950a027df5378cdd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.816388 17412 raft_consensus.cc:3060] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.818001 17411 raft_consensus.cc:2468] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2148f2bf702c4738a23fadb9df5f8e99 in term 2.
I20260709 12:08:48.819129 17453 leader_election.cc:304] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2148f2bf702c4738a23fadb9df5f8e99, 854572a3bda640e7950a027df5378cdd; no voters: 
I20260709 12:08:48.819814 17675 raft_consensus.cc:2804] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:48.820250 17675 raft_consensus.cc:697] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 LEADER]: Becoming Leader. State: Replica: 2148f2bf702c4738a23fadb9df5f8e99, State: Running, Role: LEADER
I20260709 12:08:48.821010 17675 consensus_queue.cc:237] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:48.822984 17559 raft_consensus.cc:2468] T 556c7c2480ef40c5adfaa946e5d95c8b P 290dc05c27f24fdf9873533e9b0f6445 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2148f2bf702c4738a23fadb9df5f8e99 in term 2.
I20260709 12:08:48.826099 17487 raft_consensus.cc:2468] T b4f614b23b964d519944544229c1cf98 P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 290dc05c27f24fdf9873533e9b0f6445 in term 2.
I20260709 12:08:48.826253 17410 raft_consensus.cc:515] T 04e015de4bdc40b893cb59db8d999cbd P 854572a3bda640e7950a027df5378cdd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:48.827975 17310 catalog_manager.cc:5697] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 reported cstate change: term changed from 1 to 2, leader changed from 854572a3bda640e7950a027df5378cdd (127.16.98.193) to 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194). New cstate: current_term: 2 leader_uuid: "2148f2bf702c4738a23fadb9df5f8e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.828192 17412 raft_consensus.cc:515] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:48.829878 17410 leader_election.cc:290] T 04e015de4bdc40b893cb59db8d999cbd P 854572a3bda640e7950a027df5378cdd [CANDIDATE]: Term 2 election: Requested vote from peers 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635), 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195:37765)
I20260709 12:08:48.829972 17560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e015de4bdc40b893cb59db8d999cbd" candidate_uuid: "854572a3bda640e7950a027df5378cdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "290dc05c27f24fdf9873533e9b0f6445"
I20260709 12:08:48.831120 17487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e015de4bdc40b893cb59db8d999cbd" candidate_uuid: "854572a3bda640e7950a027df5378cdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99"
I20260709 12:08:48.831575 17487 raft_consensus.cc:3055] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:48.831785 17487 raft_consensus.cc:740] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2148f2bf702c4738a23fadb9df5f8e99, State: Running, Role: LEADER
I20260709 12:08:48.832538 17487 consensus_queue.cc:260] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:48.833703 17487 raft_consensus.cc:3060] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.838308 17487 raft_consensus.cc:2468] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 854572a3bda640e7950a027df5378cdd in term 2.
I20260709 12:08:48.830538 17560 raft_consensus.cc:3060] T 04e015de4bdc40b893cb59db8d999cbd P 290dc05c27f24fdf9873533e9b0f6445 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.838798 17561 leader_election.cc:290] T b4f614b23b964d519944544229c1cf98 P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 2 election: Requested vote from peers 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181), 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635)
I20260709 12:08:48.839495 17377 leader_election.cc:304] T 04e015de4bdc40b893cb59db8d999cbd P 854572a3bda640e7950a027df5378cdd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2148f2bf702c4738a23fadb9df5f8e99, 854572a3bda640e7950a027df5378cdd; no voters: 
I20260709 12:08:48.839919 17486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "349c94cc3eb84c8dbcf13222e8d85105" candidate_uuid: "854572a3bda640e7950a027df5378cdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99"
I20260709 12:08:48.840302 17646 raft_consensus.cc:2804] T 04e015de4bdc40b893cb59db8d999cbd P 854572a3bda640e7950a027df5378cdd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:48.840471 17486 raft_consensus.cc:3055] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:48.840778 17646 raft_consensus.cc:697] T 04e015de4bdc40b893cb59db8d999cbd P 854572a3bda640e7950a027df5378cdd [term 2 LEADER]: Becoming Leader. State: Replica: 854572a3bda640e7950a027df5378cdd, State: Running, Role: LEADER
I20260709 12:08:48.840827 17486 raft_consensus.cc:740] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2148f2bf702c4738a23fadb9df5f8e99, State: Running, Role: LEADER
I20260709 12:08:48.841758 17561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "349c94cc3eb84c8dbcf13222e8d85105" candidate_uuid: "854572a3bda640e7950a027df5378cdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "290dc05c27f24fdf9873533e9b0f6445"
I20260709 12:08:48.841701 17646 consensus_queue.cc:237] T 04e015de4bdc40b893cb59db8d999cbd P 854572a3bda640e7950a027df5378cdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:48.841718 17486 consensus_queue.cc:260] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:48.842726 17412 leader_election.cc:290] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [CANDIDATE]: Term 2 election: Requested vote from peers 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635), 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195:37765)
I20260709 12:08:48.843055 17486 raft_consensus.cc:3060] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.842381 17561 raft_consensus.cc:3060] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.846524 17560 raft_consensus.cc:2468] T 04e015de4bdc40b893cb59db8d999cbd P 290dc05c27f24fdf9873533e9b0f6445 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 854572a3bda640e7950a027df5378cdd in term 2.
I20260709 12:08:48.850092 17486 raft_consensus.cc:2468] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 854572a3bda640e7950a027df5378cdd in term 2.
I20260709 12:08:48.850632 17561 raft_consensus.cc:2468] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 854572a3bda640e7950a027df5378cdd in term 2.
I20260709 12:08:48.851022 17377 leader_election.cc:304] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2148f2bf702c4738a23fadb9df5f8e99, 854572a3bda640e7950a027df5378cdd; no voters: 
I20260709 12:08:48.850754 17310 catalog_manager.cc:5697] T 04e015de4bdc40b893cb59db8d999cbd P 854572a3bda640e7950a027df5378cdd reported cstate change: term changed from 1 to 2, leader changed from 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194) to 854572a3bda640e7950a027df5378cdd (127.16.98.193). New cstate: current_term: 2 leader_uuid: "854572a3bda640e7950a027df5378cdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.851835 17646 raft_consensus.cc:2804] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:48.852319 17646 raft_consensus.cc:697] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [term 2 LEADER]: Becoming Leader. State: Replica: 854572a3bda640e7950a027df5378cdd, State: Running, Role: LEADER
I20260709 12:08:48.853009 17646 consensus_queue.cc:237] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:48.863416 17310 catalog_manager.cc:5697] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd reported cstate change: term changed from 1 to 2, leader changed from 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194) to 854572a3bda640e7950a027df5378cdd (127.16.98.193). New cstate: current_term: 2 leader_uuid: "854572a3bda640e7950a027df5378cdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.917584 17645 raft_consensus.cc:993] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd: : Instructing follower 2148f2bf702c4738a23fadb9df5f8e99 to start an election
I20260709 12:08:48.918087 17646 raft_consensus.cc:1081] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [term 1 LEADER]: Signalling peer 2148f2bf702c4738a23fadb9df5f8e99 to start an election
I20260709 12:08:48.919471 17486 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a81d098aae2c4871a507e0a1c48e006d"
dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99"
 from {username='slave'} at 127.0.0.1:54470
I20260709 12:08:48.919983 17486 raft_consensus.cc:493] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:48.920326 17486 raft_consensus.cc:3060] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.925230 17486 raft_consensus.cc:515] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:48.926791 17486 leader_election.cc:290] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 [CANDIDATE]: Term 2 election: Requested vote from peers 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181), 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195:37765)
I20260709 12:08:48.927742 17412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d098aae2c4871a507e0a1c48e006d" candidate_uuid: "2148f2bf702c4738a23fadb9df5f8e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "854572a3bda640e7950a027df5378cdd"
I20260709 12:08:48.927984 17561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d098aae2c4871a507e0a1c48e006d" candidate_uuid: "2148f2bf702c4738a23fadb9df5f8e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "290dc05c27f24fdf9873533e9b0f6445"
I20260709 12:08:48.928259 17412 raft_consensus.cc:3055] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:48.928500 17561 raft_consensus.cc:3060] T a81d098aae2c4871a507e0a1c48e006d P 290dc05c27f24fdf9873533e9b0f6445 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.928586 17412 raft_consensus.cc:740] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 854572a3bda640e7950a027df5378cdd, State: Running, Role: LEADER
I20260709 12:08:48.929414 17412 consensus_queue.cc:260] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:48.930282 17412 raft_consensus.cc:3060] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.933091 17561 raft_consensus.cc:2468] T a81d098aae2c4871a507e0a1c48e006d P 290dc05c27f24fdf9873533e9b0f6445 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2148f2bf702c4738a23fadb9df5f8e99 in term 2.
I20260709 12:08:48.934067 17450 leader_election.cc:304] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2148f2bf702c4738a23fadb9df5f8e99, 290dc05c27f24fdf9873533e9b0f6445; no voters: 
I20260709 12:08:48.934885 17412 raft_consensus.cc:2468] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2148f2bf702c4738a23fadb9df5f8e99 in term 2.
I20260709 12:08:48.934850 17675 raft_consensus.cc:2804] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:48.935556 17675 raft_consensus.cc:697] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 LEADER]: Becoming Leader. State: Replica: 2148f2bf702c4738a23fadb9df5f8e99, State: Running, Role: LEADER
I20260709 12:08:48.936360 17675 consensus_queue.cc:237] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:48.942082 17310 catalog_manager.cc:5697] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 reported cstate change: term changed from 1 to 2, leader changed from 854572a3bda640e7950a027df5378cdd (127.16.98.193) to 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194). New cstate: current_term: 2 leader_uuid: "2148f2bf702c4738a23fadb9df5f8e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:48.974380 17622 raft_consensus.cc:993] T 6fdffb55b864444ba1e3539a24b9f729 P 290dc05c27f24fdf9873533e9b0f6445: : Instructing follower 2148f2bf702c4738a23fadb9df5f8e99 to start an election
I20260709 12:08:48.974825 17624 raft_consensus.cc:1081] T 6fdffb55b864444ba1e3539a24b9f729 P 290dc05c27f24fdf9873533e9b0f6445 [term 1 LEADER]: Signalling peer 2148f2bf702c4738a23fadb9df5f8e99 to start an election
I20260709 12:08:48.976104 17486 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6fdffb55b864444ba1e3539a24b9f729"
dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99"
 from {username='slave'} at 127.0.0.1:54462
I20260709 12:08:48.976501 17486 raft_consensus.cc:493] T 6fdffb55b864444ba1e3539a24b9f729 P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:48.976743 17486 raft_consensus.cc:3060] T 6fdffb55b864444ba1e3539a24b9f729 P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.981503 17486 raft_consensus.cc:515] T 6fdffb55b864444ba1e3539a24b9f729 P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:48.983040 17486 leader_election.cc:290] T 6fdffb55b864444ba1e3539a24b9f729 P 2148f2bf702c4738a23fadb9df5f8e99 [CANDIDATE]: Term 2 election: Requested vote from peers 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181), 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195:37765)
I20260709 12:08:48.983848 17412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fdffb55b864444ba1e3539a24b9f729" candidate_uuid: "2148f2bf702c4738a23fadb9df5f8e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "854572a3bda640e7950a027df5378cdd"
I20260709 12:08:48.984042 17561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fdffb55b864444ba1e3539a24b9f729" candidate_uuid: "2148f2bf702c4738a23fadb9df5f8e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "290dc05c27f24fdf9873533e9b0f6445"
I20260709 12:08:48.984426 17412 raft_consensus.cc:3060] T 6fdffb55b864444ba1e3539a24b9f729 P 854572a3bda640e7950a027df5378cdd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.984540 17561 raft_consensus.cc:3055] T 6fdffb55b864444ba1e3539a24b9f729 P 290dc05c27f24fdf9873533e9b0f6445 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:08:48.984880 17561 raft_consensus.cc:740] T 6fdffb55b864444ba1e3539a24b9f729 P 290dc05c27f24fdf9873533e9b0f6445 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 290dc05c27f24fdf9873533e9b0f6445, State: Running, Role: LEADER
I20260709 12:08:48.985673 17561 consensus_queue.cc:260] T 6fdffb55b864444ba1e3539a24b9f729 P 290dc05c27f24fdf9873533e9b0f6445 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:48.986847 17561 raft_consensus.cc:3060] T 6fdffb55b864444ba1e3539a24b9f729 P 290dc05c27f24fdf9873533e9b0f6445 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:08:48.991032 17412 raft_consensus.cc:2468] T 6fdffb55b864444ba1e3539a24b9f729 P 854572a3bda640e7950a027df5378cdd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2148f2bf702c4738a23fadb9df5f8e99 in term 2.
I20260709 12:08:48.992136 17453 leader_election.cc:304] T 6fdffb55b864444ba1e3539a24b9f729 P 2148f2bf702c4738a23fadb9df5f8e99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2148f2bf702c4738a23fadb9df5f8e99, 854572a3bda640e7950a027df5378cdd; no voters: 
I20260709 12:08:48.992832 17675 raft_consensus.cc:2804] T 6fdffb55b864444ba1e3539a24b9f729 P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:08:48.992865 17561 raft_consensus.cc:2468] T 6fdffb55b864444ba1e3539a24b9f729 P 290dc05c27f24fdf9873533e9b0f6445 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2148f2bf702c4738a23fadb9df5f8e99 in term 2.
I20260709 12:08:48.993412 17675 raft_consensus.cc:697] T 6fdffb55b864444ba1e3539a24b9f729 P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 LEADER]: Becoming Leader. State: Replica: 2148f2bf702c4738a23fadb9df5f8e99, State: Running, Role: LEADER
I20260709 12:08:48.994328 17675 consensus_queue.cc:237] T 6fdffb55b864444ba1e3539a24b9f729 P 2148f2bf702c4738a23fadb9df5f8e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:48.999769 17310 catalog_manager.cc:5697] T 6fdffb55b864444ba1e3539a24b9f729 P 2148f2bf702c4738a23fadb9df5f8e99 reported cstate change: term changed from 1 to 2, leader changed from 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195) to 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194). New cstate: current_term: 2 leader_uuid: "2148f2bf702c4738a23fadb9df5f8e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } health_report { overall_health: UNKNOWN } } }
I20260709 12:08:49.063097 17561 raft_consensus.cc:1275] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [term 2 FOLLOWER]: Refusing update from remote peer 854572a3bda640e7950a027df5378cdd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.064194 17646 consensus_queue.cc:1048] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.072127 17486 raft_consensus.cc:1275] T ce29ffec4f0245cf8ebfd905f615b11d P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 FOLLOWER]: Refusing update from remote peer 854572a3bda640e7950a027df5378cdd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.073709 17680 consensus_queue.cc:1048] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.085963 17486 raft_consensus.cc:1275] T abc0445a2776423098f7ba93cfe3e7f2 P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 FOLLOWER]: Refusing update from remote peer 854572a3bda640e7950a027df5378cdd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.087113 17680 consensus_queue.cc:1048] T abc0445a2776423098f7ba93cfe3e7f2 P 854572a3bda640e7950a027df5378cdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.094904 17561 raft_consensus.cc:1275] T abc0445a2776423098f7ba93cfe3e7f2 P 290dc05c27f24fdf9873533e9b0f6445 [term 2 FOLLOWER]: Refusing update from remote peer 854572a3bda640e7950a027df5378cdd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.099145 17679 consensus_queue.cc:1048] T abc0445a2776423098f7ba93cfe3e7f2 P 854572a3bda640e7950a027df5378cdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.160616 17561 raft_consensus.cc:1275] T f854f3e731a84e6e9ade0adcad9a7e10 P 290dc05c27f24fdf9873533e9b0f6445 [term 2 FOLLOWER]: Refusing update from remote peer 854572a3bda640e7950a027df5378cdd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.161872 17679 consensus_queue.cc:1048] T f854f3e731a84e6e9ade0adcad9a7e10 P 854572a3bda640e7950a027df5378cdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.170099 17486 raft_consensus.cc:1275] T f854f3e731a84e6e9ade0adcad9a7e10 P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 FOLLOWER]: Refusing update from remote peer 854572a3bda640e7950a027df5378cdd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.171538 17680 consensus_queue.cc:1048] T f854f3e731a84e6e9ade0adcad9a7e10 P 854572a3bda640e7950a027df5378cdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.308661 17561 raft_consensus.cc:1275] T 556c7c2480ef40c5adfaa946e5d95c8b P 290dc05c27f24fdf9873533e9b0f6445 [term 2 FOLLOWER]: Refusing update from remote peer 2148f2bf702c4738a23fadb9df5f8e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.309899 17675 consensus_queue.cc:1048] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.317308 17412 raft_consensus.cc:1275] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [term 2 FOLLOWER]: Refusing update from remote peer 2148f2bf702c4738a23fadb9df5f8e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.318791 17675 consensus_queue.cc:1048] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.324856 17486 raft_consensus.cc:1275] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 FOLLOWER]: Refusing update from remote peer 854572a3bda640e7950a027df5378cdd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.326030 17646 consensus_queue.cc:1048] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.335132 17412 raft_consensus.cc:1275] T b4f614b23b964d519944544229c1cf98 P 854572a3bda640e7950a027df5378cdd [term 2 FOLLOWER]: Refusing update from remote peer 290dc05c27f24fdf9873533e9b0f6445: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.335126 17561 raft_consensus.cc:1275] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445 [term 2 FOLLOWER]: Refusing update from remote peer 854572a3bda640e7950a027df5378cdd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.337021 17624 consensus_queue.cc:1048] T b4f614b23b964d519944544229c1cf98 P 290dc05c27f24fdf9873533e9b0f6445 [LEADER]: Connected to new peer: Peer: permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.336928 17646 consensus_queue.cc:1048] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.340679 17410 raft_consensus.cc:1275] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [term 2 FOLLOWER]: Refusing update from remote peer 2148f2bf702c4738a23fadb9df5f8e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.342365 17675 consensus_queue.cc:1048] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.349581 17486 raft_consensus.cc:1275] T b4f614b23b964d519944544229c1cf98 P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 FOLLOWER]: Refusing update from remote peer 290dc05c27f24fdf9873533e9b0f6445: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.355947 17624 consensus_queue.cc:1048] T b4f614b23b964d519944544229c1cf98 P 290dc05c27f24fdf9873533e9b0f6445 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.370384 17561 raft_consensus.cc:1275] T a81d098aae2c4871a507e0a1c48e006d P 290dc05c27f24fdf9873533e9b0f6445 [term 2 FOLLOWER]: Refusing update from remote peer 2148f2bf702c4738a23fadb9df5f8e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.372848 17641 consensus_queue.cc:1048] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.391582 17561 raft_consensus.cc:1275] T 6fdffb55b864444ba1e3539a24b9f729 P 290dc05c27f24fdf9873533e9b0f6445 [term 2 FOLLOWER]: Refusing update from remote peer 2148f2bf702c4738a23fadb9df5f8e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.392702 17641 consensus_queue.cc:1048] T 6fdffb55b864444ba1e3539a24b9f729 P 2148f2bf702c4738a23fadb9df5f8e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.399897 17412 raft_consensus.cc:1275] T 6fdffb55b864444ba1e3539a24b9f729 P 854572a3bda640e7950a027df5378cdd [term 2 FOLLOWER]: Refusing update from remote peer 2148f2bf702c4738a23fadb9df5f8e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.401197 17641 consensus_queue.cc:1048] T 6fdffb55b864444ba1e3539a24b9f729 P 2148f2bf702c4738a23fadb9df5f8e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.402031 17561 raft_consensus.cc:1275] T 04e015de4bdc40b893cb59db8d999cbd P 290dc05c27f24fdf9873533e9b0f6445 [term 2 FOLLOWER]: Refusing update from remote peer 854572a3bda640e7950a027df5378cdd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.403906 17646 consensus_queue.cc:1048] T 04e015de4bdc40b893cb59db8d999cbd P 854572a3bda640e7950a027df5378cdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:49.413805 17486 raft_consensus.cc:1275] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 FOLLOWER]: Refusing update from remote peer 854572a3bda640e7950a027df5378cdd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:08:49.415603 17645 consensus_queue.cc:1048] T 04e015de4bdc40b893cb59db8d999cbd P 854572a3bda640e7950a027df5378cdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:08:51.527634 16779 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:08:51.528302 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:51.544296 17412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "349c94cc3eb84c8dbcf13222e8d85105"
dest_uuid: "854572a3bda640e7950a027df5378cdd"
mode: GRACEFUL
new_leader_uuid: "290dc05c27f24fdf9873533e9b0f6445"
 from {username='slave'} at 127.0.0.1:46790
I20260709 12:08:51.544806 17412 raft_consensus.cc:606] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [term 2 LEADER]: Received request to transfer leadership to TS 290dc05c27f24fdf9873533e9b0f6445
I20260709 12:08:51.547075 17412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce29ffec4f0245cf8ebfd905f615b11d"
dest_uuid: "854572a3bda640e7950a027df5378cdd"
mode: GRACEFUL
new_leader_uuid: "290dc05c27f24fdf9873533e9b0f6445"
 from {username='slave'} at 127.0.0.1:46790
I20260709 12:08:51.547509 17412 raft_consensus.cc:606] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [term 2 LEADER]: Received request to transfer leadership to TS 290dc05c27f24fdf9873533e9b0f6445
I20260709 12:08:51.548563 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:08:51.548982 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:51.809134 17707 raft_consensus.cc:993] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd: : Instructing follower 290dc05c27f24fdf9873533e9b0f6445 to start an election
I20260709 12:08:51.809568 17679 raft_consensus.cc:1081] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [term 2 LEADER]: Signalling peer 290dc05c27f24fdf9873533e9b0f6445 to start an election
I20260709 12:08:51.810829 17561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce29ffec4f0245cf8ebfd905f615b11d"
dest_uuid: "290dc05c27f24fdf9873533e9b0f6445"
 from {username='slave'} at 127.0.0.1:60214
I20260709 12:08:51.811290 17561 raft_consensus.cc:493] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:51.811548 17561 raft_consensus.cc:3060] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:51.815804 17561 raft_consensus.cc:515] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:51.817373 17561 leader_election.cc:290] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 3 election: Requested vote from peers 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181), 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635)
I20260709 12:08:51.818040 17412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce29ffec4f0245cf8ebfd905f615b11d" candidate_uuid: "290dc05c27f24fdf9873533e9b0f6445" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "854572a3bda640e7950a027df5378cdd"
I20260709 12:08:51.818418 17486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce29ffec4f0245cf8ebfd905f615b11d" candidate_uuid: "290dc05c27f24fdf9873533e9b0f6445" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99"
I20260709 12:08:51.818625 17412 raft_consensus.cc:3055] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:51.819017 17486 raft_consensus.cc:3060] T ce29ffec4f0245cf8ebfd905f615b11d P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:51.819020 17412 raft_consensus.cc:740] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 854572a3bda640e7950a027df5378cdd, State: Running, Role: LEADER
I20260709 12:08:51.819923 17412 consensus_queue.cc:260] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:51.820766 17412 raft_consensus.cc:3060] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:51.824851 17486 raft_consensus.cc:2468] T ce29ffec4f0245cf8ebfd905f615b11d P 2148f2bf702c4738a23fadb9df5f8e99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 290dc05c27f24fdf9873533e9b0f6445 in term 3.
I20260709 12:08:51.825618 17707 raft_consensus.cc:993] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd: : Instructing follower 290dc05c27f24fdf9873533e9b0f6445 to start an election
I20260709 12:08:51.826027 17707 raft_consensus.cc:1081] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [term 2 LEADER]: Signalling peer 290dc05c27f24fdf9873533e9b0f6445 to start an election
I20260709 12:08:51.826027 17526 leader_election.cc:304] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2148f2bf702c4738a23fadb9df5f8e99, 290dc05c27f24fdf9873533e9b0f6445; no voters: 
I20260709 12:08:51.826995 17706 raft_consensus.cc:2804] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:51.827545 17561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "349c94cc3eb84c8dbcf13222e8d85105"
dest_uuid: "290dc05c27f24fdf9873533e9b0f6445"
 from {username='slave'} at 127.0.0.1:60214
I20260709 12:08:51.827850 17412 raft_consensus.cc:2468] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 290dc05c27f24fdf9873533e9b0f6445 in term 3.
I20260709 12:08:51.828037 17706 raft_consensus.cc:697] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [term 3 LEADER]: Becoming Leader. State: Replica: 290dc05c27f24fdf9873533e9b0f6445, State: Running, Role: LEADER
I20260709 12:08:51.828122 17561 raft_consensus.cc:493] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:08:51.828647 17561 raft_consensus.cc:3060] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:51.828951 17706 consensus_queue.cc:237] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:51.833065 17561 raft_consensus.cc:515] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:51.835340 17412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "349c94cc3eb84c8dbcf13222e8d85105" candidate_uuid: "290dc05c27f24fdf9873533e9b0f6445" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "854572a3bda640e7950a027df5378cdd"
I20260709 12:08:51.835863 17412 raft_consensus.cc:3055] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:08:51.836125 17561 leader_election.cc:290] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 3 election: Requested vote from peers 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181), 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635)
I20260709 12:08:51.836186 17412 raft_consensus.cc:740] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 854572a3bda640e7950a027df5378cdd, State: Running, Role: LEADER
I20260709 12:08:51.836400 17309 catalog_manager.cc:5697] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 reported cstate change: term changed from 2 to 3, leader changed from 854572a3bda640e7950a027df5378cdd (127.16.98.193) to 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195). New cstate: current_term: 3 leader_uuid: "290dc05c27f24fdf9873533e9b0f6445" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:51.837004 17412 consensus_queue.cc:260] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:51.838043 17412 raft_consensus.cc:3060] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:51.838827 17486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "349c94cc3eb84c8dbcf13222e8d85105" candidate_uuid: "290dc05c27f24fdf9873533e9b0f6445" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99"
I20260709 12:08:51.839293 17486 raft_consensus.cc:3060] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:08:51.842846 17412 raft_consensus.cc:2468] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 290dc05c27f24fdf9873533e9b0f6445 in term 3.
I20260709 12:08:51.843883 17527 leader_election.cc:304] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 290dc05c27f24fdf9873533e9b0f6445, 854572a3bda640e7950a027df5378cdd; no voters: 
I20260709 12:08:51.844676 17706 raft_consensus.cc:2804] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:08:51.845091 17706 raft_consensus.cc:697] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445 [term 3 LEADER]: Becoming Leader. State: Replica: 290dc05c27f24fdf9873533e9b0f6445, State: Running, Role: LEADER
I20260709 12:08:51.845783 17706 consensus_queue.cc:237] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:08:51.847327 17486 raft_consensus.cc:2468] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 290dc05c27f24fdf9873533e9b0f6445 in term 3.
I20260709 12:08:51.858973 17309 catalog_manager.cc:5697] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445 reported cstate change: term changed from 2 to 3, leader changed from 854572a3bda640e7950a027df5378cdd (127.16.98.193) to 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195). New cstate: current_term: 3 leader_uuid: "290dc05c27f24fdf9873533e9b0f6445" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } health_report { overall_health: HEALTHY } } }
I20260709 12:08:52.262850 17486 raft_consensus.cc:1275] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99 [term 3 FOLLOWER]: Refusing update from remote peer 290dc05c27f24fdf9873533e9b0f6445: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:52.264142 17706 consensus_queue.cc:1048] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:52.272895 17412 raft_consensus.cc:1275] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [term 3 FOLLOWER]: Refusing update from remote peer 290dc05c27f24fdf9873533e9b0f6445: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:52.274519 17706 consensus_queue.cc:1048] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445 [LEADER]: Connected to new peer: Peer: permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:08:52.396277 17487 raft_consensus.cc:1275] T ce29ffec4f0245cf8ebfd905f615b11d P 2148f2bf702c4738a23fadb9df5f8e99 [term 3 FOLLOWER]: Refusing update from remote peer 290dc05c27f24fdf9873533e9b0f6445: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:52.397504 17706 consensus_queue.cc:1048] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:52.405181 17412 raft_consensus.cc:1275] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [term 3 FOLLOWER]: Refusing update from remote peer 290dc05c27f24fdf9873533e9b0f6445: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:08:52.406715 17706 consensus_queue.cc:1048] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [LEADER]: Connected to new peer: Peer: permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:08:52.549855 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:52.556010 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:52.556457 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:53.557420 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:53.563301 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:53.563701 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:54.564582 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:54.570400 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:54.570813 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:55.571846 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:55.578161 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:55.578567 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:56.579655 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:56.585830 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:56.586277 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:57.587285 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:57.593827 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:57.594359 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:58.595309 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:58.600384 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:58.600785 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:08:59.601725 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:08:59.608112 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:08:59.608522 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:00.609436 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:00.614506 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:00.614967 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:01.645942 16779 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:09:01.656118 17560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "349c94cc3eb84c8dbcf13222e8d85105"
dest_uuid: "290dc05c27f24fdf9873533e9b0f6445"
mode: GRACEFUL
new_leader_uuid: "854572a3bda640e7950a027df5378cdd"
 from {username='slave'} at 127.0.0.1:60222
I20260709 12:09:01.656782 17560 raft_consensus.cc:606] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445 [term 3 LEADER]: Received request to transfer leadership to TS 854572a3bda640e7950a027df5378cdd
I20260709 12:09:01.664127 17560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce29ffec4f0245cf8ebfd905f615b11d"
dest_uuid: "290dc05c27f24fdf9873533e9b0f6445"
mode: GRACEFUL
new_leader_uuid: "854572a3bda640e7950a027df5378cdd"
 from {username='slave'} at 127.0.0.1:60222
I20260709 12:09:01.664701 17560 raft_consensus.cc:606] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [term 3 LEADER]: Received request to transfer leadership to TS 854572a3bda640e7950a027df5378cdd
I20260709 12:09:01.669324 17486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a81d098aae2c4871a507e0a1c48e006d"
dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99"
mode: GRACEFUL
new_leader_uuid: "854572a3bda640e7950a027df5378cdd"
 from {username='slave'} at 127.0.0.1:54476
I20260709 12:09:01.669710 17486 raft_consensus.cc:606] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 LEADER]: Received request to transfer leadership to TS 854572a3bda640e7950a027df5378cdd
I20260709 12:09:01.673867 17486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "556c7c2480ef40c5adfaa946e5d95c8b"
dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99"
mode: GRACEFUL
new_leader_uuid: "854572a3bda640e7950a027df5378cdd"
 from {username='slave'} at 127.0.0.1:54476
I20260709 12:09:01.674245 17486 raft_consensus.cc:606] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 LEADER]: Received request to transfer leadership to TS 854572a3bda640e7950a027df5378cdd
I20260709 12:09:01.678174 17486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8eadcb8f48ad471599f2fe5c00f9c5fa"
dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99"
mode: GRACEFUL
new_leader_uuid: "854572a3bda640e7950a027df5378cdd"
 from {username='slave'} at 127.0.0.1:54476
I20260709 12:09:01.678548 17486 raft_consensus.cc:606] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 LEADER]: Received request to transfer leadership to TS 854572a3bda640e7950a027df5378cdd
I20260709 12:09:01.770833 17729 raft_consensus.cc:993] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445: : Instructing follower 854572a3bda640e7950a027df5378cdd to start an election
I20260709 12:09:01.771392 17737 raft_consensus.cc:1081] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445 [term 3 LEADER]: Signalling peer 854572a3bda640e7950a027df5378cdd to start an election
I20260709 12:09:01.772921 17410 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "349c94cc3eb84c8dbcf13222e8d85105"
dest_uuid: "854572a3bda640e7950a027df5378cdd"
 from {username='slave'} at 127.0.0.1:41116
I20260709 12:09:01.773412 17410 raft_consensus.cc:493] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:01.773751 17410 raft_consensus.cc:3060] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:01.778942 17410 raft_consensus.cc:515] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:09:01.780647 17410 leader_election.cc:290] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [CANDIDATE]: Term 4 election: Requested vote from peers 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635), 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195:37765)
I20260709 12:09:01.781616 17486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "349c94cc3eb84c8dbcf13222e8d85105" candidate_uuid: "854572a3bda640e7950a027df5378cdd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99"
I20260709 12:09:01.781623 17560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "349c94cc3eb84c8dbcf13222e8d85105" candidate_uuid: "854572a3bda640e7950a027df5378cdd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "290dc05c27f24fdf9873533e9b0f6445"
I20260709 12:09:01.782356 17486 raft_consensus.cc:3060] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:01.782513 17560 raft_consensus.cc:3055] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:01.782904 17560 raft_consensus.cc:740] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 290dc05c27f24fdf9873533e9b0f6445, State: Running, Role: LEADER
I20260709 12:09:01.783814 17560 consensus_queue.cc:260] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:09:01.785028 17560 raft_consensus.cc:3060] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:01.789186 17486 raft_consensus.cc:2468] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 854572a3bda640e7950a027df5378cdd in term 4.
I20260709 12:09:01.790402 17377 leader_election.cc:304] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2148f2bf702c4738a23fadb9df5f8e99, 854572a3bda640e7950a027df5378cdd; no voters: 
I20260709 12:09:01.791220 17734 raft_consensus.cc:2804] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:01.791222 17560 raft_consensus.cc:2468] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 854572a3bda640e7950a027df5378cdd in term 4.
I20260709 12:09:01.792470 17734 raft_consensus.cc:697] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [term 4 LEADER]: Becoming Leader. State: Replica: 854572a3bda640e7950a027df5378cdd, State: Running, Role: LEADER
I20260709 12:09:01.793319 17734 consensus_queue.cc:237] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:09:01.800557 17309 catalog_manager.cc:5697] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd reported cstate change: term changed from 3 to 4, leader changed from 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195) to 854572a3bda640e7950a027df5378cdd (127.16.98.193). New cstate: current_term: 4 leader_uuid: "854572a3bda640e7950a027df5378cdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:01.971318 17731 raft_consensus.cc:993] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99: : Instructing follower 854572a3bda640e7950a027df5378cdd to start an election
I20260709 12:09:01.971894 17736 raft_consensus.cc:1081] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 LEADER]: Signalling peer 854572a3bda640e7950a027df5378cdd to start an election
I20260709 12:09:01.973606 17410 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8eadcb8f48ad471599f2fe5c00f9c5fa"
dest_uuid: "854572a3bda640e7950a027df5378cdd"
 from {username='slave'} at 127.0.0.1:41118
I20260709 12:09:01.974515 17410 raft_consensus.cc:493] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 854572a3bda640e7950a027df5378cdd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:01.975160 17410 raft_consensus.cc:3060] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 854572a3bda640e7950a027df5378cdd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:01.990118 17410 raft_consensus.cc:515] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 854572a3bda640e7950a027df5378cdd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:09:02.052989 17486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eadcb8f48ad471599f2fe5c00f9c5fa" candidate_uuid: "854572a3bda640e7950a027df5378cdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99"
I20260709 12:09:02.053648 17486 raft_consensus.cc:3055] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:02.053974 17486 raft_consensus.cc:740] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2148f2bf702c4738a23fadb9df5f8e99, State: Running, Role: LEADER
I20260709 12:09:02.054774 17486 consensus_queue.cc:260] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:09:02.056416 17486 raft_consensus.cc:3060] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:02.081015 17410 leader_election.cc:290] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 854572a3bda640e7950a027df5378cdd [CANDIDATE]: Term 2 election: Requested vote from peers 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635), 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195:37765)
I20260709 12:09:02.418329 17748 raft_consensus.cc:993] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99: : Instructing follower 854572a3bda640e7950a027df5378cdd to start an election
I20260709 12:09:02.418777 17748 raft_consensus.cc:1081] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 LEADER]: Signalling peer 854572a3bda640e7950a027df5378cdd to start an election
I20260709 12:09:02.423776 17410 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "556c7c2480ef40c5adfaa946e5d95c8b"
dest_uuid: "854572a3bda640e7950a027df5378cdd"
 from {username='slave'} at 127.0.0.1:41118
I20260709 12:09:02.424366 17410 raft_consensus.cc:493] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:02.424768 17410 raft_consensus.cc:3060] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:02.437122 17485 raft_consensus.cc:1275] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99 [term 4 FOLLOWER]: Refusing update from remote peer 854572a3bda640e7950a027df5378cdd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:02.438720 17734 consensus_queue.cc:1048] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:02.439121 17410 raft_consensus.cc:515] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:09:02.447364 17731 raft_consensus.cc:993] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99: : Instructing follower 854572a3bda640e7950a027df5378cdd to start an election
I20260709 12:09:02.448657 17736 raft_consensus.cc:1081] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 LEADER]: Signalling peer 854572a3bda640e7950a027df5378cdd to start an election
I20260709 12:09:02.449934 17559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eadcb8f48ad471599f2fe5c00f9c5fa" candidate_uuid: "854572a3bda640e7950a027df5378cdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "290dc05c27f24fdf9873533e9b0f6445"
I20260709 12:09:02.450593 17559 raft_consensus.cc:3060] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 290dc05c27f24fdf9873533e9b0f6445 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:02.451360 17412 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a81d098aae2c4871a507e0a1c48e006d"
dest_uuid: "854572a3bda640e7950a027df5378cdd"
 from {username='slave'} at 127.0.0.1:41118
I20260709 12:09:02.451874 17412 raft_consensus.cc:493] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:02.452150 17412 raft_consensus.cc:3060] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:02.456466 17559 raft_consensus.cc:2468] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 290dc05c27f24fdf9873533e9b0f6445 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 854572a3bda640e7950a027df5378cdd in term 2.
I20260709 12:09:02.456898 17412 raft_consensus.cc:515] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:09:02.457729 17375 leader_election.cc:304] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 854572a3bda640e7950a027df5378cdd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 290dc05c27f24fdf9873533e9b0f6445, 854572a3bda640e7950a027df5378cdd; no voters: 
I20260709 12:09:02.459290 17412 leader_election.cc:290] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [CANDIDATE]: Term 3 election: Requested vote from peers 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635), 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195:37765)
I20260709 12:09:02.459887 17739 raft_consensus.cc:2804] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 854572a3bda640e7950a027df5378cdd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:02.460392 17739 raft_consensus.cc:697] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 854572a3bda640e7950a027df5378cdd [term 2 LEADER]: Becoming Leader. State: Replica: 854572a3bda640e7950a027df5378cdd, State: Running, Role: LEADER
I20260709 12:09:02.461397 17556 raft_consensus.cc:1275] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445 [term 4 FOLLOWER]: Refusing update from remote peer 854572a3bda640e7950a027df5378cdd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:02.461558 17484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d098aae2c4871a507e0a1c48e006d" candidate_uuid: "854572a3bda640e7950a027df5378cdd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99"
I20260709 12:09:02.461324 17739 consensus_queue.cc:237] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 854572a3bda640e7950a027df5378cdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:09:02.462361 17484 raft_consensus.cc:3055] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:02.462757 17484 raft_consensus.cc:740] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2148f2bf702c4738a23fadb9df5f8e99, State: Running, Role: LEADER
I20260709 12:09:02.464169 17558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d098aae2c4871a507e0a1c48e006d" candidate_uuid: "854572a3bda640e7950a027df5378cdd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "290dc05c27f24fdf9873533e9b0f6445"
I20260709 12:09:02.464812 17558 raft_consensus.cc:3060] T a81d098aae2c4871a507e0a1c48e006d P 290dc05c27f24fdf9873533e9b0f6445 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:02.464895 17484 consensus_queue.cc:260] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:09:02.465541 17410 leader_election.cc:290] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [CANDIDATE]: Term 3 election: Requested vote from peers 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635), 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195:37765)
I20260709 12:09:02.466354 17484 raft_consensus.cc:3060] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:02.467306 17560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556c7c2480ef40c5adfaa946e5d95c8b" candidate_uuid: "854572a3bda640e7950a027df5378cdd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "290dc05c27f24fdf9873533e9b0f6445"
I20260709 12:09:02.467820 17560 raft_consensus.cc:3060] T 556c7c2480ef40c5adfaa946e5d95c8b P 290dc05c27f24fdf9873533e9b0f6445 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:02.470216 17487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556c7c2480ef40c5adfaa946e5d95c8b" candidate_uuid: "854572a3bda640e7950a027df5378cdd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99"
I20260709 12:09:02.470872 17487 raft_consensus.cc:3055] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:02.471161 17487 raft_consensus.cc:740] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2148f2bf702c4738a23fadb9df5f8e99, State: Running, Role: LEADER
I20260709 12:09:02.472019 17487 consensus_queue.cc:260] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:09:02.472390 17558 raft_consensus.cc:2468] T a81d098aae2c4871a507e0a1c48e006d P 290dc05c27f24fdf9873533e9b0f6445 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 854572a3bda640e7950a027df5378cdd in term 3.
I20260709 12:09:02.473054 17487 raft_consensus.cc:3060] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:02.474817 17560 raft_consensus.cc:2468] T 556c7c2480ef40c5adfaa946e5d95c8b P 290dc05c27f24fdf9873533e9b0f6445 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 854572a3bda640e7950a027df5378cdd in term 3.
I20260709 12:09:02.475515 17375 leader_election.cc:304] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 290dc05c27f24fdf9873533e9b0f6445, 854572a3bda640e7950a027df5378cdd; no voters: 
I20260709 12:09:02.476297 17747 consensus_queue.cc:1048] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:02.477756 17737 raft_consensus.cc:993] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445: : Instructing follower 854572a3bda640e7950a027df5378cdd to start an election
I20260709 12:09:02.478251 17737 raft_consensus.cc:1081] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [term 3 LEADER]: Signalling peer 854572a3bda640e7950a027df5378cdd to start an election
I20260709 12:09:02.479525 17375 leader_election.cc:304] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 290dc05c27f24fdf9873533e9b0f6445, 854572a3bda640e7950a027df5378cdd; no voters: 
I20260709 12:09:02.480167 17745 raft_consensus.cc:2804] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:02.480981 17745 raft_consensus.cc:697] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [term 3 LEADER]: Becoming Leader. State: Replica: 854572a3bda640e7950a027df5378cdd, State: Running, Role: LEADER
I20260709 12:09:02.481950 17484 raft_consensus.cc:2468] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 854572a3bda640e7950a027df5378cdd in term 3.
I20260709 12:09:02.482071 17745 consensus_queue.cc:237] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:09:02.486588 17486 raft_consensus.cc:2468] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 854572a3bda640e7950a027df5378cdd in term 2.
I20260709 12:09:02.487903 17487 raft_consensus.cc:2468] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 854572a3bda640e7950a027df5378cdd in term 3.
I20260709 12:09:02.492937 17412 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce29ffec4f0245cf8ebfd905f615b11d"
dest_uuid: "854572a3bda640e7950a027df5378cdd"
 from {username='slave'} at 127.0.0.1:41116
I20260709 12:09:02.493399 17412 raft_consensus.cc:493] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:02.493698 17412 raft_consensus.cc:3060] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:02.482218 17734 raft_consensus.cc:2804] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:02.494333 17734 raft_consensus.cc:697] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [term 3 LEADER]: Becoming Leader. State: Replica: 854572a3bda640e7950a027df5378cdd, State: Running, Role: LEADER
I20260709 12:09:02.495600 17734 consensus_queue.cc:237] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:09:02.501580 17412 raft_consensus.cc:515] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:09:02.504696 17412 leader_election.cc:290] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [CANDIDATE]: Term 4 election: Requested vote from peers 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635), 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195:37765)
I20260709 12:09:02.505203 17486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce29ffec4f0245cf8ebfd905f615b11d" candidate_uuid: "854572a3bda640e7950a027df5378cdd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99"
I20260709 12:09:02.505963 17486 raft_consensus.cc:3060] T ce29ffec4f0245cf8ebfd905f615b11d P 2148f2bf702c4738a23fadb9df5f8e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:02.507689 17560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce29ffec4f0245cf8ebfd905f615b11d" candidate_uuid: "854572a3bda640e7950a027df5378cdd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "290dc05c27f24fdf9873533e9b0f6445"
I20260709 12:09:02.508278 17560 raft_consensus.cc:3055] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:02.508879 17560 raft_consensus.cc:740] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 290dc05c27f24fdf9873533e9b0f6445, State: Running, Role: LEADER
I20260709 12:09:02.516074 17560 consensus_queue.cc:260] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:09:02.518399 17560 raft_consensus.cc:3060] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:02.524847 17310 catalog_manager.cc:5697] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 854572a3bda640e7950a027df5378cdd reported cstate change: term changed from 1 to 2, leader changed from 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194) to 854572a3bda640e7950a027df5378cdd (127.16.98.193). New cstate: current_term: 2 leader_uuid: "854572a3bda640e7950a027df5378cdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:02.527268 17486 raft_consensus.cc:2468] T ce29ffec4f0245cf8ebfd905f615b11d P 2148f2bf702c4738a23fadb9df5f8e99 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 854572a3bda640e7950a027df5378cdd in term 4.
I20260709 12:09:02.528613 17487 raft_consensus.cc:1240] T ce29ffec4f0245cf8ebfd905f615b11d P 2148f2bf702c4738a23fadb9df5f8e99 [term 4 FOLLOWER]: Rejecting Update request from peer 290dc05c27f24fdf9873533e9b0f6445 for earlier term 3. Current term is 4. Ops: []
I20260709 12:09:02.526577 17310 catalog_manager.cc:5697] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd reported cstate change: term changed from 2 to 3, leader changed from 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194) to 854572a3bda640e7950a027df5378cdd (127.16.98.193). New cstate: current_term: 3 leader_uuid: "854572a3bda640e7950a027df5378cdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:02.526608 17560 raft_consensus.cc:2468] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 854572a3bda640e7950a027df5378cdd in term 4.
I20260709 12:09:02.533711 17377 leader_election.cc:304] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2148f2bf702c4738a23fadb9df5f8e99, 854572a3bda640e7950a027df5378cdd; no voters: 
I20260709 12:09:02.533634 17310 catalog_manager.cc:5697] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd reported cstate change: term changed from 2 to 3, leader changed from 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194) to 854572a3bda640e7950a027df5378cdd (127.16.98.193). New cstate: current_term: 3 leader_uuid: "854572a3bda640e7950a027df5378cdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:02.534667 17739 raft_consensus.cc:2804] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:02.535244 17739 raft_consensus.cc:697] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [term 4 LEADER]: Becoming Leader. State: Replica: 854572a3bda640e7950a027df5378cdd, State: Running, Role: LEADER
I20260709 12:09:02.536123 17739 consensus_queue.cc:237] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:09:02.559448 17309 catalog_manager.cc:5697] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd reported cstate change: term changed from 3 to 4, leader changed from 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195) to 854572a3bda640e7950a027df5378cdd (127.16.98.193). New cstate: current_term: 4 leader_uuid: "854572a3bda640e7950a027df5378cdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:02.871248 17559 raft_consensus.cc:1275] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 290dc05c27f24fdf9873533e9b0f6445 [term 2 FOLLOWER]: Refusing update from remote peer 854572a3bda640e7950a027df5378cdd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:02.872282 17739 consensus_queue.cc:1048] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 854572a3bda640e7950a027df5378cdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:02.880695 17486 raft_consensus.cc:1275] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 FOLLOWER]: Refusing update from remote peer 854572a3bda640e7950a027df5378cdd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:02.882930 17745 consensus_queue.cc:1048] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 854572a3bda640e7950a027df5378cdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:02.893286 17486 raft_consensus.cc:1275] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 [term 3 FOLLOWER]: Refusing update from remote peer 854572a3bda640e7950a027df5378cdd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:02.894349 17745 consensus_queue.cc:1048] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:02.903218 17559 raft_consensus.cc:1275] T 556c7c2480ef40c5adfaa946e5d95c8b P 290dc05c27f24fdf9873533e9b0f6445 [term 3 FOLLOWER]: Refusing update from remote peer 854572a3bda640e7950a027df5378cdd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:02.904661 17745 consensus_queue.cc:1048] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:02.908249 17560 raft_consensus.cc:1275] T a81d098aae2c4871a507e0a1c48e006d P 290dc05c27f24fdf9873533e9b0f6445 [term 3 FOLLOWER]: Refusing update from remote peer 854572a3bda640e7950a027df5378cdd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:02.913335 17745 consensus_queue.cc:1048] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:02.921895 17486 raft_consensus.cc:1275] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 [term 3 FOLLOWER]: Refusing update from remote peer 854572a3bda640e7950a027df5378cdd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:02.923985 17734 consensus_queue.cc:1048] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:03.000923 17559 raft_consensus.cc:1275] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [term 4 FOLLOWER]: Refusing update from remote peer 854572a3bda640e7950a027df5378cdd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:03.002255 17734 consensus_queue.cc:1048] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:03.012492 17486 raft_consensus.cc:1275] T ce29ffec4f0245cf8ebfd905f615b11d P 2148f2bf702c4738a23fadb9df5f8e99 [term 4 FOLLOWER]: Refusing update from remote peer 854572a3bda640e7950a027df5378cdd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:03.013604 17739 consensus_queue.cc:1048] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:09:03.088186 17433 debug-util.cc:398] Leaking SignalData structure 0x7b08001490e0 after lost signal to thread 16782
W20260709 12:09:03.089035 17433 debug-util.cc:398] Leaking SignalData structure 0x7b08001497c0 after lost signal to thread 17344
W20260709 12:09:03.089908 17433 debug-util.cc:398] Leaking SignalData structure 0x7b080014aa80 after lost signal to thread 17436
W20260709 12:09:03.090623 17433 debug-util.cc:398] Leaking SignalData structure 0x7b08001a80e0 after lost signal to thread 17511
W20260709 12:09:03.091382 17433 debug-util.cc:398] Leaking SignalData structure 0x7b08000ae0a0 after lost signal to thread 17585
I20260709 12:09:04.738541 16779 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:09:04.739408 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:04.748718 17412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04e015de4bdc40b893cb59db8d999cbd"
dest_uuid: "854572a3bda640e7950a027df5378cdd"
mode: GRACEFUL
new_leader_uuid: "290dc05c27f24fdf9873533e9b0f6445"
 from {username='slave'} at 127.0.0.1:46790
I20260709 12:09:04.749207 17412 raft_consensus.cc:606] T 04e015de4bdc40b893cb59db8d999cbd P 854572a3bda640e7950a027df5378cdd [term 2 LEADER]: Received request to transfer leadership to TS 290dc05c27f24fdf9873533e9b0f6445
I20260709 12:09:04.751736 17412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "556c7c2480ef40c5adfaa946e5d95c8b"
dest_uuid: "854572a3bda640e7950a027df5378cdd"
mode: GRACEFUL
new_leader_uuid: "290dc05c27f24fdf9873533e9b0f6445"
 from {username='slave'} at 127.0.0.1:46790
I20260709 12:09:04.752177 17412 raft_consensus.cc:606] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [term 3 LEADER]: Received request to transfer leadership to TS 290dc05c27f24fdf9873533e9b0f6445
I20260709 12:09:04.754616 17412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8eadcb8f48ad471599f2fe5c00f9c5fa"
dest_uuid: "854572a3bda640e7950a027df5378cdd"
mode: GRACEFUL
new_leader_uuid: "2148f2bf702c4738a23fadb9df5f8e99"
 from {username='slave'} at 127.0.0.1:46790
I20260709 12:09:04.755213 17412 raft_consensus.cc:606] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 854572a3bda640e7950a027df5378cdd [term 2 LEADER]: Received request to transfer leadership to TS 2148f2bf702c4738a23fadb9df5f8e99
I20260709 12:09:04.757294 17412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a81d098aae2c4871a507e0a1c48e006d"
dest_uuid: "854572a3bda640e7950a027df5378cdd"
mode: GRACEFUL
new_leader_uuid: "2148f2bf702c4738a23fadb9df5f8e99"
 from {username='slave'} at 127.0.0.1:46790
I20260709 12:09:04.757715 17412 raft_consensus.cc:606] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [term 3 LEADER]: Received request to transfer leadership to TS 2148f2bf702c4738a23fadb9df5f8e99
I20260709 12:09:04.758538 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:09:04.759016 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:04.850168 17771 raft_consensus.cc:993] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 854572a3bda640e7950a027df5378cdd: : Instructing follower 2148f2bf702c4738a23fadb9df5f8e99 to start an election
I20260709 12:09:04.850672 17746 raft_consensus.cc:1081] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 854572a3bda640e7950a027df5378cdd [term 2 LEADER]: Signalling peer 2148f2bf702c4738a23fadb9df5f8e99 to start an election
I20260709 12:09:04.851994 17486 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8eadcb8f48ad471599f2fe5c00f9c5fa"
dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99"
 from {username='slave'} at 127.0.0.1:54470
I20260709 12:09:04.852407 17486 raft_consensus.cc:493] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:04.852666 17486 raft_consensus.cc:3060] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:04.857029 17486 raft_consensus.cc:515] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:09:04.859432 17486 leader_election.cc:290] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [CANDIDATE]: Term 3 election: Requested vote from peers 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181), 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195:37765)
I20260709 12:09:04.860054 17412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eadcb8f48ad471599f2fe5c00f9c5fa" candidate_uuid: "2148f2bf702c4738a23fadb9df5f8e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "854572a3bda640e7950a027df5378cdd"
I20260709 12:09:04.860636 17412 raft_consensus.cc:3055] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 854572a3bda640e7950a027df5378cdd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:04.860956 17412 raft_consensus.cc:740] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 854572a3bda640e7950a027df5378cdd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 854572a3bda640e7950a027df5378cdd, State: Running, Role: LEADER
I20260709 12:09:04.861239 17558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eadcb8f48ad471599f2fe5c00f9c5fa" candidate_uuid: "2148f2bf702c4738a23fadb9df5f8e99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "290dc05c27f24fdf9873533e9b0f6445"
I20260709 12:09:04.861794 17558 raft_consensus.cc:3060] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 290dc05c27f24fdf9873533e9b0f6445 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:04.861744 17412 consensus_queue.cc:260] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 854572a3bda640e7950a027df5378cdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:09:04.863097 17412 raft_consensus.cc:3060] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 854572a3bda640e7950a027df5378cdd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:04.866362 17558 raft_consensus.cc:2468] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 290dc05c27f24fdf9873533e9b0f6445 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2148f2bf702c4738a23fadb9df5f8e99 in term 3.
I20260709 12:09:04.867601 17450 leader_election.cc:304] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2148f2bf702c4738a23fadb9df5f8e99, 290dc05c27f24fdf9873533e9b0f6445; no voters: 
I20260709 12:09:04.868263 17731 raft_consensus.cc:2804] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:04.869298 17731 raft_consensus.cc:697] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [term 3 LEADER]: Becoming Leader. State: Replica: 2148f2bf702c4738a23fadb9df5f8e99, State: Running, Role: LEADER
I20260709 12:09:04.869663 17412 raft_consensus.cc:2468] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 854572a3bda640e7950a027df5378cdd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2148f2bf702c4738a23fadb9df5f8e99 in term 3.
I20260709 12:09:04.870105 17731 consensus_queue.cc:237] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:09:04.877887 17309 catalog_manager.cc:5697] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 reported cstate change: term changed from 2 to 3, leader changed from 854572a3bda640e7950a027df5378cdd (127.16.98.193) to 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194). New cstate: current_term: 3 leader_uuid: "2148f2bf702c4738a23fadb9df5f8e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:05.042263 17746 raft_consensus.cc:993] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd: : Instructing follower 290dc05c27f24fdf9873533e9b0f6445 to start an election
I20260709 12:09:05.042747 17771 raft_consensus.cc:1081] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [term 3 LEADER]: Signalling peer 290dc05c27f24fdf9873533e9b0f6445 to start an election
I20260709 12:09:05.044247 17558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "556c7c2480ef40c5adfaa946e5d95c8b"
dest_uuid: "290dc05c27f24fdf9873533e9b0f6445"
 from {username='slave'} at 127.0.0.1:60214
I20260709 12:09:05.044832 17558 raft_consensus.cc:493] T 556c7c2480ef40c5adfaa946e5d95c8b P 290dc05c27f24fdf9873533e9b0f6445 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:05.045221 17558 raft_consensus.cc:3060] T 556c7c2480ef40c5adfaa946e5d95c8b P 290dc05c27f24fdf9873533e9b0f6445 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:05.052502 17558 raft_consensus.cc:515] T 556c7c2480ef40c5adfaa946e5d95c8b P 290dc05c27f24fdf9873533e9b0f6445 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:09:05.055321 17558 leader_election.cc:290] T 556c7c2480ef40c5adfaa946e5d95c8b P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 4 election: Requested vote from peers 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181), 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635)
I20260709 12:09:05.055928 17412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556c7c2480ef40c5adfaa946e5d95c8b" candidate_uuid: "290dc05c27f24fdf9873533e9b0f6445" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "854572a3bda640e7950a027df5378cdd"
I20260709 12:09:05.056238 17486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556c7c2480ef40c5adfaa946e5d95c8b" candidate_uuid: "290dc05c27f24fdf9873533e9b0f6445" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99"
I20260709 12:09:05.056465 17412 raft_consensus.cc:3055] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:05.056699 17486 raft_consensus.cc:3060] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:05.056771 17412 raft_consensus.cc:740] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 854572a3bda640e7950a027df5378cdd, State: Running, Role: LEADER
I20260709 12:09:05.057524 17412 consensus_queue.cc:260] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:09:05.058581 17412 raft_consensus.cc:3060] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:05.062808 17486 raft_consensus.cc:2468] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 290dc05c27f24fdf9873533e9b0f6445 in term 4.
I20260709 12:09:05.064076 17526 leader_election.cc:304] T 556c7c2480ef40c5adfaa946e5d95c8b P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2148f2bf702c4738a23fadb9df5f8e99, 290dc05c27f24fdf9873533e9b0f6445; no voters: 
I20260709 12:09:05.064396 17412 raft_consensus.cc:2468] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 290dc05c27f24fdf9873533e9b0f6445 in term 4.
I20260709 12:09:05.064877 17738 raft_consensus.cc:2804] T 556c7c2480ef40c5adfaa946e5d95c8b P 290dc05c27f24fdf9873533e9b0f6445 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:05.066732 17738 raft_consensus.cc:697] T 556c7c2480ef40c5adfaa946e5d95c8b P 290dc05c27f24fdf9873533e9b0f6445 [term 4 LEADER]: Becoming Leader. State: Replica: 290dc05c27f24fdf9873533e9b0f6445, State: Running, Role: LEADER
I20260709 12:09:05.067497 17738 consensus_queue.cc:237] T 556c7c2480ef40c5adfaa946e5d95c8b P 290dc05c27f24fdf9873533e9b0f6445 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:09:05.069217 17771 raft_consensus.cc:993] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd: : Instructing follower 2148f2bf702c4738a23fadb9df5f8e99 to start an election
I20260709 12:09:05.069655 17771 raft_consensus.cc:1081] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [term 3 LEADER]: Signalling peer 2148f2bf702c4738a23fadb9df5f8e99 to start an election
I20260709 12:09:05.071266 17486 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a81d098aae2c4871a507e0a1c48e006d"
dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99"
 from {username='slave'} at 127.0.0.1:54470
I20260709 12:09:05.071882 17486 raft_consensus.cc:493] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:05.072283 17486 raft_consensus.cc:3060] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:05.074887 17309 catalog_manager.cc:5697] T 556c7c2480ef40c5adfaa946e5d95c8b P 290dc05c27f24fdf9873533e9b0f6445 reported cstate change: term changed from 3 to 4, leader changed from 854572a3bda640e7950a027df5378cdd (127.16.98.193) to 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195). New cstate: current_term: 4 leader_uuid: "290dc05c27f24fdf9873533e9b0f6445" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:05.078904 17486 raft_consensus.cc:515] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:09:05.081601 17412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d098aae2c4871a507e0a1c48e006d" candidate_uuid: "2148f2bf702c4738a23fadb9df5f8e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "854572a3bda640e7950a027df5378cdd"
I20260709 12:09:05.081737 17486 leader_election.cc:290] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 [CANDIDATE]: Term 4 election: Requested vote from peers 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181), 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195:37765)
I20260709 12:09:05.082118 17412 raft_consensus.cc:3055] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:05.082242 17558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a81d098aae2c4871a507e0a1c48e006d" candidate_uuid: "2148f2bf702c4738a23fadb9df5f8e99" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "290dc05c27f24fdf9873533e9b0f6445"
I20260709 12:09:05.082454 17412 raft_consensus.cc:740] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 854572a3bda640e7950a027df5378cdd, State: Running, Role: LEADER
I20260709 12:09:05.082813 17558 raft_consensus.cc:3060] T a81d098aae2c4871a507e0a1c48e006d P 290dc05c27f24fdf9873533e9b0f6445 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:05.083189 17412 consensus_queue.cc:260] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:09:05.084270 17412 raft_consensus.cc:3060] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:05.089267 17558 raft_consensus.cc:2468] T a81d098aae2c4871a507e0a1c48e006d P 290dc05c27f24fdf9873533e9b0f6445 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2148f2bf702c4738a23fadb9df5f8e99 in term 4.
I20260709 12:09:05.090214 17412 raft_consensus.cc:2468] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2148f2bf702c4738a23fadb9df5f8e99 in term 4.
I20260709 12:09:05.090862 17450 leader_election.cc:304] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2148f2bf702c4738a23fadb9df5f8e99, 290dc05c27f24fdf9873533e9b0f6445; no voters: 
I20260709 12:09:05.091599 17731 raft_consensus.cc:2804] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:05.092074 17731 raft_consensus.cc:697] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 [term 4 LEADER]: Becoming Leader. State: Replica: 2148f2bf702c4738a23fadb9df5f8e99, State: Running, Role: LEADER
I20260709 12:09:05.092763 17731 consensus_queue.cc:237] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:09:05.099673 17309 catalog_manager.cc:5697] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 reported cstate change: term changed from 3 to 4, leader changed from 854572a3bda640e7950a027df5378cdd (127.16.98.193) to 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194). New cstate: current_term: 4 leader_uuid: "2148f2bf702c4738a23fadb9df5f8e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:05.169338 17771 raft_consensus.cc:993] T 04e015de4bdc40b893cb59db8d999cbd P 854572a3bda640e7950a027df5378cdd: : Instructing follower 290dc05c27f24fdf9873533e9b0f6445 to start an election
I20260709 12:09:05.169813 17746 raft_consensus.cc:1081] T 04e015de4bdc40b893cb59db8d999cbd P 854572a3bda640e7950a027df5378cdd [term 2 LEADER]: Signalling peer 290dc05c27f24fdf9873533e9b0f6445 to start an election
I20260709 12:09:05.171218 17558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04e015de4bdc40b893cb59db8d999cbd"
dest_uuid: "290dc05c27f24fdf9873533e9b0f6445"
 from {username='slave'} at 127.0.0.1:60214
I20260709 12:09:05.171770 17558 raft_consensus.cc:493] T 04e015de4bdc40b893cb59db8d999cbd P 290dc05c27f24fdf9873533e9b0f6445 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:05.172127 17558 raft_consensus.cc:3060] T 04e015de4bdc40b893cb59db8d999cbd P 290dc05c27f24fdf9873533e9b0f6445 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:05.177606 17558 raft_consensus.cc:515] T 04e015de4bdc40b893cb59db8d999cbd P 290dc05c27f24fdf9873533e9b0f6445 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:09:05.179522 17558 leader_election.cc:290] T 04e015de4bdc40b893cb59db8d999cbd P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 3 election: Requested vote from peers 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181), 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635)
I20260709 12:09:05.180435 17487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e015de4bdc40b893cb59db8d999cbd" candidate_uuid: "290dc05c27f24fdf9873533e9b0f6445" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99"
I20260709 12:09:05.180953 17487 raft_consensus.cc:3060] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:05.181496 17412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e015de4bdc40b893cb59db8d999cbd" candidate_uuid: "290dc05c27f24fdf9873533e9b0f6445" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "854572a3bda640e7950a027df5378cdd"
I20260709 12:09:05.181994 17412 raft_consensus.cc:3055] T 04e015de4bdc40b893cb59db8d999cbd P 854572a3bda640e7950a027df5378cdd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:05.182248 17412 raft_consensus.cc:740] T 04e015de4bdc40b893cb59db8d999cbd P 854572a3bda640e7950a027df5378cdd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 854572a3bda640e7950a027df5378cdd, State: Running, Role: LEADER
I20260709 12:09:05.183046 17412 consensus_queue.cc:260] T 04e015de4bdc40b893cb59db8d999cbd P 854572a3bda640e7950a027df5378cdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:09:05.184091 17412 raft_consensus.cc:3060] T 04e015de4bdc40b893cb59db8d999cbd P 854572a3bda640e7950a027df5378cdd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:05.186935 17487 raft_consensus.cc:2468] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 290dc05c27f24fdf9873533e9b0f6445 in term 3.
I20260709 12:09:05.187925 17526 leader_election.cc:304] T 04e015de4bdc40b893cb59db8d999cbd P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2148f2bf702c4738a23fadb9df5f8e99, 290dc05c27f24fdf9873533e9b0f6445; no voters: 
I20260709 12:09:05.188674 17738 raft_consensus.cc:2804] T 04e015de4bdc40b893cb59db8d999cbd P 290dc05c27f24fdf9873533e9b0f6445 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:05.189181 17738 raft_consensus.cc:697] T 04e015de4bdc40b893cb59db8d999cbd P 290dc05c27f24fdf9873533e9b0f6445 [term 3 LEADER]: Becoming Leader. State: Replica: 290dc05c27f24fdf9873533e9b0f6445, State: Running, Role: LEADER
I20260709 12:09:05.189584 17412 raft_consensus.cc:2468] T 04e015de4bdc40b893cb59db8d999cbd P 854572a3bda640e7950a027df5378cdd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 290dc05c27f24fdf9873533e9b0f6445 in term 3.
I20260709 12:09:05.190075 17738 consensus_queue.cc:237] T 04e015de4bdc40b893cb59db8d999cbd P 290dc05c27f24fdf9873533e9b0f6445 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:09:05.197993 17309 catalog_manager.cc:5697] T 04e015de4bdc40b893cb59db8d999cbd P 290dc05c27f24fdf9873533e9b0f6445 reported cstate change: term changed from 2 to 3, leader changed from 854572a3bda640e7950a027df5378cdd (127.16.98.193) to 290dc05c27f24fdf9873533e9b0f6445 (127.16.98.195). New cstate: current_term: 3 leader_uuid: "290dc05c27f24fdf9873533e9b0f6445" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:05.304721 17558 raft_consensus.cc:1275] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 290dc05c27f24fdf9873533e9b0f6445 [term 3 FOLLOWER]: Refusing update from remote peer 2148f2bf702c4738a23fadb9df5f8e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:05.305845 17731 consensus_queue.cc:1048] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:05.315236 17412 raft_consensus.cc:1275] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 854572a3bda640e7950a027df5378cdd [term 3 FOLLOWER]: Refusing update from remote peer 2148f2bf702c4738a23fadb9df5f8e99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:05.316725 17731 consensus_queue.cc:1048] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:05.664333 17412 raft_consensus.cc:1275] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [term 4 FOLLOWER]: Refusing update from remote peer 2148f2bf702c4738a23fadb9df5f8e99: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:05.665622 17731 consensus_queue.cc:1048] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:05.669308 17487 raft_consensus.cc:1275] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 [term 4 FOLLOWER]: Refusing update from remote peer 290dc05c27f24fdf9873533e9b0f6445: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:05.671258 17738 consensus_queue.cc:1048] T 556c7c2480ef40c5adfaa946e5d95c8b P 290dc05c27f24fdf9873533e9b0f6445 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:05.676496 17558 raft_consensus.cc:1275] T a81d098aae2c4871a507e0a1c48e006d P 290dc05c27f24fdf9873533e9b0f6445 [term 4 FOLLOWER]: Refusing update from remote peer 2148f2bf702c4738a23fadb9df5f8e99: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:05.679138 17731 consensus_queue.cc:1048] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:05.679631 17484 raft_consensus.cc:1275] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99 [term 3 FOLLOWER]: Refusing update from remote peer 290dc05c27f24fdf9873533e9b0f6445: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:05.682544 17778 consensus_queue.cc:1048] T 04e015de4bdc40b893cb59db8d999cbd P 290dc05c27f24fdf9873533e9b0f6445 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:05.688493 17412 raft_consensus.cc:1275] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [term 4 FOLLOWER]: Refusing update from remote peer 290dc05c27f24fdf9873533e9b0f6445: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:09:05.691139 17778 consensus_queue.cc:1048] T 556c7c2480ef40c5adfaa946e5d95c8b P 290dc05c27f24fdf9873533e9b0f6445 [LEADER]: Connected to new peer: Peer: permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:05.740831 17410 raft_consensus.cc:1275] T 04e015de4bdc40b893cb59db8d999cbd P 854572a3bda640e7950a027df5378cdd [term 3 FOLLOWER]: Refusing update from remote peer 290dc05c27f24fdf9873533e9b0f6445: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:05.744277 17738 consensus_queue.cc:1048] T 04e015de4bdc40b893cb59db8d999cbd P 290dc05c27f24fdf9873533e9b0f6445 [LEADER]: Connected to new peer: Peer: permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:05.762966 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:05.772756 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:05.773449 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:06.774755 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:06.782183 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:06.782689 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:07.783737 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:07.788868 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:07.789283 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:08.790043 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:08.795243 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:08.795642 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:09.796473 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:09.801556 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:09.801963 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:10.802820 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:10.808044 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:10.808466 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:12.314527 17808 raft_consensus.cc:493] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 854572a3bda640e7950a027df5378cdd)
I20260709 12:09:12.315518 17808 raft_consensus.cc:515] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:09:12.380448 17808 leader_election.cc:290] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181), 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635)
I20260709 12:09:12.381326 17808 raft_consensus.cc:493] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 290dc05c27f24fdf9873533e9b0f6445 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2148f2bf702c4738a23fadb9df5f8e99)
I20260709 12:09:12.381971 17808 raft_consensus.cc:515] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 290dc05c27f24fdf9873533e9b0f6445 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "854572a3bda640e7950a027df5378cdd" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 37181 } } peers { permanent_uuid: "2148f2bf702c4738a23fadb9df5f8e99" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45635 } } peers { permanent_uuid: "290dc05c27f24fdf9873533e9b0f6445" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37765 } }
I20260709 12:09:12.384429 17808 leader_election.cc:290] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181), 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635)
I20260709 12:09:12.407653 17486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "349c94cc3eb84c8dbcf13222e8d85105" candidate_uuid: "290dc05c27f24fdf9873533e9b0f6445" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99" is_pre_election: true
I20260709 12:09:12.415021 17486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eadcb8f48ad471599f2fe5c00f9c5fa" candidate_uuid: "290dc05c27f24fdf9873533e9b0f6445" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2148f2bf702c4738a23fadb9df5f8e99" is_pre_election: true
I20260709 12:09:12.433722 17411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "349c94cc3eb84c8dbcf13222e8d85105" candidate_uuid: "290dc05c27f24fdf9873533e9b0f6445" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "854572a3bda640e7950a027df5378cdd" is_pre_election: true
I20260709 12:09:12.433866 17412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eadcb8f48ad471599f2fe5c00f9c5fa" candidate_uuid: "290dc05c27f24fdf9873533e9b0f6445" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "854572a3bda640e7950a027df5378cdd" is_pre_election: true
I20260709 12:09:12.436599 17527 leader_election.cc:304] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 290dc05c27f24fdf9873533e9b0f6445; no voters: 2148f2bf702c4738a23fadb9df5f8e99, 854572a3bda640e7950a027df5378cdd
I20260709 12:09:12.437450 17812 raft_consensus.cc:2749] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:09:12.438726 17527 leader_election.cc:304] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 290dc05c27f24fdf9873533e9b0f6445 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 290dc05c27f24fdf9873533e9b0f6445; no voters: 2148f2bf702c4738a23fadb9df5f8e99, 854572a3bda640e7950a027df5378cdd
I20260709 12:09:12.439276 17808 raft_consensus.cc:2749] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 290dc05c27f24fdf9873533e9b0f6445 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:09:12.681872 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:12.687335 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:12.687744 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:09:13.216306 17508 debug-util.cc:398] Leaking SignalData structure 0x7b08000fed60 after lost signal to thread 16782
W20260709 12:09:13.217017 17508 debug-util.cc:398] Leaking SignalData structure 0x7b08000fd480 after lost signal to thread 17344
W20260709 12:09:13.217702 17508 debug-util.cc:398] Leaking SignalData structure 0x7b080015be20 after lost signal to thread 17436
W20260709 12:09:13.218452 17508 debug-util.cc:398] Leaking SignalData structure 0x7b08000c23c0 after lost signal to thread 17511
W20260709 12:09:13.219273 17508 debug-util.cc:398] Leaking SignalData structure 0x7b08001d3460 after lost signal to thread 17585
I20260709 12:09:13.688587 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:13.693697 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:13.694104 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:14.695276 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:14.701476 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:09:14.701894 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:15.730877 16779 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:09:15.731410 16779 tablet_server.cc:179] TabletServer@127.16.98.193:0 shutting down...
W20260709 12:09:15.744445 17527 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
W20260709 12:09:15.754401 17527 consensus_peers.cc:597] T b4f614b23b964d519944544229c1cf98 P 290dc05c27f24fdf9873533e9b0f6445 -> Peer 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181): Couldn't send request to peer 854572a3bda640e7950a027df5378cdd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:15.765040 16779 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:09:15.765756 16779 tablet_replica.cc:333] T b4f614b23b964d519944544229c1cf98 P 854572a3bda640e7950a027df5378cdd: stopping tablet replica
I20260709 12:09:15.766439 16779 raft_consensus.cc:2243] T b4f614b23b964d519944544229c1cf98 P 854572a3bda640e7950a027df5378cdd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.767040 16779 raft_consensus.cc:2272] T b4f614b23b964d519944544229c1cf98 P 854572a3bda640e7950a027df5378cdd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.769484 16779 tablet_replica.cc:333] T 6fdffb55b864444ba1e3539a24b9f729 P 854572a3bda640e7950a027df5378cdd: stopping tablet replica
I20260709 12:09:15.770126 16779 raft_consensus.cc:2243] T 6fdffb55b864444ba1e3539a24b9f729 P 854572a3bda640e7950a027df5378cdd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.770593 16779 raft_consensus.cc:2272] T 6fdffb55b864444ba1e3539a24b9f729 P 854572a3bda640e7950a027df5378cdd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.772460 16779 tablet_replica.cc:333] T abc0445a2776423098f7ba93cfe3e7f2 P 854572a3bda640e7950a027df5378cdd: stopping tablet replica
I20260709 12:09:15.772997 16779 raft_consensus.cc:2243] T abc0445a2776423098f7ba93cfe3e7f2 P 854572a3bda640e7950a027df5378cdd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.773723 16779 raft_consensus.cc:2272] T abc0445a2776423098f7ba93cfe3e7f2 P 854572a3bda640e7950a027df5378cdd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.775602 16779 tablet_replica.cc:333] T 04e015de4bdc40b893cb59db8d999cbd P 854572a3bda640e7950a027df5378cdd: stopping tablet replica
I20260709 12:09:15.776110 16779 raft_consensus.cc:2243] T 04e015de4bdc40b893cb59db8d999cbd P 854572a3bda640e7950a027df5378cdd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.776551 16779 raft_consensus.cc:2272] T 04e015de4bdc40b893cb59db8d999cbd P 854572a3bda640e7950a027df5378cdd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.778223 16779 tablet_replica.cc:333] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd: stopping tablet replica
I20260709 12:09:15.778801 16779 raft_consensus.cc:2243] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.779556 16779 raft_consensus.cc:2272] T ce29ffec4f0245cf8ebfd905f615b11d P 854572a3bda640e7950a027df5378cdd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.781390 16779 tablet_replica.cc:333] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd: stopping tablet replica
I20260709 12:09:15.781939 16779 raft_consensus.cc:2243] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.782379 16779 raft_consensus.cc:2272] T 556c7c2480ef40c5adfaa946e5d95c8b P 854572a3bda640e7950a027df5378cdd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.784215 16779 tablet_replica.cc:333] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd: stopping tablet replica
I20260709 12:09:15.784726 16779 raft_consensus.cc:2243] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.785441 16779 raft_consensus.cc:2272] T 349c94cc3eb84c8dbcf13222e8d85105 P 854572a3bda640e7950a027df5378cdd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.787182 16779 tablet_replica.cc:333] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd: stopping tablet replica
I20260709 12:09:15.787680 16779 raft_consensus.cc:2243] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.788087 16779 raft_consensus.cc:2272] T a81d098aae2c4871a507e0a1c48e006d P 854572a3bda640e7950a027df5378cdd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.790023 16779 tablet_replica.cc:333] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 854572a3bda640e7950a027df5378cdd: stopping tablet replica
I20260709 12:09:15.790512 16779 raft_consensus.cc:2243] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 854572a3bda640e7950a027df5378cdd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.791005 16779 raft_consensus.cc:2272] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 854572a3bda640e7950a027df5378cdd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.792970 16779 tablet_replica.cc:333] T f854f3e731a84e6e9ade0adcad9a7e10 P 854572a3bda640e7950a027df5378cdd: stopping tablet replica
I20260709 12:09:15.793444 16779 raft_consensus.cc:2243] T f854f3e731a84e6e9ade0adcad9a7e10 P 854572a3bda640e7950a027df5378cdd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.794113 16779 raft_consensus.cc:2272] T f854f3e731a84e6e9ade0adcad9a7e10 P 854572a3bda640e7950a027df5378cdd [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:09:15.824638 17453 consensus_peers.cc:597] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 -> Peer 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181): Couldn't send request to peer 854572a3bda640e7950a027df5378cdd. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:37181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:15.846597 16779 tablet_server.cc:196] TabletServer@127.16.98.193:0 shutdown complete.
I20260709 12:09:15.866252 16779 tablet_server.cc:179] TabletServer@127.16.98.194:0 shutting down...
I20260709 12:09:15.890407 16779 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:09:15.891103 16779 tablet_replica.cc:333] T b4f614b23b964d519944544229c1cf98 P 2148f2bf702c4738a23fadb9df5f8e99: stopping tablet replica
I20260709 12:09:15.891690 16779 raft_consensus.cc:2243] T b4f614b23b964d519944544229c1cf98 P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.892150 16779 raft_consensus.cc:2272] T b4f614b23b964d519944544229c1cf98 P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.894045 16779 tablet_replica.cc:333] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99: stopping tablet replica
I20260709 12:09:15.894588 16779 raft_consensus.cc:2243] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.895080 16779 raft_consensus.cc:2272] T 556c7c2480ef40c5adfaa946e5d95c8b P 2148f2bf702c4738a23fadb9df5f8e99 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.896649 16779 tablet_replica.cc:333] T ce29ffec4f0245cf8ebfd905f615b11d P 2148f2bf702c4738a23fadb9df5f8e99: stopping tablet replica
I20260709 12:09:15.897121 16779 raft_consensus.cc:2243] T ce29ffec4f0245cf8ebfd905f615b11d P 2148f2bf702c4738a23fadb9df5f8e99 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.897554 16779 raft_consensus.cc:2272] T ce29ffec4f0245cf8ebfd905f615b11d P 2148f2bf702c4738a23fadb9df5f8e99 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.899216 16779 tablet_replica.cc:333] T 6fdffb55b864444ba1e3539a24b9f729 P 2148f2bf702c4738a23fadb9df5f8e99: stopping tablet replica
I20260709 12:09:15.899677 16779 raft_consensus.cc:2243] T 6fdffb55b864444ba1e3539a24b9f729 P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.900386 16779 raft_consensus.cc:2272] T 6fdffb55b864444ba1e3539a24b9f729 P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.901965 16779 tablet_replica.cc:333] T abc0445a2776423098f7ba93cfe3e7f2 P 2148f2bf702c4738a23fadb9df5f8e99: stopping tablet replica
I20260709 12:09:15.902623 16779 raft_consensus.cc:2243] T abc0445a2776423098f7ba93cfe3e7f2 P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.903388 16779 raft_consensus.cc:2272] T abc0445a2776423098f7ba93cfe3e7f2 P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.905543 16779 tablet_replica.cc:333] T f854f3e731a84e6e9ade0adcad9a7e10 P 2148f2bf702c4738a23fadb9df5f8e99: stopping tablet replica
I20260709 12:09:15.906126 16779 raft_consensus.cc:2243] T f854f3e731a84e6e9ade0adcad9a7e10 P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.906797 16779 raft_consensus.cc:2272] T f854f3e731a84e6e9ade0adcad9a7e10 P 2148f2bf702c4738a23fadb9df5f8e99 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:09:15.907655 17527 consensus_peers.cc:597] T 04e015de4bdc40b893cb59db8d999cbd P 290dc05c27f24fdf9873533e9b0f6445 -> Peer 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181): Couldn't send request to peer 854572a3bda640e7950a027df5378cdd. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:37181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:15.908715 16779 tablet_replica.cc:333] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99: stopping tablet replica
I20260709 12:09:15.909155 16779 raft_consensus.cc:2243] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.909789 16779 raft_consensus.cc:2272] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 2148f2bf702c4738a23fadb9df5f8e99 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.911413 16779 tablet_replica.cc:333] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99: stopping tablet replica
I20260709 12:09:15.911820 16779 raft_consensus.cc:2243] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.912166 16779 raft_consensus.cc:2272] T 04e015de4bdc40b893cb59db8d999cbd P 2148f2bf702c4738a23fadb9df5f8e99 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.913611 16779 tablet_replica.cc:333] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99: stopping tablet replica
I20260709 12:09:15.914008 16779 raft_consensus.cc:2243] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:09:15.914603 16779 raft_consensus.cc:2272] T a81d098aae2c4871a507e0a1c48e006d P 2148f2bf702c4738a23fadb9df5f8e99 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.916173 16779 tablet_replica.cc:333] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99: stopping tablet replica
I20260709 12:09:15.916570 16779 raft_consensus.cc:2243] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:15.916921 16779 raft_consensus.cc:2272] T 349c94cc3eb84c8dbcf13222e8d85105 P 2148f2bf702c4738a23fadb9df5f8e99 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:15.978255 16779 tablet_server.cc:196] TabletServer@127.16.98.194:0 shutdown complete.
W20260709 12:09:15.995324 17527 consensus_peers.cc:597] T 556c7c2480ef40c5adfaa946e5d95c8b P 290dc05c27f24fdf9873533e9b0f6445 -> Peer 854572a3bda640e7950a027df5378cdd (127.16.98.193:37181): Couldn't send request to peer 854572a3bda640e7950a027df5378cdd. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:37181: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:16.007184 16779 tablet_server.cc:179] TabletServer@127.16.98.195:0 shutting down...
W20260709 12:09:16.021957 17526 consensus_peers.cc:597] T b4f614b23b964d519944544229c1cf98 P 290dc05c27f24fdf9873533e9b0f6445 -> Peer 2148f2bf702c4738a23fadb9df5f8e99 (127.16.98.194:45635): Couldn't send request to peer 2148f2bf702c4738a23fadb9df5f8e99. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.194:45635: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:16.036350 16779 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:09:16.037258 16779 tablet_replica.cc:333] T 04e015de4bdc40b893cb59db8d999cbd P 290dc05c27f24fdf9873533e9b0f6445: stopping tablet replica
I20260709 12:09:16.038215 16779 raft_consensus.cc:2243] T 04e015de4bdc40b893cb59db8d999cbd P 290dc05c27f24fdf9873533e9b0f6445 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:09:16.039505 16779 raft_consensus.cc:2272] T 04e015de4bdc40b893cb59db8d999cbd P 290dc05c27f24fdf9873533e9b0f6445 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:16.041534 16779 tablet_replica.cc:333] T b4f614b23b964d519944544229c1cf98 P 290dc05c27f24fdf9873533e9b0f6445: stopping tablet replica
I20260709 12:09:16.042150 16779 raft_consensus.cc:2243] T b4f614b23b964d519944544229c1cf98 P 290dc05c27f24fdf9873533e9b0f6445 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:09:16.043197 16779 raft_consensus.cc:2272] T b4f614b23b964d519944544229c1cf98 P 290dc05c27f24fdf9873533e9b0f6445 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:16.044842 16779 tablet_replica.cc:333] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445: stopping tablet replica
I20260709 12:09:16.045425 16779 raft_consensus.cc:2243] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:16.045967 16779 raft_consensus.cc:2272] T 349c94cc3eb84c8dbcf13222e8d85105 P 290dc05c27f24fdf9873533e9b0f6445 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:16.047814 16779 tablet_replica.cc:333] T a81d098aae2c4871a507e0a1c48e006d P 290dc05c27f24fdf9873533e9b0f6445: stopping tablet replica
I20260709 12:09:16.048333 16779 raft_consensus.cc:2243] T a81d098aae2c4871a507e0a1c48e006d P 290dc05c27f24fdf9873533e9b0f6445 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:16.048838 16779 raft_consensus.cc:2272] T a81d098aae2c4871a507e0a1c48e006d P 290dc05c27f24fdf9873533e9b0f6445 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:16.050573 16779 tablet_replica.cc:333] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 290dc05c27f24fdf9873533e9b0f6445: stopping tablet replica
I20260709 12:09:16.051258 16779 raft_consensus.cc:2243] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 290dc05c27f24fdf9873533e9b0f6445 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:16.051785 16779 raft_consensus.cc:2272] T 8eadcb8f48ad471599f2fe5c00f9c5fa P 290dc05c27f24fdf9873533e9b0f6445 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:16.053503 16779 tablet_replica.cc:333] T f854f3e731a84e6e9ade0adcad9a7e10 P 290dc05c27f24fdf9873533e9b0f6445: stopping tablet replica
I20260709 12:09:16.054014 16779 raft_consensus.cc:2243] T f854f3e731a84e6e9ade0adcad9a7e10 P 290dc05c27f24fdf9873533e9b0f6445 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:16.054458 16779 raft_consensus.cc:2272] T f854f3e731a84e6e9ade0adcad9a7e10 P 290dc05c27f24fdf9873533e9b0f6445 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:16.056123 16779 tablet_replica.cc:333] T 6fdffb55b864444ba1e3539a24b9f729 P 290dc05c27f24fdf9873533e9b0f6445: stopping tablet replica
I20260709 12:09:16.056653 16779 raft_consensus.cc:2243] T 6fdffb55b864444ba1e3539a24b9f729 P 290dc05c27f24fdf9873533e9b0f6445 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:16.057133 16779 raft_consensus.cc:2272] T 6fdffb55b864444ba1e3539a24b9f729 P 290dc05c27f24fdf9873533e9b0f6445 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:16.058887 16779 tablet_replica.cc:333] T abc0445a2776423098f7ba93cfe3e7f2 P 290dc05c27f24fdf9873533e9b0f6445: stopping tablet replica
I20260709 12:09:16.059362 16779 raft_consensus.cc:2243] T abc0445a2776423098f7ba93cfe3e7f2 P 290dc05c27f24fdf9873533e9b0f6445 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:16.059842 16779 raft_consensus.cc:2272] T abc0445a2776423098f7ba93cfe3e7f2 P 290dc05c27f24fdf9873533e9b0f6445 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:16.061501 16779 tablet_replica.cc:333] T 556c7c2480ef40c5adfaa946e5d95c8b P 290dc05c27f24fdf9873533e9b0f6445: stopping tablet replica
I20260709 12:09:16.061970 16779 raft_consensus.cc:2243] T 556c7c2480ef40c5adfaa946e5d95c8b P 290dc05c27f24fdf9873533e9b0f6445 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:09:16.063012 16779 raft_consensus.cc:2272] T 556c7c2480ef40c5adfaa946e5d95c8b P 290dc05c27f24fdf9873533e9b0f6445 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:16.064577 16779 tablet_replica.cc:333] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445: stopping tablet replica
I20260709 12:09:16.065026 16779 raft_consensus.cc:2243] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:16.065521 16779 raft_consensus.cc:2272] T ce29ffec4f0245cf8ebfd905f615b11d P 290dc05c27f24fdf9873533e9b0f6445 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:16.094844 16779 tablet_server.cc:196] TabletServer@127.16.98.195:0 shutdown complete.
I20260709 12:09:16.115406 16779 master.cc:562] Master@127.16.98.254:39263 shutting down...
I20260709 12:09:16.140568 16779 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a924c8c29f604e19b20e24a7d12e2383 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:09:16.141237 16779 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a924c8c29f604e19b20e24a7d12e2383 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:16.141566 16779 tablet_replica.cc:333] T 00000000000000000000000000000000 P a924c8c29f604e19b20e24a7d12e2383: stopping tablet replica
I20260709 12:09:16.161582 16779 master.cc:584] Master@127.16.98.254:39263 shutdown complete.
2148f2bf702c4738a23fadb9df5f8e99  4
290dc05c27f24fdf9873533e9b0f6445  1
854572a3bda640e7950a027df5378cdd  5
2148f2bf702c4738a23fadb9df5f8e99  4
290dc05c27f24fdf9873533e9b0f6445  3
854572a3bda640e7950a027df5378cdd  3
2148f2bf702c4738a23fadb9df5f8e99  1
290dc05c27f24fdf9873533e9b0f6445  1
854572a3bda640e7950a027df5378cdd  8
2148f2bf702c4738a23fadb9df5f8e99  3
290dc05c27f24fdf9873533e9b0f6445  3
854572a3bda640e7950a027df5378cdd  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (29789 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:09:16.212936 16779 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.98.254:38823
I20260709 12:09:16.214146 16779 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:16.220191 17822 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:16.220196 17823 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:16.221282 16779 server_base.cc:1061] running on GCE node
W20260709 12:09:16.221632 17825 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:16.222589 16779 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:16.222818 16779 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:16.222932 16779 hybrid_clock.cc:648] HybridClock initialized: now 1783598956222921 us; error 0 us; skew 500 ppm
I20260709 12:09:16.223371 16779 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:16.225522 16779 webserver.cc:533] Webserver started at http://127.16.98.254:44399/ using document root <none> and password file <none>
I20260709 12:09:16.225972 16779 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:16.226167 16779 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:16.226439 16779 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:16.227893 16779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/master-0-root/instance:
uuid: "b852ae4791e4401b8356c71ae33bbc7d"
format_stamp: "Formatted at 2026-07-09 12:09:16 on dist-test-slave-9bv4"
I20260709 12:09:16.232228 16779 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:09:16.235505 17830 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:16.236191 16779 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:09:16.236477 16779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/master-0-root
uuid: "b852ae4791e4401b8356c71ae33bbc7d"
format_stamp: "Formatted at 2026-07-09 12:09:16 on dist-test-slave-9bv4"
I20260709 12:09:16.236761 16779 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:16.250180 16779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:16.251401 16779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:16.288494 16779 rpc_server.cc:307] RPC server started. Bound to: 127.16.98.254:38823
I20260709 12:09:16.288584 17881 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.98.254:38823 every 8 connection(s)
I20260709 12:09:16.292366 17882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.301622 17882 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b852ae4791e4401b8356c71ae33bbc7d: Bootstrap starting.
I20260709 12:09:16.305998 17882 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b852ae4791e4401b8356c71ae33bbc7d: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:16.309842 17882 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b852ae4791e4401b8356c71ae33bbc7d: No bootstrap required, opened a new log
I20260709 12:09:16.311893 17882 raft_consensus.cc:359] T 00000000000000000000000000000000 P b852ae4791e4401b8356c71ae33bbc7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b852ae4791e4401b8356c71ae33bbc7d" member_type: VOTER }
I20260709 12:09:16.312297 17882 raft_consensus.cc:385] T 00000000000000000000000000000000 P b852ae4791e4401b8356c71ae33bbc7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:16.312474 17882 raft_consensus.cc:740] T 00000000000000000000000000000000 P b852ae4791e4401b8356c71ae33bbc7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b852ae4791e4401b8356c71ae33bbc7d, State: Initialized, Role: FOLLOWER
I20260709 12:09:16.312944 17882 consensus_queue.cc:260] T 00000000000000000000000000000000 P b852ae4791e4401b8356c71ae33bbc7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b852ae4791e4401b8356c71ae33bbc7d" member_type: VOTER }
I20260709 12:09:16.313340 17882 raft_consensus.cc:399] T 00000000000000000000000000000000 P b852ae4791e4401b8356c71ae33bbc7d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:09:16.313535 17882 raft_consensus.cc:493] T 00000000000000000000000000000000 P b852ae4791e4401b8356c71ae33bbc7d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:09:16.313746 17882 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b852ae4791e4401b8356c71ae33bbc7d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:16.317638 17882 raft_consensus.cc:515] T 00000000000000000000000000000000 P b852ae4791e4401b8356c71ae33bbc7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b852ae4791e4401b8356c71ae33bbc7d" member_type: VOTER }
I20260709 12:09:16.318073 17882 leader_election.cc:304] T 00000000000000000000000000000000 P b852ae4791e4401b8356c71ae33bbc7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b852ae4791e4401b8356c71ae33bbc7d; no voters: 
I20260709 12:09:16.319121 17882 leader_election.cc:290] T 00000000000000000000000000000000 P b852ae4791e4401b8356c71ae33bbc7d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:09:16.319482 17885 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b852ae4791e4401b8356c71ae33bbc7d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:16.320756 17885 raft_consensus.cc:697] T 00000000000000000000000000000000 P b852ae4791e4401b8356c71ae33bbc7d [term 1 LEADER]: Becoming Leader. State: Replica: b852ae4791e4401b8356c71ae33bbc7d, State: Running, Role: LEADER
I20260709 12:09:16.321380 17885 consensus_queue.cc:237] T 00000000000000000000000000000000 P b852ae4791e4401b8356c71ae33bbc7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b852ae4791e4401b8356c71ae33bbc7d" member_type: VOTER }
I20260709 12:09:16.321956 17882 sys_catalog.cc:565] T 00000000000000000000000000000000 P b852ae4791e4401b8356c71ae33bbc7d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:09:16.328347 17886 sys_catalog.cc:455] T 00000000000000000000000000000000 P b852ae4791e4401b8356c71ae33bbc7d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b852ae4791e4401b8356c71ae33bbc7d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b852ae4791e4401b8356c71ae33bbc7d" member_type: VOTER } }
I20260709 12:09:16.328491 17887 sys_catalog.cc:455] T 00000000000000000000000000000000 P b852ae4791e4401b8356c71ae33bbc7d [sys.catalog]: SysCatalogTable state changed. Reason: New leader b852ae4791e4401b8356c71ae33bbc7d. Latest consensus state: current_term: 1 leader_uuid: "b852ae4791e4401b8356c71ae33bbc7d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b852ae4791e4401b8356c71ae33bbc7d" member_type: VOTER } }
I20260709 12:09:16.329123 17886 sys_catalog.cc:458] T 00000000000000000000000000000000 P b852ae4791e4401b8356c71ae33bbc7d [sys.catalog]: This master's current role is: LEADER
I20260709 12:09:16.329239 17887 sys_catalog.cc:458] T 00000000000000000000000000000000 P b852ae4791e4401b8356c71ae33bbc7d [sys.catalog]: This master's current role is: LEADER
I20260709 12:09:16.330999 17895 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:09:16.336884 17895 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:09:16.337924 16779 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:09:16.345737 17895 catalog_manager.cc:1383] Generated new cluster ID: 4d8547e679ef454a9275d9c09385e0d8
I20260709 12:09:16.346004 17895 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:09:16.368942 17895 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:09:16.370163 17895 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:09:16.390396 17895 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b852ae4791e4401b8356c71ae33bbc7d: Generated new TSK 0
I20260709 12:09:16.390985 17895 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:09:16.404520 16779 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:16.410233 17903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:16.411489 17904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:16.413079 16779 server_base.cc:1061] running on GCE node
W20260709 12:09:16.413770 17906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:16.414605 16779 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:16.414882 16779 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:16.415060 16779 hybrid_clock.cc:648] HybridClock initialized: now 1783598956415032 us; error 0 us; skew 500 ppm
I20260709 12:09:16.415624 16779 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:16.417806 16779 webserver.cc:533] Webserver started at http://127.16.98.193:38539/ using document root <none> and password file <none>
I20260709 12:09:16.418299 16779 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:16.418478 16779 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:16.418804 16779 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:16.419844 16779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-0-root/instance:
uuid: "63f5bddeebd84e5788d671a176cfa8e1"
format_stamp: "Formatted at 2026-07-09 12:09:16 on dist-test-slave-9bv4"
I20260709 12:09:16.424101 16779 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:09:16.427095 17911 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:16.427995 16779 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:09:16.428294 16779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-0-root
uuid: "63f5bddeebd84e5788d671a176cfa8e1"
format_stamp: "Formatted at 2026-07-09 12:09:16 on dist-test-slave-9bv4"
I20260709 12:09:16.428540 16779 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:16.441215 16779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:16.442399 16779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:16.443846 16779 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:16.446009 16779 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:16.446211 16779 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:16.446457 16779 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:16.446606 16779 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:16.485392 16779 rpc_server.cc:307] RPC server started. Bound to: 127.16.98.193:39123
I20260709 12:09:16.485502 17973 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.98.193:39123 every 8 connection(s)
I20260709 12:09:16.490181 16779 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:16.497222 17978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:16.500196 17979 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:16.500545 16779 server_base.cc:1061] running on GCE node
W20260709 12:09:16.501209 17981 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:16.502241 16779 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:16.502487 16779 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:16.502729 16779 hybrid_clock.cc:648] HybridClock initialized: now 1783598956502709 us; error 0 us; skew 500 ppm
I20260709 12:09:16.503396 16779 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:16.503551 17974 heartbeater.cc:344] Connected to a master server at 127.16.98.254:38823
I20260709 12:09:16.503914 17974 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:16.504879 17974 heartbeater.cc:507] Master 127.16.98.254:38823 requested a full tablet report, sending...
I20260709 12:09:16.506197 16779 webserver.cc:533] Webserver started at http://127.16.98.194:39641/ using document root <none> and password file <none>
I20260709 12:09:16.506850 16779 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:16.507090 16779 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:16.507229 17847 ts_manager.cc:194] Registered new tserver with Master: 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123)
I20260709 12:09:16.507426 16779 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:16.508957 16779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-1-root/instance:
uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
format_stamp: "Formatted at 2026-07-09 12:09:16 on dist-test-slave-9bv4"
I20260709 12:09:16.509569 17847 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45910
I20260709 12:09:16.514007 16779 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:09:16.517118 17986 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:16.517818 16779 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:09:16.518093 16779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-1-root
uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
format_stamp: "Formatted at 2026-07-09 12:09:16 on dist-test-slave-9bv4"
I20260709 12:09:16.518332 16779 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:16.528733 16779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:16.529819 16779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:16.531445 16779 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:16.533516 16779 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:16.533732 16779 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:16.533984 16779 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:16.534154 16779 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:16.571677 16779 rpc_server.cc:307] RPC server started. Bound to: 127.16.98.194:36297
I20260709 12:09:16.571758 18048 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.98.194:36297 every 8 connection(s)
I20260709 12:09:16.576349 16779 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:16.583360 18052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:16.584012 18053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:16.585920 18055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:16.586786 16779 server_base.cc:1061] running on GCE node
I20260709 12:09:16.587733 16779 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:16.588001 16779 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:16.588197 16779 hybrid_clock.cc:648] HybridClock initialized: now 1783598956588161 us; error 0 us; skew 500 ppm
I20260709 12:09:16.588694 18049 heartbeater.cc:344] Connected to a master server at 127.16.98.254:38823
I20260709 12:09:16.588838 16779 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:16.589102 18049 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:16.589963 18049 heartbeater.cc:507] Master 127.16.98.254:38823 requested a full tablet report, sending...
I20260709 12:09:16.591401 16779 webserver.cc:533] Webserver started at http://127.16.98.195:38743/ using document root <none> and password file <none>
I20260709 12:09:16.591951 16779 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:16.592135 16779 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:16.592041 17847 ts_manager.cc:194] Registered new tserver with Master: c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:16.592522 16779 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:16.593462 17847 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45912
I20260709 12:09:16.593598 16779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-2-root/instance:
uuid: "4813437da0a74e65b61eb7bd1d18f110"
format_stamp: "Formatted at 2026-07-09 12:09:16 on dist-test-slave-9bv4"
I20260709 12:09:16.597898 16779 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:09:16.600827 18060 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:16.601507 16779 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:09:16.601794 16779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-2-root
uuid: "4813437da0a74e65b61eb7bd1d18f110"
format_stamp: "Formatted at 2026-07-09 12:09:16 on dist-test-slave-9bv4"
I20260709 12:09:16.602072 16779 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:16.610054 16779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:16.611209 16779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:16.612512 16779 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:16.614549 16779 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:16.614837 16779 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:16.615070 16779 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:16.615236 16779 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:16.654536 16779 rpc_server.cc:307] RPC server started. Bound to: 127.16.98.195:41931
I20260709 12:09:16.654634 18122 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.98.195:41931 every 8 connection(s)
I20260709 12:09:16.667676 18123 heartbeater.cc:344] Connected to a master server at 127.16.98.254:38823
I20260709 12:09:16.667979 18123 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:16.668668 18123 heartbeater.cc:507] Master 127.16.98.254:38823 requested a full tablet report, sending...
I20260709 12:09:16.670401 17847 ts_manager.cc:194] Registered new tserver with Master: 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:16.670837 16779 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013240233s
I20260709 12:09:16.672032 17847 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45928
I20260709 12:09:16.696897 17847 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45944:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:09:16.702864 17847 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:09:16.915750 18014 tablet_service.cc:1511] Processing CreateTablet for tablet 924b1f0746ad425bb3e560d8665428c1 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:09:16.916194 18088 tablet_service.cc:1511] Processing CreateTablet for tablet 924b1f0746ad425bb3e560d8665428c1 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:09:16.917260 18014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 924b1f0746ad425bb3e560d8665428c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.917448 18088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 924b1f0746ad425bb3e560d8665428c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.917853 18085 tablet_service.cc:1511] Processing CreateTablet for tablet 75266a6e976c41a99e22b9d7d7a2cd65 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:09:16.918143 18087 tablet_service.cc:1511] Processing CreateTablet for tablet e3cd916f51d64d5d87b9c504a06a8a1e (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:09:16.919297 18085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75266a6e976c41a99e22b9d7d7a2cd65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.919968 18084 tablet_service.cc:1511] Processing CreateTablet for tablet b8e1f5339f9042c5935e082c5f212b35 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:09:16.920064 18086 tablet_service.cc:1511] Processing CreateTablet for tablet 528748760fc743e3a2bce89e03314aab (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:09:16.922022 18083 tablet_service.cc:1511] Processing CreateTablet for tablet 7b8822f4f1de477e8866529047a823b9 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:09:16.923950 18013 tablet_service.cc:1511] Processing CreateTablet for tablet e3cd916f51d64d5d87b9c504a06a8a1e (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:09:16.924746 18082 tablet_service.cc:1511] Processing CreateTablet for tablet 6135c6398c3f4926b6f07433b6f63759 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:09:16.925292 18013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3cd916f51d64d5d87b9c504a06a8a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.929260 18012 tablet_service.cc:1511] Processing CreateTablet for tablet 528748760fc743e3a2bce89e03314aab (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:09:16.931815 18011 tablet_service.cc:1511] Processing CreateTablet for tablet 75266a6e976c41a99e22b9d7d7a2cd65 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:09:16.934082 18010 tablet_service.cc:1511] Processing CreateTablet for tablet b8e1f5339f9042c5935e082c5f212b35 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:09:16.936376 18081 tablet_service.cc:1511] Processing CreateTablet for tablet c345cb34fc6343e98baf0b21aac6d4d7 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:09:16.936838 18080 tablet_service.cc:1511] Processing CreateTablet for tablet c592029696004db48d68a9e4c3f45004 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:09:16.938337 18079 tablet_service.cc:1511] Processing CreateTablet for tablet 49c83fd6efbc4c8a92e2e65890ffafd2 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:09:16.938920 18009 tablet_service.cc:1511] Processing CreateTablet for tablet 7b8822f4f1de477e8866529047a823b9 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:09:16.940306 18008 tablet_service.cc:1511] Processing CreateTablet for tablet 6135c6398c3f4926b6f07433b6f63759 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:09:16.941330 17939 tablet_service.cc:1511] Processing CreateTablet for tablet 924b1f0746ad425bb3e560d8665428c1 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:09:16.941644 18007 tablet_service.cc:1511] Processing CreateTablet for tablet c345cb34fc6343e98baf0b21aac6d4d7 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:09:16.942732 17939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 924b1f0746ad425bb3e560d8665428c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.943302 18006 tablet_service.cc:1511] Processing CreateTablet for tablet c592029696004db48d68a9e4c3f45004 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:09:16.943614 17937 tablet_service.cc:1511] Processing CreateTablet for tablet 528748760fc743e3a2bce89e03314aab (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:09:16.944926 17937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 528748760fc743e3a2bce89e03314aab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.944643 18005 tablet_service.cc:1511] Processing CreateTablet for tablet 49c83fd6efbc4c8a92e2e65890ffafd2 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:09:16.941730 17938 tablet_service.cc:1511] Processing CreateTablet for tablet e3cd916f51d64d5d87b9c504a06a8a1e (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:09:16.947441 17938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3cd916f51d64d5d87b9c504a06a8a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.949308 17936 tablet_service.cc:1511] Processing CreateTablet for tablet 75266a6e976c41a99e22b9d7d7a2cd65 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:09:16.949731 17934 tablet_service.cc:1511] Processing CreateTablet for tablet 7b8822f4f1de477e8866529047a823b9 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:09:16.955338 17931 tablet_service.cc:1511] Processing CreateTablet for tablet c592029696004db48d68a9e4c3f45004 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:09:16.955729 17930 tablet_service.cc:1511] Processing CreateTablet for tablet 49c83fd6efbc4c8a92e2e65890ffafd2 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:09:16.930572 18012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 528748760fc743e3a2bce89e03314aab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.951833 17935 tablet_service.cc:1511] Processing CreateTablet for tablet b8e1f5339f9042c5935e082c5f212b35 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:09:16.953037 17932 tablet_service.cc:1511] Processing CreateTablet for tablet c345cb34fc6343e98baf0b21aac6d4d7 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:09:16.950594 17936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75266a6e976c41a99e22b9d7d7a2cd65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.959887 17930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49c83fd6efbc4c8a92e2e65890ffafd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.959964 18009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b8822f4f1de477e8866529047a823b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.962942 17931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c592029696004db48d68a9e4c3f45004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.963162 18005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49c83fd6efbc4c8a92e2e65890ffafd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.965905 18007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c345cb34fc6343e98baf0b21aac6d4d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.966696 17932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c345cb34fc6343e98baf0b21aac6d4d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.966923 18008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6135c6398c3f4926b6f07433b6f63759. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.951839 17933 tablet_service.cc:1511] Processing CreateTablet for tablet 6135c6398c3f4926b6f07433b6f63759 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:09:16.968017 17933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6135c6398c3f4926b6f07433b6f63759. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.952733 18084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8e1f5339f9042c5935e082c5f212b35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.971223 18082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6135c6398c3f4926b6f07433b6f63759. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.971752 18010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8e1f5339f9042c5935e082c5f212b35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.978966 18087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3cd916f51d64d5d87b9c504a06a8a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.983019 17934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b8822f4f1de477e8866529047a823b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.987031 17935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8e1f5339f9042c5935e082c5f212b35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.990710 18012 tablet_service.cc:1511] Processing CreateTablet for tablet f9b0c864d78846698db31224c547a091 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:09:16.991690 18006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c592029696004db48d68a9e4c3f45004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:16.996991 18086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 528748760fc743e3a2bce89e03314aab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.002954 18080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c592029696004db48d68a9e4c3f45004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.015209 18083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b8822f4f1de477e8866529047a823b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.018761 18081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c345cb34fc6343e98baf0b21aac6d4d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.023222 18079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49c83fd6efbc4c8a92e2e65890ffafd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.054890 18011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75266a6e976c41a99e22b9d7d7a2cd65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.058992 18012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9b0c864d78846698db31224c547a091. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.061162 18087 tablet_service.cc:1511] Processing CreateTablet for tablet f9b0c864d78846698db31224c547a091 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:09:17.062420 18087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9b0c864d78846698db31224c547a091. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.066468 18088 tablet_service.cc:1511] Processing CreateTablet for tablet 66bde4bf25ea49f2b5f4b768cba4cdd0 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:09:17.067826 18088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66bde4bf25ea49f2b5f4b768cba4cdd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.077755 18008 tablet_service.cc:1511] Processing CreateTablet for tablet 92e1586ba70a4331be2a55f4a31dd687 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:09:17.079160 18008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92e1586ba70a4331be2a55f4a31dd687. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.093299 18138 tablet_bootstrap.cc:492] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:17.115160 18013 tablet_service.cc:1511] Processing CreateTablet for tablet 374a5fb3dfcf4ad4adf6e172cc1759a4 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:09:17.116425 18013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 374a5fb3dfcf4ad4adf6e172cc1759a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.046487 18010 tablet_service.cc:1511] Processing CreateTablet for tablet 66bde4bf25ea49f2b5f4b768cba4cdd0 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:09:17.119374 18010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66bde4bf25ea49f2b5f4b768cba4cdd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.132586 18013 tablet_service.cc:1511] Processing CreateTablet for tablet c4f794e5675049b284921052a24eea37 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:09:17.133898 18013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4f794e5675049b284921052a24eea37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.136384 18011 tablet_service.cc:1511] Processing CreateTablet for tablet 16728addc56e43129f085b3bfd185dcb (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:09:17.138604 18011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16728addc56e43129f085b3bfd185dcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.150565 18005 tablet_service.cc:1511] Processing CreateTablet for tablet 13f69f8ad8c84e4f9fdacc0e26cb2bc0 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:09:17.157184 18005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13f69f8ad8c84e4f9fdacc0e26cb2bc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.153213 17930 tablet_service.cc:1511] Processing CreateTablet for tablet f9b0c864d78846698db31224c547a091 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:09:17.159502 17930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9b0c864d78846698db31224c547a091. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.155682 18081 tablet_service.cc:1511] Processing CreateTablet for tablet c4f794e5675049b284921052a24eea37 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:09:17.151882 18085 tablet_service.cc:1511] Processing CreateTablet for tablet 92e1586ba70a4331be2a55f4a31dd687 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:09:17.169447 18085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92e1586ba70a4331be2a55f4a31dd687. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.159430 17935 tablet_service.cc:1511] Processing CreateTablet for tablet 66bde4bf25ea49f2b5f4b768cba4cdd0 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:09:17.159834 18083 tablet_service.cc:1511] Processing CreateTablet for tablet 16728addc56e43129f085b3bfd185dcb (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:09:17.170506 18083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16728addc56e43129f085b3bfd185dcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.154850 18087 tablet_service.cc:1511] Processing CreateTablet for tablet 374a5fb3dfcf4ad4adf6e172cc1759a4 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:09:17.161739 18082 tablet_service.cc:1511] Processing CreateTablet for tablet 13f69f8ad8c84e4f9fdacc0e26cb2bc0 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:09:17.163522 18139 tablet_bootstrap.cc:492] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:17.175858 18140 tablet_bootstrap.cc:492] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:17.176760 18138 tablet_bootstrap.cc:654] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.186962 18087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 374a5fb3dfcf4ad4adf6e172cc1759a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.176339 18009 tablet_service.cc:1511] Processing CreateTablet for tablet 7201987495494cf8a78424cb721d1c88 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:09:17.193218 17935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66bde4bf25ea49f2b5f4b768cba4cdd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.195498 17936 tablet_service.cc:1511] Processing CreateTablet for tablet 92e1586ba70a4331be2a55f4a31dd687 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:09:17.196034 18079 tablet_service.cc:1511] Processing CreateTablet for tablet 1f6ed08238924344ac4e43e997223ac9 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:09:17.196720 17936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92e1586ba70a4331be2a55f4a31dd687. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.197203 18139 tablet_bootstrap.cc:654] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.197914 17934 tablet_service.cc:1511] Processing CreateTablet for tablet 374a5fb3dfcf4ad4adf6e172cc1759a4 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:09:17.199518 18007 tablet_service.cc:1511] Processing CreateTablet for tablet 1f6ed08238924344ac4e43e997223ac9 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:09:17.201521 17931 tablet_service.cc:1511] Processing CreateTablet for tablet c4f794e5675049b284921052a24eea37 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:09:17.207392 18009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7201987495494cf8a78424cb721d1c88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.212435 18140 tablet_bootstrap.cc:654] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.218168 18007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f6ed08238924344ac4e43e997223ac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.218459 18012 tablet_service.cc:1511] Processing CreateTablet for tablet 158a286025af4eddba6fb641c128cd25 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:09:17.218838 18080 tablet_service.cc:1511] Processing CreateTablet for tablet 7201987495494cf8a78424cb721d1c88 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:09:17.219719 18012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 158a286025af4eddba6fb641c128cd25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.225908 18086 tablet_service.cc:1511] Processing CreateTablet for tablet 158a286025af4eddba6fb641c128cd25 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:09:17.226249 18005 tablet_service.cc:1511] Processing CreateTablet for tablet 46c726e58f614fbdab58f22a7da00365 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:09:17.229568 18014 tablet_service.cc:1511] Processing CreateTablet for tablet 2753b334cd624cd290d57dacd79d8edc (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:09:17.231815 18014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2753b334cd624cd290d57dacd79d8edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.231060 18084 tablet_service.cc:1511] Processing CreateTablet for tablet 40f9c84f7e9940ce943e3ad8e2888beb (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:09:17.236431 18005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46c726e58f614fbdab58f22a7da00365. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.240254 18138 tablet_bootstrap.cc:492] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:17.243686 18138 ts_tablet_manager.cc:1403] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.151s	user 0.012s	sys 0.010s
I20260709 12:09:17.247532 18138 raft_consensus.cc:359] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:17.248477 18138 raft_consensus.cc:385] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.248858 18138 raft_consensus.cc:740] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.249950 18138 consensus_queue.cc:260] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:17.215616 18082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13f69f8ad8c84e4f9fdacc0e26cb2bc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.255177 18086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 158a286025af4eddba6fb641c128cd25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.258912 18080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7201987495494cf8a78424cb721d1c88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.263034 18081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4f794e5675049b284921052a24eea37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.264364 17932 tablet_service.cc:1511] Processing CreateTablet for tablet 16728addc56e43129f085b3bfd185dcb (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:09:17.265568 17932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16728addc56e43129f085b3bfd185dcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.267727 18088 tablet_service.cc:1511] Processing CreateTablet for tablet 46c726e58f614fbdab58f22a7da00365 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:09:17.268579 18079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f6ed08238924344ac4e43e997223ac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.272029 17938 tablet_service.cc:1511] Processing CreateTablet for tablet 13f69f8ad8c84e4f9fdacc0e26cb2bc0 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:09:17.273221 17938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13f69f8ad8c84e4f9fdacc0e26cb2bc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.277107 17934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 374a5fb3dfcf4ad4adf6e172cc1759a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.277650 17931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4f794e5675049b284921052a24eea37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.280041 17933 tablet_service.cc:1511] Processing CreateTablet for tablet 1f6ed08238924344ac4e43e997223ac9 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:09:17.280516 17937 tablet_service.cc:1511] Processing CreateTablet for tablet 40f9c84f7e9940ce943e3ad8e2888beb (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:09:17.281248 17933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f6ed08238924344ac4e43e997223ac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.242115 18006 tablet_service.cc:1511] Processing CreateTablet for tablet 53fdd1cc63be4f3b8a533d34af81d0c6 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:09:17.282197 18006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53fdd1cc63be4f3b8a533d34af81d0c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.216004 18011 tablet_service.cc:1511] Processing CreateTablet for tablet 40f9c84f7e9940ce943e3ad8e2888beb (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:09:17.287756 18011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40f9c84f7e9940ce943e3ad8e2888beb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.288553 17939 tablet_service.cc:1511] Processing CreateTablet for tablet 7201987495494cf8a78424cb721d1c88 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:09:17.289732 17939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7201987495494cf8a78424cb721d1c88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.290359 18010 tablet_service.cc:1511] Processing CreateTablet for tablet 993eae98279b413f8c6fed0d4ea79eae (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:09:17.291533 18010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 993eae98279b413f8c6fed0d4ea79eae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.292101 17937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40f9c84f7e9940ce943e3ad8e2888beb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.292853 18084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40f9c84f7e9940ce943e3ad8e2888beb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.300549 18088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46c726e58f614fbdab58f22a7da00365. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.328567 18008 tablet_service.cc:1511] Processing CreateTablet for tablet 43c6bbfd11044938bb4686693c3544a7 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
W20260709 12:09:17.331845 17894 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:17.335151 17930 tablet_service.cc:1511] Processing CreateTablet for tablet 158a286025af4eddba6fb641c128cd25 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:09:17.336391 17930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 158a286025af4eddba6fb641c128cd25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.346264 18049 heartbeater.cc:499] Master 127.16.98.254:38823 was elected leader, sending a full tablet report...
I20260709 12:09:17.346350 18145 raft_consensus.cc:493] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.347020 18145 raft_consensus.cc:515] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:17.356685 18140 tablet_bootstrap.cc:492] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:17.357163 18140 ts_tablet_manager.cc:1403] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.182s	user 0.012s	sys 0.028s
I20260709 12:09:17.359977 18140 raft_consensus.cc:359] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:17.360699 18140 raft_consensus.cc:385] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.360991 18140 raft_consensus.cc:740] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.361838 18007 tablet_service.cc:1511] Processing CreateTablet for tablet ca33c22be72d48f79260f24a00a8f8bb (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:09:17.365280 18140 consensus_queue.cc:260] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:17.372076 18086 tablet_service.cc:1511] Processing CreateTablet for tablet 993eae98279b413f8c6fed0d4ea79eae (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:09:17.385905 18086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 993eae98279b413f8c6fed0d4ea79eae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.385833 17930 tablet_service.cc:1511] Processing CreateTablet for tablet 2753b334cd624cd290d57dacd79d8edc (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:09:17.387666 17930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2753b334cd624cd290d57dacd79d8edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.361838 18083 tablet_service.cc:1511] Processing CreateTablet for tablet 53fdd1cc63be4f3b8a533d34af81d0c6 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:09:17.392127 18083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53fdd1cc63be4f3b8a533d34af81d0c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.318830 18085 tablet_service.cc:1511] Processing CreateTablet for tablet 2753b334cd624cd290d57dacd79d8edc (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:09:17.413616 18085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2753b334cd624cd290d57dacd79d8edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.421346 18079 tablet_service.cc:1511] Processing CreateTablet for tablet 43c6bbfd11044938bb4686693c3544a7 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:09:17.379585 18008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43c6bbfd11044938bb4686693c3544a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.372008 17931 tablet_service.cc:1511] Processing CreateTablet for tablet 46c726e58f614fbdab58f22a7da00365 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:09:17.452104 18079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43c6bbfd11044938bb4686693c3544a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.458676 18007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca33c22be72d48f79260f24a00a8f8bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.466998 17931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46c726e58f614fbdab58f22a7da00365. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.467406 18087 tablet_service.cc:1511] Processing CreateTablet for tablet ca33c22be72d48f79260f24a00a8f8bb (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:09:17.479333 18138 ts_tablet_manager.cc:1434] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.235s	user 0.033s	sys 0.058s
I20260709 12:09:17.480548 18138 tablet_bootstrap.cc:492] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:17.483824 18087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca33c22be72d48f79260f24a00a8f8bb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:17.485653 17832 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 100173us
I20260709 12:09:17.450956 18145 leader_election.cc:290] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:17.497189 18138 tablet_bootstrap.cc:654] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.503942 17932 tablet_service.cc:1511] Processing CreateTablet for tablet 53fdd1cc63be4f3b8a533d34af81d0c6 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:09:17.505297 17932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53fdd1cc63be4f3b8a533d34af81d0c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.513859 17974 heartbeater.cc:499] Master 127.16.98.254:38823 was elected leader, sending a full tablet report...
I20260709 12:09:17.514097 18009 tablet_service.cc:1511] Processing CreateTablet for tablet 5c560710763a42e79b5b8080eff3b58b (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:09:17.514793 18139 tablet_bootstrap.cc:492] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:17.515223 18139 ts_tablet_manager.cc:1403] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.352s	user 0.032s	sys 0.067s
I20260709 12:09:17.515364 18009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c560710763a42e79b5b8080eff3b58b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.526957 18140 ts_tablet_manager.cc:1434] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.169s	user 0.007s	sys 0.012s
I20260709 12:09:17.534799 18140 tablet_bootstrap.cc:492] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:17.542157 17934 tablet_service.cc:1511] Processing CreateTablet for tablet 993eae98279b413f8c6fed0d4ea79eae (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:09:17.548175 17934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 993eae98279b413f8c6fed0d4ea79eae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.549481 18006 tablet_service.cc:1511] Processing CreateTablet for tablet 26495f0b11bb4f9b9d118b8b2a43da91 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:09:17.550935 18006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26495f0b11bb4f9b9d118b8b2a43da91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.517956 18139 raft_consensus.cc:359] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:17.519753 18088 tablet_service.cc:1511] Processing CreateTablet for tablet 48619849881f46989095c1f3642592b7 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:09:17.559638 18139 raft_consensus.cc:385] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.562198 18139 raft_consensus.cc:740] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
W20260709 12:09:17.579370 18050 tablet.cc:2406] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:09:17.580461 18013 tablet_service.cc:1511] Processing CreateTablet for tablet 48619849881f46989095c1f3642592b7 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:09:17.581888 18013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48619849881f46989095c1f3642592b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.601362 18012 tablet_service.cc:1511] Processing CreateTablet for tablet b03f131254e14da2918c02bf0fcf9c5c (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:09:17.617098 18140 tablet_bootstrap.cc:654] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.627010 18138 tablet_bootstrap.cc:492] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:17.627493 18138 ts_tablet_manager.cc:1403] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.147s	user 0.025s	sys 0.039s
I20260709 12:09:17.629912 18138 raft_consensus.cc:359] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:17.630633 18138 raft_consensus.cc:385] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.631138 18138 raft_consensus.cc:740] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.631611 18140 tablet_bootstrap.cc:492] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:17.632112 18140 ts_tablet_manager.cc:1403] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.104s	user 0.012s	sys 0.000s
I20260709 12:09:17.631891 18138 consensus_queue.cc:260] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:17.632196 17930 tablet_service.cc:1511] Processing CreateTablet for tablet 43c6bbfd11044938bb4686693c3544a7 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:09:17.633616 17930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43c6bbfd11044938bb4686693c3544a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.634407 18138 ts_tablet_manager.cc:1434] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:17.635087 18140 raft_consensus.cc:359] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:17.635643 18140 raft_consensus.cc:385] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.635895 18140 raft_consensus.cc:740] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.636579 18140 consensus_queue.cc:260] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:17.638428 18140 ts_tablet_manager.cc:1434] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.001s
I20260709 12:09:17.639479 18140 tablet_bootstrap.cc:492] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:17.642539 18080 tablet_service.cc:1511] Processing CreateTablet for tablet 5c560710763a42e79b5b8080eff3b58b (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:09:17.644060 18140 tablet_bootstrap.cc:654] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.638247 18139 consensus_queue.cc:260] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:17.651367 17939 tablet_service.cc:1511] Processing CreateTablet for tablet 48619849881f46989095c1f3642592b7 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:09:17.651664 17930 tablet_service.cc:1511] Processing CreateTablet for tablet ca33c22be72d48f79260f24a00a8f8bb (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:09:17.652879 17939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48619849881f46989095c1f3642592b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.653519 17930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca33c22be72d48f79260f24a00a8f8bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.661190 17932 tablet_service.cc:1511] Processing CreateTablet for tablet 5c560710763a42e79b5b8080eff3b58b (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:09:17.662447 17932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c560710763a42e79b5b8080eff3b58b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.670333 18149 raft_consensus.cc:493] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.670878 18149 raft_consensus.cc:515] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:17.672434 17930 tablet_service.cc:1511] Processing CreateTablet for tablet b03f131254e14da2918c02bf0fcf9c5c (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:09:17.673710 17930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b03f131254e14da2918c02bf0fcf9c5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.674883 18123 heartbeater.cc:499] Master 127.16.98.254:38823 was elected leader, sending a full tablet report...
I20260709 12:09:17.677101 18140 tablet_bootstrap.cc:492] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:17.677655 18140 ts_tablet_manager.cc:1403] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.038s	user 0.006s	sys 0.006s
I20260709 12:09:17.681227 18140 raft_consensus.cc:359] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:17.682075 18140 raft_consensus.cc:385] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:17.681891 18149 leader_election.cc:290] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:17.688714 17937 tablet_service.cc:1511] Processing CreateTablet for tablet e46c78c4c90c48cd9221b9e9f0a327bc (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:09:17.689563 17939 tablet_service.cc:1511] Processing CreateTablet for tablet 26495f0b11bb4f9b9d118b8b2a43da91 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:09:17.693125 17930 tablet_service.cc:1511] Processing CreateTablet for tablet 137ed415b9d242989f28f349c1618c74 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:09:17.690024 17937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e46c78c4c90c48cd9221b9e9f0a327bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.696285 17939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26495f0b11bb4f9b9d118b8b2a43da91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.702616 17930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 137ed415b9d242989f28f349c1618c74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.711141 18139 ts_tablet_manager.cc:1434] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.196s	user 0.012s	sys 0.009s
I20260709 12:09:17.718341 17930 tablet_service.cc:1511] Processing CreateTablet for tablet 57fe00fa09a54eb295024fca83b933ec (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:09:17.720521 17930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57fe00fa09a54eb295024fca83b933ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.720683 17937 tablet_service.cc:1511] Processing CreateTablet for tablet 9bb1ec98e5b847df8a401343514ac12d (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:09:17.721794 17937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bb1ec98e5b847df8a401343514ac12d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.735594 17930 tablet_service.cc:1511] Processing CreateTablet for tablet 28dbc0f2cd704e82b686ffe4c9b9967e (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:09:17.736757 17930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28dbc0f2cd704e82b686ffe4c9b9967e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.741654 17939 tablet_service.cc:1511] Processing CreateTablet for tablet 9c0d192cc9cf47c1ba111cde01fad070 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:09:17.745602 17939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c0d192cc9cf47c1ba111cde01fad070. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.734357 18009 tablet_service.cc:1511] Processing CreateTablet for tablet e46c78c4c90c48cd9221b9e9f0a327bc (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:09:17.753158 18010 tablet_service.cc:1511] Processing CreateTablet for tablet 137ed415b9d242989f28f349c1618c74 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:09:17.753158 17930 tablet_service.cc:1511] Processing CreateTablet for tablet 75c1f6edbec54664bbafbe9c9385ff6c (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:09:17.755038 17930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75c1f6edbec54664bbafbe9c9385ff6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.762809 18007 tablet_service.cc:1511] Processing CreateTablet for tablet 57fe00fa09a54eb295024fca83b933ec (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:09:17.682428 18140 raft_consensus.cc:740] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:17.770318 17930 tablet_service.cc:1511] Processing CreateTablet for tablet 9e2acd40c27e44219e850b489602d01a (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:09:17.771414 17930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e2acd40c27e44219e850b489602d01a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.771441 17935 tablet_service.cc:1511] Processing CreateTablet for tablet 320059eb6db148929cae07ba683cfe1f (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:09:17.772720 17935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 320059eb6db148929cae07ba683cfe1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.777058 18011 tablet_service.cc:1511] Processing CreateTablet for tablet 9bb1ec98e5b847df8a401343514ac12d (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:09:17.778301 18012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b03f131254e14da2918c02bf0fcf9c5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.779052 18140 consensus_queue.cc:260] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:17.781245 18140 ts_tablet_manager.cc:1434] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.103s	user 0.008s	sys 0.000s
I20260709 12:09:17.782110 18140 tablet_bootstrap.cc:492] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:17.782918 18010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 137ed415b9d242989f28f349c1618c74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.786942 18011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bb1ec98e5b847df8a401343514ac12d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.795534 18086 tablet_service.cc:1511] Processing CreateTablet for tablet 26495f0b11bb4f9b9d118b8b2a43da91 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:09:17.796685 18013 tablet_service.cc:1511] Processing CreateTablet for tablet 28dbc0f2cd704e82b686ffe4c9b9967e (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:09:17.797962 18013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28dbc0f2cd704e82b686ffe4c9b9967e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.798346 18140 tablet_bootstrap.cc:654] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.801882 18088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48619849881f46989095c1f3642592b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.812908 17933 tablet_service.cc:1511] Processing CreateTablet for tablet ffcd5906663d452ca5003ea36d28164f (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:09:17.814201 17933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffcd5906663d452ca5003ea36d28164f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.817978 18006 tablet_service.cc:1511] Processing CreateTablet for tablet 9c0d192cc9cf47c1ba111cde01fad070 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:09:17.819558 18139 tablet_bootstrap.cc:492] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:17.821074 18085 tablet_service.cc:1511] Processing CreateTablet for tablet e46c78c4c90c48cd9221b9e9f0a327bc (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:09:17.822504 18085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e46c78c4c90c48cd9221b9e9f0a327bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.823017 18084 tablet_service.cc:1511] Processing CreateTablet for tablet 137ed415b9d242989f28f349c1618c74 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:09:17.824234 18084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 137ed415b9d242989f28f349c1618c74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.827539 18139 tablet_bootstrap.cc:654] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.828891 18149 raft_consensus.cc:493] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.829356 18149 raft_consensus.cc:515] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:17.820128 18082 tablet_service.cc:1511] Processing CreateTablet for tablet b03f131254e14da2918c02bf0fcf9c5c (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:09:17.832871 18149 leader_election.cc:290] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:17.835106 18138 tablet_bootstrap.cc:492] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:17.835788 18082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b03f131254e14da2918c02bf0fcf9c5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.835126 18081 tablet_service.cc:1511] Processing CreateTablet for tablet 9c0d192cc9cf47c1ba111cde01fad070 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:09:17.836730 18081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c0d192cc9cf47c1ba111cde01fad070. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.835130 18087 tablet_service.cc:1511] Processing CreateTablet for tablet 9bb1ec98e5b847df8a401343514ac12d (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:09:17.840723 18083 tablet_service.cc:1511] Processing CreateTablet for tablet 75c1f6edbec54664bbafbe9c9385ff6c (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:09:17.841325 18080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c560710763a42e79b5b8080eff3b58b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.827615 18079 tablet_service.cc:1511] Processing CreateTablet for tablet 57fe00fa09a54eb295024fca83b933ec (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:09:17.847721 18152 raft_consensus.cc:493] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:17.822504 18006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c0d192cc9cf47c1ba111cde01fad070. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.865973 18083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75c1f6edbec54664bbafbe9c9385ff6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.868253 18008 tablet_service.cc:1511] Processing CreateTablet for tablet 75c1f6edbec54664bbafbe9c9385ff6c (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:09:17.886080 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:09:17.891013 17989 leader_election.cc:343] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.876828 18152 raft_consensus.cc:515] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:17.892879 18086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26495f0b11bb4f9b9d118b8b2a43da91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.895092 18152 leader_election.cc:290] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:09:17.892766 18014 consensus_meta.cc:287] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.568s	user 0.013s	sys 0.000s
I20260709 12:09:17.896329 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:17.901960 18087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bb1ec98e5b847df8a401343514ac12d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.902840 18007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57fe00fa09a54eb295024fca83b933ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.897794 18082 tablet_service.cc:1511] Processing CreateTablet for tablet 28dbc0f2cd704e82b686ffe4c9b9967e (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:09:17.903937 18082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28dbc0f2cd704e82b686ffe4c9b9967e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.921868 17937 tablet_service.cc:1511] Processing CreateTablet for tablet 7829c9fa612b452fb76b1c08f805472d (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:09:17.922392 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:17.923015 18079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57fe00fa09a54eb295024fca83b933ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.926100 17937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7829c9fa612b452fb76b1c08f805472d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.928640 18014 tablet_service.cc:1511] Processing CreateTablet for tablet 9e2acd40c27e44219e850b489602d01a (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:09:17.930855 17939 tablet_service.cc:1511] Processing CreateTablet for tablet 74a818492fb249b0ba39c6bed00cd202 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:09:17.932109 17939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74a818492fb249b0ba39c6bed00cd202. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.923086 18097 raft_consensus.cc:2468] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 0.
I20260709 12:09:17.937726 18138 tablet_bootstrap.cc:654] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:17.938884 18085 tablet_service.cc:1511] Processing CreateTablet for tablet ffcd5906663d452ca5003ea36d28164f (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:09:17.941800 18085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffcd5906663d452ca5003ea36d28164f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.945456 18012 tablet_service.cc:1511] Processing CreateTablet for tablet 7829c9fa612b452fb76b1c08f805472d (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:09:17.925144 18013 tablet_service.cc:1511] Processing CreateTablet for tablet 320059eb6db148929cae07ba683cfe1f (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:09:17.941475 18010 tablet_service.cc:1511] Processing CreateTablet for tablet ffcd5906663d452ca5003ea36d28164f (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:09:17.937474 18084 tablet_service.cc:1511] Processing CreateTablet for tablet 9e2acd40c27e44219e850b489602d01a (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:09:17.947285 18084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e2acd40c27e44219e850b489602d01a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.948132 18140 tablet_bootstrap.cc:492] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:17.948597 18140 ts_tablet_manager.cc:1403] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.167s	user 0.028s	sys 0.011s
I20260709 12:09:17.949144 18005 tablet_service.cc:1511] Processing CreateTablet for tablet 74a818492fb249b0ba39c6bed00cd202 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:09:17.950374 18014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e2acd40c27e44219e850b489602d01a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.952742 18008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75c1f6edbec54664bbafbe9c9385ff6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.953644 18005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74a818492fb249b0ba39c6bed00cd202. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.955699 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:17.959038 18013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 320059eb6db148929cae07ba683cfe1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.962998 18012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7829c9fa612b452fb76b1c08f805472d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:17.965837 18009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e46c78c4c90c48cd9221b9e9f0a327bc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:17.967125 17988 leader_election.cc:343] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:17.967579 17988 leader_election.cc:304] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:17.968462 18143 raft_consensus.cc:2749] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:17.978852 18010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffcd5906663d452ca5003ea36d28164f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.000069 18149 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.000556 18149 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.002550 18149 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:18.005189 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:18.006516 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:18.007265 18088 tablet_service.cc:1511] Processing CreateTablet for tablet 320059eb6db148929cae07ba683cfe1f (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:09:18.007735 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:18.008574 18088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 320059eb6db148929cae07ba683cfe1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.009501 17934 tablet_service.cc:1511] Processing CreateTablet for tablet a474344628f842a781e714727d867c3a (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:09:18.010756 17934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a474344628f842a781e714727d867c3a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:18.015630 17913 leader_election.cc:343] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:18.016320 17913 leader_election.cc:343] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:18.016920 17913 leader_election.cc:343] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.061412 18086 tablet_service.cc:1511] Processing CreateTablet for tablet 7829c9fa612b452fb76b1c08f805472d (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:09:18.084046 18139 tablet_bootstrap.cc:492] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:18.084573 18139 ts_tablet_manager.cc:1403] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.265s	user 0.012s	sys 0.012s
I20260709 12:09:18.090360 18139 raft_consensus.cc:359] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:09:18.091084 18139 raft_consensus.cc:385] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.091388 18139 raft_consensus.cc:740] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.054258 18140 raft_consensus.cc:359] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.064575 18086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7829c9fa612b452fb76b1c08f805472d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.093502 18139 consensus_queue.cc:260] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:09:18.095685 18139 ts_tablet_manager.cc:1434] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:09:18.096590 18140 raft_consensus.cc:385] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.096937 18140 raft_consensus.cc:740] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.097707 18140 consensus_queue.cc:260] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:09:18.099452 17914 leader_election.cc:343] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.099926 17914 leader_election.cc:304] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:18.100138 18138 tablet_bootstrap.cc:492] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:18.100699 18138 ts_tablet_manager.cc:1403] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.266s	user 0.033s	sys 0.050s
I20260709 12:09:18.101092 17914 leader_election.cc:304] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:18.101832 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:18.101999 18149 raft_consensus.cc:2749] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.102638 18149 raft_consensus.cc:2804] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.102981 18149 raft_consensus.cc:493] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.106473 18149 raft_consensus.cc:3060] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.106729 18138 raft_consensus.cc:359] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.107045 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:18.108325 18138 raft_consensus.cc:385] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.108414 18014 tablet_service.cc:1511] Processing CreateTablet for tablet a474344628f842a781e714727d867c3a (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:09:18.108752 18138 raft_consensus.cc:740] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.109666 18014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a474344628f842a781e714727d867c3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.109709 18138 consensus_queue.cc:260] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.100920 18084 tablet_service.cc:1511] Processing CreateTablet for tablet 74a818492fb249b0ba39c6bed00cd202 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:09:18.122798 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:18.124195 18082 tablet_service.cc:1511] Processing CreateTablet for tablet a474344628f842a781e714727d867c3a (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:09:18.125417 18082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a474344628f842a781e714727d867c3a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:09:18.126098 18062 leader_election.cc:343] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.127100 17937 tablet_service.cc:1511] Processing CreateTablet for tablet 5379a078a5d24d8cba5cb4e56eee5b5f (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:09:18.127452 18149 raft_consensus.cc:515] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.128322 17937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5379a078a5d24d8cba5cb4e56eee5b5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.128574 17949 raft_consensus.cc:2393] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 1: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:09:18.130674 18084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74a818492fb249b0ba39c6bed00cd202. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.134639 18006 tablet_service.cc:1511] Processing CreateTablet for tablet 3cdd445b25e5404da2f578c388210925 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:09:18.135864 18006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cdd445b25e5404da2f578c388210925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.137084 18152 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.137542 18152 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:09:18.139510 18152 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123)
I20260709 12:09:18.136500 18079 tablet_service.cc:1511] Processing CreateTablet for tablet 3cdd445b25e5404da2f578c388210925 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:09:18.140885 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:18.141227 18079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cdd445b25e5404da2f578c388210925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.141445 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:09:18.142306 18062 leader_election.cc:343] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:18.143008 18062 leader_election.cc:343] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.143402 18062 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:18.145452 18081 tablet_service.cc:1511] Processing CreateTablet for tablet 5379a078a5d24d8cba5cb4e56eee5b5f (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:09:18.146627 18081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5379a078a5d24d8cba5cb4e56eee5b5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.147034 18152 raft_consensus.cc:2749] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.157169 18143 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.157770 18143 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.160429 18143 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:18.161953 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:09:18.163360 17989 leader_election.cc:343] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.165653 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:09:18.167035 17988 leader_election.cc:343] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.167475 17988 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:18.168541 18143 raft_consensus.cc:2749] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.147078 18062 leader_election.cc:304] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:18.170048 18152 raft_consensus.cc:3060] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.147975 18013 tablet_service.cc:1511] Processing CreateTablet for tablet 5379a078a5d24d8cba5cb4e56eee5b5f (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:09:18.171595 18013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5379a078a5d24d8cba5cb4e56eee5b5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.131815 18139 tablet_bootstrap.cc:492] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
W20260709 12:09:18.173417 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 72414.3us
W20260709 12:09:18.174168 17914 leader_election.cc:343] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.174605 17914 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:18.179891 18152 raft_consensus.cc:2749] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.182343 18162 raft_consensus.cc:2749] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.182942 18138 ts_tablet_manager.cc:1434] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.082s	user 0.006s	sys 0.002s
I20260709 12:09:18.187547 18149 leader_election.cc:290] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:18.188232 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:18.189153 18139 tablet_bootstrap.cc:654] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.190249 18138 tablet_bootstrap.cc:492] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:18.190338 17939 tablet_service.cc:1511] Processing CreateTablet for tablet 59c85902a99e4edabb1fa20b800476fc (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
W20260709 12:09:18.190673 17913 leader_election.cc:343] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.191589 17939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59c85902a99e4edabb1fa20b800476fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.195549 18005 tablet_service.cc:1511] Processing CreateTablet for tablet 59c85902a99e4edabb1fa20b800476fc (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:09:18.203557 18005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59c85902a99e4edabb1fa20b800476fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.207317 17934 tablet_service.cc:1511] Processing CreateTablet for tablet 3cdd445b25e5404da2f578c388210925 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:09:18.196816 18138 tablet_bootstrap.cc:654] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.198498 17933 tablet_service.cc:1511] Processing CreateTablet for tablet ba159d1da5c74efba256a169e746d3d9 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:09:18.200475 18140 ts_tablet_manager.cc:1434] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.252s	user 0.009s	sys 0.000s
I20260709 12:09:18.198557 18009 tablet_service.cc:1511] Processing CreateTablet for tablet ba159d1da5c74efba256a169e746d3d9 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:09:18.214032 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:18.214493 18009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba159d1da5c74efba256a169e746d3d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.221306 18097 raft_consensus.cc:2468] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 1.
I20260709 12:09:18.222537 17914 leader_election.cc:304] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:18.223651 18149 raft_consensus.cc:2804] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.224110 18149 raft_consensus.cc:697] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:09:18.224709 17931 tablet_service.cc:1511] Processing CreateTablet for tablet 1372b5e0da1c481fb926410510c94341 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:09:18.224900 18149 consensus_queue.cc:237] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.225473 18139 tablet_bootstrap.cc:492] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:18.225955 18139 ts_tablet_manager.cc:1403] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.107s	user 0.011s	sys 0.004s
I20260709 12:09:18.227830 18087 tablet_service.cc:1511] Processing CreateTablet for tablet 59c85902a99e4edabb1fa20b800476fc (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:09:18.233947 18081 tablet_service.cc:1511] Processing CreateTablet for tablet 1372b5e0da1c481fb926410510c94341 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:09:18.237190 18006 tablet_service.cc:1511] Processing CreateTablet for tablet 0139f0228a724bb58ab2352ee5195b7a (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:09:18.239008 18006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0139f0228a724bb58ab2352ee5195b7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.239213 17932 tablet_service.cc:1511] Processing CreateTablet for tablet 0139f0228a724bb58ab2352ee5195b7a (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:09:18.239384 18085 tablet_service.cc:1511] Processing CreateTablet for tablet 0139f0228a724bb58ab2352ee5195b7a (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:09:18.248947 17933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba159d1da5c74efba256a169e746d3d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.250089 18086 tablet_service.cc:1511] Processing CreateTablet for tablet ba159d1da5c74efba256a169e746d3d9 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:09:18.250906 18139 raft_consensus.cc:359] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.254943 18140 tablet_bootstrap.cc:492] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:18.253006 18087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59c85902a99e4edabb1fa20b800476fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.260346 17934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cdd445b25e5404da2f578c388210925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.264464 17847 catalog_manager.cc:5697] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 1 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.266587 17932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0139f0228a724bb58ab2352ee5195b7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.270316 18140 tablet_bootstrap.cc:654] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.270936 17931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1372b5e0da1c481fb926410510c94341. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.252614 18139 raft_consensus.cc:385] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.285022 18084 tablet_service.cc:1511] Processing CreateTablet for tablet 05a4983c833c415a94a4c285b408b305 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:09:18.287658 18014 tablet_service.cc:1511] Processing CreateTablet for tablet 05a4983c833c415a94a4c285b408b305 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:09:18.289963 18014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05a4983c833c415a94a4c285b408b305. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.276832 18139 raft_consensus.cc:740] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.295403 18085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0139f0228a724bb58ab2352ee5195b7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.296188 18084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05a4983c833c415a94a4c285b408b305. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.298385 18138 tablet_bootstrap.cc:492] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:18.298866 18138 ts_tablet_manager.cc:1403] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.109s	user 0.012s	sys 0.000s
I20260709 12:09:18.299242 18139 consensus_queue.cc:260] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.301635 18138 raft_consensus.cc:359] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.302326 18138 raft_consensus.cc:385] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.304617 18086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba159d1da5c74efba256a169e746d3d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.252003 18005 tablet_service.cc:1511] Processing CreateTablet for tablet 1372b5e0da1c481fb926410510c94341 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:09:18.302595 18138 raft_consensus.cc:740] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.307281 18138 consensus_queue.cc:260] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.308135 18081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1372b5e0da1c481fb926410510c94341. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.309417 18138 ts_tablet_manager.cc:1434] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 12:09:18.307971 18005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1372b5e0da1c481fb926410510c94341. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.316097 18138 tablet_bootstrap.cc:492] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:18.307770 17939 tablet_service.cc:1511] Processing CreateTablet for tablet 17e56ed7b94d4185a4f7dd88f922e17d (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:09:18.317823 18013 tablet_service.cc:1511] Processing CreateTablet for tablet 17e56ed7b94d4185a4f7dd88f922e17d (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:09:18.320222 17939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17e56ed7b94d4185a4f7dd88f922e17d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.326426 18149 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.326894 18149 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.329034 18149 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:18.329551 18079 tablet_service.cc:1511] Processing CreateTablet for tablet 17e56ed7b94d4185a4f7dd88f922e17d (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:09:18.330993 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:18.331439 18079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17e56ed7b94d4185a4f7dd88f922e17d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.331667 18139 ts_tablet_manager.cc:1434] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.105s	user 0.004s	sys 0.004s
W20260709 12:09:18.332494 17913 leader_election.cc:343] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.332379 18012 tablet_service.cc:1511] Processing CreateTablet for tablet a8c7e98721a04c9690aef2689338516a (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:09:18.331001 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:18.333734 17933 tablet_service.cc:1511] Processing CreateTablet for tablet 05a4983c833c415a94a4c285b408b305 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
W20260709 12:09:18.334990 17914 leader_election.cc:343] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.335409 17914 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:18.336746 18140 tablet_bootstrap.cc:492] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:18.337704 18140 ts_tablet_manager.cc:1403] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.084s	user 0.019s	sys 0.007s
I20260709 12:09:18.337098 18149 raft_consensus.cc:2749] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.332612 18139 tablet_bootstrap.cc:492] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:18.340770 18013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17e56ed7b94d4185a4f7dd88f922e17d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.341032 17933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05a4983c833c415a94a4c285b408b305. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.341550 17934 tablet_service.cc:1511] Processing CreateTablet for tablet a8c7e98721a04c9690aef2689338516a (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:09:18.343156 18140 raft_consensus.cc:359] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.348495 18088 tablet_service.cc:1511] Processing CreateTablet for tablet a8c7e98721a04c9690aef2689338516a (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:09:18.351589 18007 tablet_service.cc:1511] Processing CreateTablet for tablet 45c29a91be76451a9328d8cd9e3eecab (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:09:18.354238 18080 tablet_service.cc:1511] Processing CreateTablet for tablet 45c29a91be76451a9328d8cd9e3eecab (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:09:18.358569 18012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c7e98721a04c9690aef2689338516a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.356519 18140 raft_consensus.cc:385] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.359227 18140 raft_consensus.cc:740] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.359930 18140 consensus_queue.cc:260] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:09:18.360502 17894 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:18.362207 18140 ts_tablet_manager.cc:1434] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.000s
I20260709 12:09:18.362969 18007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45c29a91be76451a9328d8cd9e3eecab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.372231 18143 raft_consensus.cc:493] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.372684 18143 raft_consensus.cc:515] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.375590 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:18.375808 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:18.376190 17949 raft_consensus.cc:2468] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 0.
W20260709 12:09:18.377283 17989 leader_election.cc:343] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.377871 18088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c7e98721a04c9690aef2689338516a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.377911 18143 leader_election.cc:290] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:18.379438 17939 tablet_service.cc:1511] Processing CreateTablet for tablet 2d1876d442ce42248de2b1ad2804234a (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:09:18.380842 17988 leader_election.cc:304] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:09:18.385668 18139 tablet_bootstrap.cc:654] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.386888 18080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45c29a91be76451a9328d8cd9e3eecab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.387035 18143 raft_consensus.cc:2804] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.387409 18143 raft_consensus.cc:493] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.387773 18143 raft_consensus.cc:3060] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.389807 18140 tablet_bootstrap.cc:492] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:18.395392 17939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d1876d442ce42248de2b1ad2804234a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.396649 17934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c7e98721a04c9690aef2689338516a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.399878 17932 tablet_service.cc:1511] Processing CreateTablet for tablet 45c29a91be76451a9328d8cd9e3eecab (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:09:18.401103 17932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45c29a91be76451a9328d8cd9e3eecab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.414371 18014 tablet_service.cc:1511] Processing CreateTablet for tablet 2d1876d442ce42248de2b1ad2804234a (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:09:18.414525 18079 tablet_service.cc:1511] Processing CreateTablet for tablet 2d1876d442ce42248de2b1ad2804234a (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:09:18.415635 18014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d1876d442ce42248de2b1ad2804234a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.415750 18079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d1876d442ce42248de2b1ad2804234a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.415875 18143 raft_consensus.cc:515] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.418540 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:18.419250 17949 raft_consensus.cc:3060] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.425527 17931 tablet_service.cc:1511] Processing CreateTablet for tablet 4ccf0bcc20ae40e79c32530091613e1e (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:09:18.426926 17931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ccf0bcc20ae40e79c32530091613e1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.426723 18005 tablet_service.cc:1511] Processing CreateTablet for tablet 4ccf0bcc20ae40e79c32530091613e1e (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:09:18.428042 18005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ccf0bcc20ae40e79c32530091613e1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.442552 18140 tablet_bootstrap.cc:654] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.444414 18084 tablet_service.cc:1511] Processing CreateTablet for tablet 4ccf0bcc20ae40e79c32530091613e1e (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:09:18.445922 18084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ccf0bcc20ae40e79c32530091613e1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.448000 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
W20260709 12:09:18.449353 17989 leader_election.cc:343] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.451673 17949 raft_consensus.cc:2468] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 1.
I20260709 12:09:18.452787 17988 leader_election.cc:304] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:09:18.458827 17937 tablet_service.cc:1511] Processing CreateTablet for tablet 9ae30b26b2734033a87c3e1ba937a39f (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:09:18.460062 17937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ae30b26b2734033a87c3e1ba937a39f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.464350 18009 tablet_service.cc:1511] Processing CreateTablet for tablet 9ae30b26b2734033a87c3e1ba937a39f (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:09:18.465545 18009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ae30b26b2734033a87c3e1ba937a39f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.475142 18138 tablet_bootstrap.cc:654] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.483842 18080 tablet_service.cc:1511] Processing CreateTablet for tablet 9ae30b26b2734033a87c3e1ba937a39f (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:09:18.486524 18080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ae30b26b2734033a87c3e1ba937a39f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.492393 18139 tablet_bootstrap.cc:492] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:18.492926 18139 ts_tablet_manager.cc:1403] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.161s	user 0.015s	sys 0.003s
I20260709 12:09:18.475526 18143 leader_election.cc:290] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:18.495743 17934 tablet_service.cc:1511] Processing CreateTablet for tablet ee9612b75b8d458dab1e3d254afae227 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:09:18.499725 18139 raft_consensus.cc:359] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.508255 18014 tablet_service.cc:1511] Processing CreateTablet for tablet ee9612b75b8d458dab1e3d254afae227 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:09:18.505534 18143 raft_consensus.cc:2804] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.509701 18014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee9612b75b8d458dab1e3d254afae227. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.509729 18143 raft_consensus.cc:697] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:09:18.510812 18143 consensus_queue.cc:237] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.508350 18086 tablet_service.cc:1511] Processing CreateTablet for tablet ee9612b75b8d458dab1e3d254afae227 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:09:18.513360 18086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee9612b75b8d458dab1e3d254afae227. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.504894 18139 raft_consensus.cc:385] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.514742 18139 raft_consensus.cc:740] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.515846 18139 consensus_queue.cc:260] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:09:18.524158 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 71471us
I20260709 12:09:18.525704 18139 ts_tablet_manager.cc:1434] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.032s	user 0.002s	sys 0.007s
I20260709 12:09:18.535878 17939 tablet_service.cc:1511] Processing CreateTablet for tablet f5d18fbba7e34ac7810ef1fbf82c3697 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:09:18.535892 18005 tablet_service.cc:1511] Processing CreateTablet for tablet f5d18fbba7e34ac7810ef1fbf82c3697 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:09:18.537096 18005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5d18fbba7e34ac7810ef1fbf82c3697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.539819 17934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee9612b75b8d458dab1e3d254afae227. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.542970 17939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5d18fbba7e34ac7810ef1fbf82c3697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.558745 18140 tablet_bootstrap.cc:492] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:18.559234 18140 ts_tablet_manager.cc:1403] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.170s	user 0.028s	sys 0.016s
I20260709 12:09:18.562044 18140 raft_consensus.cc:359] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.562744 18140 raft_consensus.cc:385] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.563042 18140 raft_consensus.cc:740] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.563719 18140 consensus_queue.cc:260] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.565905 18140 ts_tablet_manager.cc:1434] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 12:09:18.566781 18139 tablet_bootstrap.cc:492] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:18.573088 18139 tablet_bootstrap.cc:654] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.600036 18079 tablet_service.cc:1511] Processing CreateTablet for tablet f5d18fbba7e34ac7810ef1fbf82c3697 (DEFAULT_TABLE table=test-workload [id=d402379e42da44a0bdc237a817409e32]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:09:18.601511 18079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5d18fbba7e34ac7810ef1fbf82c3697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:18.604522 18140 tablet_bootstrap.cc:492] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:18.612640 18140 tablet_bootstrap.cc:654] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.616461 17847 catalog_manager.cc:5697] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.621982 18138 tablet_bootstrap.cc:492] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:18.622457 18138 ts_tablet_manager.cc:1403] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.307s	user 0.011s	sys 0.015s
I20260709 12:09:18.625100 18139 tablet_bootstrap.cc:492] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:18.625557 18139 ts_tablet_manager.cc:1403] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.059s	user 0.014s	sys 0.010s
I20260709 12:09:18.625871 18140 tablet_bootstrap.cc:492] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:18.626353 18140 ts_tablet_manager.cc:1403] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.030s	user 0.004s	sys 0.017s
I20260709 12:09:18.628384 18139 raft_consensus.cc:359] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.629092 18139 raft_consensus.cc:385] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.629426 18139 raft_consensus.cc:740] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.629204 18140 raft_consensus.cc:359] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.630336 18140 raft_consensus.cc:385] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.630291 18139 consensus_queue.cc:260] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.631048 18140 raft_consensus.cc:740] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.630890 18138 raft_consensus.cc:359] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.631801 18138 raft_consensus.cc:385] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.632112 18138 raft_consensus.cc:740] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.632031 18140 consensus_queue.cc:260] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.632917 18138 consensus_queue.cc:260] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.634346 18140 ts_tablet_manager.cc:1434] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:09:18.636288 18139 ts_tablet_manager.cc:1434] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:09:18.636801 18152 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.637233 18139 tablet_bootstrap.cc:492] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:18.637189 18152 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.639163 18152 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:09:18.640002 17913 consensus_peers.cc:597] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:18.640487 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:18.641096 18022 raft_consensus.cc:2468] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 0.
I20260709 12:09:18.641626 18138 ts_tablet_manager.cc:1434] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:09:18.642331 18062 leader_election.cc:304] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:18.642584 18138 tablet_bootstrap.cc:492] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:18.643924 18139 tablet_bootstrap.cc:654] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.645020 18152 raft_consensus.cc:2804] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.645390 18152 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.645736 18152 raft_consensus.cc:3060] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.646695 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:18.647330 17949 raft_consensus.cc:2468] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 0.
I20260709 12:09:18.648847 18140 tablet_bootstrap.cc:492] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:18.651024 18138 tablet_bootstrap.cc:654] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.654709 18140 tablet_bootstrap.cc:654] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.659929 18139 tablet_bootstrap.cc:492] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:18.660384 18139 ts_tablet_manager.cc:1403] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.002s
I20260709 12:09:18.661985 18138 tablet_bootstrap.cc:492] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:18.662472 18138 ts_tablet_manager.cc:1403] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.005s
I20260709 12:09:18.662865 18152 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.663204 18139 raft_consensus.cc:359] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.663931 18139 raft_consensus.cc:385] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.664232 18139 raft_consensus.cc:740] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.664803 18152 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:18.664935 18139 consensus_queue.cc:260] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.666181 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:18.666751 18022 raft_consensus.cc:3060] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.667608 18139 ts_tablet_manager.cc:1434] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:09:18.667562 18138 raft_consensus.cc:359] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.668357 18138 raft_consensus.cc:385] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.668639 18138 raft_consensus.cc:740] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.668756 18139 tablet_bootstrap.cc:492] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:18.669010 18149 raft_consensus.cc:493] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.666218 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:18.669371 18138 consensus_queue.cc:260] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.669440 18149 raft_consensus.cc:515] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.669938 17949 raft_consensus.cc:3060] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.671926 18138 ts_tablet_manager.cc:1434] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:09:18.673027 18138 tablet_bootstrap.cc:492] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:18.675493 18139 tablet_bootstrap.cc:654] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.675807 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:09:18.677155 17913 leader_election.cc:343] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.679078 18140 tablet_bootstrap.cc:492] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:18.679486 18140 ts_tablet_manager.cc:1403] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.000s
I20260709 12:09:18.679502 18138 tablet_bootstrap.cc:654] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.682263 18149 leader_election.cc:290] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:18.682049 18140 raft_consensus.cc:359] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:09:18.683880 18140 raft_consensus.cc:385] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.684159 18140 raft_consensus.cc:740] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.684842 18140 consensus_queue.cc:260] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:09:18.687325 17949 raft_consensus.cc:2468] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 1.
I20260709 12:09:18.687733 18140 ts_tablet_manager.cc:1434] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:09:18.687624 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:18.688308 18097 raft_consensus.cc:2468] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 0.
I20260709 12:09:18.688592 18062 leader_election.cc:304] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:09:18.689484 18152 raft_consensus.cc:2804] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.692121 18140 tablet_bootstrap.cc:492] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:18.693114 17914 leader_election.cc:304] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:18.695019 18149 raft_consensus.cc:2804] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.695466 18149 raft_consensus.cc:493] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.695851 18138 tablet_bootstrap.cc:492] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:18.696472 18138 ts_tablet_manager.cc:1403] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.005s
I20260709 12:09:18.697590 18140 tablet_bootstrap.cc:654] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.683245 18022 raft_consensus.cc:2468] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 1.
I20260709 12:09:18.700106 18138 raft_consensus.cc:359] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.701084 18138 raft_consensus.cc:385] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.701440 18138 raft_consensus.cc:740] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.695866 18149 raft_consensus.cc:3060] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.709758 18140 tablet_bootstrap.cc:492] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:18.710261 18140 ts_tablet_manager.cc:1403] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.002s
I20260709 12:09:18.712476 18149 raft_consensus.cc:515] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.712867 18140 raft_consensus.cc:359] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.713536 18140 raft_consensus.cc:385] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.713791 18140 raft_consensus.cc:740] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.714564 18140 consensus_queue.cc:260] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.715866 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
W20260709 12:09:18.717383 17913 leader_election.cc:343] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.719367 18140 ts_tablet_manager.cc:1434] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:09:18.719431 18152 raft_consensus.cc:697] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:18.720295 18140 tablet_bootstrap.cc:492] T 6135c6398c3f4926b6f07433b6f63759 P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:18.720412 18152 consensus_queue.cc:237] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.702333 18138 consensus_queue.cc:260] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.724195 18138 ts_tablet_manager.cc:1434] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.000s
I20260709 12:09:18.725041 18149 leader_election.cc:290] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:18.726210 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:18.726323 18138 tablet_bootstrap.cc:492] T 7b8822f4f1de477e8866529047a823b9 P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:18.726804 18097 raft_consensus.cc:3060] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.731667 18143 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.732149 18143 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.733822 18138 tablet_bootstrap.cc:654] T 7b8822f4f1de477e8866529047a823b9 P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.734232 18143 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:18.735730 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:09:18.737709 17989 leader_election.cc:343] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.738767 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:09:18.741040 17988 leader_election.cc:343] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.734318 18097 raft_consensus.cc:2468] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 1.
I20260709 12:09:18.741488 17988 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:18.742415 18172 raft_consensus.cc:2749] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:18.742432 17914 leader_election.cc:304] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:18.744544 18149 raft_consensus.cc:2804] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.745141 18149 raft_consensus.cc:697] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:09:18.746150 18149 consensus_queue.cc:237] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.752110 18140 tablet_bootstrap.cc:654] T 6135c6398c3f4926b6f07433b6f63759 P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.758316 18139 tablet_bootstrap.cc:492] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:18.758960 18139 ts_tablet_manager.cc:1403] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.090s	user 0.038s	sys 0.030s
I20260709 12:09:18.758949 17845 catalog_manager.cc:5697] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:18.763160 18139 raft_consensus.cc:359] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.764114 18139 raft_consensus.cc:385] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.764506 18139 raft_consensus.cc:740] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.765618 18139 consensus_queue.cc:260] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.768595 18139 ts_tablet_manager.cc:1434] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:09:18.769827 18139 tablet_bootstrap.cc:492] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:18.777709 18139 tablet_bootstrap.cc:654] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.783977 17846 catalog_manager.cc:5697] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 1 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:18.795015 18139 tablet_bootstrap.cc:492] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:18.795629 18139 ts_tablet_manager.cc:1403] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.007s
I20260709 12:09:18.798938 18139 raft_consensus.cc:359] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.799835 18139 raft_consensus.cc:385] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.800190 18139 raft_consensus.cc:740] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.801190 18139 consensus_queue.cc:260] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.803020 18139 ts_tablet_manager.cc:1434] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:09:18.803638 18183 raft_consensus.cc:493] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.803977 18139 tablet_bootstrap.cc:492] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:18.804119 18183 raft_consensus.cc:515] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.805162 18152 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.805603 18152 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.806300 18183 leader_election.cc:290] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:18.807487 18152 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:18.808687 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:18.809762 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:09:18.809969 18062 leader_election.cc:343] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.810537 18139 tablet_bootstrap.cc:654] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.810360 17948 raft_consensus.cc:2468] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 0.
I20260709 12:09:18.811002 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:18.811587 18062 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:09:18.811899 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:18.812232 18138 tablet_bootstrap.cc:492] T 7b8822f4f1de477e8866529047a823b9 P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:18.811596 18022 raft_consensus.cc:2468] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 0.
I20260709 12:09:18.813133 18138 ts_tablet_manager.cc:1403] T 7b8822f4f1de477e8866529047a823b9 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.087s	user 0.034s	sys 0.042s
W20260709 12:09:18.814052 18062 leader_election.cc:343] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.819566 18062 leader_election.cc:304] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:18.820585 18183 raft_consensus.cc:2804] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.817698 18138 raft_consensus.cc:359] T 7b8822f4f1de477e8866529047a823b9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.821275 18138 raft_consensus.cc:385] T 7b8822f4f1de477e8866529047a823b9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.821027 18152 raft_consensus.cc:2804] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.821614 18138 raft_consensus.cc:740] T 7b8822f4f1de477e8866529047a823b9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.821122 18183 raft_consensus.cc:493] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.822125 18152 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.822505 18152 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.822368 18183 raft_consensus.cc:3060] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.822574 18138 consensus_queue.cc:260] T 7b8822f4f1de477e8866529047a823b9 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.827275 18138 ts_tablet_manager.cc:1434] T 7b8822f4f1de477e8866529047a823b9 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:09:18.828142 18138 tablet_bootstrap.cc:492] T c345cb34fc6343e98baf0b21aac6d4d7 P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:18.829378 18152 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.831658 18152 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:18.833101 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:18.833395 18138 tablet_bootstrap.cc:654] T c345cb34fc6343e98baf0b21aac6d4d7 P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.833705 17948 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.833637 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
W20260709 12:09:18.838420 18062 leader_election.cc:343] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.844301 18138 tablet_bootstrap.cc:492] T c345cb34fc6343e98baf0b21aac6d4d7 P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:18.844734 18138 ts_tablet_manager.cc:1403] T c345cb34fc6343e98baf0b21aac6d4d7 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 12:09:18.845767 17948 raft_consensus.cc:2468] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 1.
I20260709 12:09:18.846848 18062 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:18.848295 18152 raft_consensus.cc:2804] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.849777 18183 raft_consensus.cc:515] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.851040 18149 consensus_queue.cc:1048] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:18.851755 18183 leader_election.cc:290] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:18.847216 18138 raft_consensus.cc:359] T c345cb34fc6343e98baf0b21aac6d4d7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.853142 18138 raft_consensus.cc:385] T c345cb34fc6343e98baf0b21aac6d4d7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.853430 18138 raft_consensus.cc:740] T c345cb34fc6343e98baf0b21aac6d4d7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.853967 18140 tablet_bootstrap.cc:492] T 6135c6398c3f4926b6f07433b6f63759 P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:18.854390 18139 tablet_bootstrap.cc:492] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:18.854159 18138 consensus_queue.cc:260] T c345cb34fc6343e98baf0b21aac6d4d7 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.854457 18140 ts_tablet_manager.cc:1403] T 6135c6398c3f4926b6f07433b6f63759 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.134s	user 0.032s	sys 0.058s
I20260709 12:09:18.854457 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:18.854827 18139 ts_tablet_manager.cc:1403] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.003s
I20260709 12:09:18.856547 18143 raft_consensus.cc:493] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.856609 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:18.857266 18022 raft_consensus.cc:3060] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.857110 18143 raft_consensus.cc:515] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.857409 18140 raft_consensus.cc:359] T 6135c6398c3f4926b6f07433b6f63759 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.858225 18140 raft_consensus.cc:385] T 6135c6398c3f4926b6f07433b6f63759 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.858530 18140 raft_consensus.cc:740] T 6135c6398c3f4926b6f07433b6f63759 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.859246 18143 leader_election.cc:290] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:18.859326 18140 consensus_queue.cc:260] T 6135c6398c3f4926b6f07433b6f63759 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.861001 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:18.861749 18097 raft_consensus.cc:2393] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 1: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
W20260709 12:09:18.863111 18119 debug-util.cc:398] Leaking SignalData structure 0x7b08001b3420 after lost signal to thread 16782
W20260709 12:09:18.863991 18119 debug-util.cc:398] Leaking SignalData structure 0x7b08001d5840 after lost signal to thread 17881
I20260709 12:09:18.864215 18022 raft_consensus.cc:2468] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 1.
I20260709 12:09:18.865701 18139 raft_consensus.cc:359] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.866425 18139 raft_consensus.cc:385] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.866686 18139 raft_consensus.cc:740] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
W20260709 12:09:18.866686 18119 debug-util.cc:398] Leaking SignalData structure 0x7b0800155600 after lost signal to thread 18122
I20260709 12:09:18.866941 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:18.867447 18139 consensus_queue.cc:260] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.868556 18140 ts_tablet_manager.cc:1434] T 6135c6398c3f4926b6f07433b6f63759 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:09:18.868451 17988 leader_election.cc:304] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:18.869339 18139 ts_tablet_manager.cc:1434] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.000s
I20260709 12:09:18.869764 18143 raft_consensus.cc:3060] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.870137 18139 tablet_bootstrap.cc:492] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:18.872084 18140 tablet_bootstrap.cc:492] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:18.874779 18183 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.875291 18183 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.877396 18183 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:18.878080 18140 tablet_bootstrap.cc:654] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.879899 18138 ts_tablet_manager.cc:1434] T c345cb34fc6343e98baf0b21aac6d4d7 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 12:09:18.880637 18139 tablet_bootstrap.cc:654] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.884707 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:18.885545 17948 raft_consensus.cc:2468] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 0.
I20260709 12:09:18.888000 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:18.888818 18138 tablet_bootstrap.cc:492] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:18.889748 18062 leader_election.cc:304] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:18.882475 18143 raft_consensus.cc:2749] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:18.891502 18062 leader_election.cc:343] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:18.892405 18062 leader_election.cc:343] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.893209 18183 raft_consensus.cc:2804] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:18.893699 18183 raft_consensus.cc:697] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:18.893505 18062 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:18.894567 18183 consensus_queue.cc:237] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.895598 18192 raft_consensus.cc:2804] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.895977 18192 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.896296 18152 raft_consensus.cc:697] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:18.897212 18152 consensus_queue.cc:237] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.896311 18192 raft_consensus.cc:3060] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.901383 18138 tablet_bootstrap.cc:654] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.905612 18143 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.906306 18143 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.910172 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:18.910842 17948 raft_consensus.cc:2468] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 0.
I20260709 12:09:18.911304 18143 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:18.912058 17988 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:18.912011 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:18.919821 18143 raft_consensus.cc:2804] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.923605 18143 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.924049 18143 raft_consensus.cc:3060] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.931504 17846 catalog_manager.cc:5697] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:18.920459 18097 raft_consensus.cc:2468] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 0.
W20260709 12:09:18.940757 17989 consensus_peers.cc:597] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Couldn't send request to peer 4813437da0a74e65b61eb7bd1d18f110. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:18.952913 18162 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.954628 18162 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.965737 18200 raft_consensus.cc:493] T 7b8822f4f1de477e8866529047a823b9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.967403 18162 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:18.968513 18140 tablet_bootstrap.cc:492] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:18.968956 18140 ts_tablet_manager.cc:1403] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.097s	user 0.050s	sys 0.024s
I20260709 12:09:18.971328 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:18.971561 18140 raft_consensus.cc:359] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.972266 18140 raft_consensus.cc:385] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.972517 18140 raft_consensus.cc:740] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.972968 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:18.973167 18140 consensus_queue.cc:260] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.972285 18149 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.975114 18140 ts_tablet_manager.cc:1434] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:09:18.975311 18149 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:09:18.977279 18022 raft_consensus.cc:2468] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 0.
I20260709 12:09:18.968333 18172 consensus_queue.cc:1048] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
W20260709 12:09:18.978263 17914 leader_election.cc:343] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.978762 18140 tablet_bootstrap.cc:492] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:18.979415 18138 tablet_bootstrap.cc:492] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:18.979807 18138 ts_tablet_manager.cc:1403] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.091s	user 0.027s	sys 0.030s
I20260709 12:09:18.981930 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:18.982362 18138 raft_consensus.cc:359] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.983055 18138 raft_consensus.cc:385] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:18.983335 18138 raft_consensus.cc:740] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:18.984088 18192 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.984740 18140 tablet_bootstrap.cc:654] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:18.985082 18138 consensus_queue.cc:260] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.987855 18139 tablet_bootstrap.cc:492] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:18.988245 18139 ts_tablet_manager.cc:1403] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.118s	user 0.012s	sys 0.000s
I20260709 12:09:18.989168 18149 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:18.987668 17913 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:09:18.990864 18149 raft_consensus.cc:2804] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.990793 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:18.991420 18149 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.991609 18098 raft_consensus.cc:2468] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 0.
I20260709 12:09:18.991050 18162 raft_consensus.cc:493] T 6135c6398c3f4926b6f07433b6f63759 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:18.991976 18149 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.992280 18162 raft_consensus.cc:515] T 6135c6398c3f4926b6f07433b6f63759 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.994336 18162 leader_election.cc:290] T 6135c6398c3f4926b6f07433b6f63759 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:09:18.994686 17913 leader_election.cc:343] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:18.967090 18200 raft_consensus.cc:515] T 7b8822f4f1de477e8866529047a823b9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:18.995954 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:18.997365 17914 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:18.997820 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:18.998128 18162 raft_consensus.cc:2804] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:18.998584 18162 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:18.998878 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:18.999316 18162 raft_consensus.cc:3060] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.999686 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:18.998584 18022 raft_consensus.cc:2393] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 1: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:09:18.999954 18097 raft_consensus.cc:2393] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 1: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:09:19.001502 17989 leader_election.cc:304] T 7b8822f4f1de477e8866529047a823b9 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:19.001667 17913 leader_election.cc:304] T 6135c6398c3f4926b6f07433b6f63759 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:19.002395 18172 raft_consensus.cc:3060] T 7b8822f4f1de477e8866529047a823b9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:18.998345 18200 leader_election.cc:290] T 7b8822f4f1de477e8866529047a823b9 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:19.000746 17846 catalog_manager.cc:5697] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:19.022604 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
W20260709 12:09:19.024057 18062 leader_election.cc:343] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.015664 18143 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.017962 18192 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:19.032382 18138 ts_tablet_manager.cc:1434] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 12:09:19.033476 18138 tablet_bootstrap.cc:492] T f9b0c864d78846698db31224c547a091 P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:19.036311 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:19.036935 18097 raft_consensus.cc:3060] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.041481 18139 raft_consensus.cc:359] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.042160 18139 raft_consensus.cc:385] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.042402 18139 raft_consensus.cc:740] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.043129 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:19.043742 17949 raft_consensus.cc:3060] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.043128 18139 consensus_queue.cc:260] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.044384 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:19.044986 17947 raft_consensus.cc:3060] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.045775 18139 ts_tablet_manager.cc:1434] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.057s	user 0.010s	sys 0.023s
I20260709 12:09:19.047631 18097 raft_consensus.cc:2468] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 1.
I20260709 12:09:19.048542 18139 tablet_bootstrap.cc:492] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:19.038393 18143 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:19.052030 17949 raft_consensus.cc:2468] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 1.
I20260709 12:09:19.052757 17947 raft_consensus.cc:2468] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 1.
I20260709 12:09:19.053308 18192 raft_consensus.cc:493] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.053730 18192 raft_consensus.cc:515] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.043232 18162 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:09:19.054422 18062 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:19.055159 18204 raft_consensus.cc:3060] T 6135c6398c3f4926b6f07433b6f63759 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.056668 18183 raft_consensus.cc:2804] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.057168 18183 raft_consensus.cc:697] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:19.057329 18162 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:19.057838 18183 consensus_queue.cc:237] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.058828 17989 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:19.059616 18143 raft_consensus.cc:2804] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.059602 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:19.060328 18097 raft_consensus.cc:3060] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.060403 18143 raft_consensus.cc:697] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:09:19.060976 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:19.061287 18143 consensus_queue.cc:237] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:09:19.062122 17913 leader_election.cc:343] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.064605 18172 raft_consensus.cc:2749] T 7b8822f4f1de477e8866529047a823b9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.066893 18192 leader_election.cc:290] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:19.067402 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:19.068030 17947 raft_consensus.cc:2468] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 0.
I20260709 12:09:19.068192 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:09:19.070263 18062 leader_election.cc:343] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.071302 18062 leader_election.cc:304] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:19.072302 18183 raft_consensus.cc:2804] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.072450 18097 raft_consensus.cc:2468] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 1.
I20260709 12:09:19.072700 18183 raft_consensus.cc:493] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.073194 18183 raft_consensus.cc:3060] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.076002 17914 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:19.077132 18162 raft_consensus.cc:2804] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.079356 17847 catalog_manager.cc:5697] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:19.075199 18172 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.080543 18172 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.083387 18183 raft_consensus.cc:515] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.086802 17846 catalog_manager.cc:5697] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.085618 18172 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:19.090862 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:19.091683 17949 raft_consensus.cc:3060] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.095582 18139 tablet_bootstrap.cc:654] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.086935 18162 raft_consensus.cc:697] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:09:19.096714 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:19.097442 17947 raft_consensus.cc:2393] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 1: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:09:19.098577 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:19.099124 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:09:19.100090 18062 leader_election.cc:343] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.100504 17989 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:19.097442 18162 consensus_queue.cc:237] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:09:19.101648 18172 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.096732 18183 leader_election.cc:290] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:19.112979 18204 raft_consensus.cc:2749] T 6135c6398c3f4926b6f07433b6f63759 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.115061 17949 raft_consensus.cc:2468] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 1.
I20260709 12:09:19.129992 18062 leader_election.cc:304] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:19.130681 18149 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.131744 18140 tablet_bootstrap.cc:492] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:19.132207 18140 ts_tablet_manager.cc:1403] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.154s	user 0.020s	sys 0.014s
I20260709 12:09:19.134629 18138 tablet_bootstrap.cc:654] T f9b0c864d78846698db31224c547a091 P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.134557 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:19.135478 18022 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.136030 18183 raft_consensus.cc:2804] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.137737 18183 raft_consensus.cc:697] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:19.138118 18140 raft_consensus.cc:359] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.138821 18140 raft_consensus.cc:385] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.138571 18183 consensus_queue.cc:237] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.139197 18140 raft_consensus.cc:740] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.141350 18140 consensus_queue.cc:260] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.142158 18172 raft_consensus.cc:2749] T c345cb34fc6343e98baf0b21aac6d4d7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.143362 18140 ts_tablet_manager.cc:1434] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:09:19.144214 18140 tablet_bootstrap.cc:492] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:19.144593 18022 raft_consensus.cc:2468] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 1.
I20260709 12:09:19.145051 17846 catalog_manager.cc:5697] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 1 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:19.147403 17913 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:19.150208 18207 raft_consensus.cc:2804] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.153436 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:19.152226 18149 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:19.154759 18207 raft_consensus.cc:697] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:09:19.155611 18207 consensus_queue.cc:237] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:09:19.156250 17914 leader_election.cc:343] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.170378 18139 tablet_bootstrap.cc:492] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:19.170807 18139 ts_tablet_manager.cc:1403] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.122s	user 0.010s	sys 0.008s
I20260709 12:09:19.173534 18140 tablet_bootstrap.cc:654] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.175529 18138 tablet_bootstrap.cc:492] T f9b0c864d78846698db31224c547a091 P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:19.176210 18138 ts_tablet_manager.cc:1403] T f9b0c864d78846698db31224c547a091 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.143s	user 0.009s	sys 0.005s
I20260709 12:09:19.179863 18139 raft_consensus.cc:359] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.180383 18139 raft_consensus.cc:385] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.180648 18139 raft_consensus.cc:740] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.190845 17847 catalog_manager.cc:5697] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 1 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.204784 18139 consensus_queue.cc:260] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.203526 17846 catalog_manager.cc:5697] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:19.207051 18139 ts_tablet_manager.cc:1434] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.036s	user 0.012s	sys 0.006s
I20260709 12:09:19.207355 18138 raft_consensus.cc:359] T f9b0c864d78846698db31224c547a091 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.207922 18139 tablet_bootstrap.cc:492] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:19.208038 18138 raft_consensus.cc:385] T f9b0c864d78846698db31224c547a091 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.208379 18138 raft_consensus.cc:740] T f9b0c864d78846698db31224c547a091 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.211082 18138 consensus_queue.cc:260] T f9b0c864d78846698db31224c547a091 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.212980 18138 ts_tablet_manager.cc:1434] T f9b0c864d78846698db31224c547a091 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.001s
I20260709 12:09:19.213855 18138 tablet_bootstrap.cc:492] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:19.221077 18139 tablet_bootstrap.cc:654] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.224308 18140 tablet_bootstrap.cc:492] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:19.224768 18140 ts_tablet_manager.cc:1403] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.081s	user 0.005s	sys 0.007s
I20260709 12:09:19.227444 18140 raft_consensus.cc:359] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.228073 18138 tablet_bootstrap.cc:654] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.228137 18140 raft_consensus.cc:385] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.229084 18140 raft_consensus.cc:740] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.229763 18140 consensus_queue.cc:260] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.236274 18140 ts_tablet_manager.cc:1434] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:09:19.234748 18139 tablet_bootstrap.cc:492] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:19.237077 18139 ts_tablet_manager.cc:1403] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.004s
I20260709 12:09:19.238325 18138 tablet_bootstrap.cc:492] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:19.238765 18138 ts_tablet_manager.cc:1403] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.000s
I20260709 12:09:19.239326 18140 tablet_bootstrap.cc:492] T 16728addc56e43129f085b3bfd185dcb P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:19.241276 18138 raft_consensus.cc:359] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.241910 18138 raft_consensus.cc:385] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.242187 18138 raft_consensus.cc:740] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.242969 18138 consensus_queue.cc:260] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.245798 18140 tablet_bootstrap.cc:654] T 16728addc56e43129f085b3bfd185dcb P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.247825 18139 raft_consensus.cc:359] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.248461 18139 raft_consensus.cc:385] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.248733 18139 raft_consensus.cc:740] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.249644 18139 consensus_queue.cc:260] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.255541 18138 ts_tablet_manager.cc:1434] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 12:09:19.259513 18138 tablet_bootstrap.cc:492] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:19.259652 18207 consensus_queue.cc:1048] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.260509 18139 ts_tablet_manager.cc:1434] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 12:09:19.261447 18183 consensus_queue.cc:1048] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.264020 18139 tablet_bootstrap.cc:492] T 92e1586ba70a4331be2a55f4a31dd687 P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:19.265503 18138 tablet_bootstrap.cc:654] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.278045 18183 consensus_queue.cc:1048] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.285516 18140 tablet_bootstrap.cc:492] T 16728addc56e43129f085b3bfd185dcb P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:19.328352 18140 ts_tablet_manager.cc:1403] T 16728addc56e43129f085b3bfd185dcb P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.089s	user 0.007s	sys 0.017s
I20260709 12:09:19.331645 18183 consensus_queue.cc:1048] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.301946 18200 raft_consensus.cc:493] T f9b0c864d78846698db31224c547a091 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.333474 18200 raft_consensus.cc:515] T f9b0c864d78846698db31224c547a091 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.334719 18139 tablet_bootstrap.cc:654] T 92e1586ba70a4331be2a55f4a31dd687 P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.336180 18149 consensus_queue.cc:1048] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.338153 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:19.345950 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:19.347002 17948 raft_consensus.cc:2393] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 1: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:09:19.348187 17988 leader_election.cc:304] T f9b0c864d78846698db31224c547a091 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:19.349246 18172 raft_consensus.cc:3060] T f9b0c864d78846698db31224c547a091 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.293100 18207 raft_consensus.cc:493] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.352504 18207 raft_consensus.cc:515] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.360752 18207 leader_election.cc:290] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:19.335820 18200 leader_election.cc:290] T f9b0c864d78846698db31224c547a091 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:19.374748 18139 tablet_bootstrap.cc:492] T 92e1586ba70a4331be2a55f4a31dd687 P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:19.374963 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:19.375247 18139 ts_tablet_manager.cc:1403] T 92e1586ba70a4331be2a55f4a31dd687 P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.111s	user 0.008s	sys 0.011s
W20260709 12:09:19.377888 17914 leader_election.cc:343] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.378376 18138 tablet_bootstrap.cc:492] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:19.379298 18138 ts_tablet_manager.cc:1403] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.120s	user 0.019s	sys 0.020s
I20260709 12:09:19.382191 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:09:19.383915 17913 leader_election.cc:343] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.383723 18140 raft_consensus.cc:359] T 16728addc56e43129f085b3bfd185dcb P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.384342 17913 leader_election.cc:304] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:19.384531 18139 raft_consensus.cc:359] T 92e1586ba70a4331be2a55f4a31dd687 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.385200 18139 raft_consensus.cc:385] T 92e1586ba70a4331be2a55f4a31dd687 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.385475 18139 raft_consensus.cc:740] T 92e1586ba70a4331be2a55f4a31dd687 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.384362 18140 raft_consensus.cc:385] T 16728addc56e43129f085b3bfd185dcb P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.385937 18140 raft_consensus.cc:740] T 16728addc56e43129f085b3bfd185dcb P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.386108 18211 raft_consensus.cc:2749] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.386560 18140 consensus_queue.cc:260] T 16728addc56e43129f085b3bfd185dcb P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.388598 18140 ts_tablet_manager.cc:1434] T 16728addc56e43129f085b3bfd185dcb P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.060s	user 0.005s	sys 0.000s
I20260709 12:09:19.389324 18172 raft_consensus.cc:2749] T f9b0c864d78846698db31224c547a091 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.389449 18140 tablet_bootstrap.cc:492] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:19.393173 18138 raft_consensus.cc:359] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:09:19.393936 18138 raft_consensus.cc:385] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.394277 18138 raft_consensus.cc:740] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.380709 18152 consensus_queue.cc:1048] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:09:19.396116 18138 consensus_queue.cc:260] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:09:19.398500 18138 ts_tablet_manager.cc:1434] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.002s
I20260709 12:09:19.400753 18097 raft_consensus.cc:3060] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.427202 18200 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.427701 18200 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.431888 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:19.432531 17949 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 0.
I20260709 12:09:19.433686 17988 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:09:19.403859 17894 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:19.434566 18172 raft_consensus.cc:2804] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.409425 18140 tablet_bootstrap.cc:654] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.394872 18139 consensus_queue.cc:260] T 92e1586ba70a4331be2a55f4a31dd687 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.434988 18172 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.435354 18172 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.436537 18139 ts_tablet_manager.cc:1434] T 92e1586ba70a4331be2a55f4a31dd687 P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.061s	user 0.005s	sys 0.000s
I20260709 12:09:19.437422 18139 tablet_bootstrap.cc:492] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:19.439010 18200 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:19.442884 18138 tablet_bootstrap.cc:492] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:19.443557 18172 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.446406 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:19.446998 18139 tablet_bootstrap.cc:654] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.447366 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
W20260709 12:09:19.449519 17989 leader_election.cc:343] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.448423 17949 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.456975 17949 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 1.
I20260709 12:09:19.467748 18172 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:19.471222 17988 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:19.471141 18195 consensus_queue.cc:1048] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.472472 18183 consensus_queue.cc:1048] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.473971 18140 tablet_bootstrap.cc:492] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:19.474458 18140 ts_tablet_manager.cc:1403] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.085s	user 0.009s	sys 0.009s
I20260709 12:09:19.475296 18172 raft_consensus.cc:2804] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.475667 18138 tablet_bootstrap.cc:654] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.475780 18172 raft_consensus.cc:697] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:09:19.473883 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
W20260709 12:09:19.479061 17989 leader_election.cc:343] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.476907 18172 consensus_queue.cc:237] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.497108 18140 raft_consensus.cc:359] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.498842 18140 raft_consensus.cc:385] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.499053 18140 raft_consensus.cc:740] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.503499 18140 consensus_queue.cc:260] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.504662 18152 consensus_queue.cc:1048] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.511117 18140 ts_tablet_manager.cc:1434] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 12:09:19.513267 18200 consensus_queue.cc:1048] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.514127 18140 tablet_bootstrap.cc:492] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:19.521425 18138 tablet_bootstrap.cc:492] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:19.521907 18138 ts_tablet_manager.cc:1403] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.079s	user 0.013s	sys 0.003s
I20260709 12:09:19.523730 18139 tablet_bootstrap.cc:492] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:19.524205 18139 ts_tablet_manager.cc:1403] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.087s	user 0.015s	sys 0.015s
I20260709 12:09:19.524483 18138 raft_consensus.cc:359] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.525154 18138 raft_consensus.cc:385] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.525403 18138 raft_consensus.cc:740] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.526125 18138 consensus_queue.cc:260] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.526636 18139 raft_consensus.cc:359] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.527598 18139 raft_consensus.cc:385] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.527931 18139 raft_consensus.cc:740] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.528271 18138 ts_tablet_manager.cc:1434] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:09:19.528906 18139 consensus_queue.cc:260] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.541364 18139 ts_tablet_manager.cc:1434] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:09:19.529167 18138 tablet_bootstrap.cc:492] T c592029696004db48d68a9e4c3f45004 P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:19.546136 17847 catalog_manager.cc:5697] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.549505 18200 consensus_queue.cc:1048] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.542557 18139 tablet_bootstrap.cc:492] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:19.551561 18152 consensus_queue.cc:1048] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.526762 18140 tablet_bootstrap.cc:654] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.556268 18211 consensus_queue.cc:1048] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.556828 18138 tablet_bootstrap.cc:654] T c592029696004db48d68a9e4c3f45004 P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.574827 18172 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.576062 18172 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.603390 18211 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.603614 18152 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:19.605873 18062 consensus_peers.cc:597] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:19.633389 18183 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.646371 18139 tablet_bootstrap.cc:654] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.621526 18152 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.648440 18172 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:19.652900 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:19.621697 18211 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.672544 18211 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:19.649072 18183 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.679168 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:19.680114 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:19.683264 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:19.679944 18096 raft_consensus.cc:2468] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 0.
I20260709 12:09:19.689585 18138 tablet_bootstrap.cc:492] T c592029696004db48d68a9e4c3f45004 P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:19.690057 18138 ts_tablet_manager.cc:1403] T c592029696004db48d68a9e4c3f45004 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.161s	user 0.034s	sys 0.026s
I20260709 12:09:19.690153 18195 consensus_queue.cc:1048] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:09:19.689631 17914 leader_election.cc:343] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.693145 18183 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:09:19.694052 17988 leader_election.cc:343] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:19.694296 17913 leader_election.cc:343] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.694759 17913 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:19.696918 17989 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:19.698122 18143 raft_consensus.cc:2804] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.698518 18143 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.698908 18143 raft_consensus.cc:3060] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.699146 18211 raft_consensus.cc:2749] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.694770 18200 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.701099 18200 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.703145 18200 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:19.703229 18152 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:19.709012 18139 tablet_bootstrap.cc:492] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:19.709515 18139 ts_tablet_manager.cc:1403] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.167s	user 0.024s	sys 0.000s
I20260709 12:09:19.709695 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:19.712021 18139 raft_consensus.cc:359] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.712711 18139 raft_consensus.cc:385] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.712965 18139 raft_consensus.cc:740] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.713609 18139 consensus_queue.cc:260] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.714689 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:19.716077 18139 ts_tablet_manager.cc:1434] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:09:19.723680 18139 tablet_bootstrap.cc:492] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
W20260709 12:09:19.724165 17989 leader_election.cc:343] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.727358 18020 raft_consensus.cc:3060] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.729830 18139 tablet_bootstrap.cc:654] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.717375 18098 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.718060 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:19.730724 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:19.731138 18023 raft_consensus.cc:2393] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 1: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:09:19.732905 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:09:19.735685 18062 leader_election.cc:343] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.737749 18138 raft_consensus.cc:359] T c592029696004db48d68a9e4c3f45004 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.738451 18138 raft_consensus.cc:385] T c592029696004db48d68a9e4c3f45004 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.738746 18138 raft_consensus.cc:740] T c592029696004db48d68a9e4c3f45004 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.739504 18138 consensus_queue.cc:260] T c592029696004db48d68a9e4c3f45004 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.740352 18140 tablet_bootstrap.cc:492] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:19.740768 18140 ts_tablet_manager.cc:1403] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.227s	user 0.012s	sys 0.001s
I20260709 12:09:19.741508 18138 ts_tablet_manager.cc:1434] T c592029696004db48d68a9e4c3f45004 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.000s
I20260709 12:09:19.742314 18138 tablet_bootstrap.cc:492] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:19.743228 18140 raft_consensus.cc:359] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.743897 18140 raft_consensus.cc:385] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.744191 18140 raft_consensus.cc:740] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.744840 18140 consensus_queue.cc:260] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.745596 18207 consensus_queue.cc:1048] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.722183 18143 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.747695 18022 raft_consensus.cc:2393] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 1: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:09:19.749392 18062 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:19.750211 18183 raft_consensus.cc:3060] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.751865 18211 consensus_queue.cc:1048] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.753168 18207 consensus_queue.cc:1048] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:19.755884 18143 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:19.757251 18140 ts_tablet_manager.cc:1434] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 12:09:19.758592 18140 tablet_bootstrap.cc:492] T 2753b334cd624cd290d57dacd79d8edc P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:19.760689 18143 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.761170 18143 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:09:19.761469 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:19.725358 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:09:19.743237 17988 leader_election.cc:343] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.779692 18195 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.779453 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:19.779201 17988 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:19.782786 18172 raft_consensus.cc:2749] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.780161 18195 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.785099 18195 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:19.785657 18143 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123)
I20260709 12:09:19.788496 18183 raft_consensus.cc:2749] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.789122 18195 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.804314 18140 tablet_bootstrap.cc:654] T 2753b334cd624cd290d57dacd79d8edc P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.797626 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:19.804666 18062 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:19.806504 18183 raft_consensus.cc:2749] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:19.796768 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 53557us
W20260709 12:09:19.807256 18062 leader_election.cc:343] T 92e1586ba70a4331be2a55f4a31dd687 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.818455 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:19.818394 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:19.798417 18195 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.824209 18139 tablet_bootstrap.cc:492] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:19.824612 18139 ts_tablet_manager.cc:1403] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.101s	user 0.017s	sys 0.008s
I20260709 12:09:19.829574 18096 raft_consensus.cc:2468] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 1.
I20260709 12:09:19.831713 18195 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:19.835354 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:19.837388 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:19.838807 17946 raft_consensus.cc:2393] T 16728addc56e43129f085b3bfd185dcb P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 1: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
W20260709 12:09:19.844322 17988 leader_election.cc:343] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.845304 17988 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:19.837419 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:19.848117 18138 tablet_bootstrap.cc:654] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.850615 18062 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:19.851439 18152 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.853199 18139 raft_consensus.cc:359] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.854861 18139 raft_consensus.cc:385] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.855212 18139 raft_consensus.cc:740] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.856264 18139 consensus_queue.cc:260] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.858907 17989 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:19.859517 18139 ts_tablet_manager.cc:1434] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.001s
I20260709 12:09:19.859997 18200 raft_consensus.cc:2804] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.860680 18139 tablet_bootstrap.cc:492] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:19.860795 18200 raft_consensus.cc:697] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:09:19.861760 18200 consensus_queue.cc:237] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:09:19.862757 18062 leader_election.cc:343] T 92e1586ba70a4331be2a55f4a31dd687 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.863260 18062 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:19.865650 18245 raft_consensus.cc:2749] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:19.869174 18183 raft_consensus.cc:2749] T 92e1586ba70a4331be2a55f4a31dd687 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.876546 18152 raft_consensus.cc:2749] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.894485 18138 tablet_bootstrap.cc:492] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:19.894950 18138 ts_tablet_manager.cc:1403] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.153s	user 0.017s	sys 0.011s
I20260709 12:09:19.895696 18139 tablet_bootstrap.cc:654] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.897442 18138 raft_consensus.cc:359] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.898100 18138 raft_consensus.cc:385] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.898370 18138 raft_consensus.cc:740] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.899011 18138 consensus_queue.cc:260] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.899917 18140 tablet_bootstrap.cc:492] T 2753b334cd624cd290d57dacd79d8edc P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:19.900367 18140 ts_tablet_manager.cc:1403] T 2753b334cd624cd290d57dacd79d8edc P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.142s	user 0.012s	sys 0.000s
I20260709 12:09:19.901448 18138 ts_tablet_manager.cc:1434] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:19.902281 18138 tablet_bootstrap.cc:492] T 1f6ed08238924344ac4e43e997223ac9 P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:19.902751 18140 raft_consensus.cc:359] T 2753b334cd624cd290d57dacd79d8edc P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.912302 18140 raft_consensus.cc:385] T 2753b334cd624cd290d57dacd79d8edc P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:19.912604 18140 raft_consensus.cc:740] T 2753b334cd624cd290d57dacd79d8edc P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:19.912739 18200 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.908280 18138 tablet_bootstrap.cc:654] T 1f6ed08238924344ac4e43e997223ac9 P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:19.913242 18200 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.913311 18140 consensus_queue.cc:260] T 2753b334cd624cd290d57dacd79d8edc P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.915937 18200 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:19.916515 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:19.917593 18140 ts_tablet_manager.cc:1434] T 2753b334cd624cd290d57dacd79d8edc P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:09:19.918327 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:19.911806 17845 catalog_manager.cc:5697] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:19.918467 18140 tablet_bootstrap.cc:492] T 43c6bbfd11044938bb4686693c3544a7 P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:19.923378 17988 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:19.924484 18143 raft_consensus.cc:2749] T c592029696004db48d68a9e4c3f45004 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:19.925290 18207 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.925756 18207 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.930474 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:19.931344 18022 raft_consensus.cc:2468] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 0.
I20260709 12:09:19.933032 17913 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:19.934119 18211 raft_consensus.cc:2804] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.934583 18211 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.935041 18211 raft_consensus.cc:3060] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.938443 18207 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:19.942632 18152 raft_consensus.cc:493] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:19.943118 18152 raft_consensus.cc:515] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.945322 18152 leader_election.cc:290] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:19.949980 18211 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.953835 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:19.954564 18022 raft_consensus.cc:3060] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.958443 18143 consensus_queue.cc:1048] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.961966 18022 raft_consensus.cc:2468] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 1.
I20260709 12:09:19.962564 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:19.963474 17913 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:19.963783 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:19.963905 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:19.964380 17946 raft_consensus.cc:2468] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 0.
I20260709 12:09:19.965063 18207 raft_consensus.cc:2804] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:19.970317 18020 raft_consensus.cc:3060] T c592029696004db48d68a9e4c3f45004 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:19.971014 17914 leader_election.cc:343] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:19.966194 18207 raft_consensus.cc:697] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:09:19.976455 18207 consensus_queue.cc:237] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:19.979372 18062 leader_election.cc:304] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:09:19.980733 18183 raft_consensus.cc:2804] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:19.981094 18183 raft_consensus.cc:493] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:19.981431 18183 raft_consensus.cc:3060] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:19.986908 18200 consensus_queue.cc:1048] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:19.988994 18211 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:19.994562 18183 raft_consensus.cc:515] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.003007 18183 leader_election.cc:290] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:09:20.001166 18062 leader_election.cc:343] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.005299 18140 tablet_bootstrap.cc:654] T 43c6bbfd11044938bb4686693c3544a7 P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.008700 18138 tablet_bootstrap.cc:492] T 1f6ed08238924344ac4e43e997223ac9 P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:20.011235 18138 ts_tablet_manager.cc:1403] T 1f6ed08238924344ac4e43e997223ac9 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.109s	user 0.024s	sys 0.043s
I20260709 12:09:20.017228 18138 raft_consensus.cc:359] T 1f6ed08238924344ac4e43e997223ac9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.020617 18138 raft_consensus.cc:385] T 1f6ed08238924344ac4e43e997223ac9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.020866 18138 raft_consensus.cc:740] T 1f6ed08238924344ac4e43e997223ac9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.021893 18138 consensus_queue.cc:260] T 1f6ed08238924344ac4e43e997223ac9 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.023343 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:20.023952 17949 raft_consensus.cc:3060] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.024873 18138 ts_tablet_manager.cc:1434] T 1f6ed08238924344ac4e43e997223ac9 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.002s
I20260709 12:09:20.025869 18138 tablet_bootstrap.cc:492] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:20.028777 17844 catalog_manager.cc:5697] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 1 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.031423 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:20.034408 17949 raft_consensus.cc:2468] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 1.
I20260709 12:09:20.036795 18138 tablet_bootstrap.cc:654] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:20.037616 18062 leader_election.cc:343] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.038316 18062 leader_election.cc:304] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:20.035784 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:20.041311 18183 raft_consensus.cc:2804] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.041771 18183 raft_consensus.cc:697] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:20.042558 18183 consensus_queue.cc:237] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:09:20.045142 17914 leader_election.cc:343] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.048907 18139 tablet_bootstrap.cc:492] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:20.049340 18139 ts_tablet_manager.cc:1403] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.189s	user 0.016s	sys 0.019s
I20260709 12:09:20.051751 18139 raft_consensus.cc:359] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.052379 18139 raft_consensus.cc:385] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.052644 18139 raft_consensus.cc:740] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.059983 18139 consensus_queue.cc:260] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.062031 18139 ts_tablet_manager.cc:1434] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:09:20.065493 18138 tablet_bootstrap.cc:492] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:20.064659 17844 catalog_manager.cc:5697] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:20.066111 18139 tablet_bootstrap.cc:492] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:20.070972 18138 ts_tablet_manager.cc:1403] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.013s
I20260709 12:09:20.073534 18138 raft_consensus.cc:359] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.074187 18138 raft_consensus.cc:385] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.074455 18138 raft_consensus.cc:740] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.077677 18139 tablet_bootstrap.cc:654] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.075093 18138 consensus_queue.cc:260] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.082959 18138 ts_tablet_manager.cc:1434] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:09:20.083849 18138 tablet_bootstrap.cc:492] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:20.089275 18138 tablet_bootstrap.cc:654] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.078002 18140 tablet_bootstrap.cc:492] T 43c6bbfd11044938bb4686693c3544a7 P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:20.096779 18140 ts_tablet_manager.cc:1403] T 43c6bbfd11044938bb4686693c3544a7 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.178s	user 0.010s	sys 0.014s
I20260709 12:09:20.099669 18140 raft_consensus.cc:359] T 43c6bbfd11044938bb4686693c3544a7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.100433 18140 raft_consensus.cc:385] T 43c6bbfd11044938bb4686693c3544a7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.100699 18140 raft_consensus.cc:740] T 43c6bbfd11044938bb4686693c3544a7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.101044 18138 tablet_bootstrap.cc:492] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:20.101467 18138 ts_tablet_manager.cc:1403] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.018s	user 0.005s	sys 0.011s
I20260709 12:09:20.101351 18140 consensus_queue.cc:260] T 43c6bbfd11044938bb4686693c3544a7 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.103372 18140 ts_tablet_manager.cc:1434] T 43c6bbfd11044938bb4686693c3544a7 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 12:09:20.104842 18140 tablet_bootstrap.cc:492] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:20.107570 18138 raft_consensus.cc:359] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.108201 18138 raft_consensus.cc:385] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.108446 18138 raft_consensus.cc:740] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.109063 18138 consensus_queue.cc:260] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.110749 18140 tablet_bootstrap.cc:654] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.113757 18138 ts_tablet_manager.cc:1434] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:09:20.114605 18138 tablet_bootstrap.cc:492] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:20.114841 18139 tablet_bootstrap.cc:492] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:20.115278 18139 ts_tablet_manager.cc:1403] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.019s
I20260709 12:09:20.117834 18139 raft_consensus.cc:359] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.118486 18139 raft_consensus.cc:385] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.118777 18139 raft_consensus.cc:740] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.119393 18139 consensus_queue.cc:260] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.119971 18138 tablet_bootstrap.cc:654] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.125296 18139 ts_tablet_manager.cc:1434] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:09:20.126227 18139 tablet_bootstrap.cc:492] T ca33c22be72d48f79260f24a00a8f8bb P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:20.133824 18183 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.134852 18139 tablet_bootstrap.cc:654] T ca33c22be72d48f79260f24a00a8f8bb P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.134470 18183 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.137044 18183 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:20.139504 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:20.140506 18140 tablet_bootstrap.cc:492] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:20.140959 18140 ts_tablet_manager.cc:1403] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.003s
W20260709 12:09:20.141582 18062 leader_election.cc:343] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.143177 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:20.144011 18140 raft_consensus.cc:359] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.144704 18140 raft_consensus.cc:385] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.145001 18140 raft_consensus.cc:740] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
W20260709 12:09:20.145129 18062 leader_election.cc:343] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.145861 18062 leader_election.cc:304] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:20.145888 18140 consensus_queue.cc:260] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.150053 18152 raft_consensus.cc:2749] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.152988 18139 tablet_bootstrap.cc:492] T ca33c22be72d48f79260f24a00a8f8bb P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:20.153407 18139 ts_tablet_manager.cc:1403] T ca33c22be72d48f79260f24a00a8f8bb P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.005s
I20260709 12:09:20.154182 18140 ts_tablet_manager.cc:1434] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.005s
I20260709 12:09:20.155040 18140 tablet_bootstrap.cc:492] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:20.155758 18139 raft_consensus.cc:359] T ca33c22be72d48f79260f24a00a8f8bb P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.156387 18139 raft_consensus.cc:385] T ca33c22be72d48f79260f24a00a8f8bb P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.156626 18139 raft_consensus.cc:740] T ca33c22be72d48f79260f24a00a8f8bb P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.157228 18139 consensus_queue.cc:260] T ca33c22be72d48f79260f24a00a8f8bb P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.159221 18139 ts_tablet_manager.cc:1434] T ca33c22be72d48f79260f24a00a8f8bb P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:09:20.159960 18139 tablet_bootstrap.cc:492] T 7201987495494cf8a78424cb721d1c88 P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:20.160766 18140 tablet_bootstrap.cc:654] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.161710 18207 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.162200 18207 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.165239 18207 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:20.165907 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:20.166729 18020 raft_consensus.cc:2468] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 0.
I20260709 12:09:20.168885 17913 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:20.173348 18207 raft_consensus.cc:2804] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.174116 18207 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.174571 18207 raft_consensus.cc:3060] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.178336 18152 raft_consensus.cc:493] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.178396 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:20.178901 18152 raft_consensus.cc:515] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:09:20.179692 17914 leader_election.cc:343] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.180815 18152 leader_election.cc:290] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:20.184351 18139 tablet_bootstrap.cc:654] T 7201987495494cf8a78424cb721d1c88 P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.186268 18200 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.186898 18200 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.190886 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:20.191675 18098 raft_consensus.cc:2468] T 92e1586ba70a4331be2a55f4a31dd687 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 0.
I20260709 12:09:20.199911 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:20.200798 18020 raft_consensus.cc:2468] T 1f6ed08238924344ac4e43e997223ac9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 0.
I20260709 12:09:20.203747 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:20.209506 17989 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:20.210829 18143 raft_consensus.cc:2804] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.211411 18143 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.211833 18143 raft_consensus.cc:3060] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.212014 18162 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.216718 18162 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.221760 18162 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:20.194391 18200 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:20.228266 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:20.213793 18062 leader_election.cc:304] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:09:20.230674 18062 leader_election.cc:343] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.231909 18207 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.234005 18207 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:20.236337 18152 raft_consensus.cc:2804] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.236304 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:20.237488 18152 raft_consensus.cc:493] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.237872 18152 raft_consensus.cc:3060] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.238023 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:20.238684 18022 raft_consensus.cc:2468] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 0.
W20260709 12:09:20.239207 17988 leader_election.cc:343] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.241185 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:20.241755 18022 raft_consensus.cc:3060] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.242690 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:20.240720 17913 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:09:20.250730 17914 leader_election.cc:343] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:20.252988 17914 leader_election.cc:343] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.253902 18162 raft_consensus.cc:2804] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.254314 18162 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.254739 18162 raft_consensus.cc:3060] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.257472 18022 raft_consensus.cc:2468] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 1.
I20260709 12:09:20.245101 18152 raft_consensus.cc:515] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.259262 17913 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:09:20.260910 18211 raft_consensus.cc:2804] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.261368 18211 raft_consensus.cc:697] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:09:20.262346 18211 consensus_queue.cc:237] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.261346 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:20.265350 18140 tablet_bootstrap.cc:492] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:20.265391 18138 tablet_bootstrap.cc:492] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:20.265869 18140 ts_tablet_manager.cc:1403] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.111s	user 0.045s	sys 0.023s
I20260709 12:09:20.265944 18138 ts_tablet_manager.cc:1403] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.152s	user 0.042s	sys 0.054s
I20260709 12:09:20.266938 18162 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:09:20.268044 18062 leader_election.cc:343] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.271428 18138 raft_consensus.cc:359] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.271576 18140 raft_consensus.cc:359] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.272087 18138 raft_consensus.cc:385] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.272173 18140 raft_consensus.cc:385] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.272413 18138 raft_consensus.cc:740] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.272472 18140 raft_consensus.cc:740] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.273731 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:20.274375 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:20.273109 18140 consensus_queue.cc:260] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.273109 18138 consensus_queue.cc:260] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.275074 18020 raft_consensus.cc:3060] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:20.275247 17914 leader_election.cc:343] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.279844 18138 ts_tablet_manager.cc:1434] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:09:20.280650 18138 tablet_bootstrap.cc:492] T 158a286025af4eddba6fb641c128cd25 P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:20.292337 18020 raft_consensus.cc:2468] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 1.
I20260709 12:09:20.296442 18140 ts_tablet_manager.cc:1434] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.001s
I20260709 12:09:20.297382 18140 tablet_bootstrap.cc:492] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:20.279563 18143 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.272428 18162 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:20.275776 18152 leader_election.cc:290] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:20.300256 18200 consensus_queue.cc:1048] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.300194 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:20.301052 18020 raft_consensus.cc:3060] T 1f6ed08238924344ac4e43e997223ac9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.320519 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:20.321165 18096 raft_consensus.cc:3060] T 92e1586ba70a4331be2a55f4a31dd687 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.325568 18139 tablet_bootstrap.cc:492] T 7201987495494cf8a78424cb721d1c88 P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:20.326031 18139 ts_tablet_manager.cc:1403] T 7201987495494cf8a78424cb721d1c88 P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.166s	user 0.017s	sys 0.013s
I20260709 12:09:20.317956 18143 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:20.328495 18020 raft_consensus.cc:2468] T 1f6ed08238924344ac4e43e997223ac9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 1.
I20260709 12:09:20.329900 18062 leader_election.cc:304] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:20.330699 18152 raft_consensus.cc:2804] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.331213 18152 raft_consensus.cc:697] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:20.331534 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:20.332080 18152 consensus_queue.cc:237] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.332604 17913 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:09:20.333771 18211 raft_consensus.cc:2804] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.334231 18211 raft_consensus.cc:697] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:09:20.335042 18211 consensus_queue.cc:237] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.338014 18096 raft_consensus.cc:2468] T 92e1586ba70a4331be2a55f4a31dd687 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 1.
I20260709 12:09:20.339246 17989 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:20.340126 18143 raft_consensus.cc:2804] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.340808 18143 raft_consensus.cc:697] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:09:20.341918 18138 tablet_bootstrap.cc:654] T 158a286025af4eddba6fb641c128cd25 P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.343750 18139 raft_consensus.cc:359] T 7201987495494cf8a78424cb721d1c88 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.344848 18139 raft_consensus.cc:385] T 7201987495494cf8a78424cb721d1c88 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.345196 18139 raft_consensus.cc:740] T 7201987495494cf8a78424cb721d1c88 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.346611 18139 consensus_queue.cc:260] T 7201987495494cf8a78424cb721d1c88 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.348894 18183 raft_consensus.cc:493] T ca33c22be72d48f79260f24a00a8f8bb P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.354365 18183 raft_consensus.cc:515] T ca33c22be72d48f79260f24a00a8f8bb P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.357177 18183 leader_election.cc:290] T ca33c22be72d48f79260f24a00a8f8bb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:09:20.361647 17988 leader_election.cc:343] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.366748 18139 ts_tablet_manager.cc:1434] T 7201987495494cf8a78424cb721d1c88 P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.002s
W20260709 12:09:20.367601 17988 consensus_peers.cc:597] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:20.369828 18140 tablet_bootstrap.cc:654] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.370185 18139 tablet_bootstrap.cc:492] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:20.369163 17843 catalog_manager.cc:5697] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 1 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.371187 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:20.373272 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:20.366628 18143 consensus_queue.cc:237] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:09:20.378098 18062 leader_election.cc:343] T ca33c22be72d48f79260f24a00a8f8bb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:20.379199 18062 leader_election.cc:343] T ca33c22be72d48f79260f24a00a8f8bb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.379678 18062 leader_election.cc:304] T ca33c22be72d48f79260f24a00a8f8bb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:20.380455 18195 raft_consensus.cc:2749] T ca33c22be72d48f79260f24a00a8f8bb P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.384248 18139 tablet_bootstrap.cc:654] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.388229 17843 catalog_manager.cc:5697] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 1 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.397711 18211 raft_consensus.cc:493] T 2753b334cd624cd290d57dacd79d8edc P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.398293 18211 raft_consensus.cc:515] T 2753b334cd624cd290d57dacd79d8edc P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.400846 18211 leader_election.cc:290] T 2753b334cd624cd290d57dacd79d8edc P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:20.402905 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:20.402740 17844 catalog_manager.cc:5697] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:20.404109 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:09:20.405525 17913 leader_election.cc:343] T 2753b334cd624cd290d57dacd79d8edc P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:20.407043 17914 leader_election.cc:343] T 2753b334cd624cd290d57dacd79d8edc P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.407469 17914 leader_election.cc:304] T 2753b334cd624cd290d57dacd79d8edc P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:20.407719 18140 tablet_bootstrap.cc:492] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:20.408171 18140 ts_tablet_manager.cc:1403] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.111s	user 0.016s	sys 0.000s
I20260709 12:09:20.408536 18211 raft_consensus.cc:2749] T 2753b334cd624cd290d57dacd79d8edc P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.408761 18138 tablet_bootstrap.cc:492] T 158a286025af4eddba6fb641c128cd25 P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:20.409904 18138 ts_tablet_manager.cc:1403] T 158a286025af4eddba6fb641c128cd25 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.129s	user 0.021s	sys 0.008s
I20260709 12:09:20.411968 18140 raft_consensus.cc:359] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.412298 18138 raft_consensus.cc:359] T 158a286025af4eddba6fb641c128cd25 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.412968 18140 raft_consensus.cc:385] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.413085 18138 raft_consensus.cc:385] T 158a286025af4eddba6fb641c128cd25 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.411985 17846 catalog_manager.cc:5697] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.413249 18140 raft_consensus.cc:740] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.413358 18138 raft_consensus.cc:740] T 158a286025af4eddba6fb641c128cd25 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.413959 18140 consensus_queue.cc:260] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.414072 18138 consensus_queue.cc:260] T 158a286025af4eddba6fb641c128cd25 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.415992 18138 ts_tablet_manager.cc:1434] T 158a286025af4eddba6fb641c128cd25 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:09:20.416805 18138 tablet_bootstrap.cc:492] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:20.424403 18138 tablet_bootstrap.cc:654] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.427371 18211 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.427884 18211 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.429905 18211 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:20.432058 18139 tablet_bootstrap.cc:492] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:20.432617 18139 ts_tablet_manager.cc:1403] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.001s
I20260709 12:09:20.433692 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:20.434340 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:09:20.435098 17913 leader_election.cc:343] T 43c6bbfd11044938bb4686693c3544a7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:20.435604 17914 leader_election.cc:343] T 43c6bbfd11044938bb4686693c3544a7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.435899 17914 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:20.435904 18139 raft_consensus.cc:359] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.436650 18139 raft_consensus.cc:385] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.436861 18140 ts_tablet_manager.cc:1434] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:09:20.436925 18139 raft_consensus.cc:740] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.437067 18211 raft_consensus.cc:2749] T 43c6bbfd11044938bb4686693c3544a7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.437708 18139 consensus_queue.cc:260] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.440019 18139 ts_tablet_manager.cc:1434] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:09:20.443575 18024 raft_consensus.cc:3060] T 158a286025af4eddba6fb641c128cd25 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.443836 18139 tablet_bootstrap.cc:492] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:20.443951 18138 tablet_bootstrap.cc:492] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:20.444401 18138 ts_tablet_manager.cc:1403] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.008s
I20260709 12:09:20.445768 18140 tablet_bootstrap.cc:492] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:20.448637 18138 raft_consensus.cc:359] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.449745 18138 raft_consensus.cc:385] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.450004 18138 raft_consensus.cc:740] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.450734 18138 consensus_queue.cc:260] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.458182 18275 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.458932 18138 ts_tablet_manager.cc:1434] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.007s
I20260709 12:09:20.459929 18138 tablet_bootstrap.cc:492] T 993eae98279b413f8c6fed0d4ea79eae P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:20.458678 18275 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.463712 18275 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:20.458918 18211 raft_consensus.cc:493] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.466936 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:20.465914 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:20.467744 18020 raft_consensus.cc:2393] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 1: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:09:20.466807 18211 raft_consensus.cc:515] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.473157 18211 leader_election.cc:290] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:09:20.473467 17894 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:20.473984 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:20.471750 18275 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.475088 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:09:20.476217 17913 leader_election.cc:343] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.477061 18062 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:20.474870 18275 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.481117 18140 tablet_bootstrap.cc:654] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.482575 18195 raft_consensus.cc:3060] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.482810 18138 tablet_bootstrap.cc:654] T 993eae98279b413f8c6fed0d4ea79eae P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.483649 18211 consensus_queue.cc:1048] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.486753 18139 tablet_bootstrap.cc:654] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.486929 18200 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.487371 18200 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.489400 18200 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:20.491180 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:09:20.492619 17989 leader_election.cc:343] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.494765 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:20.495558 17949 raft_consensus.cc:2468] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 0.
I20260709 12:09:20.497608 17988 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:09:20.498575 18200 raft_consensus.cc:2804] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.497944 18195 raft_consensus.cc:2749] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.509333 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:20.520685 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:20.533171 18020 raft_consensus.cc:2393] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 1: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:09:20.500932 18200 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.534633 18200 raft_consensus.cc:3060] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.502898 18275 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:20.527956 18152 consensus_queue.cc:1048] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:09:20.503646 17914 leader_election.cc:343] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.538085 17914 leader_election.cc:304] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:20.539402 18271 raft_consensus.cc:2749] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.550318 18140 tablet_bootstrap.cc:492] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:20.550920 18140 ts_tablet_manager.cc:1403] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.105s	user 0.013s	sys 0.021s
I20260709 12:09:20.558589 18140 raft_consensus.cc:359] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.559504 18140 raft_consensus.cc:385] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.559825 18140 raft_consensus.cc:740] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.560636 18140 consensus_queue.cc:260] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.544677 18200 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.565910 18139 tablet_bootstrap.cc:492] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:20.566485 18139 ts_tablet_manager.cc:1403] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.123s	user 0.014s	sys 0.024s
I20260709 12:09:20.568300 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:20.568847 17949 raft_consensus.cc:3060] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.569260 18139 raft_consensus.cc:359] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.569926 18139 raft_consensus.cc:385] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.570188 18139 raft_consensus.cc:740] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.570840 18139 consensus_queue.cc:260] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.572880 18139 ts_tablet_manager.cc:1434] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:20.573760 18139 tablet_bootstrap.cc:492] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:20.575554 17949 raft_consensus.cc:2468] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 1.
I20260709 12:09:20.576576 17988 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:20.577940 18172 raft_consensus.cc:2804] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.578440 18172 raft_consensus.cc:697] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:09:20.579310 18172 consensus_queue.cc:237] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.581571 18139 tablet_bootstrap.cc:654] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.590020 18140 ts_tablet_manager.cc:1434] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 12:09:20.590504 18139 tablet_bootstrap.cc:492] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:20.590966 18139 ts_tablet_manager.cc:1403] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 12:09:20.590970 18140 tablet_bootstrap.cc:492] T 40f9c84f7e9940ce943e3ad8e2888beb P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:20.601357 18062 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:20.608343 18195 raft_consensus.cc:3060] T 7201987495494cf8a78424cb721d1c88 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.605924 18140 tablet_bootstrap.cc:654] T 40f9c84f7e9940ce943e3ad8e2888beb P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.607496 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:20.594527 18139 raft_consensus.cc:359] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.610625 18139 raft_consensus.cc:385] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.610945 18139 raft_consensus.cc:740] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
W20260709 12:09:20.611361 17989 leader_election.cc:343] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.611584 18139 consensus_queue.cc:260] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.613900 18139 ts_tablet_manager.cc:1434] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:09:20.614816 18139 tablet_bootstrap.cc:492] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:20.616420 18183 raft_consensus.cc:493] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.616892 18183 raft_consensus.cc:515] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.618861 18183 leader_election.cc:290] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:20.620304 18195 raft_consensus.cc:2749] T 7201987495494cf8a78424cb721d1c88 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.622136 18139 tablet_bootstrap.cc:654] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.626055 17846 catalog_manager.cc:5697] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.626173 18200 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:20.626008 18140 tablet_bootstrap.cc:492] T 40f9c84f7e9940ce943e3ad8e2888beb P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:20.633965 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:20.634632 17949 raft_consensus.cc:2468] T 2753b334cd624cd290d57dacd79d8edc P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 0.
I20260709 12:09:20.636587 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:20.638306 18211 consensus_queue.cc:1048] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.639124 18195 consensus_queue.cc:1048] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.639310 18062 leader_election.cc:304] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:09:20.640113 18183 raft_consensus.cc:2804] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.640412 18138 tablet_bootstrap.cc:492] T 993eae98279b413f8c6fed0d4ea79eae P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:20.640479 18183 raft_consensus.cc:493] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.641021 18183 raft_consensus.cc:3060] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.641058 18138 ts_tablet_manager.cc:1403] T 993eae98279b413f8c6fed0d4ea79eae P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.181s	user 0.037s	sys 0.038s
I20260709 12:09:20.644603 18138 raft_consensus.cc:359] T 993eae98279b413f8c6fed0d4ea79eae P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.645443 18138 raft_consensus.cc:385] T 993eae98279b413f8c6fed0d4ea79eae P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.645744 18138 raft_consensus.cc:740] T 993eae98279b413f8c6fed0d4ea79eae P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.648459 18140 ts_tablet_manager.cc:1403] T 40f9c84f7e9940ce943e3ad8e2888beb P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.058s	user 0.011s	sys 0.002s
I20260709 12:09:20.649081 18183 raft_consensus.cc:515] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.652864 18140 raft_consensus.cc:359] T 40f9c84f7e9940ce943e3ad8e2888beb P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.653774 18140 raft_consensus.cc:385] T 40f9c84f7e9940ce943e3ad8e2888beb P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.654117 18140 raft_consensus.cc:740] T 40f9c84f7e9940ce943e3ad8e2888beb P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.655107 18172 raft_consensus.cc:493] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.655560 18172 raft_consensus.cc:515] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:09:20.657176 18062 leader_election.cc:343] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.658123 18138 consensus_queue.cc:260] T 993eae98279b413f8c6fed0d4ea79eae P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.658701 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:20.658844 18172 leader_election.cc:290] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:20.659040 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:09:20.661001 17988 leader_election.cc:343] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.660852 18140 consensus_queue.cc:260] T 40f9c84f7e9940ce943e3ad8e2888beb P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:09:20.661526 17989 leader_election.cc:343] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.661937 17989 leader_election.cc:304] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:20.662968 18140 ts_tablet_manager.cc:1434] T 40f9c84f7e9940ce943e3ad8e2888beb P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:09:20.663232 18138 ts_tablet_manager.cc:1434] T 993eae98279b413f8c6fed0d4ea79eae P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:09:20.663828 18140 tablet_bootstrap.cc:492] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:20.664204 18138 tablet_bootstrap.cc:492] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:20.659359 18183 leader_election.cc:290] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:20.667959 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:20.668550 17948 raft_consensus.cc:3060] T 2753b334cd624cd290d57dacd79d8edc P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.668812 18172 raft_consensus.cc:2749] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.675133 18139 tablet_bootstrap.cc:492] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:20.675576 18139 ts_tablet_manager.cc:1403] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.061s	user 0.021s	sys 0.018s
I20260709 12:09:20.678159 18139 raft_consensus.cc:359] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.678833 18139 raft_consensus.cc:385] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.679075 18139 raft_consensus.cc:740] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.679852 18140 tablet_bootstrap.cc:654] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.679710 18139 consensus_queue.cc:260] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.690920 18139 ts_tablet_manager.cc:1434] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:09:20.691062 17948 raft_consensus.cc:2468] T 2753b334cd624cd290d57dacd79d8edc P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 1.
I20260709 12:09:20.692837 18139 tablet_bootstrap.cc:492] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:20.693207 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
W20260709 12:09:20.701401 18062 leader_election.cc:343] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.704457 18062 leader_election.cc:304] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:20.705205 18139 tablet_bootstrap.cc:654] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.708103 18183 raft_consensus.cc:2804] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.708597 18183 raft_consensus.cc:697] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:20.709417 18183 consensus_queue.cc:237] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.720114 18138 tablet_bootstrap.cc:654] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.722894 18211 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.723663 18211 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.725409 18211 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:20.726052 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:20.726622 18020 raft_consensus.cc:2468] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 0.
I20260709 12:09:20.727707 17913 leader_election.cc:304] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:20.728964 18211 raft_consensus.cc:2804] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.730736 18140 tablet_bootstrap.cc:492] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:20.730791 18211 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.731267 18140 ts_tablet_manager.cc:1403] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.068s	user 0.003s	sys 0.018s
I20260709 12:09:20.731290 18211 raft_consensus.cc:3060] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.733055 18139 tablet_bootstrap.cc:492] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:20.733475 18139 ts_tablet_manager.cc:1403] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.007s
I20260709 12:09:20.734230 18140 raft_consensus.cc:359] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.735224 18140 raft_consensus.cc:385] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.735545 18140 raft_consensus.cc:740] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.736223 18140 consensus_queue.cc:260] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.736974 18138 tablet_bootstrap.cc:492] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:20.737419 18138 ts_tablet_manager.cc:1403] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.073s	user 0.009s	sys 0.001s
I20260709 12:09:20.740607 18138 raft_consensus.cc:359] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.741217 18138 raft_consensus.cc:385] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.741457 18138 raft_consensus.cc:740] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.742033 18138 consensus_queue.cc:260] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.744716 18139 raft_consensus.cc:359] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.745360 18139 raft_consensus.cc:385] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.745626 18139 raft_consensus.cc:740] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.746053 17843 catalog_manager.cc:5697] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:20.747674 18140 ts_tablet_manager.cc:1434] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:09:20.747605 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:20.751118 18211 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.752267 18140 tablet_bootstrap.cc:492] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:20.753616 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:20.754170 18020 raft_consensus.cc:3060] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.760443 18139 consensus_queue.cc:260] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.762986 18020 raft_consensus.cc:2468] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 1.
I20260709 12:09:20.764334 17913 leader_election.cc:304] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:20.766397 18271 raft_consensus.cc:2804] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.766866 18271 raft_consensus.cc:697] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:09:20.767634 18271 consensus_queue.cc:237] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.769577 18138 ts_tablet_manager.cc:1434] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 12:09:20.769809 18139 ts_tablet_manager.cc:1434] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 12:09:20.770705 18139 tablet_bootstrap.cc:492] T c4f794e5675049b284921052a24eea37 P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
W20260709 12:09:20.766860 17914 leader_election.cc:343] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.780043 18211 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:20.782094 18140 tablet_bootstrap.cc:654] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.785789 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:20.786980 18138 tablet_bootstrap.cc:492] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
W20260709 12:09:20.791329 17914 leader_election.cc:343] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.795192 18140 tablet_bootstrap.cc:492] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:20.795639 18140 ts_tablet_manager.cc:1403] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.002s
I20260709 12:09:20.800688 18139 tablet_bootstrap.cc:654] T c4f794e5675049b284921052a24eea37 P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.801834 18138 tablet_bootstrap.cc:654] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.807518 18140 raft_consensus.cc:359] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.808519 18140 raft_consensus.cc:385] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.808908 18140 raft_consensus.cc:740] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.809613 18140 consensus_queue.cc:260] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.811110 18139 tablet_bootstrap.cc:492] T c4f794e5675049b284921052a24eea37 P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:20.811537 18139 ts_tablet_manager.cc:1403] T c4f794e5675049b284921052a24eea37 P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.006s
I20260709 12:09:20.812518 18140 ts_tablet_manager.cc:1434] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.002s
I20260709 12:09:20.812172 17843 catalog_manager.cc:5697] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 1 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:20.813531 18140 tablet_bootstrap.cc:492] T e46c78c4c90c48cd9221b9e9f0a327bc P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:20.814028 18139 raft_consensus.cc:359] T c4f794e5675049b284921052a24eea37 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.814689 18139 raft_consensus.cc:385] T c4f794e5675049b284921052a24eea37 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.820611 18140 tablet_bootstrap.cc:654] T e46c78c4c90c48cd9221b9e9f0a327bc P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.814946 18139 raft_consensus.cc:740] T c4f794e5675049b284921052a24eea37 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.823428 18183 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.824085 18183 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.824162 18139 consensus_queue.cc:260] T c4f794e5675049b284921052a24eea37 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.825843 18271 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.826488 18183 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:20.826277 18271 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.827167 18183 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.827581 18183 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.828325 18271 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:20.829950 18183 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:20.830475 18139 ts_tablet_manager.cc:1434] T c4f794e5675049b284921052a24eea37 P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:09:20.831419 18139 tablet_bootstrap.cc:492] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:20.831929 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:20.833248 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:20.834023 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:09:20.836145 17913 leader_election.cc:343] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.836297 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:20.837018 18020 raft_consensus.cc:2393] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 1: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:09:20.837189 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:20.838277 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:20.839027 17949 raft_consensus.cc:2393] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 1: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:09:20.841171 18062 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:20.842152 18096 raft_consensus.cc:3060] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.844175 18139 tablet_bootstrap.cc:654] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.845451 18140 tablet_bootstrap.cc:492] T e46c78c4c90c48cd9221b9e9f0a327bc P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:20.845530 18162 consensus_queue.cc:1048] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.845995 18140 ts_tablet_manager.cc:1403] T e46c78c4c90c48cd9221b9e9f0a327bc P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.007s
W20260709 12:09:20.847100 17914 leader_election.cc:343] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.847553 17914 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:20.848260 18162 raft_consensus.cc:2749] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:20.849329 17988 consensus_peers.cc:597] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:20.849542 18062 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:20.853112 18183 raft_consensus.cc:2749] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.853413 18140 raft_consensus.cc:359] T e46c78c4c90c48cd9221b9e9f0a327bc P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.854208 18140 raft_consensus.cc:385] T e46c78c4c90c48cd9221b9e9f0a327bc P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.854727 18140 raft_consensus.cc:740] T e46c78c4c90c48cd9221b9e9f0a327bc P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.855082 18183 raft_consensus.cc:3060] T c4f794e5675049b284921052a24eea37 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.855386 18138 tablet_bootstrap.cc:492] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:20.855938 18138 ts_tablet_manager.cc:1403] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.069s	user 0.007s	sys 0.016s
I20260709 12:09:20.855415 18140 consensus_queue.cc:260] T e46c78c4c90c48cd9221b9e9f0a327bc P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.858436 18138 raft_consensus.cc:359] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.860731 18211 consensus_queue.cc:1048] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:20.859115 18138 raft_consensus.cc:385] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.862247 18138 raft_consensus.cc:740] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.863514 18183 raft_consensus.cc:2749] T c4f794e5675049b284921052a24eea37 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:20.863679 18138 consensus_queue.cc:260] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.865432 18140 ts_tablet_manager.cc:1434] T e46c78c4c90c48cd9221b9e9f0a327bc P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.003s
I20260709 12:09:20.865767 18138 ts_tablet_manager.cc:1434] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:09:20.866348 18140 tablet_bootstrap.cc:492] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:20.869323 18138 tablet_bootstrap.cc:492] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:20.875787 18275 consensus_queue.cc:1048] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.878304 18138 tablet_bootstrap.cc:654] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.882557 18275 raft_consensus.cc:493] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.883038 18275 raft_consensus.cc:515] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.885072 18275 leader_election.cc:290] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:20.886909 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:20.889273 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:20.889905 18022 raft_consensus.cc:2468] T 993eae98279b413f8c6fed0d4ea79eae P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 0.
I20260709 12:09:20.891497 18062 leader_election.cc:304] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:20.893124 18195 raft_consensus.cc:2804] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.893497 18195 raft_consensus.cc:493] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.893846 18195 raft_consensus.cc:3060] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.895032 18200 raft_consensus.cc:493] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:20.895552 18200 raft_consensus.cc:515] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.897523 18200 leader_election.cc:290] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:20.899044 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:20.899659 18098 raft_consensus.cc:2468] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 0.
I20260709 12:09:20.901958 17989 leader_election.cc:304] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:20.902302 18195 raft_consensus.cc:515] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.904137 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:09:20.904811 18062 leader_election.cc:343] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.904762 17949 raft_consensus.cc:2468] T 40f9c84f7e9940ce943e3ad8e2888beb P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 0.
I20260709 12:09:20.905320 18200 raft_consensus.cc:2804] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:20.905684 18200 raft_consensus.cc:493] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:20.907002 18200 raft_consensus.cc:3060] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.907524 18138 tablet_bootstrap.cc:492] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:20.908025 18138 ts_tablet_manager.cc:1403] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.000s
I20260709 12:09:20.911204 18138 raft_consensus.cc:359] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.911906 18138 raft_consensus.cc:385] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:20.916067 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:20.916591 18143 consensus_queue.cc:1048] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.918023 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:20.918572 18022 raft_consensus.cc:3060] T 993eae98279b413f8c6fed0d4ea79eae P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.912233 18138 raft_consensus.cc:740] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:20.921650 18138 consensus_queue.cc:260] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.925199 18138 ts_tablet_manager.cc:1434] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:09:20.925925 18022 raft_consensus.cc:2468] T 993eae98279b413f8c6fed0d4ea79eae P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 1.
I20260709 12:09:20.904286 18195 leader_election.cc:290] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:20.929607 18138 tablet_bootstrap.cc:492] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
W20260709 12:09:20.927004 18303 log.cc:927] Time spent T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:09:20.931459 18211 consensus_queue.cc:1048] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260709 12:09:20.932833 18062 consensus_peers.cc:597] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:09:20.935945 18062 leader_election.cc:343] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:20.937001 18062 leader_election.cc:304] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:20.939160 18140 tablet_bootstrap.cc:654] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.941748 18138 tablet_bootstrap.cc:654] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:20.932145 18200 raft_consensus.cc:515] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.960798 18162 consensus_queue.cc:1048] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:20.970011 18183 raft_consensus.cc:2804] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:20.973503 18183 raft_consensus.cc:697] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:20.974335 18183 consensus_queue.cc:237] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:20.976028 18200 leader_election.cc:290] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:20.977348 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:20.982895 18094 raft_consensus.cc:3060] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:20.983218 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:20.993180 18139 tablet_bootstrap.cc:492] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:20.993710 18139 ts_tablet_manager.cc:1403] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.162s	user 0.021s	sys 0.031s
I20260709 12:09:20.988903 17949 raft_consensus.cc:3060] T 40f9c84f7e9940ce943e3ad8e2888beb P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.008294 18200 raft_consensus.cc:493] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.008807 18200 raft_consensus.cc:515] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.011999 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:21.013406 17948 raft_consensus.cc:2468] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 0.
I20260709 12:09:21.017298 18139 raft_consensus.cc:359] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.017824 18139 raft_consensus.cc:385] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.018042 18139 raft_consensus.cc:740] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.018554 18139 consensus_queue.cc:260] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.025563 17988 leader_election.cc:304] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:21.025655 18094 raft_consensus.cc:2468] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 1.
I20260709 12:09:21.028538 18143 raft_consensus.cc:2804] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.029109 18138 tablet_bootstrap.cc:492] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:21.055143 18139 ts_tablet_manager.cc:1434] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.000s
I20260709 12:09:21.055306 18138 ts_tablet_manager.cc:1403] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.129s	user 0.023s	sys 0.033s
I20260709 12:09:21.028894 18143 raft_consensus.cc:493] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.056337 18139 tablet_bootstrap.cc:492] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:21.054260 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:21.057449 18094 raft_consensus.cc:2468] T ca33c22be72d48f79260f24a00a8f8bb P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 0.
I20260709 12:09:21.058903 17949 raft_consensus.cc:2468] T 40f9c84f7e9940ce943e3ad8e2888beb P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 1.
I20260709 12:09:21.028919 17989 leader_election.cc:304] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:21.060256 18143 raft_consensus.cc:3060] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.060856 18172 raft_consensus.cc:2804] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.054597 18183 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.065873 18183 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.067899 18183 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:21.068524 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:21.069149 17949 raft_consensus.cc:2468] T 43c6bbfd11044938bb4686693c3544a7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 0.
I20260709 12:09:21.019629 18200 leader_election.cc:290] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:21.072357 18062 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:09:21.071882 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:21.073472 18195 raft_consensus.cc:2804] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.070755 18143 raft_consensus.cc:515] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:09:21.075037 18062 leader_election.cc:343] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.074580 18195 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.077062 18195 raft_consensus.cc:3060] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.078814 18140 tablet_bootstrap.cc:492] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:21.079252 18140 ts_tablet_manager.cc:1403] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.213s	user 0.022s	sys 0.020s
I20260709 12:09:21.081684 18140 raft_consensus.cc:359] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.082310 18140 raft_consensus.cc:385] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.082557 18140 raft_consensus.cc:740] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.072219 18172 raft_consensus.cc:697] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:09:21.083537 18140 consensus_queue.cc:260] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.084682 18172 consensus_queue.cc:237] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.086748 18140 ts_tablet_manager.cc:1434] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:21.087666 18140 tablet_bootstrap.cc:492] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:21.087270 18195 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.091777 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:21.093034 17949 raft_consensus.cc:3060] T 43c6bbfd11044938bb4686693c3544a7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.095223 17846 catalog_manager.cc:5697] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:21.099653 18143 leader_election.cc:290] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:21.102437 18139 tablet_bootstrap.cc:654] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.102975 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:21.098426 18138 raft_consensus.cc:359] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.106557 17948 raft_consensus.cc:3060] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.106601 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:21.106812 17949 raft_consensus.cc:2468] T 43c6bbfd11044938bb4686693c3544a7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 1.
I20260709 12:09:21.109738 18062 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
W20260709 12:09:21.110767 18062 leader_election.cc:343] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.111423 18183 raft_consensus.cc:2804] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.111935 18183 raft_consensus.cc:697] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:21.112726 18183 consensus_queue.cc:237] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.113207 17948 raft_consensus.cc:2468] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 1.
I20260709 12:09:21.115103 17988 leader_election.cc:304] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:21.116039 18200 raft_consensus.cc:2804] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.106624 18138 raft_consensus.cc:385] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.116468 18200 raft_consensus.cc:697] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:09:21.116861 18138 raft_consensus.cc:740] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.104156 18195 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:21.117401 18200 consensus_queue.cc:237] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.117571 18138 consensus_queue.cc:260] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.118415 18140 tablet_bootstrap.cc:654] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.119800 18138 ts_tablet_manager.cc:1434] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.000s
I20260709 12:09:21.121743 18138 tablet_bootstrap.cc:492] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:21.137622 18162 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.138198 18162 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.141225 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:21.142059 18162 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:21.142343 18096 raft_consensus.cc:3060] T ca33c22be72d48f79260f24a00a8f8bb P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.143966 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:21.145341 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:09:21.151059 17914 leader_election.cc:343] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:21.151609 17913 leader_election.cc:343] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.152020 17913 leader_election.cc:304] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:21.154173 18162 raft_consensus.cc:2749] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.157742 18096 raft_consensus.cc:2468] T ca33c22be72d48f79260f24a00a8f8bb P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 1.
I20260709 12:09:21.159220 18139 tablet_bootstrap.cc:492] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:21.159726 18138 tablet_bootstrap.cc:654] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.159739 18139 ts_tablet_manager.cc:1403] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.104s	user 0.008s	sys 0.012s
I20260709 12:09:21.160040 17845 catalog_manager.cc:5697] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.165552 18139 raft_consensus.cc:359] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.166213 18139 raft_consensus.cc:385] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.166565 18139 raft_consensus.cc:740] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.168532 18140 tablet_bootstrap.cc:492] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:21.168283 18139 consensus_queue.cc:260] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.169276 18140 ts_tablet_manager.cc:1403] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.082s	user 0.011s	sys 0.008s
I20260709 12:09:21.170200 17846 catalog_manager.cc:5697] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:21.171011 18139 ts_tablet_manager.cc:1434] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.011s	user 0.000s	sys 0.006s
I20260709 12:09:21.172029 18139 tablet_bootstrap.cc:492] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:21.181213 18200 consensus_queue.cc:1048] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.182006 18183 consensus_queue.cc:1048] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.185528 18140 raft_consensus.cc:359] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.186224 18140 raft_consensus.cc:385] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.186530 18140 raft_consensus.cc:740] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.187215 18140 consensus_queue.cc:260] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.189368 18140 ts_tablet_manager.cc:1434] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 12:09:21.190780 18140 tablet_bootstrap.cc:492] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:21.196297 18172 consensus_queue.cc:1048] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.212857 17846 catalog_manager.cc:5697] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.214854 18172 raft_consensus.cc:493] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.215337 18172 raft_consensus.cc:515] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.217319 18172 leader_election.cc:290] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:21.218263 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:21.218633 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:21.218941 17949 raft_consensus.cc:2468] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 0.
I20260709 12:09:21.220290 17988 leader_election.cc:304] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:09:21.220952 17989 leader_election.cc:343] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.221247 18172 raft_consensus.cc:2804] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.221756 18172 raft_consensus.cc:493] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.222659 18172 raft_consensus.cc:3060] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.227701 18195 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.228169 18195 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.230908 18195 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:09:21.232039 18062 consensus_peers.cc:597] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:21.234201 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:21.235044 18024 raft_consensus.cc:2393] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 1: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:09:21.235312 18172 raft_consensus.cc:515] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.238441 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:21.239733 18138 tablet_bootstrap.cc:492] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:21.240151 18138 ts_tablet_manager.cc:1403] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.119s	user 0.008s	sys 0.016s
I20260709 12:09:21.241830 18094 raft_consensus.cc:3060] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.242713 18062 leader_election.cc:304] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:21.242800 18172 leader_election.cc:290] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:21.246124 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
W20260709 12:09:21.249876 17989 leader_election.cc:343] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.251053 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:21.251602 17949 raft_consensus.cc:3060] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.258970 18139 tablet_bootstrap.cc:654] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.259384 18195 raft_consensus.cc:2749] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.260663 18162 consensus_queue.cc:1048] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.261735 17949 raft_consensus.cc:2468] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 1.
I20260709 12:09:21.262291 18140 tablet_bootstrap.cc:654] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.271255 17988 leader_election.cc:304] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:09:21.272600 18200 raft_consensus.cc:2804] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.273370 18200 raft_consensus.cc:697] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:09:21.274402 18200 consensus_queue.cc:237] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.281122 18140 tablet_bootstrap.cc:492] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:21.281606 18140 ts_tablet_manager.cc:1403] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.091s	user 0.013s	sys 0.000s
I20260709 12:09:21.290975 18271 raft_consensus.cc:493] T e46c78c4c90c48cd9221b9e9f0a327bc P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.291450 18271 raft_consensus.cc:515] T e46c78c4c90c48cd9221b9e9f0a327bc P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.294526 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:21.295737 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:09:21.295864 17914 leader_election.cc:343] T e46c78c4c90c48cd9221b9e9f0a327bc P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.296626 18162 consensus_queue.cc:1048] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:09:21.297207 17913 leader_election.cc:343] T e46c78c4c90c48cd9221b9e9f0a327bc P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.297657 17913 leader_election.cc:304] T e46c78c4c90c48cd9221b9e9f0a327bc P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:21.298772 18162 raft_consensus.cc:2749] T e46c78c4c90c48cd9221b9e9f0a327bc P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.300225 18271 leader_election.cc:290] T e46c78c4c90c48cd9221b9e9f0a327bc P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:21.310083 18138 raft_consensus.cc:359] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.310853 18138 raft_consensus.cc:385] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.311174 18138 raft_consensus.cc:740] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.315129 18138 consensus_queue.cc:260] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.321228 18138 ts_tablet_manager.cc:1434] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.000s
I20260709 12:09:21.321903 18138 tablet_bootstrap.cc:492] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:21.338264 18140 raft_consensus.cc:359] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.339639 18140 raft_consensus.cc:385] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.341099 18140 raft_consensus.cc:740] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.343410 17846 catalog_manager.cc:5697] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.346745 18138 tablet_bootstrap.cc:654] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.347306 18140 consensus_queue.cc:260] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.351199 18140 ts_tablet_manager.cc:1434] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.069s	user 0.008s	sys 0.001s
I20260709 12:09:21.345438 18139 tablet_bootstrap.cc:492] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:21.351691 18139 ts_tablet_manager.cc:1403] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.180s	user 0.031s	sys 0.018s
I20260709 12:09:21.354099 18139 raft_consensus.cc:359] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.354764 18139 raft_consensus.cc:385] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.355039 18139 raft_consensus.cc:740] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.355629 18139 consensus_queue.cc:260] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.357512 18139 ts_tablet_manager.cc:1434] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.003s
I20260709 12:09:21.358404 18140 tablet_bootstrap.cc:492] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:21.363973 18140 tablet_bootstrap.cc:654] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.366994 18139 tablet_bootstrap.cc:492] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:21.369395 18138 tablet_bootstrap.cc:492] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:21.369900 18138 ts_tablet_manager.cc:1403] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.048s	user 0.019s	sys 0.007s
I20260709 12:09:21.373466 18139 tablet_bootstrap.cc:654] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.375156 18138 raft_consensus.cc:359] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.375962 18138 raft_consensus.cc:385] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.376296 18138 raft_consensus.cc:740] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.380367 18140 tablet_bootstrap.cc:492] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:21.380957 18140 ts_tablet_manager.cc:1403] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.000s
I20260709 12:09:21.383544 18140 raft_consensus.cc:359] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.376959 18138 consensus_queue.cc:260] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.386711 18138 ts_tablet_manager.cc:1434] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:09:21.387604 18138 tablet_bootstrap.cc:492] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:21.392755 18200 raft_consensus.cc:493] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.393229 18200 raft_consensus.cc:515] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.395298 18200 leader_election.cc:290] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:21.396694 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:09:21.398090 17989 leader_election.cc:343] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.404126 18140 raft_consensus.cc:385] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.403942 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:21.404495 18140 raft_consensus.cc:740] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.404868 17949 raft_consensus.cc:2468] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 0.
I20260709 12:09:21.405285 18140 consensus_queue.cc:260] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.407305 18138 tablet_bootstrap.cc:654] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.412161 17988 leader_election.cc:304] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:09:21.412945 18200 raft_consensus.cc:2804] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.413308 18200 raft_consensus.cc:493] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.413630 18200 raft_consensus.cc:3060] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.419281 18140 ts_tablet_manager.cc:1434] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 12:09:21.421753 18200 raft_consensus.cc:515] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.422456 18140 tablet_bootstrap.cc:492] T 75c1f6edbec54664bbafbe9c9385ff6c P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:21.424250 18195 consensus_queue.cc:1048] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.432689 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:21.433022 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:21.435282 17949 raft_consensus.cc:3060] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.437093 18200 leader_election.cc:290] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:21.439146 18139 tablet_bootstrap.cc:492] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:21.439566 18139 ts_tablet_manager.cc:1403] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.073s	user 0.025s	sys 0.039s
W20260709 12:09:21.439679 17989 leader_election.cc:343] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.433679 17946 raft_consensus.cc:3060] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:21.445313 18062 consensus_peers.cc:597] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:21.447417 18139 raft_consensus.cc:359] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.449365 18139 raft_consensus.cc:385] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.449642 18139 raft_consensus.cc:740] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.450281 18139 consensus_queue.cc:260] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.452288 18139 ts_tablet_manager.cc:1434] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:09:21.452780 17946 raft_consensus.cc:2468] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 1.
I20260709 12:09:21.453265 18139 tablet_bootstrap.cc:492] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:21.453698 18138 tablet_bootstrap.cc:492] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:21.454108 18138 ts_tablet_manager.cc:1403] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.067s	user 0.009s	sys 0.001s
I20260709 12:09:21.453948 17988 leader_election.cc:304] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:09:21.454835 18172 raft_consensus.cc:2804] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.455267 18172 raft_consensus.cc:697] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:09:21.449083 18140 tablet_bootstrap.cc:654] T 75c1f6edbec54664bbafbe9c9385ff6c P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.459184 18172 consensus_queue.cc:237] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.459333 18138 raft_consensus.cc:359] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.462807 18138 raft_consensus.cc:385] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.463110 18138 raft_consensus.cc:740] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.463760 18138 consensus_queue.cc:260] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.466255 18138 ts_tablet_manager.cc:1434] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:09:21.467110 18138 tablet_bootstrap.cc:492] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:21.493120 17845 catalog_manager.cc:5697] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:21.496798 18139 tablet_bootstrap.cc:654] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.513019 18140 tablet_bootstrap.cc:492] T 75c1f6edbec54664bbafbe9c9385ff6c P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:21.513474 18140 ts_tablet_manager.cc:1403] T 75c1f6edbec54664bbafbe9c9385ff6c P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.093s	user 0.013s	sys 0.004s
I20260709 12:09:21.515918 18140 raft_consensus.cc:359] T 75c1f6edbec54664bbafbe9c9385ff6c P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.516582 18140 raft_consensus.cc:385] T 75c1f6edbec54664bbafbe9c9385ff6c P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.516815 18140 raft_consensus.cc:740] T 75c1f6edbec54664bbafbe9c9385ff6c P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.517581 18140 consensus_queue.cc:260] T 75c1f6edbec54664bbafbe9c9385ff6c P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.518635 18138 tablet_bootstrap.cc:654] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.519801 18140 ts_tablet_manager.cc:1434] T 75c1f6edbec54664bbafbe9c9385ff6c P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:09:21.520651 18140 tablet_bootstrap.cc:492] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:21.520712 18139 tablet_bootstrap.cc:492] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:21.521332 18139 ts_tablet_manager.cc:1403] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.068s	user 0.005s	sys 0.017s
I20260709 12:09:21.526028 18183 consensus_queue.cc:1048] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.527360 18140 tablet_bootstrap.cc:654] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.535689 18139 raft_consensus.cc:359] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.536528 18140 tablet_bootstrap.cc:492] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:21.537586 18140 ts_tablet_manager.cc:1403] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 12:09:21.537506 18139 raft_consensus.cc:385] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.538461 18138 tablet_bootstrap.cc:492] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:21.538560 18139 raft_consensus.cc:740] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.538905 18138 ts_tablet_manager.cc:1403] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.072s	user 0.010s	sys 0.002s
I20260709 12:09:21.540086 18140 raft_consensus.cc:359] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.540728 18140 raft_consensus.cc:385] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.541000 18140 raft_consensus.cc:740] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.540352 18139 consensus_queue.cc:260] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.541783 18138 raft_consensus.cc:359] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.541704 18140 consensus_queue.cc:260] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.542410 18138 raft_consensus.cc:385] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.542706 18138 raft_consensus.cc:740] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.543542 18211 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.543402 18138 consensus_queue.cc:260] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.543947 18211 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.545890 18211 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:21.546056 18138 ts_tablet_manager.cc:1434] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.002s
I20260709 12:09:21.547648 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:21.547734 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:21.548205 18138 tablet_bootstrap.cc:492] T b03f131254e14da2918c02bf0fcf9c5c P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
W20260709 12:09:21.549348 17913 leader_election.cc:343] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.550357 18140 ts_tablet_manager.cc:1434] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:09:21.551229 18140 tablet_bootstrap.cc:492] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:21.554039 18138 tablet_bootstrap.cc:654] T b03f131254e14da2918c02bf0fcf9c5c P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.557715 18140 tablet_bootstrap.cc:654] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
W20260709 12:09:21.559227 17894 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:09:21.559675 17914 leader_election.cc:343] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.560124 17914 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:21.561211 18211 raft_consensus.cc:2749] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.563881 18183 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.564297 18183 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.566205 18183 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:21.567147 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:21.567730 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:21.567976 17946 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 0.
I20260709 12:09:21.568380 18024 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 0.
I20260709 12:09:21.569664 18062 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:21.570518 18183 raft_consensus.cc:2804] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.570856 18183 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.571228 18183 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.573042 18172 consensus_queue.cc:1048] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.578385 18140 tablet_bootstrap.cc:492] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:21.578852 18140 ts_tablet_manager.cc:1403] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.000s
I20260709 12:09:21.578900 18183 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.581470 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:21.581418 18140 raft_consensus.cc:359] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.582055 17946 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.582085 18140 raft_consensus.cc:385] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.582533 18140 raft_consensus.cc:740] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.583312 18140 consensus_queue.cc:260] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.585335 18275 raft_consensus.cc:493] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.585681 18140 ts_tablet_manager.cc:1434] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:09:21.585837 18275 raft_consensus.cc:515] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.586581 18140 tablet_bootstrap.cc:492] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:21.587977 18275 leader_election.cc:290] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:21.588491 17946 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 1.
I20260709 12:09:21.589510 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:21.589617 18062 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:09:21.590149 17948 raft_consensus.cc:2468] T e46c78c4c90c48cd9221b9e9f0a327bc P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 0.
I20260709 12:09:21.591990 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:21.599474 18062 leader_election.cc:304] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:09:21.599088 18328 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.605067 18152 raft_consensus.cc:2804] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.605451 18152 raft_consensus.cc:493] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.605301 18328 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.605824 18152 raft_consensus.cc:3060] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.606470 18139 ts_tablet_manager.cc:1434] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.085s	user 0.005s	sys 0.000s
I20260709 12:09:21.607384 18328 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:21.607414 18139 tablet_bootstrap.cc:492] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
W20260709 12:09:21.611385 18062 leader_election.cc:343] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.612408 18183 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:21.596653 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:21.601284 18140 tablet_bootstrap.cc:654] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.613672 18022 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.593006 18275 raft_consensus.cc:2804] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.625952 18200 consensus_queue.cc:1048] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:21.629191 18020 raft_consensus.cc:3060] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.629119 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:21.642745 18139 tablet_bootstrap.cc:654] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.630069 18275 raft_consensus.cc:697] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
W20260709 12:09:21.643584 17913 leader_election.cc:343] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.650447 18022 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 1.
I20260709 12:09:21.651453 18138 tablet_bootstrap.cc:492] T b03f131254e14da2918c02bf0fcf9c5c P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:21.651923 18138 ts_tablet_manager.cc:1403] T b03f131254e14da2918c02bf0fcf9c5c P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.104s	user 0.007s	sys 0.017s
I20260709 12:09:21.653950 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:21.654438 18138 raft_consensus.cc:359] T b03f131254e14da2918c02bf0fcf9c5c P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.655102 18138 raft_consensus.cc:385] T b03f131254e14da2918c02bf0fcf9c5c P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.655366 18138 raft_consensus.cc:740] T b03f131254e14da2918c02bf0fcf9c5c P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.645838 18152 raft_consensus.cc:515] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.659381 18138 consensus_queue.cc:260] T b03f131254e14da2918c02bf0fcf9c5c P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.660283 18143 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.660238 18346 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.662861 18143 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.671883 18138 ts_tablet_manager.cc:1434] T b03f131254e14da2918c02bf0fcf9c5c P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:09:21.673061 18138 tablet_bootstrap.cc:492] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:21.661871 18195 consensus_queue.cc:1048] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:09:21.682255 18152 leader_election.cc:290] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:21.676688 18172 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.672336 18346 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.688862 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:21.690943 18172 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.688797 18313 consensus_queue.cc:1048] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
W20260709 12:09:21.689567 17914 leader_election.cc:343] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.707573 17914 leader_election.cc:304] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:21.709362 18271 raft_consensus.cc:2749] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.707756 18346 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:09:21.712035 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 45480.7us
I20260709 12:09:21.719014 18152 raft_consensus.cc:493] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.719331 18172 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:21.719480 18152 raft_consensus.cc:515] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.680909 18275 consensus_queue.cc:237] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.727458 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:21.728118 18024 raft_consensus.cc:2468] T b03f131254e14da2918c02bf0fcf9c5c P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 0.
I20260709 12:09:21.728274 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:21.732048 18152 leader_election.cc:290] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:21.732707 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:21.733204 18139 tablet_bootstrap.cc:492] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:21.733356 17948 raft_consensus.cc:2468] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 0.
I20260709 12:09:21.733623 18139 ts_tablet_manager.cc:1403] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.126s	user 0.014s	sys 0.022s
I20260709 12:09:21.734632 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:21.736195 17946 raft_consensus.cc:3060] T e46c78c4c90c48cd9221b9e9f0a327bc P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.737984 18062 leader_election.cc:304] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:09:21.739825 18152 raft_consensus.cc:2804] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.739998 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:21.740231 18152 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.740677 17947 raft_consensus.cc:2468] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 0.
I20260709 12:09:21.740850 18152 raft_consensus.cc:3060] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.742393 18143 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:21.743255 18139 raft_consensus.cc:359] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.744094 18139 raft_consensus.cc:385] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.744447 18139 raft_consensus.cc:740] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.747046 17988 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:09:21.747344 18062 leader_election.cc:343] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.740684 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:21.748484 17948 raft_consensus.cc:2393] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 1: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:09:21.749948 18140 tablet_bootstrap.cc:492] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:21.750381 18140 ts_tablet_manager.cc:1403] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.164s	user 0.012s	sys 0.018s
I20260709 12:09:21.751262 18139 consensus_queue.cc:260] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.754832 18200 raft_consensus.cc:2804] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:21.754984 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:21.755219 18200 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:21.755141 18172 consensus_queue.cc:1048] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:21.755717 18200 raft_consensus.cc:3060] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.756950 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:21.758519 18096 raft_consensus.cc:3060] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.763981 17989 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:21.766260 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:09:21.767660 17989 leader_election.cc:343] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.770226 18211 raft_consensus.cc:493] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.770702 18211 raft_consensus.cc:515] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.773130 18211 leader_election.cc:290] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:21.773671 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:21.774622 18062 leader_election.cc:304] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:09:21.779282 17914 leader_election.cc:343] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.776793 18140 raft_consensus.cc:359] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.783587 18140 raft_consensus.cc:385] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:21.784168 18140 raft_consensus.cc:740] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:21.796203 18139 ts_tablet_manager.cc:1434] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.062s	user 0.004s	sys 0.003s
I20260709 12:09:21.797091 18139 tablet_bootstrap.cc:492] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:21.799265 17946 raft_consensus.cc:2468] T e46c78c4c90c48cd9221b9e9f0a327bc P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 1.
I20260709 12:09:21.800410 18062 leader_election.cc:304] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:21.802110 18138 tablet_bootstrap.cc:654] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.806341 18140 consensus_queue.cc:260] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.809314 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:21.814999 18143 raft_consensus.cc:2749] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:21.815331 17913 leader_election.cc:343] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.816938 18139 tablet_bootstrap.cc:654] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:21.815760 17913 leader_election.cc:304] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:21.823364 18020 raft_consensus.cc:3060] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.826452 18200 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.808363 18275 raft_consensus.cc:2804] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:21.832592 18140 ts_tablet_manager.cc:1434] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.082s	user 0.007s	sys 0.000s
I20260709 12:09:21.831560 18271 raft_consensus.cc:2749] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.833704 18275 raft_consensus.cc:697] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:21.834556 18275 consensus_queue.cc:237] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.837636 18140 tablet_bootstrap.cc:492] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:21.838610 18351 consensus_queue.cc:1048] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:21.843633 18271 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.847698 18271 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.842012 18200 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:21.843238 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:21.851890 17948 raft_consensus.cc:3060] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.857087 18152 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.857595 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:21.859611 18152 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:21.853675 18211 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.860396 18211 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.860630 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:21.860926 18271 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:21.861234 18024 raft_consensus.cc:3060] T b03f131254e14da2918c02bf0fcf9c5c P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:21.862250 17913 leader_election.cc:343] T 75c1f6edbec54664bbafbe9c9385ff6c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.869732 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:21.869151 18346 raft_consensus.cc:2749] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:21.875590 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:21.878901 18200 consensus_queue.cc:1048] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:21.870527 17944 raft_consensus.cc:3060] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:21.915691 17989 leader_election.cc:343] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:21.938714 18348 raft_consensus.cc:493] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.939291 18348 raft_consensus.cc:515] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.970846 18348 leader_election.cc:290] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:21.977785 18139 tablet_bootstrap.cc:492] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:21.978421 18139 ts_tablet_manager.cc:1403] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.181s	user 0.015s	sys 0.003s
I20260709 12:09:21.972617 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:09:21.983703 18354 log.cc:927] Time spent T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 12:09:21.971999 18024 raft_consensus.cc:2468] T b03f131254e14da2918c02bf0fcf9c5c P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 1.
I20260709 12:09:21.990201 18098 raft_consensus.cc:3060] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:21.992733 17946 raft_consensus.cc:2393] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 1: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:09:21.992620 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:21.983799 18275 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:21.999378 18275 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:21.987313 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:22.028311 18062 leader_election.cc:304] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:22.027988 18139 raft_consensus.cc:359] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.030351 18139 raft_consensus.cc:385] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.031414 18139 raft_consensus.cc:740] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.033732 18062 leader_election.cc:304] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:22.036391 18313 consensus_queue.cc:1048] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.034619 18346 raft_consensus.cc:2804] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.038280 18346 raft_consensus.cc:697] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:22.039104 18346 consensus_queue.cc:237] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.040359 18211 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:22.041626 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:22.045537 18140 tablet_bootstrap.cc:654] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.051612 17948 raft_consensus.cc:2468] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 1.
I20260709 12:09:22.054791 18139 consensus_queue.cc:260] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.058193 17988 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:09:22.064162 18139 ts_tablet_manager.cc:1434] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.085s	user 0.002s	sys 0.009s
I20260709 12:09:22.064910 18139 tablet_bootstrap.cc:492] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:22.062870 18313 raft_consensus.cc:2804] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.070765 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:22.074468 18313 raft_consensus.cc:697] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
W20260709 12:09:22.079334 17914 leader_election.cc:343] T 75c1f6edbec54664bbafbe9c9385ff6c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.089599 17914 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:22.092715 18328 raft_consensus.cc:2749] T 75c1f6edbec54664bbafbe9c9385ff6c P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.097267 18313 consensus_queue.cc:237] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.110026 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:22.114300 17914 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:09:22.119575 18062 leader_election.cc:343] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.119069 18328 raft_consensus.cc:2749] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.105312 17944 raft_consensus.cc:2468] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 1.
I20260709 12:09:22.107702 18275 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:09:22.133703 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 54922.5us
I20260709 12:09:22.134553 18351 raft_consensus.cc:493] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:09:22.136471 18152 raft_consensus.cc:2749] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.154456 18143 consensus_queue.cc:1048] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.142935 18351 raft_consensus.cc:515] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:09:22.187331 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 43984.2us
I20260709 12:09:22.195667 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:22.195962 18139 tablet_bootstrap.cc:654] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.197144 18138 tablet_bootstrap.cc:492] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:22.197621 18138 ts_tablet_manager.cc:1403] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.525s	user 0.020s	sys 0.038s
I20260709 12:09:22.203665 18138 raft_consensus.cc:359] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.204295 18138 raft_consensus.cc:385] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.204533 18138 raft_consensus.cc:740] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.205120 18138 consensus_queue.cc:260] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:09:22.208734 18062 leader_election.cc:343] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.209141 18062 leader_election.cc:304] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:22.210991 18152 raft_consensus.cc:2749] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.219147 18138 ts_tablet_manager.cc:1434] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:09:22.224268 18138 tablet_bootstrap.cc:492] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:22.217123 17946 raft_consensus.cc:3060] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.231215 17843 catalog_manager.cc:5697] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:22.244663 18140 tablet_bootstrap.cc:492] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:22.245117 18140 ts_tablet_manager.cc:1403] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.408s	user 0.016s	sys 0.040s
I20260709 12:09:22.245034 17843 catalog_manager.cc:5697] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:22.263643 18139 tablet_bootstrap.cc:492] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:22.259764 18351 leader_election.cc:290] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:22.265193 18139 ts_tablet_manager.cc:1403] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.200s	user 0.015s	sys 0.011s
I20260709 12:09:22.264160 18275 consensus_queue.cc:1048] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:22.267729 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:22.252532 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:22.284016 17988 leader_election.cc:304] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:22.284890 18367 raft_consensus.cc:2749] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:09:22.305308 18183 consensus_queue.cc:1048] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.308393 18138 tablet_bootstrap.cc:654] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.325237 18139 raft_consensus.cc:359] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.330025 18140 raft_consensus.cc:359] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.330933 18140 raft_consensus.cc:385] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.331261 18140 raft_consensus.cc:740] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.331923 18140 consensus_queue.cc:260] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.335274 18140 ts_tablet_manager.cc:1434] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.075s	user 0.007s	sys 0.000s
I20260709 12:09:22.336203 18183 consensus_queue.cc:1048] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.347107 18140 tablet_bootstrap.cc:492] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:22.354801 18139 raft_consensus.cc:385] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.356353 18139 raft_consensus.cc:740] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.357146 18139 consensus_queue.cc:260] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.368281 18139 ts_tablet_manager.cc:1434] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.103s	user 0.005s	sys 0.001s
I20260709 12:09:22.373353 18139 tablet_bootstrap.cc:492] T 28dbc0f2cd704e82b686ffe4c9b9967e P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:22.375054 18138 tablet_bootstrap.cc:492] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:22.378572 18138 ts_tablet_manager.cc:1403] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.155s	user 0.016s	sys 0.003s
I20260709 12:09:22.391646 18138 raft_consensus.cc:359] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.392441 18138 raft_consensus.cc:385] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.392791 18138 raft_consensus.cc:740] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.393465 18138 consensus_queue.cc:260] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.372032 18140 tablet_bootstrap.cc:654] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.410045 18139 tablet_bootstrap.cc:654] T 28dbc0f2cd704e82b686ffe4c9b9967e P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.395730 18138 ts_tablet_manager.cc:1434] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:09:22.497047 18346 raft_consensus.cc:493] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.497468 18346 raft_consensus.cc:515] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.499010 18346 leader_election.cc:290] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:09:22.506757 18062 consensus_peers.cc:597] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:22.507298 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:22.508018 18024 raft_consensus.cc:2468] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 0.
I20260709 12:09:22.510008 18062 leader_election.cc:304] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:22.510798 18183 raft_consensus.cc:2804] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.511133 18183 raft_consensus.cc:493] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.511456 18183 raft_consensus.cc:3060] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.514073 18152 raft_consensus.cc:493] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.514504 18152 raft_consensus.cc:515] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.516327 18152 leader_election.cc:290] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:22.518169 18183 raft_consensus.cc:515] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.519970 18183 leader_election.cc:290] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:22.521817 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:22.522324 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:22.522957 18020 raft_consensus.cc:3060] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.531206 18020 raft_consensus.cc:2468] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 1.
W20260709 12:09:22.536088 18062 leader_election.cc:343] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.536698 18062 leader_election.cc:304] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:22.537369 18348 raft_consensus.cc:2804] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.537783 18348 raft_consensus.cc:697] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:22.538549 18348 consensus_queue.cc:237] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.546697 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:22.547466 17946 raft_consensus.cc:2468] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 0.
I20260709 12:09:22.549270 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:22.549984 17946 raft_consensus.cc:2468] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 0.
I20260709 12:09:22.554133 18373 consensus_queue.cc:1048] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:22.555019 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:22.555819 17946 raft_consensus.cc:3060] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.564471 17946 raft_consensus.cc:2468] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 1.
I20260709 12:09:22.569646 18140 tablet_bootstrap.cc:492] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:22.569717 18062 leader_election.cc:304] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:22.570197 18140 ts_tablet_manager.cc:1403] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.223s	user 0.012s	sys 0.000s
I20260709 12:09:22.572171 18138 tablet_bootstrap.cc:492] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:22.572822 18140 raft_consensus.cc:359] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.573513 18140 raft_consensus.cc:385] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.573786 18140 raft_consensus.cc:740] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.574767 18140 consensus_queue.cc:260] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.576416 17844 catalog_manager.cc:5697] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.579782 18348 raft_consensus.cc:2804] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.580166 18348 raft_consensus.cc:493] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.580505 18348 raft_consensus.cc:3060] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.582772 18346 consensus_queue.cc:1048] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:22.587941 18140 ts_tablet_manager.cc:1434] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:09:22.588896 18140 tablet_bootstrap.cc:492] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:22.596334 18348 raft_consensus.cc:515] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.597448 18138 tablet_bootstrap.cc:654] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.598402 18348 leader_election.cc:290] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:09:22.600383 17989 consensus_peers.cc:597] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Couldn't send request to peer 4813437da0a74e65b61eb7bd1d18f110. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:22.604948 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:22.609959 18183 consensus_queue.cc:1048] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:09:22.611176 18062 leader_election.cc:343] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.611433 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:22.612015 17948 raft_consensus.cc:3060] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.613418 18373 raft_consensus.cc:493] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.613997 18373 raft_consensus.cc:515] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.617712 18373 leader_election.cc:290] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:22.619545 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:09:22.621569 17989 leader_election.cc:343] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.622954 18138 tablet_bootstrap.cc:492] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:22.623427 18138 ts_tablet_manager.cc:1403] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.209s	user 0.017s	sys 0.005s
I20260709 12:09:22.625933 18138 raft_consensus.cc:359] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.627051 18138 raft_consensus.cc:385] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.627377 18138 raft_consensus.cc:740] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
W20260709 12:09:22.627823 17894 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:22.628108 18138 consensus_queue.cc:260] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.631335 18138 ts_tablet_manager.cc:1434] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:09:22.632198 18138 tablet_bootstrap.cc:492] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:22.639765 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:22.643471 18162 raft_consensus.cc:493] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.643935 18162 raft_consensus.cc:515] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.644656 17846 catalog_manager.cc:5697] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
W20260709 12:09:22.645320 17988 leader_election.cc:343] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.645509 18139 tablet_bootstrap.cc:492] T 28dbc0f2cd704e82b686ffe4c9b9967e P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:22.645727 17988 leader_election.cc:304] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:22.645962 18139 ts_tablet_manager.cc:1403] T 28dbc0f2cd704e82b686ffe4c9b9967e P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.273s	user 0.010s	sys 0.008s
I20260709 12:09:22.647434 17846 catalog_manager.cc:5697] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:22.648798 18162 leader_election.cc:290] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:22.650053 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:22.647262 18373 raft_consensus.cc:2749] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.662985 18139 raft_consensus.cc:359] T 28dbc0f2cd704e82b686ffe4c9b9967e P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.663648 18139 raft_consensus.cc:385] T 28dbc0f2cd704e82b686ffe4c9b9967e P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.663930 18139 raft_consensus.cc:740] T 28dbc0f2cd704e82b686ffe4c9b9967e P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.667279 18139 consensus_queue.cc:260] T 28dbc0f2cd704e82b686ffe4c9b9967e P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.668143 18183 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.668676 18183 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.677245 18138 tablet_bootstrap.cc:654] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.681071 18139 ts_tablet_manager.cc:1434] T 28dbc0f2cd704e82b686ffe4c9b9967e P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 12:09:22.667752 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:22.681951 18139 tablet_bootstrap.cc:492] T 57fe00fa09a54eb295024fca83b933ec P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:22.683424 18183 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:22.682449 17948 raft_consensus.cc:2468] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 1.
I20260709 12:09:22.691929 17913 leader_election.cc:304] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:22.695328 18211 raft_consensus.cc:2749] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.700937 18140 tablet_bootstrap.cc:654] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.710794 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:22.718321 18062 leader_election.cc:304] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:22.719105 18348 raft_consensus.cc:2804] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.720682 18348 raft_consensus.cc:697] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:22.721577 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:22.721590 18348 consensus_queue.cc:237] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.726539 18373 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.727191 18373 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.735517 18373 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:22.737545 18062 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:22.738747 18348 raft_consensus.cc:2749] T 28dbc0f2cd704e82b686ffe4c9b9967e P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.730569 18139 tablet_bootstrap.cc:654] T 57fe00fa09a54eb295024fca83b933ec P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.740000 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:22.740715 18095 raft_consensus.cc:2468] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 0.
I20260709 12:09:22.741938 17989 leader_election.cc:304] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:22.743556 18313 raft_consensus.cc:2804] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.743907 18313 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.744241 18313 raft_consensus.cc:3060] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.744494 18138 tablet_bootstrap.cc:492] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:22.744930 18138 ts_tablet_manager.cc:1403] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.113s	user 0.008s	sys 0.005s
I20260709 12:09:22.745893 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:09:22.747768 17988 leader_election.cc:343] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.747471 18138 raft_consensus.cc:359] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.748709 18138 raft_consensus.cc:385] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.748893 18138 raft_consensus.cc:740] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.749460 18138 consensus_queue.cc:260] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.740031 18140 tablet_bootstrap.cc:492] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:22.751101 18140 ts_tablet_manager.cc:1403] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.162s	user 0.015s	sys 0.000s
I20260709 12:09:22.753340 18140 raft_consensus.cc:359] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.753960 18140 raft_consensus.cc:385] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.754213 18140 raft_consensus.cc:740] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.754878 18140 consensus_queue.cc:260] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.757097 18140 ts_tablet_manager.cc:1434] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:22.757872 18140 tablet_bootstrap.cc:492] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:22.758903 18138 ts_tablet_manager.cc:1434] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:09:22.762692 17846 catalog_manager.cc:5697] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:22.763710 18140 tablet_bootstrap.cc:654] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.761849 18313 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.764953 18138 tablet_bootstrap.cc:492] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:22.768152 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:22.768735 18095 raft_consensus.cc:3060] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.776329 18095 raft_consensus.cc:2468] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 1.
I20260709 12:09:22.777230 18313 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:22.777418 18140 tablet_bootstrap.cc:492] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:22.778241 18140 ts_tablet_manager.cc:1403] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.005s
I20260709 12:09:22.781250 18140 raft_consensus.cc:359] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.781929 18140 raft_consensus.cc:385] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.782202 18140 raft_consensus.cc:740] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.782824 18140 consensus_queue.cc:260] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.784457 18140 ts_tablet_manager.cc:1434] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 12:09:22.784713 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:22.785053 17989 leader_election.cc:304] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:22.785276 18140 tablet_bootstrap.cc:492] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:22.786121 18367 raft_consensus.cc:2804] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.786610 18367 raft_consensus.cc:697] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:09:22.787545 18367 consensus_queue.cc:237] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:09:22.789194 17988 leader_election.cc:343] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.791831 18140 tablet_bootstrap.cc:654] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.799530 18139 tablet_bootstrap.cc:492] T 57fe00fa09a54eb295024fca83b933ec P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:22.799957 18139 ts_tablet_manager.cc:1403] T 57fe00fa09a54eb295024fca83b933ec P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.118s	user 0.012s	sys 0.000s
I20260709 12:09:22.802932 18139 raft_consensus.cc:359] T 57fe00fa09a54eb295024fca83b933ec P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.803597 18139 raft_consensus.cc:385] T 57fe00fa09a54eb295024fca83b933ec P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.803848 18139 raft_consensus.cc:740] T 57fe00fa09a54eb295024fca83b933ec P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.804455 18139 consensus_queue.cc:260] T 57fe00fa09a54eb295024fca83b933ec P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.807842 18139 ts_tablet_manager.cc:1434] T 57fe00fa09a54eb295024fca83b933ec P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:09:22.803367 18138 tablet_bootstrap.cc:654] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.809322 18139 tablet_bootstrap.cc:492] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:22.810010 18211 raft_consensus.cc:493] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.810470 18211 raft_consensus.cc:515] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.812573 18211 leader_election.cc:290] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:22.814553 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:22.815184 18020 raft_consensus.cc:2468] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 0.
I20260709 12:09:22.815699 18139 tablet_bootstrap.cc:654] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.816767 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:22.818123 17913 leader_election.cc:304] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:09:22.819736 17914 leader_election.cc:343] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.821029 18211 raft_consensus.cc:2804] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:22.821558 18211 raft_consensus.cc:493] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:22.821981 18211 raft_consensus.cc:3060] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.822220 17845 catalog_manager.cc:5697] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.830204 18138 tablet_bootstrap.cc:492] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:22.830731 18138 ts_tablet_manager.cc:1403] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.066s	user 0.014s	sys 0.000s
I20260709 12:09:22.833391 18138 raft_consensus.cc:359] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.834210 18138 raft_consensus.cc:385] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.838189 18138 raft_consensus.cc:740] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.838924 18138 consensus_queue.cc:260] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.840513 18138 ts_tablet_manager.cc:1434] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:09:22.841429 18138 tablet_bootstrap.cc:492] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:22.842628 18328 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:22.843184 18328 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.845050 18328 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:22.846416 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:09:22.847697 17914 leader_election.cc:343] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.848515 18140 tablet_bootstrap.cc:492] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:22.848976 18140 ts_tablet_manager.cc:1403] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.064s	user 0.010s	sys 0.001s
I20260709 12:09:22.849155 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:09:22.850400 17913 leader_election.cc:343] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.850800 17913 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:22.851627 18328 raft_consensus.cc:2749] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:22.852038 18140 raft_consensus.cc:359] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.852725 18140 raft_consensus.cc:385] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.853010 18140 raft_consensus.cc:740] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.853842 18138 tablet_bootstrap.cc:654] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.853641 18140 consensus_queue.cc:260] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.860064 18211 raft_consensus.cc:515] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.863915 18139 tablet_bootstrap.cc:492] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:22.864871 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:22.865345 18139 ts_tablet_manager.cc:1403] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.056s	user 0.029s	sys 0.009s
I20260709 12:09:22.865478 18020 raft_consensus.cc:3060] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.868474 18139 raft_consensus.cc:359] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.869118 18139 raft_consensus.cc:385] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.869381 18139 raft_consensus.cc:740] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.870185 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
W20260709 12:09:22.872891 17914 leader_election.cc:343] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:22.873732 18211 leader_election.cc:290] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:22.874516 18020 raft_consensus.cc:2468] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 1.
I20260709 12:09:22.870116 18139 consensus_queue.cc:260] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.875826 17913 leader_election.cc:304] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:09:22.876469 18211 raft_consensus.cc:2804] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:22.876919 18211 raft_consensus.cc:697] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:09:22.877592 18211 consensus_queue.cc:237] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.884840 18139 ts_tablet_manager.cc:1434] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 12:09:22.886480 18140 ts_tablet_manager.cc:1434] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.001s
I20260709 12:09:22.887374 18140 tablet_bootstrap.cc:492] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:22.891248 18139 tablet_bootstrap.cc:492] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:22.900482 18140 tablet_bootstrap.cc:654] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.904408 17946 raft_consensus.cc:3060] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:22.905682 18139 tablet_bootstrap.cc:654] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.919202 18138 tablet_bootstrap.cc:492] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:22.919781 18138 ts_tablet_manager.cc:1403] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.079s	user 0.037s	sys 0.017s
I20260709 12:09:22.921952 17846 catalog_manager.cc:5697] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 1 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:22.924010 18139 tablet_bootstrap.cc:492] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:22.924445 18139 ts_tablet_manager.cc:1403] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.033s	user 0.004s	sys 0.006s
I20260709 12:09:22.928066 18138 raft_consensus.cc:359] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.928956 18138 raft_consensus.cc:385] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.929230 18138 raft_consensus.cc:740] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.931763 18139 raft_consensus.cc:359] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.932472 18139 raft_consensus.cc:385] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.932755 18139 raft_consensus.cc:740] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.933416 18139 consensus_queue.cc:260] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.929843 18138 consensus_queue.cc:260] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.936720 18138 ts_tablet_manager.cc:1434] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:09:22.941808 18138 tablet_bootstrap.cc:492] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:22.947625 18138 tablet_bootstrap.cc:654] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.948608 18140 tablet_bootstrap.cc:492] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:22.949064 18140 ts_tablet_manager.cc:1403] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.062s	user 0.012s	sys 0.000s
I20260709 12:09:22.951138 18139 ts_tablet_manager.cc:1434] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:09:22.951452 18140 raft_consensus.cc:359] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.952069 18139 tablet_bootstrap.cc:492] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:22.952101 18140 raft_consensus.cc:385] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.952541 18140 raft_consensus.cc:740] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.953171 18140 consensus_queue.cc:260] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.958312 18139 tablet_bootstrap.cc:654] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.961791 18140 ts_tablet_manager.cc:1434] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:09:22.962733 18140 tablet_bootstrap.cc:492] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:22.984091 18140 tablet_bootstrap.cc:654] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:22.989688 18138 tablet_bootstrap.cc:492] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:22.990146 18138 ts_tablet_manager.cc:1403] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.049s	user 0.015s	sys 0.005s
I20260709 12:09:22.992795 18138 raft_consensus.cc:359] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.993455 18138 raft_consensus.cc:385] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:22.993705 18138 raft_consensus.cc:740] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:22.994798 18138 consensus_queue.cc:260] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:22.996873 18138 ts_tablet_manager.cc:1434] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:09:22.997676 18138 tablet_bootstrap.cc:492] T 9c0d192cc9cf47c1ba111cde01fad070 P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:23.000304 18139 tablet_bootstrap.cc:492] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:23.000730 18139 ts_tablet_manager.cc:1403] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.049s	user 0.018s	sys 0.003s
I20260709 12:09:23.003268 18139 raft_consensus.cc:359] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.003890 18139 raft_consensus.cc:385] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.004172 18139 raft_consensus.cc:740] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.004768 18139 consensus_queue.cc:260] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.010341 18139 ts_tablet_manager.cc:1434] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:09:23.012269 18139 tablet_bootstrap.cc:492] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:23.012799 18138 tablet_bootstrap.cc:654] T 9c0d192cc9cf47c1ba111cde01fad070 P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.016808 18140 tablet_bootstrap.cc:492] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:23.017222 18140 ts_tablet_manager.cc:1403] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.055s	user 0.010s	sys 0.011s
I20260709 12:09:23.017876 18139 tablet_bootstrap.cc:654] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.019678 18140 raft_consensus.cc:359] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.020394 18140 raft_consensus.cc:385] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.020745 18140 raft_consensus.cc:740] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.021852 18313 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.021574 18140 consensus_queue.cc:260] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.022326 18313 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.023954 18140 ts_tablet_manager.cc:1434] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:09:23.024520 18313 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:23.025542 18140 tablet_bootstrap.cc:492] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:23.026543 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:23.027302 17946 raft_consensus.cc:2468] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 0.
I20260709 12:09:23.028095 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:23.028723 18098 raft_consensus.cc:2468] T 57fe00fa09a54eb295024fca83b933ec P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 0.
I20260709 12:09:23.029336 17988 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:23.030495 18313 raft_consensus.cc:2804] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.030884 18313 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.031224 18313 raft_consensus.cc:3060] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.032449 18138 tablet_bootstrap.cc:492] T 9c0d192cc9cf47c1ba111cde01fad070 P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:23.032887 18138 ts_tablet_manager.cc:1403] T 9c0d192cc9cf47c1ba111cde01fad070 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 12:09:23.033859 18328 raft_consensus.cc:493] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.034312 18328 raft_consensus.cc:515] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.035844 18140 tablet_bootstrap.cc:654] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.035825 18367 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.036283 18328 leader_election.cc:290] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:23.036412 18367 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.038053 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:23.038465 18367 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:23.039837 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:23.040194 18138 raft_consensus.cc:359] T 9c0d192cc9cf47c1ba111cde01fad070 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.040467 18098 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 0.
I20260709 12:09:23.040874 18138 raft_consensus.cc:385] T 9c0d192cc9cf47c1ba111cde01fad070 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.041168 18138 raft_consensus.cc:740] T 9c0d192cc9cf47c1ba111cde01fad070 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.041549 17989 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:23.041764 18138 consensus_queue.cc:260] T 9c0d192cc9cf47c1ba111cde01fad070 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.042532 18351 raft_consensus.cc:2804] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.042930 18351 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.043251 18351 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.043807 18138 ts_tablet_manager.cc:1434] T 9c0d192cc9cf47c1ba111cde01fad070 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:09:23.044665 18138 tablet_bootstrap.cc:492] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:23.045084 18313 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.048123 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:23.048673 18098 raft_consensus.cc:3060] T 57fe00fa09a54eb295024fca83b933ec P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.050261 18138 tablet_bootstrap.cc:654] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.050907 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:23.064076 18138 tablet_bootstrap.cc:492] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:23.064567 18138 ts_tablet_manager.cc:1403] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.003s
I20260709 12:09:23.051669 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:23.055617 18348 consensus_queue.cc:1048] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.065815 18139 tablet_bootstrap.cc:492] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:23.065757 18345 consensus_queue.cc:1048] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.064514 17946 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 0.
I20260709 12:09:23.057142 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:23.057601 18313 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:23.066854 17944 raft_consensus.cc:3060] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.061432 18140 tablet_bootstrap.cc:492] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:23.066373 18139 ts_tablet_manager.cc:1403] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.001s
I20260709 12:09:23.068181 18140 ts_tablet_manager.cc:1403] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.006s
I20260709 12:09:23.070261 18139 raft_consensus.cc:359] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.070492 18140 raft_consensus.cc:359] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.070961 18139 raft_consensus.cc:385] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.071086 18140 raft_consensus.cc:385] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.071264 18139 raft_consensus.cc:740] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.071388 18140 raft_consensus.cc:740] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.071998 18140 consensus_queue.cc:260] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.072084 18139 consensus_queue.cc:260] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.073875 18140 ts_tablet_manager.cc:1434] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:09:23.074712 18140 tablet_bootstrap.cc:492] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:23.078096 17944 raft_consensus.cc:2468] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 1.
I20260709 12:09:23.079041 17913 leader_election.cc:304] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:23.080142 18140 tablet_bootstrap.cc:654] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.081434 18139 ts_tablet_manager.cc:1434] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 12:09:23.081629 18138 raft_consensus.cc:359] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.087410 18138 raft_consensus.cc:385] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.087684 18138 raft_consensus.cc:740] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.088291 18138 consensus_queue.cc:260] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.090270 18138 ts_tablet_manager.cc:1434] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:09:23.091126 18138 tablet_bootstrap.cc:492] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:23.091652 18211 raft_consensus.cc:2749] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.056466 18098 raft_consensus.cc:2468] T 57fe00fa09a54eb295024fca83b933ec P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 1.
I20260709 12:09:23.094852 18139 tablet_bootstrap.cc:492] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:23.097535 17989 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:23.102411 18313 raft_consensus.cc:2804] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.104501 18313 raft_consensus.cc:697] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:09:23.105283 18313 consensus_queue.cc:237] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.124991 18373 raft_consensus.cc:493] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.129264 18373 raft_consensus.cc:515] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.132038 18373 leader_election.cc:290] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:23.133249 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:23.133880 18098 raft_consensus.cc:2468] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 0.
I20260709 12:09:23.134888 17989 leader_election.cc:304] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:23.135666 18367 raft_consensus.cc:2804] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.136013 18367 raft_consensus.cc:493] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.136340 18367 raft_consensus.cc:3060] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.136644 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:23.137637 17948 raft_consensus.cc:2468] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 0.
I20260709 12:09:23.142999 18140 tablet_bootstrap.cc:492] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:23.143497 18140 ts_tablet_manager.cc:1403] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.069s	user 0.015s	sys 0.011s
I20260709 12:09:23.139428 18138 tablet_bootstrap.cc:654] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.149914 18351 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.146806 18367 raft_consensus.cc:515] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.156520 18367 leader_election.cc:290] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:23.156710 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:23.157320 18098 raft_consensus.cc:3060] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.158411 18351 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:23.159467 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:23.161588 18095 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.164405 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:23.164960 17946 raft_consensus.cc:3060] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.164997 18098 raft_consensus.cc:2468] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 1.
I20260709 12:09:23.166227 17989 leader_election.cc:304] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:23.167022 18351 raft_consensus.cc:2804] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.167147 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:23.167505 18351 raft_consensus.cc:697] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:09:23.167725 17948 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.168212 18313 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.168578 18351 consensus_queue.cc:237] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.168726 18313 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.171723 18313 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:23.173907 18139 tablet_bootstrap.cc:654] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.160262 17845 catalog_manager.cc:5697] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.175503 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:23.175655 18140 raft_consensus.cc:359] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.176123 17943 raft_consensus.cc:2468] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 0.
I20260709 12:09:23.176532 18140 raft_consensus.cc:385] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.176956 18140 raft_consensus.cc:740] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.177594 18140 consensus_queue.cc:260] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.179312 17948 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 1.
I20260709 12:09:23.180157 18346 consensus_queue.cc:1048] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:23.182317 17988 leader_election.cc:304] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:23.183010 18373 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.183233 18367 raft_consensus.cc:2804] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.183420 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:23.183670 18367 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.183476 18373 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.184075 18367 raft_consensus.cc:3060] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.185776 18373 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:23.186975 18095 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 1.
I20260709 12:09:23.187723 17988 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:23.188458 18373 raft_consensus.cc:2804] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.188802 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:23.189081 18373 raft_consensus.cc:697] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:09:23.189982 18373 consensus_queue.cc:237] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:09:23.194321 17988 leader_election.cc:343] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:23.188014 17989 leader_election.cc:343] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.200996 18367 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.205389 18095 raft_consensus.cc:3060] T 28dbc0f2cd704e82b686ffe4c9b9967e P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.212798 17946 raft_consensus.cc:2468] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 1.
I20260709 12:09:23.212862 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
W20260709 12:09:23.214788 17989 leader_election.cc:343] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.216085 18367 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:23.205482 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:23.208101 18138 tablet_bootstrap.cc:492] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:23.208298 18140 ts_tablet_manager.cc:1434] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.064s	user 0.005s	sys 0.000s
I20260709 12:09:23.217549 18138 ts_tablet_manager.cc:1403] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.127s	user 0.008s	sys 0.009s
I20260709 12:09:23.217679 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
W20260709 12:09:23.217902 17989 leader_election.cc:343] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.218283 17946 raft_consensus.cc:3060] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.218360 17989 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:23.220079 18138 raft_consensus.cc:359] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.220677 18138 raft_consensus.cc:385] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.220913 18138 raft_consensus.cc:740] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.221527 18138 consensus_queue.cc:260] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.223475 18138 ts_tablet_manager.cc:1434] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:09:23.224314 18138 tablet_bootstrap.cc:492] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:23.224365 18140 tablet_bootstrap.cc:492] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:23.224776 18313 raft_consensus.cc:2749] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.225977 18020 raft_consensus.cc:3060] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.245929 18345 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.245323 18367 raft_consensus.cc:493] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.249212 18367 raft_consensus.cc:515] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.251128 18367 leader_election.cc:290] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:23.251804 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:23.252348 18346 consensus_queue.cc:1048] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.252470 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:23.248351 18345 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.252817 18211 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.253858 18211 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.334717 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:23.356423 18020 raft_consensus.cc:2468] T 9c0d192cc9cf47c1ba111cde01fad070 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 0.
I20260709 12:09:23.360281 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:23.362509 18138 tablet_bootstrap.cc:654] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.360093 18062 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:23.365772 18183 raft_consensus.cc:2804] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.366230 18183 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.366612 18183 raft_consensus.cc:3060] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.348506 18328 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.372709 18211 leader_election.cc:290] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:23.342487 18275 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.356033 18345 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:23.335575 17946 raft_consensus.cc:2468] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 1.
I20260709 12:09:23.280507 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:23.322530 17989 leader_election.cc:304] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:23.375145 17947 raft_consensus.cc:3060] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.393775 18183 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.398106 18140 tablet_bootstrap.cc:654] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.399442 17988 leader_election.cc:304] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
W20260709 12:09:23.400928 17913 leader_election.cc:343] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.401747 18211 consensus_queue.cc:1048] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.374908 18328 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.402941 18313 raft_consensus.cc:2804] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:23.412773 18139 tablet_bootstrap.cc:492] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:23.413211 18139 ts_tablet_manager.cc:1403] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.319s	user 0.007s	sys 0.028s
I20260709 12:09:23.414214 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:23.414773 18183 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:23.391041 17948 raft_consensus.cc:2468] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 0.
I20260709 12:09:23.374890 18275 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.403419 18313 raft_consensus.cc:697] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:09:23.428866 18211 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.429350 18211 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.431216 18211 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:23.432833 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:09:23.434293 17913 leader_election.cc:343] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.429724 18313 consensus_queue.cc:237] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.412015 18367 raft_consensus.cc:2749] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:23.428010 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 105817us
I20260709 12:09:23.443935 17846 catalog_manager.cc:5697] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.491588 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:23.492215 17846 catalog_manager.cc:5697] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.481603 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:09:23.479235 17970 debug-util.cc:398] Leaking SignalData structure 0x7b08000dc620 after lost signal to thread 16782
I20260709 12:09:23.463131 18275 leader_election.cc:290] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:09:23.503137 17914 consensus_peers.cc:597] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 -> Peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Couldn't send request to peer 4813437da0a74e65b61eb7bd1d18f110. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:09:23.503754 17914 leader_election.cc:343] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.504117 17914 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:23.504706 18422 raft_consensus.cc:2749] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.505956 18140 tablet_bootstrap.cc:492] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:23.506369 18140 ts_tablet_manager.cc:1403] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.287s	user 0.012s	sys 0.000s
I20260709 12:09:23.494897 18328 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:23.513168 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:23.471607 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:23.515216 18097 raft_consensus.cc:2393] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 1: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:09:23.516572 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:23.517130 18019 raft_consensus.cc:3060] T 9c0d192cc9cf47c1ba111cde01fad070 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.517668 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:23.519949 18138 tablet_bootstrap.cc:492] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:23.520529 18138 ts_tablet_manager.cc:1403] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.296s	user 0.017s	sys 0.044s
I20260709 12:09:23.479508 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:23.529445 18351 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.539155 17948 raft_consensus.cc:3060] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.539688 17914 leader_election.cc:304] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:23.548857 18367 consensus_queue.cc:1048] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.501405 18095 raft_consensus.cc:2468] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 0.
I20260709 12:09:23.538209 18351 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:09:23.557565 17970 debug-util.cc:398] Leaking SignalData structure 0x7b08000c8260 after lost signal to thread 17881
I20260709 12:09:23.550879 17944 raft_consensus.cc:2468] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 0.
I20260709 12:09:23.518718 18139 raft_consensus.cc:359] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.565830 18139 raft_consensus.cc:385] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:09:23.564322 17970 debug-util.cc:398] Leaking SignalData structure 0x7b08000ff2a0 after lost signal to thread 17973
W20260709 12:09:23.563392 18062 leader_election.cc:343] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.566234 18139 raft_consensus.cc:740] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.566339 18138 raft_consensus.cc:359] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.570173 18138 raft_consensus.cc:385] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.570421 18138 raft_consensus.cc:740] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.572194 18062 leader_election.cc:304] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:23.573226 18183 raft_consensus.cc:2804] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.573570 18183 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.573886 18183 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.573051 18139 consensus_queue.cc:260] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.574201 18138 consensus_queue.cc:260] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:09:23.582545 17970 debug-util.cc:398] Leaking SignalData structure 0x7b08001b3cc0 after lost signal to thread 18048
I20260709 12:09:23.586531 18019 raft_consensus.cc:2468] T 9c0d192cc9cf47c1ba111cde01fad070 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 1.
I20260709 12:09:23.591670 18428 consensus_queue.cc:1048] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.592209 18140 raft_consensus.cc:359] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.592854 18140 raft_consensus.cc:385] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.593108 18140 raft_consensus.cc:740] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.594148 18139 ts_tablet_manager.cc:1434] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.181s	user 0.013s	sys 0.001s
I20260709 12:09:23.595078 18139 tablet_bootstrap.cc:492] T 9bb1ec98e5b847df8a401343514ac12d P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:23.599911 18183 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.600184 17914 leader_election.cc:304] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:23.600939 18422 raft_consensus.cc:2804] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.601432 18422 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.601701 18183 leader_election.cc:290] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:23.601856 18422 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.603761 18351 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:23.604717 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:09:23.606604 17989 leader_election.cc:343] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:23.589174 17970 debug-util.cc:398] Leaking SignalData structure 0x7b0800261fc0 after lost signal to thread 18122
I20260709 12:09:23.620373 18140 consensus_queue.cc:260] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.617177 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:09:23.627557 17988 leader_election.cc:343] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.627951 17988 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:23.628757 18139 tablet_bootstrap.cc:654] T 9bb1ec98e5b847df8a401343514ac12d P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.630146 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:23.630090 17846 catalog_manager.cc:5697] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:23.629309 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:23.639537 18140 ts_tablet_manager.cc:1434] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.133s	user 0.007s	sys 0.004s
I20260709 12:09:23.640044 18062 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:23.641359 18183 raft_consensus.cc:2804] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:09:23.642467 18062 leader_election.cc:343] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.642665 18183 raft_consensus.cc:697] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:23.643633 18183 consensus_queue.cc:237] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.625401 18428 consensus_queue.cc:1048] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
W20260709 12:09:23.653283 18431 log.cc:927] Time spent T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:09:23.633531 18351 raft_consensus.cc:2749] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.659966 18140 tablet_bootstrap.cc:492] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:23.629714 18313 consensus_queue.cc:1048] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 12:09:23.663600 18367 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.664479 18428 consensus_queue.cc:1048] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.664208 18367 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.666920 18367 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:23.644863 18422 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.682739 18422 leader_election.cc:290] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:23.684128 18138 ts_tablet_manager.cc:1434] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.163s	user 0.008s	sys 0.023s
I20260709 12:09:23.685006 18138 tablet_bootstrap.cc:492] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:23.694905 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:23.695735 18091 raft_consensus.cc:2393] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 1: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:09:23.683495 17946 raft_consensus.cc:2393] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 1: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:09:23.710747 18313 consensus_queue.cc:1048] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:23.713819 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:23.715981 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:23.716650 17943 raft_consensus.cc:2468] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 0.
I20260709 12:09:23.724917 17988 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:23.743590 18162 raft_consensus.cc:2749] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:09:23.744633 17989 leader_election.cc:343] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.748270 18428 raft_consensus.cc:2804] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.769629 18424 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.781520 18424 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.784252 18424 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:23.750072 18351 consensus_queue.cc:1048] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 12:09:23.785809 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:09:23.789027 17914 leader_election.cc:343] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.791172 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:23.791862 18020 raft_consensus.cc:2468] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 0.
I20260709 12:09:23.770203 18428 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.793870 18139 tablet_bootstrap.cc:492] T 9bb1ec98e5b847df8a401343514ac12d P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:23.794304 18139 ts_tablet_manager.cc:1403] T 9bb1ec98e5b847df8a401343514ac12d P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.199s	user 0.048s	sys 0.050s
I20260709 12:09:23.797709 18062 leader_election.cc:304] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:23.798702 18348 raft_consensus.cc:2749] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.798543 18139 raft_consensus.cc:359] T 9bb1ec98e5b847df8a401343514ac12d P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.795184 18428 raft_consensus.cc:3060] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.799260 18139 raft_consensus.cc:385] T 9bb1ec98e5b847df8a401343514ac12d P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:23.799547 18139 raft_consensus.cc:740] T 9bb1ec98e5b847df8a401343514ac12d P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:23.800407 18139 consensus_queue.cc:260] T 9bb1ec98e5b847df8a401343514ac12d P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.802668 18139 ts_tablet_manager.cc:1434] T 9bb1ec98e5b847df8a401343514ac12d P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:09:23.803521 18139 tablet_bootstrap.cc:492] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:23.800248 17913 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:09:23.816880 18140 tablet_bootstrap.cc:654] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.814009 18422 raft_consensus.cc:2804] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:23.830045 18183 raft_consensus.cc:493] T 9bb1ec98e5b847df8a401343514ac12d P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.830852 18183 raft_consensus.cc:515] T 9bb1ec98e5b847df8a401343514ac12d P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.830045 18422 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:23.865406 18139 tablet_bootstrap.cc:654] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.875746 18183 leader_election.cc:290] T 9bb1ec98e5b847df8a401343514ac12d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:23.878360 18138 tablet_bootstrap.cc:654] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:23.847118 18422 raft_consensus.cc:3060] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:23.896153 18439 log.cc:927] Time spent T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:09:23.929962 18443 consensus_queue.cc:1048] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.041s
I20260709 12:09:23.933598 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:23.943990 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:23.949328 18062 leader_election.cc:304] T 9bb1ec98e5b847df8a401343514ac12d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:23.937335 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:23.951229 18348 raft_consensus.cc:2749] T 9bb1ec98e5b847df8a401343514ac12d P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.975067 18183 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:23.975564 18183 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:23.977334 18183 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:23.979651 17843 catalog_manager.cc:5697] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:23.981350 18092 raft_consensus.cc:3060] T 9bb1ec98e5b847df8a401343514ac12d P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:23.979883 18428 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:09:23.990165 17913 leader_election.cc:343] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:23.990746 17913 leader_election.cc:304] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:23.962491 18140 tablet_bootstrap.cc:492] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:23.991469 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:23.997819 18140 ts_tablet_manager.cc:1403] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.338s	user 0.010s	sys 0.005s
I20260709 12:09:24.003904 18139 tablet_bootstrap.cc:492] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:24.004370 18139 ts_tablet_manager.cc:1403] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.201s	user 0.023s	sys 0.040s
I20260709 12:09:24.014880 18425 raft_consensus.cc:2749] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:23.962534 18422 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.015478 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:09:24.036770 18062 leader_election.cc:343] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:24.037616 18062 leader_election.cc:343] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.038093 18062 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:24.038771 18345 raft_consensus.cc:2749] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.034144 18139 raft_consensus.cc:359] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.042547 18139 raft_consensus.cc:385] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.042846 18139 raft_consensus.cc:740] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.044659 18428 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:24.046257 18422 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:24.043440 18139 consensus_queue.cc:260] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.055218 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:24.055770 17946 raft_consensus.cc:3060] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.061524 18138 tablet_bootstrap.cc:492] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:24.062000 18138 ts_tablet_manager.cc:1403] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.377s	user 0.013s	sys 0.011s
I20260709 12:09:24.062213 17946 raft_consensus.cc:2468] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 1.
I20260709 12:09:24.062817 18140 raft_consensus.cc:359] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.064714 18140 raft_consensus.cc:385] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.067124 18139 ts_tablet_manager.cc:1434] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.002s
I20260709 12:09:24.068034 18139 tablet_bootstrap.cc:492] T 320059eb6db148929cae07ba683cfe1f P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:24.069928 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
W20260709 12:09:24.083666 17989 leader_election.cc:343] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:24.072018 17894 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:24.064973 18140 raft_consensus.cc:740] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.072424 18351 consensus_queue.cc:1048] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.075547 17946 raft_consensus.cc:3060] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.086454 18140 consensus_queue.cc:260] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.088562 18140 ts_tablet_manager.cc:1434] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.087s	user 0.005s	sys 0.000s
I20260709 12:09:24.077823 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:24.078747 18138 raft_consensus.cc:359] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.089026 18138 raft_consensus.cc:385] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.089056 18024 raft_consensus.cc:3060] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.089372 18138 raft_consensus.cc:740] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.090035 18138 consensus_queue.cc:260] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.070595 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:24.091423 18094 raft_consensus.cc:3060] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.095566 18138 ts_tablet_manager.cc:1434] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 12:09:24.096424 18138 tablet_bootstrap.cc:492] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:24.099195 18345 consensus_queue.cc:1048] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.105301 18139 tablet_bootstrap.cc:654] T 320059eb6db148929cae07ba683cfe1f P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.107009 17988 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:09:24.107765 18367 raft_consensus.cc:2804] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.108220 18367 raft_consensus.cc:697] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:09:24.108996 18367 consensus_queue.cc:237] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.114181 18024 raft_consensus.cc:2468] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 1.
I20260709 12:09:24.123845 18140 tablet_bootstrap.cc:492] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
W20260709 12:09:24.132623 17989 consensus_peers.cc:597] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Couldn't send request to peer 4813437da0a74e65b61eb7bd1d18f110. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:24.135114 17913 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:24.139432 18162 raft_consensus.cc:2804] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.139931 18162 raft_consensus.cc:697] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:09:24.140654 18162 consensus_queue.cc:237] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.143622 18094 raft_consensus.cc:2468] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 1.
I20260709 12:09:24.145404 18140 tablet_bootstrap.cc:654] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.141177 18138 tablet_bootstrap.cc:654] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.162865 18024 raft_consensus.cc:3060] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.173275 18275 consensus_queue.cc:1048] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:24.180619 18138 tablet_bootstrap.cc:492] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:24.181187 18138 ts_tablet_manager.cc:1403] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.085s	user 0.009s	sys 0.003s
I20260709 12:09:24.181325 18139 tablet_bootstrap.cc:492] T 320059eb6db148929cae07ba683cfe1f P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:24.181798 18139 ts_tablet_manager.cc:1403] T 320059eb6db148929cae07ba683cfe1f P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.114s	user 0.010s	sys 0.002s
I20260709 12:09:24.211035 17843 catalog_manager.cc:5697] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.213063 18140 tablet_bootstrap.cc:492] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:24.213565 18140 ts_tablet_manager.cc:1403] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.090s	user 0.012s	sys 0.000s
I20260709 12:09:24.216782 17844 catalog_manager.cc:5697] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 1 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.220920 18138 raft_consensus.cc:359] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.224211 18138 raft_consensus.cc:385] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.226109 18139 raft_consensus.cc:359] T 320059eb6db148929cae07ba683cfe1f P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.224478 18138 raft_consensus.cc:740] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.226748 18139 raft_consensus.cc:385] T 320059eb6db148929cae07ba683cfe1f P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.227046 18139 raft_consensus.cc:740] T 320059eb6db148929cae07ba683cfe1f P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.227150 18138 consensus_queue.cc:260] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.227463 18139 consensus_queue.cc:260] T 320059eb6db148929cae07ba683cfe1f P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.229548 18139 ts_tablet_manager.cc:1434] T 320059eb6db148929cae07ba683cfe1f P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.047s	user 0.009s	sys 0.001s
I20260709 12:09:24.230414 18139 tablet_bootstrap.cc:492] T 74a818492fb249b0ba39c6bed00cd202 P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:24.239111 18138 ts_tablet_manager.cc:1434] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.058s	user 0.003s	sys 0.013s
I20260709 12:09:24.240365 18138 tablet_bootstrap.cc:492] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:24.262472 18140 raft_consensus.cc:359] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.267699 18140 raft_consensus.cc:385] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.268002 18140 raft_consensus.cc:740] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.278960 18139 tablet_bootstrap.cc:654] T 74a818492fb249b0ba39c6bed00cd202 P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.301287 18140 consensus_queue.cc:260] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.302968 18138 tablet_bootstrap.cc:654] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.307935 18139 tablet_bootstrap.cc:492] T 74a818492fb249b0ba39c6bed00cd202 P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:24.308482 18139 ts_tablet_manager.cc:1403] T 74a818492fb249b0ba39c6bed00cd202 P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.078s	user 0.014s	sys 0.006s
I20260709 12:09:24.311225 18139 raft_consensus.cc:359] T 74a818492fb249b0ba39c6bed00cd202 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.312016 18139 raft_consensus.cc:385] T 74a818492fb249b0ba39c6bed00cd202 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.312318 18139 raft_consensus.cc:740] T 74a818492fb249b0ba39c6bed00cd202 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.313074 18140 ts_tablet_manager.cc:1434] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.099s	user 0.008s	sys 0.000s
I20260709 12:09:24.313107 18139 consensus_queue.cc:260] T 74a818492fb249b0ba39c6bed00cd202 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.315443 18139 ts_tablet_manager.cc:1434] T 74a818492fb249b0ba39c6bed00cd202 P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:09:24.317013 18139 tablet_bootstrap.cc:492] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:24.323568 18139 tablet_bootstrap.cc:654] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.314083 18140 tablet_bootstrap.cc:492] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:24.348281 18138 tablet_bootstrap.cc:492] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:24.348771 18138 ts_tablet_manager.cc:1403] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.109s	user 0.010s	sys 0.000s
I20260709 12:09:24.351809 18140 tablet_bootstrap.cc:654] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.356741 18139 tablet_bootstrap.cc:492] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:24.357224 18139 ts_tablet_manager.cc:1403] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.040s	user 0.019s	sys 0.018s
I20260709 12:09:24.360046 18138 raft_consensus.cc:359] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.360980 18138 raft_consensus.cc:385] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.361351 18138 raft_consensus.cc:740] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.362962 18139 raft_consensus.cc:359] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.363694 18139 raft_consensus.cc:385] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.363950 18139 raft_consensus.cc:740] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.364923 18140 tablet_bootstrap.cc:492] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:24.364588 18139 consensus_queue.cc:260] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.365343 18140 ts_tablet_manager.cc:1403] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.051s	user 0.015s	sys 0.001s
I20260709 12:09:24.363003 18138 consensus_queue.cc:260] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.368250 18139 ts_tablet_manager.cc:1434] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:09:24.368472 18140 raft_consensus.cc:359] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.369107 18139 tablet_bootstrap.cc:492] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:24.370149 18138 ts_tablet_manager.cc:1434] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:09:24.370980 18138 tablet_bootstrap.cc:492] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:24.371289 18433 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.371719 18433 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.373661 18433 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:24.375479 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:24.376109 17941 raft_consensus.cc:2468] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 0.
I20260709 12:09:24.377207 17988 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:24.379827 18433 raft_consensus.cc:2804] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.380157 18433 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.380528 18433 raft_consensus.cc:3060] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.381181 18138 tablet_bootstrap.cc:654] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.385854 18373 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.386240 18139 tablet_bootstrap.cc:654] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.369065 18140 raft_consensus.cc:385] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.385759 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:24.387025 18140 raft_consensus.cc:740] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.386359 18373 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.389212 18373 leader_election.cc:290] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:09:24.392223 17989 leader_election.cc:343] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.394142 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:24.393721 18140 consensus_queue.cc:260] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.394902 18092 raft_consensus.cc:2393] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 1: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:09:24.397034 18140 ts_tablet_manager.cc:1434] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 12:09:24.398005 18140 tablet_bootstrap.cc:492] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:24.398366 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:24.399056 17946 raft_consensus.cc:2393] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 1: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:09:24.400215 17988 leader_election.cc:304] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:24.405642 18373 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.407049 18433 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.413205 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
W20260709 12:09:24.416224 17989 leader_election.cc:343] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.412004 18433 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:24.418452 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:24.419570 18138 tablet_bootstrap.cc:492] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:24.419874 17941 raft_consensus.cc:3060] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.420029 18138 ts_tablet_manager.cc:1403] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.049s	user 0.004s	sys 0.010s
I20260709 12:09:24.421824 18426 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.422313 18426 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.424644 18426 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:24.425978 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:24.427165 18373 raft_consensus.cc:2749] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.427510 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:24.429749 18062 leader_election.cc:304] T 320059eb6db148929cae07ba683cfe1f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:24.433207 18138 raft_consensus.cc:359] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.433841 18138 raft_consensus.cc:385] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.434168 18138 raft_consensus.cc:740] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.434186 18426 raft_consensus.cc:2749] T 320059eb6db148929cae07ba683cfe1f P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.434996 18140 tablet_bootstrap.cc:654] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.435693 18138 consensus_queue.cc:260] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.444540 18138 ts_tablet_manager.cc:1434] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:09:24.446796 18138 tablet_bootstrap.cc:492] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:24.447103 17941 raft_consensus.cc:2468] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 1.
I20260709 12:09:24.450563 17988 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:09:24.452225 18373 raft_consensus.cc:2804] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.452962 18373 raft_consensus.cc:697] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:09:24.453751 18139 tablet_bootstrap.cc:492] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:24.454255 18139 ts_tablet_manager.cc:1403] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.085s	user 0.016s	sys 0.003s
I20260709 12:09:24.455044 18373 consensus_queue.cc:237] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.471098 18140 tablet_bootstrap.cc:492] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:24.471583 18140 ts_tablet_manager.cc:1403] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.074s	user 0.013s	sys 0.002s
I20260709 12:09:24.473003 18139 raft_consensus.cc:359] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.473722 18139 raft_consensus.cc:385] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.474033 18139 raft_consensus.cc:740] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.474668 18139 consensus_queue.cc:260] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.476128 18140 raft_consensus.cc:359] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.476754 18140 raft_consensus.cc:385] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.477005 18140 raft_consensus.cc:740] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.477481 18138 tablet_bootstrap.cc:654] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.477600 18140 consensus_queue.cc:260] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.491416 18162 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.491909 18162 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.494095 18162 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:24.494607 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:09:24.496160 17913 leader_election.cc:343] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.496447 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:09:24.498788 17914 leader_election.cc:343] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.499364 17914 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:24.485330 17844 catalog_manager.cc:5697] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.502425 18162 raft_consensus.cc:2749] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.486545 18139 ts_tablet_manager.cc:1434] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 12:09:24.509042 18139 tablet_bootstrap.cc:492] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:24.487265 18140 ts_tablet_manager.cc:1434] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:09:24.518389 18140 tablet_bootstrap.cc:492] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:24.519472 18094 raft_consensus.cc:3060] T 74a818492fb249b0ba39c6bed00cd202 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.524132 18425 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.524598 18425 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.525086 18140 tablet_bootstrap.cc:654] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.527631 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:24.528239 18092 raft_consensus.cc:2468] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 0.
I20260709 12:09:24.529162 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:24.529825 18024 raft_consensus.cc:2468] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 0.
I20260709 12:09:24.530232 18162 consensus_queue.cc:1048] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.530925 17913 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:24.531826 18425 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:24.531891 18422 raft_consensus.cc:2804] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.532326 18422 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.532676 18422 raft_consensus.cc:3060] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.532806 18139 tablet_bootstrap.cc:654] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.536891 18138 tablet_bootstrap.cc:492] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:24.537334 18138 ts_tablet_manager.cc:1403] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.092s	user 0.012s	sys 0.009s
I20260709 12:09:24.540894 18138 raft_consensus.cc:359] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.541522 18138 raft_consensus.cc:385] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.542137 18138 raft_consensus.cc:740] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.542791 18138 consensus_queue.cc:260] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.552139 18138 ts_tablet_manager.cc:1434] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:09:24.555701 18138 tablet_bootstrap.cc:492] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:24.562265 18092 raft_consensus.cc:3060] T 320059eb6db148929cae07ba683cfe1f P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.563999 18433 consensus_queue.cc:1048] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.554278 18422 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.596772 18138 tablet_bootstrap.cc:654] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.612479 18422 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:24.613504 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:24.617280 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:24.618053 18020 raft_consensus.cc:3060] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.614315 18098 raft_consensus.cc:3060] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.628711 18139 tablet_bootstrap.cc:492] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:24.628947 18020 raft_consensus.cc:2468] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 1.
I20260709 12:09:24.629136 18139 ts_tablet_manager.cc:1403] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.120s	user 0.006s	sys 0.007s
I20260709 12:09:24.630268 17913 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:24.631155 18425 raft_consensus.cc:2804] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.631649 18425 raft_consensus.cc:697] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:09:24.632452 18425 consensus_queue.cc:237] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.635677 18139 raft_consensus.cc:359] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.647794 18452 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.648061 18139 raft_consensus.cc:385] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.648379 18139 raft_consensus.cc:740] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.648313 18452 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.649083 18139 consensus_queue.cc:260] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.650439 18452 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:24.651568 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:24.652740 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:24.653301 18098 raft_consensus.cc:2468] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 1.
W20260709 12:09:24.653757 17989 leader_election.cc:343] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:24.655340 17988 leader_election.cc:343] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.658169 18139 ts_tablet_manager.cc:1434] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.003s
I20260709 12:09:24.659082 18139 tablet_bootstrap.cc:492] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:24.663264 18140 tablet_bootstrap.cc:492] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:24.663697 18140 ts_tablet_manager.cc:1403] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.146s	user 0.025s	sys 0.037s
I20260709 12:09:24.666198 18140 raft_consensus.cc:359] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.666864 18140 raft_consensus.cc:385] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.667129 18140 raft_consensus.cc:740] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.667834 18140 consensus_queue.cc:260] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.671329 18140 ts_tablet_manager.cc:1434] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:24.672156 18140 tablet_bootstrap.cc:492] T 17e56ed7b94d4185a4f7dd88f922e17d P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:24.676760 17988 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:24.680893 18433 raft_consensus.cc:2749] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:24.690016 18162 consensus_queue.cc:1048] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:24.697995 18162 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.698716 18162 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.700699 18162 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:24.703758 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:24.704380 18020 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 0.
I20260709 12:09:24.705405 18139 tablet_bootstrap.cc:654] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.706161 18140 tablet_bootstrap.cc:654] T 17e56ed7b94d4185a4f7dd88f922e17d P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:24.710421 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:24.711066 18097 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 0.
I20260709 12:09:24.713023 17914 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:09:24.718065 18422 raft_consensus.cc:2804] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.718420 18422 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.718756 18422 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.762374 18475 raft_consensus.cc:493] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.762918 18475 raft_consensus.cc:515] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.765010 18475 leader_election.cc:290] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:24.765810 17846 catalog_manager.cc:5697] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 1 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:24.778558 18138 tablet_bootstrap.cc:492] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:24.779201 18138 ts_tablet_manager.cc:1403] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.224s	user 0.027s	sys 0.049s
I20260709 12:09:24.781561 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:09:24.783634 17913 leader_election.cc:343] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.785837 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:24.786461 18092 raft_consensus.cc:2468] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 0.
I20260709 12:09:24.789971 17914 leader_election.cc:304] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:24.791790 18162 raft_consensus.cc:2804] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:24.792147 18162 raft_consensus.cc:493] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:24.792479 18162 raft_consensus.cc:3060] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.795948 18140 tablet_bootstrap.cc:492] T 17e56ed7b94d4185a4f7dd88f922e17d P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:24.796404 18140 ts_tablet_manager.cc:1403] T 17e56ed7b94d4185a4f7dd88f922e17d P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.124s	user 0.010s	sys 0.003s
I20260709 12:09:24.801797 18138 raft_consensus.cc:359] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.802459 18138 raft_consensus.cc:385] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.802273 18422 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.802829 18138 raft_consensus.cc:740] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.803470 18138 consensus_queue.cc:260] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.804986 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:24.805401 18138 ts_tablet_manager.cc:1434] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.000s
I20260709 12:09:24.805526 18024 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.806267 18138 tablet_bootstrap.cc:492] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:24.809527 18162 raft_consensus.cc:515] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.813609 18140 raft_consensus.cc:359] T 17e56ed7b94d4185a4f7dd88f922e17d P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.814317 18140 raft_consensus.cc:385] T 17e56ed7b94d4185a4f7dd88f922e17d P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.814814 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:24.814580 18140 raft_consensus.cc:740] T 17e56ed7b94d4185a4f7dd88f922e17d P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.815883 18140 consensus_queue.cc:260] T 17e56ed7b94d4185a4f7dd88f922e17d P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:09:24.818406 17913 leader_election.cc:343] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.817505 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:24.821363 18092 raft_consensus.cc:3060] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.820254 18452 consensus_queue.cc:1048] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:24.825877 18024 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 1.
I20260709 12:09:24.826333 18139 tablet_bootstrap.cc:492] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:24.826820 18139 ts_tablet_manager.cc:1403] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.168s	user 0.022s	sys 0.002s
I20260709 12:09:24.831218 17913 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:24.832151 18425 raft_consensus.cc:2804] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.832619 18425 raft_consensus.cc:697] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:09:24.833451 18092 raft_consensus.cc:2468] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 1.
I20260709 12:09:24.834722 17914 leader_election.cc:304] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:24.833374 18425 consensus_queue.cc:237] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.819090 18162 leader_election.cc:290] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:24.835728 18140 ts_tablet_manager.cc:1434] T 17e56ed7b94d4185a4f7dd88f922e17d P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.001s
I20260709 12:09:24.835600 18475 raft_consensus.cc:2804] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:24.941972 18139 raft_consensus.cc:359] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.942761 18140 tablet_bootstrap.cc:492] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:24.942564 18475 raft_consensus.cc:697] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:09:24.942776 18139 raft_consensus.cc:385] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:24.945180 18139 raft_consensus.cc:740] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:24.958992 18367 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.959478 18367 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.961481 18367 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:24.939606 18473 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.962342 18473 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.953403 18139 consensus_queue.cc:260] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.876876 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:24.843915 18275 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:24.967870 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:24.855643 18422 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:09:24.971649 17913 leader_election.cc:343] T 17e56ed7b94d4185a4f7dd88f922e17d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:24.968643 18473 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:24.973503 18139 ts_tablet_manager.cc:1434] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.146s	user 0.012s	sys 0.009s
I20260709 12:09:24.975190 18139 tablet_bootstrap.cc:492] T 59c85902a99e4edabb1fa20b800476fc P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:24.971171 18091 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:24.969246 18373 consensus_queue.cc:1048] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:09:24.984364 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:24.972411 18275 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:24.981989 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:24.993585 17947 raft_consensus.cc:2468] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 0.
I20260709 12:09:24.981117 18475 consensus_queue.cc:237] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.000277 18138 tablet_bootstrap.cc:654] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.003959 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:25.001405 17988 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:25.010144 18452 raft_consensus.cc:2804] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:25.010756 18091 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 1.
I20260709 12:09:25.010547 18452 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:25.011368 18452 raft_consensus.cc:3060] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.030853 18094 raft_consensus.cc:2468] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 0.
I20260709 12:09:25.038964 18140 tablet_bootstrap.cc:654] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.041651 17914 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:25.041962 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:25.042987 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:09:25.043398 17989 leader_election.cc:343] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.043674 17944 raft_consensus.cc:2468] T 17e56ed7b94d4185a4f7dd88f922e17d P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 0.
W20260709 12:09:25.044530 17989 consensus_peers.cc:597] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Couldn't send request to peer 4813437da0a74e65b61eb7bd1d18f110. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:09:25.047677 18062 leader_election.cc:343] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.048341 18062 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:25.032281 18275 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:25.051726 18345 raft_consensus.cc:2804] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:25.052102 18345 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:25.052423 18345 raft_consensus.cc:3060] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.057090 18162 consensus_queue.cc:1048] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.053802 18475 raft_consensus.cc:2804] T 17e56ed7b94d4185a4f7dd88f922e17d P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:25.060917 18475 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:25.061317 18475 raft_consensus.cc:3060] T 17e56ed7b94d4185a4f7dd88f922e17d P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.068732 17846 catalog_manager.cc:5697] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 1 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:25.077319 18475 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.079557 18345 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.080574 18139 tablet_bootstrap.cc:654] T 59c85902a99e4edabb1fa20b800476fc P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.086426 18452 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.089648 18140 tablet_bootstrap.cc:492] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:25.090189 18140 ts_tablet_manager.cc:1403] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.148s	user 0.010s	sys 0.004s
I20260709 12:09:25.089577 18345 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:25.093181 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
W20260709 12:09:25.095396 17913 leader_election.cc:343] T 17e56ed7b94d4185a4f7dd88f922e17d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.096943 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:25.097735 17944 raft_consensus.cc:2393] T 17e56ed7b94d4185a4f7dd88f922e17d P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 1: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:09:25.098742 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:25.099514 18094 raft_consensus.cc:2393] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 1: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:09:25.100772 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:25.100847 17914 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:25.101423 17942 raft_consensus.cc:3060] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.101706 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
W20260709 12:09:25.106024 18062 leader_election.cc:343] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.106211 18162 raft_consensus.cc:2749] T 17e56ed7b94d4185a4f7dd88f922e17d P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.106443 18062 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:25.107390 18489 raft_consensus.cc:2749] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.112114 18138 tablet_bootstrap.cc:492] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:25.112558 18138 ts_tablet_manager.cc:1403] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.306s	user 0.013s	sys 0.003s
I20260709 12:09:25.115236 18140 raft_consensus.cc:359] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.115921 18140 raft_consensus.cc:385] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.116164 18140 raft_consensus.cc:740] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.117790 18140 consensus_queue.cc:260] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.091691 18475 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:25.136279 18452 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:09:25.137223 17894 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:25.139505 18140 ts_tablet_manager.cc:1434] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.049s	user 0.003s	sys 0.004s
I20260709 12:09:25.148061 18140 tablet_bootstrap.cc:492] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:25.146113 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
W20260709 12:09:25.152730 17989 leader_election.cc:343] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.152658 18138 raft_consensus.cc:359] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.153836 18138 raft_consensus.cc:385] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.154117 18138 raft_consensus.cc:740] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.143597 18473 consensus_queue.cc:1048] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:09:25.158854 18138 consensus_queue.cc:260] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.160842 17843 catalog_manager.cc:5697] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 1 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:25.173317 18138 ts_tablet_manager.cc:1434] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.000s
I20260709 12:09:25.174183 18138 tablet_bootstrap.cc:492] T 1372b5e0da1c481fb926410510c94341 P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:25.153528 17942 raft_consensus.cc:2468] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 1.
I20260709 12:09:25.177889 18426 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.180375 18426 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.187525 18426 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:25.188563 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:25.189000 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:25.189589 18024 raft_consensus.cc:2468] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 0.
W20260709 12:09:25.190348 18062 leader_election.cc:343] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.190960 18062 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:25.191571 18426 raft_consensus.cc:2804] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:25.191936 18426 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:25.192243 18426 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.194949 17988 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:09:25.195905 18495 raft_consensus.cc:2804] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:25.198465 18139 tablet_bootstrap.cc:492] T 59c85902a99e4edabb1fa20b800476fc P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:25.200451 18140 tablet_bootstrap.cc:654] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.201607 18426 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.202060 18139 ts_tablet_manager.cc:1403] T 59c85902a99e4edabb1fa20b800476fc P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.227s	user 0.022s	sys 0.011s
I20260709 12:09:25.202169 18495 raft_consensus.cc:697] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:09:25.201465 18138 tablet_bootstrap.cc:654] T 1372b5e0da1c481fb926410510c94341 P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.230818 18426 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:25.237748 18140 tablet_bootstrap.cc:492] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:25.240792 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:25.238214 18140 ts_tablet_manager.cc:1403] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.090s	user 0.003s	sys 0.010s
I20260709 12:09:25.243712 18140 raft_consensus.cc:359] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.244357 18140 raft_consensus.cc:385] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.244633 18140 raft_consensus.cc:740] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.205776 18139 raft_consensus.cc:359] T 59c85902a99e4edabb1fa20b800476fc P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.245025 18139 raft_consensus.cc:385] T 59c85902a99e4edabb1fa20b800476fc P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.245277 18139 raft_consensus.cc:740] T 59c85902a99e4edabb1fa20b800476fc P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.246021 18139 consensus_queue.cc:260] T 59c85902a99e4edabb1fa20b800476fc P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.244452 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:25.247895 18020 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.247535 18139 ts_tablet_manager.cc:1434] T 59c85902a99e4edabb1fa20b800476fc P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.000s
I20260709 12:09:25.250270 18139 tablet_bootstrap.cc:492] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
W20260709 12:09:25.252487 18062 leader_election.cc:343] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.259295 18140 consensus_queue.cc:260] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.262187 18140 ts_tablet_manager.cc:1434] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.000s
I20260709 12:09:25.263394 18140 tablet_bootstrap.cc:492] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:25.209359 18495 consensus_queue.cc:237] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.274231 18139 tablet_bootstrap.cc:654] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.281523 18020 raft_consensus.cc:2468] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 1.
I20260709 12:09:25.284373 18062 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:25.285871 18426 raft_consensus.cc:2804] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:25.287155 18426 raft_consensus.cc:697] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:25.288165 18426 consensus_queue.cc:237] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.298022 18138 tablet_bootstrap.cc:492] T 1372b5e0da1c481fb926410510c94341 P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:25.298470 18138 ts_tablet_manager.cc:1403] T 1372b5e0da1c481fb926410510c94341 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.124s	user 0.008s	sys 0.026s
I20260709 12:09:25.309928 17843 catalog_manager.cc:5697] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:25.316157 18138 raft_consensus.cc:359] T 1372b5e0da1c481fb926410510c94341 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.317986 18138 raft_consensus.cc:385] T 1372b5e0da1c481fb926410510c94341 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.319792 18140 tablet_bootstrap.cc:654] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.319962 18138 raft_consensus.cc:740] T 1372b5e0da1c481fb926410510c94341 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.320761 18138 consensus_queue.cc:260] T 1372b5e0da1c481fb926410510c94341 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.324875 18138 ts_tablet_manager.cc:1434] T 1372b5e0da1c481fb926410510c94341 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.001s
I20260709 12:09:25.332885 18138 tablet_bootstrap.cc:492] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:25.335961 18139 tablet_bootstrap.cc:492] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:25.336397 18139 ts_tablet_manager.cc:1403] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.086s	user 0.012s	sys 0.001s
I20260709 12:09:25.340535 18139 raft_consensus.cc:359] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.347102 18139 raft_consensus.cc:385] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.347405 18139 raft_consensus.cc:740] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.341869 18138 tablet_bootstrap.cc:654] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.348066 18139 consensus_queue.cc:260] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.351015 18473 consensus_queue.cc:1048] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.353358 18139 ts_tablet_manager.cc:1434] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 12:09:25.343991 18140 tablet_bootstrap.cc:492] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:25.338332 17843 catalog_manager.cc:5697] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:25.353950 18140 ts_tablet_manager.cc:1403] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.091s	user 0.015s	sys 0.009s
I20260709 12:09:25.356910 18140 raft_consensus.cc:359] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.357605 18140 raft_consensus.cc:385] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.358731 18140 raft_consensus.cc:740] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.359416 18140 consensus_queue.cc:260] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.361538 18140 ts_tablet_manager.cc:1434] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 12:09:25.362403 18140 tablet_bootstrap.cc:492] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:25.362782 18475 consensus_queue.cc:1048] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.358530 18139 tablet_bootstrap.cc:492] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:25.374960 18139 tablet_bootstrap.cc:654] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.376972 18473 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.377592 18473 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.380336 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:25.380901 18473 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:09:25.381707 17913 leader_election.cc:343] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.387326 18140 tablet_bootstrap.cc:654] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.381381 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:25.389931 18475 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.390985 18475 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.396658 18475 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:09:25.397719 17914 leader_election.cc:343] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.398149 17914 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:25.398871 18475 raft_consensus.cc:2749] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.400453 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:25.401005 18024 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 0.
I20260709 12:09:25.402185 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:25.402220 17913 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:25.403308 18091 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 0.
I20260709 12:09:25.405715 18475 raft_consensus.cc:2804] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:25.406208 18475 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:25.406638 18475 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.421345 18475 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.426301 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:25.426863 18024 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.433495 18024 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 1.
I20260709 12:09:25.445784 17913 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:25.446484 18473 raft_consensus.cc:2804] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:25.447237 18473 raft_consensus.cc:697] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:09:25.448068 18473 consensus_queue.cc:237] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.449673 18475 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:25.452346 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:25.452939 18091 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.458877 18139 tablet_bootstrap.cc:492] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:25.458927 18426 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.459362 18139 ts_tablet_manager.cc:1403] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.101s	user 0.006s	sys 0.017s
I20260709 12:09:25.459547 18426 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.461514 18426 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:25.461848 18139 raft_consensus.cc:359] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.462502 18139 raft_consensus.cc:385] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.462780 18139 raft_consensus.cc:740] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.463080 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:25.463441 18139 consensus_queue.cc:260] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.465492 18139 ts_tablet_manager.cc:1434] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:25.468374 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:25.470189 18140 tablet_bootstrap.cc:492] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:25.470983 18062 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:25.471714 18140 ts_tablet_manager.cc:1403] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.109s	user 0.023s	sys 0.042s
I20260709 12:09:25.471680 18275 raft_consensus.cc:2749] T 59c85902a99e4edabb1fa20b800476fc P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.474781 18139 tablet_bootstrap.cc:492] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:25.478736 18140 raft_consensus.cc:359] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.479457 18140 raft_consensus.cc:385] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.479725 18140 raft_consensus.cc:740] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.480777 18140 consensus_queue.cc:260] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.485738 18140 ts_tablet_manager.cc:1434] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 12:09:25.486604 18140 tablet_bootstrap.cc:492] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:25.487495 18091 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 1.
I20260709 12:09:25.492187 18138 tablet_bootstrap.cc:492] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:25.492281 18162 consensus_queue.cc:1048] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.492669 18138 ts_tablet_manager.cc:1403] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.160s	user 0.004s	sys 0.021s
I20260709 12:09:25.494177 18024 raft_consensus.cc:3060] T 1372b5e0da1c481fb926410510c94341 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.495149 18094 raft_consensus.cc:3060] T 59c85902a99e4edabb1fa20b800476fc P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.502872 18162 consensus_queue.cc:1048] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.506711 18139 tablet_bootstrap.cc:654] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.508298 18138 raft_consensus.cc:359] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.508970 18138 raft_consensus.cc:385] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.509274 18138 raft_consensus.cc:740] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.509949 18138 consensus_queue.cc:260] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.512323 17844 catalog_manager.cc:5697] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 1 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:25.516665 18139 tablet_bootstrap.cc:492] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:25.517133 18139 ts_tablet_manager.cc:1403] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.000s
I20260709 12:09:25.512326 18138 ts_tablet_manager.cc:1434] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:09:25.518882 18138 tablet_bootstrap.cc:492] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:25.547389 18140 tablet_bootstrap.cc:654] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.549366 18139 raft_consensus.cc:359] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.550066 18139 raft_consensus.cc:385] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.550320 18139 raft_consensus.cc:740] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.551612 18139 consensus_queue.cc:260] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.553817 18139 ts_tablet_manager.cc:1434] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.001s
I20260709 12:09:25.555815 18139 tablet_bootstrap.cc:492] T ba159d1da5c74efba256a169e746d3d9 P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:25.574163 18138 tablet_bootstrap.cc:654] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.590835 18139 tablet_bootstrap.cc:654] T ba159d1da5c74efba256a169e746d3d9 P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.604322 18140 tablet_bootstrap.cc:492] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:25.604846 18140 ts_tablet_manager.cc:1403] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.118s	user 0.030s	sys 0.011s
I20260709 12:09:25.619414 18140 raft_consensus.cc:359] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.620221 18140 raft_consensus.cc:385] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.620549 18140 raft_consensus.cc:740] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.621273 18140 consensus_queue.cc:260] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.626335 18140 ts_tablet_manager.cc:1434] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 12:09:25.627417 18140 tablet_bootstrap.cc:492] T 9ae30b26b2734033a87c3e1ba937a39f P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:25.636543 18138 tablet_bootstrap.cc:492] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:25.636968 18138 ts_tablet_manager.cc:1403] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.118s	user 0.011s	sys 0.023s
I20260709 12:09:25.641721 18138 raft_consensus.cc:359] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.642407 18138 raft_consensus.cc:385] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.642711 18138 raft_consensus.cc:740] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.646387 18140 tablet_bootstrap.cc:654] T 9ae30b26b2734033a87c3e1ba937a39f P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.651160 18138 consensus_queue.cc:260] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.653586 18138 ts_tablet_manager.cc:1434] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.016s	user 0.000s	sys 0.004s
I20260709 12:09:25.655923 18138 tablet_bootstrap.cc:492] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:25.661593 18138 tablet_bootstrap.cc:654] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.664489 18426 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.664968 18426 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.667515 18139 tablet_bootstrap.cc:492] T ba159d1da5c74efba256a169e746d3d9 P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:25.668236 18426 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:25.669143 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:25.669554 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:25.670195 17942 raft_consensus.cc:2468] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 0.
W20260709 12:09:25.670578 18062 leader_election.cc:343] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.671258 18062 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:25.672317 18139 ts_tablet_manager.cc:1403] T ba159d1da5c74efba256a169e746d3d9 P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.117s	user 0.013s	sys 0.011s
I20260709 12:09:25.671948 18275 raft_consensus.cc:2804] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:25.672732 18275 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:25.673056 18275 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.675107 18139 raft_consensus.cc:359] T ba159d1da5c74efba256a169e746d3d9 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.675746 18139 raft_consensus.cc:385] T ba159d1da5c74efba256a169e746d3d9 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.675997 18139 raft_consensus.cc:740] T ba159d1da5c74efba256a169e746d3d9 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.676622 18139 consensus_queue.cc:260] T ba159d1da5c74efba256a169e746d3d9 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.678684 18139 ts_tablet_manager.cc:1434] T ba159d1da5c74efba256a169e746d3d9 P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:09:25.679924 18139 tablet_bootstrap.cc:492] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:25.680488 18275 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.682564 18275 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:25.683516 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:25.683737 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:25.685500 17942 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:25.686537 18062 leader_election.cc:343] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.684237 18426 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.695436 18139 tablet_bootstrap.cc:654] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.687794 18140 tablet_bootstrap.cc:492] T 9ae30b26b2734033a87c3e1ba937a39f P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:25.704314 18426 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.704911 18140 ts_tablet_manager.cc:1403] T 9ae30b26b2734033a87c3e1ba937a39f P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.078s	user 0.011s	sys 0.006s
I20260709 12:09:25.694592 17942 raft_consensus.cc:2468] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 1.
I20260709 12:09:25.706480 18426 leader_election.cc:290] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:09:25.691999 18062 consensus_peers.cc:597] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:25.707861 18140 raft_consensus.cc:359] T 9ae30b26b2734033a87c3e1ba937a39f P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.708798 18140 raft_consensus.cc:385] T 9ae30b26b2734033a87c3e1ba937a39f P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.709141 18140 raft_consensus.cc:740] T 9ae30b26b2734033a87c3e1ba937a39f P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.710088 18140 consensus_queue.cc:260] T 9ae30b26b2734033a87c3e1ba937a39f P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.713143 18140 ts_tablet_manager.cc:1434] T 9ae30b26b2734033a87c3e1ba937a39f P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:09:25.714937 18140 tablet_bootstrap.cc:492] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:25.716233 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:25.716845 17942 raft_consensus.cc:2468] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 1.
I20260709 12:09:25.718518 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:25.719066 18024 raft_consensus.cc:2468] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 1.
I20260709 12:09:25.720963 18062 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:25.721638 18345 raft_consensus.cc:2804] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:25.721956 18062 leader_election.cc:304] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:09:25.722113 18345 raft_consensus.cc:697] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:25.722683 18489 raft_consensus.cc:2804] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:25.723026 18489 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:25.723459 18489 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:25.724359 18422 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.724808 18422 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.722931 18345 consensus_queue.cc:237] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.726833 18422 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:25.731573 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:25.732156 18024 raft_consensus.cc:2468] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 0.
I20260709 12:09:25.732846 18489 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.733232 17913 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:25.734225 18473 raft_consensus.cc:2804] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:25.734592 18473 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:25.734951 18473 raft_consensus.cc:3060] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.737270 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:25.737972 17942 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:25.738632 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:25.739852 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
W20260709 12:09:25.740088 17914 leader_election.cc:343] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.740381 18020 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:25.749467 17942 raft_consensus.cc:2468] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:09:25.750929 18062 leader_election.cc:304] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:09:25.752911 18275 raft_consensus.cc:2804] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:25.753553 18020 raft_consensus.cc:2468] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:09:25.738603 18489 leader_election.cc:290] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:25.757925 18139 tablet_bootstrap.cc:492] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:25.758359 18139 ts_tablet_manager.cc:1403] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.079s	user 0.013s	sys 0.016s
I20260709 12:09:25.761173 18138 tablet_bootstrap.cc:492] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:25.761662 18138 ts_tablet_manager.cc:1403] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.106s	user 0.005s	sys 0.008s
I20260709 12:09:25.762068 18140 tablet_bootstrap.cc:654] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.763343 18139 raft_consensus.cc:359] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.764042 18139 raft_consensus.cc:385] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.764348 18138 raft_consensus.cc:359] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.765033 18138 raft_consensus.cc:385] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.765383 18138 raft_consensus.cc:740] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.763542 18473 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.769965 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:25.769791 18138 consensus_queue.cc:260] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.770480 18024 raft_consensus.cc:3060] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.773469 18138 ts_tablet_manager.cc:1434] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:09:25.774366 18138 tablet_bootstrap.cc:492] T a8c7e98721a04c9690aef2689338516a P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:25.764323 18139 raft_consensus.cc:740] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.775174 18139 consensus_queue.cc:260] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.777557 18139 ts_tablet_manager.cc:1434] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:09:25.778414 18139 tablet_bootstrap.cc:492] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:25.782287 18138 tablet_bootstrap.cc:654] T a8c7e98721a04c9690aef2689338516a P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.782863 18024 raft_consensus.cc:2468] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 1.
I20260709 12:09:25.783746 18139 tablet_bootstrap.cc:654] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.783833 18473 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:25.784040 17913 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:25.786587 18473 raft_consensus.cc:2804] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:25.788650 18422 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.790333 18422 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.792799 18422 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:25.794857 18473 raft_consensus.cc:697] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:09:25.796077 18275 raft_consensus.cc:697] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:25.814199 18275 consensus_queue.cc:237] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.802397 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:09:25.818784 17913 leader_election.cc:343] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.819018 18473 consensus_queue.cc:237] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.824939 18140 tablet_bootstrap.cc:492] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:25.825587 18140 ts_tablet_manager.cc:1403] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.111s	user 0.009s	sys 0.008s
I20260709 12:09:25.828384 18138 tablet_bootstrap.cc:492] T a8c7e98721a04c9690aef2689338516a P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:25.829044 18140 raft_consensus.cc:359] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.831614 18140 raft_consensus.cc:385] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.833552 18140 raft_consensus.cc:740] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.834261 18140 consensus_queue.cc:260] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.835095 18367 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.835532 18367 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.836470 18140 ts_tablet_manager.cc:1434] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:09:25.837404 18140 tablet_bootstrap.cc:492] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:25.837520 18367 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:25.830601 18138 ts_tablet_manager.cc:1403] T a8c7e98721a04c9690aef2689338516a P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.056s	user 0.014s	sys 0.000s
I20260709 12:09:25.840421 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:25.841034 17942 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 0.
I20260709 12:09:25.841437 18138 raft_consensus.cc:359] T a8c7e98721a04c9690aef2689338516a P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.842049 18138 raft_consensus.cc:385] T a8c7e98721a04c9690aef2689338516a P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.841964 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:25.842365 18138 raft_consensus.cc:740] T a8c7e98721a04c9690aef2689338516a P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.842576 18094 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 0.
I20260709 12:09:25.844970 17988 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:25.847124 18367 raft_consensus.cc:2804] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:25.847834 18367 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:25.848327 18367 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.852635 18138 consensus_queue.cc:260] T a8c7e98721a04c9690aef2689338516a P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.857229 18140 tablet_bootstrap.cc:654] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.862421 18139 tablet_bootstrap.cc:492] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:25.862884 18139 ts_tablet_manager.cc:1403] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.085s	user 0.034s	sys 0.049s
W20260709 12:09:25.865588 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 112420us
I20260709 12:09:25.857473 18367 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.872351 17844 catalog_manager.cc:5697] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:25.899449 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:25.890038 17843 catalog_manager.cc:5697] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 1 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:25.897737 18138 ts_tablet_manager.cc:1434] T a8c7e98721a04c9690aef2689338516a P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.001s
I20260709 12:09:25.901026 18138 tablet_bootstrap.cc:492] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:25.888468 18094 raft_consensus.cc:3060] T ba159d1da5c74efba256a169e746d3d9 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.902930 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:25.904466 17944 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.905961 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:25.907271 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:25.907416 18139 raft_consensus.cc:359] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.907840 18097 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:25.908103 18139 raft_consensus.cc:385] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.908407 18139 raft_consensus.cc:740] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.909066 18139 consensus_queue.cc:260] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.908869 18495 consensus_queue.cc:1048] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.903824 18367 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:09:25.915560 17914 leader_election.cc:343] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:25.916393 17914 leader_election.cc:343] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.916730 17914 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:25.919168 18162 raft_consensus.cc:2749] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.924850 17944 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 1.
I20260709 12:09:25.926805 18139 ts_tablet_manager.cc:1434] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.001s
I20260709 12:09:25.930684 18139 tablet_bootstrap.cc:492] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:25.933554 18275 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.933549 17988 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:25.934198 18275 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.934826 18367 raft_consensus.cc:2804] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:25.935328 18367 raft_consensus.cc:697] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:09:25.936234 18275 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:25.936154 18367 consensus_queue.cc:237] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.937920 18097 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 1.
I20260709 12:09:25.945539 18422 consensus_queue.cc:1048] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:25.949149 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:25.950762 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:09:25.956354 18062 leader_election.cc:343] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:09:25.957279 18062 leader_election.cc:343] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.958410 18162 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:25.958930 18162 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.957703 18062 leader_election.cc:304] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:25.959141 18426 consensus_queue.cc:1048] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:09:25.962913 18140 tablet_bootstrap.cc:492] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:25.963603 18140 ts_tablet_manager.cc:1403] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.126s	user 0.012s	sys 0.004s
I20260709 12:09:25.965605 18162 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:25.968248 18138 tablet_bootstrap.cc:654] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.971504 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:25.965298 18489 raft_consensus.cc:2749] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:25.966965 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:09:25.978935 17913 leader_election.cc:343] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.983770 18139 tablet_bootstrap.cc:654] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:25.986027 18140 raft_consensus.cc:359] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.986752 18140 raft_consensus.cc:385] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:25.987012 18140 raft_consensus.cc:740] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:25.987663 18140 consensus_queue.cc:260] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:25.989825 18140 ts_tablet_manager.cc:1434] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.026s	user 0.000s	sys 0.004s
I20260709 12:09:25.991330 18140 tablet_bootstrap.cc:492] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1: Bootstrap starting.
I20260709 12:09:25.993409 17844 catalog_manager.cc:5697] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:25.995615 17914 leader_election.cc:343] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:25.996193 17914 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:26.002267 18422 raft_consensus.cc:2749] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.015797 18522 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.017427 18522 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:26.019631 18495 consensus_queue.cc:1048] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:26.020968 18522 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:26.024236 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:26.027658 18422 consensus_queue.cc:1048] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:09:26.056938 18139 tablet_bootstrap.cc:492] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:26.057458 18139 ts_tablet_manager.cc:1403] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.128s	user 0.017s	sys 0.009s
I20260709 12:09:26.060783 18139 raft_consensus.cc:359] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:26.061301 18139 raft_consensus.cc:385] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.061537 18140 tablet_bootstrap.cc:654] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.061523 18139 raft_consensus.cc:740] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.062542 18139 consensus_queue.cc:260] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:26.116119 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:26.130223 17846 catalog_manager.cc:5697] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 0 to 2, leader changed from <none> to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 2 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:26.143014 18062 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:09:26.153048 18540 log.cc:927] Time spent T ba159d1da5c74efba256a169e746d3d9 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.090s	user 0.003s	sys 0.003s
I20260709 12:09:26.157492 18162 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.154620 18537 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.161247 18139 ts_tablet_manager.cc:1434] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.103s	user 0.006s	sys 0.002s
I20260709 12:09:26.187455 18538 raft_consensus.cc:2749] T ba159d1da5c74efba256a169e746d3d9 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:09:26.187253 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 44754.7us
W20260709 12:09:26.230494 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 63518us
I20260709 12:09:26.229839 18162 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:26.237684 18475 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.238333 18138 tablet_bootstrap.cc:492] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:26.239363 18138 ts_tablet_manager.cc:1403] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.338s	user 0.012s	sys 0.012s
I20260709 12:09:26.243711 18475 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:26.258214 18139 tablet_bootstrap.cc:492] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:26.245290 18537 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:26.236274 18452 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.280391 18452 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:26.281669 18162 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:09:26.285773 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 87652.4us
I20260709 12:09:26.292084 18475 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:26.285539 18452 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:26.305121 18140 tablet_bootstrap.cc:492] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1: No bootstrap required, opened a new log
I20260709 12:09:26.305981 18140 ts_tablet_manager.cc:1403] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent bootstrapping tablet: real 0.315s	user 0.014s	sys 0.003s
I20260709 12:09:26.308038 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:26.310837 18095 raft_consensus.cc:2393] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 1: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:09:26.314417 18537 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:26.316591 18139 tablet_bootstrap.cc:654] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.316466 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:26.324626 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:26.325692 17947 raft_consensus.cc:2393] T 17e56ed7b94d4185a4f7dd88f922e17d P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 1: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:09:26.345453 18546 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:09:26.347353 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 130039us
I20260709 12:09:26.329957 18138 raft_consensus.cc:359] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:26.350634 18138 raft_consensus.cc:385] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.351027 18138 raft_consensus.cc:740] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.351729 18138 consensus_queue.cc:260] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:26.346328 18546 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:26.391592 18546 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:26.398751 18020 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.398304 18140 raft_consensus.cc:359] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:26.401386 18140 raft_consensus.cc:385] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.401625 18140 raft_consensus.cc:740] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.403738 18140 consensus_queue.cc:260] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:26.407007 18140 ts_tablet_manager.cc:1434] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent starting tablet: real 0.101s	user 0.006s	sys 0.005s
W20260709 12:09:26.411016 17913 leader_election.cc:343] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.411552 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:26.412341 18024 raft_consensus.cc:2393] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 1: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:09:26.419919 18022 raft_consensus.cc:1275] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:09:26.420874 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:26.442752 18138 ts_tablet_manager.cc:1434] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.203s	user 0.012s	sys 0.010s
I20260709 12:09:26.472349 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:26.473516 18091 raft_consensus.cc:2468] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 0.
I20260709 12:09:26.479959 18095 raft_consensus.cc:3060] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.482765 18522 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.483405 18522 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:26.485744 18522 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:26.506099 17940 raft_consensus.cc:1275] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260709 12:09:26.507159 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 126255us
I20260709 12:09:26.524514 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:09:26.524828 17894 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:09:26.526080 18139 tablet_bootstrap.cc:492] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:26.526584 18139 ts_tablet_manager.cc:1403] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.269s	user 0.020s	sys 0.024s
I20260709 12:09:26.526118 18138 tablet_bootstrap.cc:492] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:26.529237 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:26.530411 17940 raft_consensus.cc:2393] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 1: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:09:26.539083 18345 consensus_queue.cc:1048] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:26.539359 18426 consensus_queue.cc:1048] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:26.542719 18062 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:26.543238 18523 consensus_queue.cc:1048] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:26.543526 18522 raft_consensus.cc:2749] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.549234 18139 raft_consensus.cc:359] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:26.549957 18139 raft_consensus.cc:385] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.550259 18139 raft_consensus.cc:740] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.552358 18139 consensus_queue.cc:260] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:26.553639 18275 consensus_queue.cc:1048] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:26.557708 17988 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:26.561174 18548 raft_consensus.cc:3060] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.567981 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:26.572158 17914 leader_election.cc:304] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:26.575523 18536 raft_consensus.cc:2804] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:26.575937 18536 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:26.577147 18536 raft_consensus.cc:3060] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.588128 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:26.578217 18544 consensus_queue.cc:1048] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
W20260709 12:09:26.603036 17914 leader_election.cc:343] T 9ae30b26b2734033a87c3e1ba937a39f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.614176 18138 tablet_bootstrap.cc:654] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.615667 18139 ts_tablet_manager.cc:1434] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.089s	user 0.008s	sys 0.001s
I20260709 12:09:26.614815 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:26.616376 18544 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.620147 17989 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:26.621861 18544 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:26.616983 17948 raft_consensus.cc:2468] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 0.
I20260709 12:09:26.630627 18139 tablet_bootstrap.cc:492] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110: Bootstrap starting.
I20260709 12:09:26.630748 18544 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:26.640549 18345 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.641026 18345 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:26.642540 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:26.643039 18345 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:09:26.644616 18062 leader_election.cc:343] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.654918 18062 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:09:26.657385 18564 log.cc:927] Time spent T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:09:26.657877 18548 raft_consensus.cc:2749] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.668064 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:26.673532 17946 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.669061 17944 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 0.
I20260709 12:09:26.703838 18139 tablet_bootstrap.cc:654] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.651887 18536 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:26.710845 18489 raft_consensus.cc:2804] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:26.711014 18536 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:26.711298 18489 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:26.711336 18495 raft_consensus.cc:2749] T a8c7e98721a04c9690aef2689338516a P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.711711 18489 raft_consensus.cc:3060] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.702431 18562 consensus_queue.cc:1048] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:09:26.707234 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:26.722787 18022 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 0.
I20260709 12:09:26.709985 18062 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:09:26.731395 18138 tablet_bootstrap.cc:492] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:26.731854 18138 ts_tablet_manager.cc:1403] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.206s	user 0.011s	sys 0.005s
I20260709 12:09:26.728130 18522 raft_consensus.cc:2804] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:26.738936 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:26.740324 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:26.747797 18489 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:09:26.749400 17913 leader_election.cc:343] T 9ae30b26b2734033a87c3e1ba937a39f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.758579 17913 leader_election.cc:304] T 9ae30b26b2734033a87c3e1ba937a39f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:26.766059 18536 raft_consensus.cc:2749] T 9ae30b26b2734033a87c3e1ba937a39f P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.767376 18544 consensus_queue.cc:1048] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:26.754886 18522 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:26.768783 18522 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.773398 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:26.781865 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
W20260709 12:09:26.783306 17913 leader_election.cc:343] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.783555 18489 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:26.787289 18138 raft_consensus.cc:359] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:26.788130 18138 raft_consensus.cc:385] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.788880 18138 raft_consensus.cc:740] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.782490 18097 raft_consensus.cc:3060] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.789784 18138 consensus_queue.cc:260] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:26.802380 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:26.800153 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:26.803848 17948 raft_consensus.cc:3060] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:09:26.807557 18062 leader_election.cc:343] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:09:26.806998 17913 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:26.822314 18544 raft_consensus.cc:2749] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:26.799455 18495 consensus_queue.cc:1048] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260709 12:09:26.871176 18522 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:26.884205 17948 raft_consensus.cc:2468] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 1.
I20260709 12:09:26.893035 18138 ts_tablet_manager.cc:1434] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.161s	user 0.009s	sys 0.000s
I20260709 12:09:26.894431 18138 tablet_bootstrap.cc:492] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
W20260709 12:09:26.899935 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 93015.1us
I20260709 12:09:26.901314 18062 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:26.902558 18275 raft_consensus.cc:2804] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:26.903070 18275 raft_consensus.cc:697] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:26.903628 18097 raft_consensus.cc:2468] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 1.
I20260709 12:09:26.904282 18275 consensus_queue.cc:237] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:26.909440 18139 tablet_bootstrap.cc:492] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110: No bootstrap required, opened a new log
I20260709 12:09:26.909899 18139 ts_tablet_manager.cc:1403] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110: Time spent bootstrapping tablet: real 0.291s	user 0.012s	sys 0.009s
I20260709 12:09:26.919579 18522 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:26.923825 17914 leader_election.cc:304] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:26.924764 18542 raft_consensus.cc:2804] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:26.925918 18542 raft_consensus.cc:697] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:09:26.926890 18542 consensus_queue.cc:237] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:26.936847 18139 raft_consensus.cc:359] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:26.937915 18139 raft_consensus.cc:385] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:26.938278 18139 raft_consensus.cc:740] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Initialized, Role: FOLLOWER
I20260709 12:09:26.939538 18139 consensus_queue.cc:260] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:26.952818 18138 tablet_bootstrap.cc:654] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:26.953553 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:26.954212 17946 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.961400 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:26.962183 18024 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:26.965123 18522 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.969357 18367 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:26.971567 18367 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:26.972596 18522 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:26.973640 18367 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:26.974572 18522 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:26.979300 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:26.979880 17948 raft_consensus.cc:2468] T 9ae30b26b2734033a87c3e1ba937a39f P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 0.
I20260709 12:09:26.984221 18024 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 1.
I20260709 12:09:26.986003 17946 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 1.
I20260709 12:09:26.988974 18139 ts_tablet_manager.cc:1434] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110: Time spent starting tablet: real 0.079s	user 0.009s	sys 0.000s
I20260709 12:09:26.990696 17988 leader_election.cc:304] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:26.993716 18548 raft_consensus.cc:2804] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:09:26.994146 18548 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:26.990628 18062 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:26.994500 18548 raft_consensus.cc:3060] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.006148 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:27.007216 17949 raft_consensus.cc:2468] T 17e56ed7b94d4185a4f7dd88f922e17d P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 1.
I20260709 12:09:27.013470 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:27.014144 18093 raft_consensus.cc:2468] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 0.
I20260709 12:09:27.002056 18523 raft_consensus.cc:2804] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:27.019610 18062 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:09:27.020460 18275 raft_consensus.cc:2804] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:09:27.021267 18275 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:09:27.023051 18275 raft_consensus.cc:3060] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:27.027233 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:09:27.027896 18021 raft_consensus.cc:2468] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 1.
I20260709 12:09:27.021437 18523 raft_consensus.cc:697] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:27.029148 18523 consensus_queue.cc:237] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:27.062428 18548 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:27.064913 18548 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:27.068315 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:27.068956 17944 raft_consensus.cc:3060] T 9ae30b26b2734033a87c3e1ba937a39f P 63f5bddeebd84e5788d671a176cfa8e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.079999 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:27.080638 18095 raft_consensus.cc:3060] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.084365 18138 tablet_bootstrap.cc:492] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:27.084821 18138 ts_tablet_manager.cc:1403] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.191s	user 0.014s	sys 0.018s
I20260709 12:09:27.085575 18275 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:27.094367 18275 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:27.095423 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:27.095592 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:27.095996 17946 raft_consensus.cc:3060] T 17e56ed7b94d4185a4f7dd88f922e17d P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:27.096408 18019 raft_consensus.cc:3060] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:27.097842 18138 raft_consensus.cc:359] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:27.098495 18138 raft_consensus.cc:385] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.098773 18138 raft_consensus.cc:740] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.100327 18138 consensus_queue.cc:260] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:27.103185 17946 raft_consensus.cc:2468] T 17e56ed7b94d4185a4f7dd88f922e17d P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:09:27.104789 18062 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:09:27.105471 18275 raft_consensus.cc:2804] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:27.106002 18275 raft_consensus.cc:697] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:27.107177 18275 consensus_queue.cc:237] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:27.112393 18138 ts_tablet_manager.cc:1434] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.002s
I20260709 12:09:27.114571 18138 tablet_bootstrap.cc:492] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb: Bootstrap starting.
I20260709 12:09:27.128808 17844 catalog_manager.cc:5697] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:27.130137 17944 raft_consensus.cc:2468] T 9ae30b26b2734033a87c3e1ba937a39f P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 1.
I20260709 12:09:27.139853 18095 raft_consensus.cc:2468] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 1.
I20260709 12:09:27.143757 17988 leader_election.cc:304] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:27.145447 18452 raft_consensus.cc:2804] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:09:27.146210 18452 raft_consensus.cc:697] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:09:27.148291 18138 tablet_bootstrap.cc:654] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb: Neither blocks nor log segments found. Creating new log.
I20260709 12:09:27.147594 18452 consensus_queue.cc:237] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:27.157239 18019 raft_consensus.cc:2468] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:09:27.188632 18452 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.189180 18452 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:27.191876 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:27.192261 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:27.193064 18095 raft_consensus.cc:2393] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 1: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:09:27.194432 18138 tablet_bootstrap.cc:492] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb: No bootstrap required, opened a new log
I20260709 12:09:27.194401 17989 leader_election.cc:304] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:27.194991 18452 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:27.196878 18138 ts_tablet_manager.cc:1403] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent bootstrapping tablet: real 0.083s	user 0.031s	sys 0.011s
I20260709 12:09:27.197301 18548 raft_consensus.cc:3060] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.204574 18548 raft_consensus.cc:2749] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:27.208164 18138 raft_consensus.cc:359] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:27.209021 18138 raft_consensus.cc:385] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:09:27.209376 18138 raft_consensus.cc:740] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Initialized, Role: FOLLOWER
I20260709 12:09:27.213136 18138 consensus_queue.cc:260] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:27.218223 18138 ts_tablet_manager.cc:1434] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 12:09:27.226615 17843 catalog_manager.cc:5697] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 1 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:27.253342 17844 catalog_manager.cc:5697] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 0 to 2, leader changed from <none> to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 2 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:27.255158 17844 catalog_manager.cc:5697] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:27.280236 18548 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:09:27.280705 18548 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:27.283190 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:09:27.283397 18548 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:27.284111 17944 raft_consensus.cc:2393] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 1: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:09:27.286437 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:09:27.290354 17989 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:27.292155 18452 raft_consensus.cc:3060] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:09:27.296242 17843 catalog_manager.cc:5697] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 0 to 1, leader changed from <none> to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:27.299880 18452 raft_consensus.cc:2749] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:09:27.350865 18523 consensus_queue.cc:1048] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:27.398962 18538 consensus_queue.cc:1048] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:27.410120 18544 consensus_queue.cc:1048] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:27.411505 18544 consensus_queue.cc:1048] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:27.499498 18022 raft_consensus.cc:1275] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:09:27.503901 18538 consensus_queue.cc:1048] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:27.533267 18538 consensus_queue.cc:1048] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:27.538110 18538 consensus_queue.cc:1048] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:27.565419 17948 raft_consensus.cc:1275] T 17e56ed7b94d4185a4f7dd88f922e17d P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:09:27.576414 18552 consensus_queue.cc:1048] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:09:27.685403 18548 consensus_queue.cc:1048] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:27.738415 18562 consensus_queue.cc:1048] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:09:29.226089 16779 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:09:29.242887 18598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:09:29.245777 18599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:29.261989 16779 server_base.cc:1061] running on GCE node
W20260709 12:09:29.261842 18601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:09:29.264612 16779 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:09:29.264925 16779 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:09:29.265147 16779 hybrid_clock.cc:648] HybridClock initialized: now 1783598969265130 us; error 0 us; skew 500 ppm
I20260709 12:09:29.265929 16779 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:09:29.272989 16779 webserver.cc:533] Webserver started at http://127.16.98.196:39389/ using document root <none> and password file <none>
I20260709 12:09:29.273742 16779 fs_manager.cc:362] Metadata directory not provided
I20260709 12:09:29.274103 16779 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:09:29.274602 16779 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:09:29.276630 16779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-3-root/instance:
uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
format_stamp: "Formatted at 2026-07-09 12:09:29 on dist-test-slave-9bv4"
I20260709 12:09:29.291617 16779 fs_manager.cc:696] Time spent creating directory manager: real 0.014s	user 0.008s	sys 0.003s
I20260709 12:09:29.303886 18606 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:29.304976 16779 fs_manager.cc:730] Time spent opening block manager: real 0.010s	user 0.004s	sys 0.003s
I20260709 12:09:29.305795 16779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-3-root
uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
format_stamp: "Formatted at 2026-07-09 12:09:29 on dist-test-slave-9bv4"
I20260709 12:09:29.306293 16779 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:09:29.356568 16779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:09:29.358906 16779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:09:29.367751 16779 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:09:29.379851 16779 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:09:29.380235 16779 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:29.380617 16779 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:09:29.380923 16779 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:09:29.607672 16779 rpc_server.cc:307] RPC server started. Bound to: 127.16.98.196:43647
I20260709 12:09:29.607956 18668 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.98.196:43647 every 8 connection(s)
I20260709 12:09:29.635174 16779 auto_leader_rebalancer-test.cc:439] add a tserver: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:29.669641 18669 heartbeater.cc:344] Connected to a master server at 127.16.98.254:38823
I20260709 12:09:29.670117 18669 heartbeater.cc:461] Registering TS with master...
I20260709 12:09:29.670924 18669 heartbeater.cc:507] Master 127.16.98.254:38823 requested a full tablet report, sending...
I20260709 12:09:29.672793 17843 ts_manager.cc:194] Registered new tserver with Master: e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:09:29.674548 17843 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40276
I20260709 12:09:30.118062 18097 consensus_queue.cc:237] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:30.133073 18018 raft_consensus.cc:1275] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:30.133073 17948 raft_consensus.cc:1275] T 2753b334cd624cd290d57dacd79d8edc P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:30.137269 18552 consensus_queue.cc:1048] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:30.138419 18673 consensus_queue.cc:1048] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:30.163944 18537 raft_consensus.cc:2955] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:30.167130 17948 raft_consensus.cc:2955] T 2753b334cd624cd290d57dacd79d8edc P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:30.178597 18019 raft_consensus.cc:2955] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:30.187592 17843 catalog_manager.cc:5697] T 2753b334cd624cd290d57dacd79d8edc P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
W20260709 12:09:30.234767 18061 consensus_peers.cc:597] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2753b334cd624cd290d57dacd79d8edc. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:09:30.248978 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 43533.5us
I20260709 12:09:30.330710 18097 consensus_queue.cc:237] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
W20260709 12:09:30.339157 18061 consensus_peers.cc:597] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 993eae98279b413f8c6fed0d4ea79eae. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:30.341475 17944 raft_consensus.cc:1275] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:30.342566 18019 raft_consensus.cc:1275] T 993eae98279b413f8c6fed0d4ea79eae P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:30.344372 18684 consensus_queue.cc:1048] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:30.345155 18552 consensus_queue.cc:1048] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:30.361222 18552 raft_consensus.cc:2955] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:30.374487 18022 raft_consensus.cc:2955] T 993eae98279b413f8c6fed0d4ea79eae P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:30.398191 17846 catalog_manager.cc:5697] T 993eae98279b413f8c6fed0d4ea79eae P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:30.403020 17948 raft_consensus.cc:2955] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:30.465158 18019 consensus_queue.cc:237] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:30.506065 18095 raft_consensus.cc:1275] T 74a818492fb249b0ba39c6bed00cd202 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:30.507877 18675 consensus_queue.cc:1048] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:30.508327 17948 raft_consensus.cc:1275] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:30.511096 18675 consensus_queue.cc:1048] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:30.532555 17987 consensus_peers.cc:597] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 74a818492fb249b0ba39c6bed00cd202. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:30.535315 18452 raft_consensus.cc:2955] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:30.539809 18095 raft_consensus.cc:2955] T 74a818492fb249b0ba39c6bed00cd202 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:30.544379 17948 raft_consensus.cc:2955] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:30.581573 18019 consensus_queue.cc:237] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:30.584412 17844 catalog_manager.cc:5697] T 74a818492fb249b0ba39c6bed00cd202 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
W20260709 12:09:30.641003 17987 consensus_peers.cc:597] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ba159d1da5c74efba256a169e746d3d9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:30.643888 17944 raft_consensus.cc:1275] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:30.645306 18562 consensus_queue.cc:1048] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:30.656927 18095 raft_consensus.cc:1275] T ba159d1da5c74efba256a169e746d3d9 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:30.658668 18562 consensus_queue.cc:1048] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:30.677711 18669 heartbeater.cc:499] Master 127.16.98.254:38823 was elected leader, sending a full tablet report...
I20260709 12:09:30.685678 18675 raft_consensus.cc:2955] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:30.691339 17948 raft_consensus.cc:2955] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:30.710433 18095 raft_consensus.cc:2955] T ba159d1da5c74efba256a169e746d3d9 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:30.716090 17846 catalog_manager.cc:5697] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:30.761603 18702 ts_tablet_manager.cc:933] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:30.779367 18702 tablet_copy_client.cc:323] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.195:41931
I20260709 12:09:30.810853 18706 ts_tablet_manager.cc:933] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:30.827764 18706 tablet_copy_client.cc:323] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.195:41931
I20260709 12:09:30.838577 18108 tablet_copy_service.cc:140] P 4813437da0a74e65b61eb7bd1d18f110: Received BeginTabletCopySession request for tablet 2753b334cd624cd290d57dacd79d8edc from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:41818)
I20260709 12:09:30.838917 18107 tablet_copy_service.cc:140] P 4813437da0a74e65b61eb7bd1d18f110: Received BeginTabletCopySession request for tablet 993eae98279b413f8c6fed0d4ea79eae from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:41818)
I20260709 12:09:30.839272 18108 tablet_copy_service.cc:161] P 4813437da0a74e65b61eb7bd1d18f110: Beginning new tablet copy session on tablet 2753b334cd624cd290d57dacd79d8edc from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:41818: session id = e28f77912a9c4ba2b9841f6fedddc2db-2753b334cd624cd290d57dacd79d8edc
I20260709 12:09:30.844064 18107 tablet_copy_service.cc:161] P 4813437da0a74e65b61eb7bd1d18f110: Beginning new tablet copy session on tablet 993eae98279b413f8c6fed0d4ea79eae from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:41818: session id = e28f77912a9c4ba2b9841f6fedddc2db-993eae98279b413f8c6fed0d4ea79eae
I20260709 12:09:30.901648 18107 tablet_copy_source_session.cc:215] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:30.907954 18108 tablet_copy_source_session.cc:215] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:30.915896 18706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 993eae98279b413f8c6fed0d4ea79eae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:30.916700 18702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2753b334cd624cd290d57dacd79d8edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:30.952975 18702 tablet_copy_client.cc:806] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:30.953768 18702 tablet_copy_client.cc:670] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:30.959345 18702 tablet_copy_client.cc:538] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:30.977622 18702 tablet_bootstrap.cc:492] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:09:30.982532 18706 tablet_copy_client.cc:806] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:30.983261 18706 tablet_copy_client.cc:670] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:30.992763 18706 tablet_copy_client.cc:538] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:31.003644 18706 tablet_bootstrap.cc:492] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:09:31.010416 18708 ts_tablet_manager.cc:933] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:31.047550 18708 tablet_copy_client.cc:323] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.194:36297
I20260709 12:09:31.071866 18702 tablet_bootstrap.cc:492] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:31.080341 18034 tablet_copy_service.cc:140] P c5ffa786c8fb43f7864fa8fbe76534cb: Received BeginTabletCopySession request for tablet 74a818492fb249b0ba39c6bed00cd202 from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:53022)
I20260709 12:09:31.081007 18034 tablet_copy_service.cc:161] P c5ffa786c8fb43f7864fa8fbe76534cb: Beginning new tablet copy session on tablet 74a818492fb249b0ba39c6bed00cd202 from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:53022: session id = e28f77912a9c4ba2b9841f6fedddc2db-74a818492fb249b0ba39c6bed00cd202
I20260709 12:09:31.081475 18702 tablet_bootstrap.cc:492] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:09:31.082201 18702 ts_tablet_manager.cc:1403] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.105s	user 0.029s	sys 0.009s
I20260709 12:09:31.085551 18702 raft_consensus.cc:359] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:31.086450 18702 raft_consensus.cc:740] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:09:31.088011 18702 consensus_queue.cc:260] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:31.124539 18702 ts_tablet_manager.cc:1434] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.042s	user 0.011s	sys 0.005s
I20260709 12:09:31.128139 18108 tablet_copy_service.cc:342] P 4813437da0a74e65b61eb7bd1d18f110: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-2753b334cd624cd290d57dacd79d8edc received from {username='slave'} at 127.0.0.1:41818
I20260709 12:09:31.128675 18108 tablet_copy_service.cc:434] P 4813437da0a74e65b61eb7bd1d18f110: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-2753b334cd624cd290d57dacd79d8edc on tablet 2753b334cd624cd290d57dacd79d8edc with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:31.131265 18702 ts_tablet_manager.cc:933] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:31.149515 18643 raft_consensus.cc:1217] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:31.195768 18034 tablet_copy_source_session.cc:215] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:31.199496 18708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74a818492fb249b0ba39c6bed00cd202. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:31.218804 18706 tablet_bootstrap.cc:492] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:31.225670 18706 tablet_bootstrap.cc:492] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:09:31.233073 18702 tablet_copy_client.cc:323] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.194:36297
I20260709 12:09:31.237483 18708 tablet_copy_client.cc:806] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:31.247728 18706 ts_tablet_manager.cc:1403] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.238s	user 0.034s	sys 0.006s
I20260709 12:09:31.262074 18708 tablet_copy_client.cc:670] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
W20260709 12:09:31.241504 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 88293.4us
W20260709 12:09:31.351230 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 109073us
I20260709 12:09:31.379612 18706 raft_consensus.cc:359] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:31.381839 18033 tablet_copy_service.cc:140] P c5ffa786c8fb43f7864fa8fbe76534cb: Received BeginTabletCopySession request for tablet ba159d1da5c74efba256a169e746d3d9 from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:53022)
I20260709 12:09:31.386140 18033 tablet_copy_service.cc:161] P c5ffa786c8fb43f7864fa8fbe76534cb: Beginning new tablet copy session on tablet ba159d1da5c74efba256a169e746d3d9 from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:53022: session id = e28f77912a9c4ba2b9841f6fedddc2db-ba159d1da5c74efba256a169e746d3d9
I20260709 12:09:31.388454 18708 tablet_copy_client.cc:538] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:31.386602 18706 raft_consensus.cc:740] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:09:31.421375 18708 tablet_bootstrap.cc:492] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:09:31.413853 18706 consensus_queue.cc:260] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:31.425935 18706 ts_tablet_manager.cc:1434] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.164s	user 0.014s	sys 0.000s
I20260709 12:09:31.431043 18033 tablet_copy_source_session.cc:215] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:09:31.429615 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 169055us
I20260709 12:09:31.444240 18108 tablet_copy_service.cc:342] P 4813437da0a74e65b61eb7bd1d18f110: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-993eae98279b413f8c6fed0d4ea79eae received from {username='slave'} at 127.0.0.1:41818
I20260709 12:09:31.444751 18108 tablet_copy_service.cc:434] P 4813437da0a74e65b61eb7bd1d18f110: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-993eae98279b413f8c6fed0d4ea79eae on tablet 993eae98279b413f8c6fed0d4ea79eae with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:31.446825 18702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba159d1da5c74efba256a169e746d3d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:31.521107 18702 tablet_copy_client.cc:806] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:31.521673 18702 tablet_copy_client.cc:670] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:31.525097 18702 tablet_copy_client.cc:538] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:09:31.532662 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 91792.4us
I20260709 12:09:31.534418 18702 tablet_bootstrap.cc:492] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:09:31.538187 18708 tablet_bootstrap.cc:492] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:31.540158 18708 tablet_bootstrap.cc:492] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:09:31.540867 18708 ts_tablet_manager.cc:1403] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.120s	user 0.020s	sys 0.005s
I20260709 12:09:31.566220 18708 raft_consensus.cc:359] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:31.567291 18708 raft_consensus.cc:740] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:09:31.567975 18708 consensus_queue.cc:260] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:31.569991 18708 ts_tablet_manager.cc:1434] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.029s	user 0.003s	sys 0.001s
I20260709 12:09:31.572152 18033 tablet_copy_service.cc:342] P c5ffa786c8fb43f7864fa8fbe76534cb: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-74a818492fb249b0ba39c6bed00cd202 received from {username='slave'} at 127.0.0.1:53022
I20260709 12:09:31.572588 18033 tablet_copy_service.cc:434] P c5ffa786c8fb43f7864fa8fbe76534cb: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-74a818492fb249b0ba39c6bed00cd202 on tablet 74a818492fb249b0ba39c6bed00cd202 with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:31.623427 18702 tablet_bootstrap.cc:492] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:31.633342 18702 tablet_bootstrap.cc:492] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:09:31.645069 18702 ts_tablet_manager.cc:1403] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.111s	user 0.019s	sys 0.008s
I20260709 12:09:31.647953 18702 raft_consensus.cc:359] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:31.666800 18702 raft_consensus.cc:740] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:09:31.667656 18702 consensus_queue.cc:260] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:31.670415 18702 ts_tablet_manager.cc:1434] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 12:09:31.673520 18033 tablet_copy_service.cc:342] P c5ffa786c8fb43f7864fa8fbe76534cb: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-ba159d1da5c74efba256a169e746d3d9 received from {username='slave'} at 127.0.0.1:53022
I20260709 12:09:31.673918 18033 tablet_copy_service.cc:434] P c5ffa786c8fb43f7864fa8fbe76534cb: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-ba159d1da5c74efba256a169e746d3d9 on tablet ba159d1da5c74efba256a169e746d3d9 with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:31.681273 18538 raft_consensus.cc:1064] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:09:31.683902 18538 consensus_queue.cc:237] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:31.705911 18644 raft_consensus.cc:1217] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:31.712905 18644 raft_consensus.cc:1275] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:31.713930 18019 raft_consensus.cc:1275] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:31.714355 17946 raft_consensus.cc:1275] T 2753b334cd624cd290d57dacd79d8edc P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:31.715963 18722 consensus_queue.cc:1048] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:31.716825 18720 consensus_queue.cc:1048] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:31.728838 18717 consensus_queue.cc:1048] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:09:31.764091 18720 raft_consensus.cc:2955] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:31.783999 18643 raft_consensus.cc:1217] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:31.802253 17949 raft_consensus.cc:2955] T 2753b334cd624cd290d57dacd79d8edc P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:31.810799 18019 raft_consensus.cc:2955] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:31.818302 17846 catalog_manager.cc:5697] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:31.837642 18644 raft_consensus.cc:2955] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:31.930225 18097 consensus_queue.cc:237] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:31.936905 18644 raft_consensus.cc:1275] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:31.937219 18019 raft_consensus.cc:1275] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:31.938860 18717 consensus_queue.cc:1048] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:31.946959 18720 consensus_queue.cc:1048] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:31.954761 18717 raft_consensus.cc:2955] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:31.962798 18018 raft_consensus.cc:2955] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:31.969478 18644 raft_consensus.cc:2955] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:31.989233 17833 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2753b334cd624cd290d57dacd79d8edc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:31.997365 17845 catalog_manager.cc:5697] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:32.045889 17933 tablet_service.cc:1558] Processing DeleteTablet for tablet 2753b334cd624cd290d57dacd79d8edc with delete_type TABLET_DATA_TOMBSTONED (TS 63f5bddeebd84e5788d671a176cfa8e1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50326
I20260709 12:09:32.069813 18644 raft_consensus.cc:1217] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:32.111836 18737 tablet_replica.cc:333] T 2753b334cd624cd290d57dacd79d8edc P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:09:32.121240 18737 raft_consensus.cc:2243] T 2753b334cd624cd290d57dacd79d8edc P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:32.122108 18737 raft_consensus.cc:2272] T 2753b334cd624cd290d57dacd79d8edc P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:32.130795 18737 ts_tablet_manager.cc:1916] T 2753b334cd624cd290d57dacd79d8edc P 63f5bddeebd84e5788d671a176cfa8e1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:32.144568 18725 raft_consensus.cc:1064] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:09:32.147158 18725 consensus_queue.cc:237] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:32.170120 18644 raft_consensus.cc:1275] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.172257 18097 raft_consensus.cc:1275] T ba159d1da5c74efba256a169e746d3d9 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.173908 17944 raft_consensus.cc:1275] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.174379 18562 consensus_queue.cc:1048] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:32.176049 18562 consensus_queue.cc:1048] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:32.177407 18737 ts_tablet_manager.cc:1929] T 2753b334cd624cd290d57dacd79d8edc P 63f5bddeebd84e5788d671a176cfa8e1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:32.177666 18726 consensus_queue.cc:1048] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:32.177953 18737 log.cc:1199] T 2753b334cd624cd290d57dacd79d8edc P 63f5bddeebd84e5788d671a176cfa8e1: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-0-root/wals/2753b334cd624cd290d57dacd79d8edc
I20260709 12:09:32.180233 17832 catalog_manager.cc:5028] TS 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): tablet 2753b334cd624cd290d57dacd79d8edc (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:09:32.214198 18726 raft_consensus.cc:2955] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:32.222116 17948 raft_consensus.cc:2955] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:32.242689 17844 catalog_manager.cc:5697] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:32.259073 18097 raft_consensus.cc:2955] T ba159d1da5c74efba256a169e746d3d9 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:32.274422 18644 raft_consensus.cc:2955] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:32.298280 18018 consensus_queue.cc:237] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:32.338862 17944 raft_consensus.cc:1275] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:32.340837 18452 consensus_queue.cc:1048] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:32.356527 18643 raft_consensus.cc:1275] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:32.362186 18726 consensus_queue.cc:1048] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:32.363572 18725 raft_consensus.cc:2955] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:32.380582 18643 raft_consensus.cc:2955] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:32.388777 17944 raft_consensus.cc:2955] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:32.410418 17844 catalog_manager.cc:5697] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:32.421167 18720 raft_consensus.cc:1064] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:09:32.423508 18720 consensus_queue.cc:237] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:32.431455 18644 raft_consensus.cc:1275] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.433290 18080 tablet_service.cc:1558] Processing DeleteTablet for tablet ba159d1da5c74efba256a169e746d3d9 with delete_type TABLET_DATA_TOMBSTONED (TS 4813437da0a74e65b61eb7bd1d18f110 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53944
I20260709 12:09:32.433136 18538 consensus_queue.cc:1048] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:32.441496 18019 raft_consensus.cc:1275] T 993eae98279b413f8c6fed0d4ea79eae P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.444808 18538 consensus_queue.cc:1048] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:32.458928 17944 raft_consensus.cc:1275] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.469266 18684 raft_consensus.cc:2955] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:32.473637 18019 raft_consensus.cc:2955] T 993eae98279b413f8c6fed0d4ea79eae P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:32.486254 18538 consensus_queue.cc:1048] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:32.486737 18746 tablet_replica.cc:333] T ba159d1da5c74efba256a169e746d3d9 P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:09:32.495077 17832 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ba159d1da5c74efba256a169e746d3d9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:32.500103 18746 raft_consensus.cc:2243] T ba159d1da5c74efba256a169e746d3d9 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:32.506992 18746 raft_consensus.cc:2272] T ba159d1da5c74efba256a169e746d3d9 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:32.509581 18643 raft_consensus.cc:2955] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:32.518855 17844 catalog_manager.cc:5697] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:32.529477 18746 ts_tablet_manager.cc:1916] T ba159d1da5c74efba256a169e746d3d9 P 4813437da0a74e65b61eb7bd1d18f110: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:32.535288 17948 raft_consensus.cc:2955] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:32.582891 18746 ts_tablet_manager.cc:1929] T ba159d1da5c74efba256a169e746d3d9 P 4813437da0a74e65b61eb7bd1d18f110: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:32.586900 18746 log.cc:1199] T ba159d1da5c74efba256a169e746d3d9 P 4813437da0a74e65b61eb7bd1d18f110: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-2-root/wals/ba159d1da5c74efba256a169e746d3d9
I20260709 12:09:32.589022 17833 catalog_manager.cc:5028] TS 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): tablet ba159d1da5c74efba256a169e746d3d9 (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:09:32.700753 18452 raft_consensus.cc:1064] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:09:32.702934 18452 consensus_queue.cc:237] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:32.725631 17948 raft_consensus.cc:1275] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.726176 18091 raft_consensus.cc:1275] T 74a818492fb249b0ba39c6bed00cd202 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.727406 18452 consensus_queue.cc:1048] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:32.731814 18562 consensus_queue.cc:1048] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:32.744843 18643 raft_consensus.cc:1275] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:32.800071 18452 consensus_queue.cc:1048] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:32.831664 18643 raft_consensus.cc:2955] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
W20260709 12:09:32.898135 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 56154.4us
I20260709 12:09:32.826555 18725 raft_consensus.cc:2955] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
W20260709 12:09:32.949187 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 102382us
I20260709 12:09:32.959391 17946 raft_consensus.cc:2955] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:32.962251 17844 catalog_manager.cc:5697] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:33.036948 18091 raft_consensus.cc:2955] T 74a818492fb249b0ba39c6bed00cd202 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:33.055873 18018 consensus_queue.cc:237] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:33.065533 18643 raft_consensus.cc:1275] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:33.072903 17944 raft_consensus.cc:1275] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:33.075608 18562 consensus_queue.cc:1048] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:33.083490 18452 raft_consensus.cc:2955] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:33.088515 18644 raft_consensus.cc:2955] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:33.095847 18755 consensus_queue.cc:1048] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:33.108614 17947 raft_consensus.cc:2955] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:33.114354 17832 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 74a818492fb249b0ba39c6bed00cd202 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:33.131855 17845 catalog_manager.cc:5697] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:33.143257 18080 tablet_service.cc:1558] Processing DeleteTablet for tablet 74a818492fb249b0ba39c6bed00cd202 with delete_type TABLET_DATA_TOMBSTONED (TS 4813437da0a74e65b61eb7bd1d18f110 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53944
I20260709 12:09:33.198797 18097 consensus_queue.cc:237] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:33.206507 18644 raft_consensus.cc:1275] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:33.213676 18717 consensus_queue.cc:1048] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:33.220530 18761 tablet_replica.cc:333] T 74a818492fb249b0ba39c6bed00cd202 P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:09:33.221695 18761 raft_consensus.cc:2243] T 74a818492fb249b0ba39c6bed00cd202 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:33.222357 18761 raft_consensus.cc:2272] T 74a818492fb249b0ba39c6bed00cd202 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:33.223430 18759 raft_consensus.cc:2955] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:33.228045 18761 ts_tablet_manager.cc:1916] T 74a818492fb249b0ba39c6bed00cd202 P 4813437da0a74e65b61eb7bd1d18f110: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:33.228576 18644 raft_consensus.cc:2955] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:33.264216 17947 raft_consensus.cc:1275] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:33.287711 18758 consensus_queue.cc:1048] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:33.340466 17947 raft_consensus.cc:2955] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:33.346127 17844 catalog_manager.cc:5697] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:33.366449 18005 tablet_service.cc:1558] Processing DeleteTablet for tablet 993eae98279b413f8c6fed0d4ea79eae with delete_type TABLET_DATA_TOMBSTONED (TS c5ffa786c8fb43f7864fa8fbe76534cb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45450
I20260709 12:09:33.374069 18761 ts_tablet_manager.cc:1929] T 74a818492fb249b0ba39c6bed00cd202 P 4813437da0a74e65b61eb7bd1d18f110: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:33.376561 18763 tablet_replica.cc:333] T 993eae98279b413f8c6fed0d4ea79eae P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:09:33.380781 18761 log.cc:1199] T 74a818492fb249b0ba39c6bed00cd202 P 4813437da0a74e65b61eb7bd1d18f110: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-2-root/wals/74a818492fb249b0ba39c6bed00cd202
I20260709 12:09:33.381431 18763 raft_consensus.cc:2243] T 993eae98279b413f8c6fed0d4ea79eae P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:33.382735 17833 catalog_manager.cc:5028] TS 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): tablet 74a818492fb249b0ba39c6bed00cd202 (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:09:33.387096 18763 raft_consensus.cc:2272] T 993eae98279b413f8c6fed0d4ea79eae P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:33.389900 18763 ts_tablet_manager.cc:1916] T 993eae98279b413f8c6fed0d4ea79eae P c5ffa786c8fb43f7864fa8fbe76534cb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:33.404572 17833 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 993eae98279b413f8c6fed0d4ea79eae with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:33.410363 18763 ts_tablet_manager.cc:1929] T 993eae98279b413f8c6fed0d4ea79eae P c5ffa786c8fb43f7864fa8fbe76534cb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:33.410861 18763 log.cc:1199] T 993eae98279b413f8c6fed0d4ea79eae P c5ffa786c8fb43f7864fa8fbe76534cb: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-1-root/wals/993eae98279b413f8c6fed0d4ea79eae
I20260709 12:09:33.412402 17832 catalog_manager.cc:5028] TS c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): tablet 993eae98279b413f8c6fed0d4ea79eae (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:09:34.442771 18091 consensus_queue.cc:237] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
W20260709 12:09:34.459882 18061 consensus_peers.cc:597] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 43c6bbfd11044938bb4686693c3544a7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:34.467505 17946 raft_consensus.cc:1275] T 43c6bbfd11044938bb4686693c3544a7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:34.467511 18021 raft_consensus.cc:1275] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:34.476061 18764 consensus_queue.cc:1048] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:34.478144 18720 consensus_queue.cc:1048] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:34.492774 18766 raft_consensus.cc:2955] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:34.495996 18018 raft_consensus.cc:2955] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:34.510686 18091 consensus_queue.cc:237] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:34.513537 17844 catalog_manager.cc:5697] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:34.516356 17947 raft_consensus.cc:2955] T 43c6bbfd11044938bb4686693c3544a7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
W20260709 12:09:34.535538 18061 consensus_peers.cc:597] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9c0d192cc9cf47c1ba111cde01fad070. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:34.538165 18018 raft_consensus.cc:1275] T 9c0d192cc9cf47c1ba111cde01fad070 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:34.539669 18720 consensus_queue.cc:1048] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:34.540009 17947 raft_consensus.cc:1275] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:34.545742 18720 consensus_queue.cc:1048] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:34.561254 18764 raft_consensus.cc:2955] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:34.572997 18018 raft_consensus.cc:2955] T 9c0d192cc9cf47c1ba111cde01fad070 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:34.572997 17947 raft_consensus.cc:2955] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:34.577991 18097 consensus_queue.cc:237] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
W20260709 12:09:34.593065 18061 consensus_peers.cc:597] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e46c78c4c90c48cd9221b9e9f0a327bc. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:34.600345 18021 raft_consensus.cc:1275] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:34.602633 17946 raft_consensus.cc:1275] T e46c78c4c90c48cd9221b9e9f0a327bc P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:34.603907 17843 catalog_manager.cc:5697] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:34.609520 18764 consensus_queue.cc:1048] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:34.615065 18764 consensus_queue.cc:1048] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:34.628885 18720 raft_consensus.cc:2955] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:34.635334 18021 raft_consensus.cc:2955] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:34.644224 18097 consensus_queue.cc:237] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:34.648401 17843 catalog_manager.cc:5697] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:34.704531 17947 raft_consensus.cc:2955] T e46c78c4c90c48cd9221b9e9f0a327bc P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
W20260709 12:09:34.716259 18061 consensus_peers.cc:597] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c592029696004db48d68a9e4c3f45004. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:34.722215 18021 raft_consensus.cc:1275] T c592029696004db48d68a9e4c3f45004 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:34.730942 17949 raft_consensus.cc:1275] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:34.734926 18720 consensus_queue.cc:1048] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:34.739156 18720 consensus_queue.cc:1048] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:34.746609 18764 raft_consensus.cc:2955] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:34.748713 18021 raft_consensus.cc:2955] T c592029696004db48d68a9e4c3f45004 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:34.757257 17949 raft_consensus.cc:2955] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:34.774247 17845 catalog_manager.cc:5697] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:34.955536 18783 ts_tablet_manager.cc:933] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:34.960520 18783 tablet_copy_client.cc:323] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.195:41931
I20260709 12:09:34.962891 18108 tablet_copy_service.cc:140] P 4813437da0a74e65b61eb7bd1d18f110: Received BeginTabletCopySession request for tablet 43c6bbfd11044938bb4686693c3544a7 from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:41818)
I20260709 12:09:34.963426 18108 tablet_copy_service.cc:161] P 4813437da0a74e65b61eb7bd1d18f110: Beginning new tablet copy session on tablet 43c6bbfd11044938bb4686693c3544a7 from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:41818: session id = e28f77912a9c4ba2b9841f6fedddc2db-43c6bbfd11044938bb4686693c3544a7
I20260709 12:09:34.977949 18108 tablet_copy_source_session.cc:215] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:34.981244 18783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43c6bbfd11044938bb4686693c3544a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:34.999845 18783 tablet_copy_client.cc:806] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:35.000476 18783 tablet_copy_client.cc:670] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:35.011031 18783 tablet_copy_client.cc:538] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:35.021123 18783 tablet_bootstrap.cc:492] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:09:35.027565 18785 ts_tablet_manager.cc:933] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:35.036208 18785 tablet_copy_client.cc:323] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.195:41931
I20260709 12:09:35.037979 18108 tablet_copy_service.cc:140] P 4813437da0a74e65b61eb7bd1d18f110: Received BeginTabletCopySession request for tablet e46c78c4c90c48cd9221b9e9f0a327bc from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:41818)
I20260709 12:09:35.038524 18108 tablet_copy_service.cc:161] P 4813437da0a74e65b61eb7bd1d18f110: Beginning new tablet copy session on tablet e46c78c4c90c48cd9221b9e9f0a327bc from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:41818: session id = e28f77912a9c4ba2b9841f6fedddc2db-e46c78c4c90c48cd9221b9e9f0a327bc
I20260709 12:09:35.046113 18108 tablet_copy_source_session.cc:215] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:35.049190 18785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e46c78c4c90c48cd9221b9e9f0a327bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:35.053931 18783 tablet_bootstrap.cc:492] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:35.054952 18783 tablet_bootstrap.cc:492] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:09:35.055670 18783 ts_tablet_manager.cc:1403] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.019s
I20260709 12:09:35.059055 18783 raft_consensus.cc:359] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:35.059908 18783 raft_consensus.cc:740] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:09:35.060596 18783 consensus_queue.cc:260] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:35.067574 18785 tablet_copy_client.cc:806] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:35.084362 18785 tablet_copy_client.cc:670] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:35.089811 18785 tablet_copy_client.cc:538] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:35.103440 18789 ts_tablet_manager.cc:933] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:35.103338 18783 ts_tablet_manager.cc:1434] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.020s
I20260709 12:09:35.110534 18108 tablet_copy_service.cc:342] P 4813437da0a74e65b61eb7bd1d18f110: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-43c6bbfd11044938bb4686693c3544a7 received from {username='slave'} at 127.0.0.1:41818
I20260709 12:09:35.110976 18108 tablet_copy_service.cc:434] P 4813437da0a74e65b61eb7bd1d18f110: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-43c6bbfd11044938bb4686693c3544a7 on tablet 43c6bbfd11044938bb4686693c3544a7 with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:35.124235 18785 tablet_bootstrap.cc:492] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:09:35.129406 18789 tablet_copy_client.cc:323] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.195:41931
I20260709 12:09:35.131192 18108 tablet_copy_service.cc:140] P 4813437da0a74e65b61eb7bd1d18f110: Received BeginTabletCopySession request for tablet 9c0d192cc9cf47c1ba111cde01fad070 from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:41818)
I20260709 12:09:35.131718 18108 tablet_copy_service.cc:161] P 4813437da0a74e65b61eb7bd1d18f110: Beginning new tablet copy session on tablet 9c0d192cc9cf47c1ba111cde01fad070 from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:41818: session id = e28f77912a9c4ba2b9841f6fedddc2db-9c0d192cc9cf47c1ba111cde01fad070
I20260709 12:09:35.142578 18108 tablet_copy_source_session.cc:215] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:35.161358 18789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c0d192cc9cf47c1ba111cde01fad070. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:35.173617 18785 tablet_bootstrap.cc:492] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:35.174659 18785 tablet_bootstrap.cc:492] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:09:35.175400 18785 ts_tablet_manager.cc:1403] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.051s	user 0.028s	sys 0.016s
I20260709 12:09:35.178597 18785 raft_consensus.cc:359] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:35.179538 18785 raft_consensus.cc:740] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:09:35.180261 18785 consensus_queue.cc:260] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:35.183040 18785 ts_tablet_manager.cc:1434] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:09:35.185389 18789 tablet_copy_client.cc:806] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:35.185947 18789 tablet_copy_client.cc:670] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:35.187173 18108 tablet_copy_service.cc:342] P 4813437da0a74e65b61eb7bd1d18f110: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-e46c78c4c90c48cd9221b9e9f0a327bc received from {username='slave'} at 127.0.0.1:41818
I20260709 12:09:35.187598 18108 tablet_copy_service.cc:434] P 4813437da0a74e65b61eb7bd1d18f110: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-e46c78c4c90c48cd9221b9e9f0a327bc on tablet e46c78c4c90c48cd9221b9e9f0a327bc with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:35.195899 18789 tablet_copy_client.cc:538] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:35.208117 18789 tablet_bootstrap.cc:492] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:09:35.223731 18785 ts_tablet_manager.cc:933] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:35.228331 18785 tablet_copy_client.cc:323] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.195:41931
I20260709 12:09:35.230124 18108 tablet_copy_service.cc:140] P 4813437da0a74e65b61eb7bd1d18f110: Received BeginTabletCopySession request for tablet c592029696004db48d68a9e4c3f45004 from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:41818)
I20260709 12:09:35.231094 18108 tablet_copy_service.cc:161] P 4813437da0a74e65b61eb7bd1d18f110: Beginning new tablet copy session on tablet c592029696004db48d68a9e4c3f45004 from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:41818: session id = e28f77912a9c4ba2b9841f6fedddc2db-c592029696004db48d68a9e4c3f45004
I20260709 12:09:35.237478 18789 tablet_bootstrap.cc:492] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:35.238462 18789 tablet_bootstrap.cc:492] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:09:35.239254 18789 ts_tablet_manager.cc:1403] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.013s
I20260709 12:09:35.242359 18789 raft_consensus.cc:359] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:35.246531 18789 raft_consensus.cc:740] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:09:35.247242 18789 consensus_queue.cc:260] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:35.250001 18789 ts_tablet_manager.cc:1434] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:09:35.254280 18107 tablet_copy_service.cc:342] P 4813437da0a74e65b61eb7bd1d18f110: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-9c0d192cc9cf47c1ba111cde01fad070 received from {username='slave'} at 127.0.0.1:41818
I20260709 12:09:35.254691 18107 tablet_copy_service.cc:434] P 4813437da0a74e65b61eb7bd1d18f110: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-9c0d192cc9cf47c1ba111cde01fad070 on tablet 9c0d192cc9cf47c1ba111cde01fad070 with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:35.294301 18108 tablet_copy_source_session.cc:215] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:35.297638 18785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c592029696004db48d68a9e4c3f45004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:35.331025 18785 tablet_copy_client.cc:806] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:35.331923 18785 tablet_copy_client.cc:670] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:35.336383 18785 tablet_copy_client.cc:538] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:35.346325 18785 tablet_bootstrap.cc:492] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:09:35.373078 18785 tablet_bootstrap.cc:492] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:35.373979 18785 tablet_bootstrap.cc:492] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:09:35.374679 18785 ts_tablet_manager.cc:1403] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.012s
I20260709 12:09:35.378171 18785 raft_consensus.cc:359] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:35.379102 18785 raft_consensus.cc:740] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:09:35.379798 18785 consensus_queue.cc:260] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:35.384008 18785 ts_tablet_manager.cc:1434] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:09:35.385551 18108 tablet_copy_service.cc:342] P 4813437da0a74e65b61eb7bd1d18f110: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-c592029696004db48d68a9e4c3f45004 received from {username='slave'} at 127.0.0.1:41818
I20260709 12:09:35.385955 18108 tablet_copy_service.cc:434] P 4813437da0a74e65b61eb7bd1d18f110: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-c592029696004db48d68a9e4c3f45004 on tablet c592029696004db48d68a9e4c3f45004 with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:35.412243 18643 raft_consensus.cc:1217] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:35.564733 18643 raft_consensus.cc:1217] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:35.599030 18643 raft_consensus.cc:1217] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:35.730773 18643 raft_consensus.cc:1217] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:35.987097 18764 raft_consensus.cc:1064] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:09:35.989130 18764 consensus_queue.cc:237] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:35.999603 18018 raft_consensus.cc:1275] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:35.998518 18643 raft_consensus.cc:1275] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:36.002238 18796 consensus_queue.cc:1048] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:36.004084 18796 consensus_queue.cc:1048] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:36.017781 17946 raft_consensus.cc:1275] T 43c6bbfd11044938bb4686693c3544a7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:36.033094 18796 consensus_queue.cc:1048] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:36.050794 18796 raft_consensus.cc:2955] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:36.063310 18643 raft_consensus.cc:2955] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:36.075579 18018 raft_consensus.cc:2955] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:36.076565 17843 catalog_manager.cc:5697] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:36.109867 17946 raft_consensus.cc:2955] T 43c6bbfd11044938bb4686693c3544a7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:36.161777 18766 raft_consensus.cc:1064] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:09:36.162964 18764 raft_consensus.cc:1064] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:09:36.164510 18766 consensus_queue.cc:237] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:36.165933 18764 consensus_queue.cc:237] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:36.195158 18643 raft_consensus.cc:1275] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:36.197165 18720 consensus_queue.cc:1048] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:36.208281 18644 raft_consensus.cc:1275] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:36.210588 18796 consensus_queue.cc:1048] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:36.277768 17949 raft_consensus.cc:1275] T e46c78c4c90c48cd9221b9e9f0a327bc P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:36.282932 17947 raft_consensus.cc:1275] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:36.293380 18022 raft_consensus.cc:1275] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:36.298568 18019 raft_consensus.cc:1275] T 9c0d192cc9cf47c1ba111cde01fad070 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:09:36.301303 18812 log.cc:927] Time spent T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.063s	user 0.001s	sys 0.001s
W20260709 12:09:36.342552 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 48500.3us
I20260709 12:09:36.345364 18810 consensus_queue.cc:1048] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:36.357319 18720 consensus_queue.cc:1048] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:36.361316 18810 consensus_queue.cc:1048] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:36.365269 18797 consensus_queue.cc:1048] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:09:36.364856 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 53254us
I20260709 12:09:36.378077 18097 consensus_queue.cc:237] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:36.408682 18810 raft_consensus.cc:1064] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:09:36.416733 18021 raft_consensus.cc:1275] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:36.420521 18643 raft_consensus.cc:1275] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:36.429176 18797 consensus_queue.cc:1048] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:09:36.448954 18796 consensus_queue.cc:1048] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:36.468909 18810 consensus_queue.cc:237] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:36.485002 18643 raft_consensus.cc:2955] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:36.500283 18796 raft_consensus.cc:2955] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:36.482174 18816 raft_consensus.cc:2955] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:36.521627 18021 raft_consensus.cc:2955] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:36.567483 17843 catalog_manager.cc:5697] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:36.591756 18720 raft_consensus.cc:2955] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:36.596241 17844 catalog_manager.cc:5697] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:36.617846 17933 tablet_service.cc:1558] Processing DeleteTablet for tablet 43c6bbfd11044938bb4686693c3544a7 with delete_type TABLET_DATA_TOMBSTONED (TS 63f5bddeebd84e5788d671a176cfa8e1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50326
I20260709 12:09:36.627758 17833 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 43c6bbfd11044938bb4686693c3544a7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:36.631089 18643 raft_consensus.cc:2955] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:36.632769 18644 raft_consensus.cc:1275] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:36.633803 18642 raft_consensus.cc:2955] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:36.653391 18797 consensus_queue.cc:1048] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:36.659389 17844 catalog_manager.cc:5697] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:36.673460 18825 tablet_replica.cc:333] T 43c6bbfd11044938bb4686693c3544a7 P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:09:36.677063 18825 raft_consensus.cc:2243] T 43c6bbfd11044938bb4686693c3544a7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:36.677420 18021 raft_consensus.cc:1275] T c592029696004db48d68a9e4c3f45004 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:36.677877 18825 raft_consensus.cc:2272] T 43c6bbfd11044938bb4686693c3544a7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:36.683161 18825 ts_tablet_manager.cc:1916] T 43c6bbfd11044938bb4686693c3544a7 P 63f5bddeebd84e5788d671a176cfa8e1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:36.687996 17947 raft_consensus.cc:1275] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:36.689523 17940 raft_consensus.cc:2955] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:36.695698 17947 raft_consensus.cc:2955] T e46c78c4c90c48cd9221b9e9f0a327bc P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:36.702266 18091 consensus_queue.cc:237] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:36.702517 18093 consensus_queue.cc:237] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:36.713666 18642 raft_consensus.cc:1275] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:36.718730 18822 consensus_queue.cc:1048] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:36.713723 18643 raft_consensus.cc:1275] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:36.725585 18019 raft_consensus.cc:2955] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:36.730930 18797 consensus_queue.cc:1048] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:36.737250 18021 raft_consensus.cc:2955] T 9c0d192cc9cf47c1ba111cde01fad070 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:36.746421 18816 raft_consensus.cc:2955] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:36.758387 18021 raft_consensus.cc:1275] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:36.764019 17944 raft_consensus.cc:1275] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:36.770298 18825 ts_tablet_manager.cc:1929] T 43c6bbfd11044938bb4686693c3544a7 P 63f5bddeebd84e5788d671a176cfa8e1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:36.770955 18825 log.cc:1199] T 43c6bbfd11044938bb4686693c3544a7 P 63f5bddeebd84e5788d671a176cfa8e1: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-0-root/wals/43c6bbfd11044938bb4686693c3544a7
I20260709 12:09:36.771183 18822 consensus_queue.cc:1048] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:36.773149 17832 catalog_manager.cc:5028] TS 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): tablet 43c6bbfd11044938bb4686693c3544a7 (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:09:36.776582 17833 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9c0d192cc9cf47c1ba111cde01fad070 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:36.777801 18822 raft_consensus.cc:2955] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:36.786844 18815 consensus_queue.cc:1048] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:36.790408 18642 raft_consensus.cc:2955] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:36.801494 18643 raft_consensus.cc:2955] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:36.806079 18720 consensus_queue.cc:1048] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:36.809453 17845 catalog_manager.cc:5697] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:36.814121 18810 consensus_queue.cc:1048] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:36.819280 17833 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e46c78c4c90c48cd9221b9e9f0a327bc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:36.822216 18005 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c0d192cc9cf47c1ba111cde01fad070 with delete_type TABLET_DATA_TOMBSTONED (TS c5ffa786c8fb43f7864fa8fbe76534cb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45450
I20260709 12:09:36.827116 17845 catalog_manager.cc:5697] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:36.829175 18019 raft_consensus.cc:2955] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:36.840817 17940 raft_consensus.cc:2955] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:36.856129 18827 tablet_replica.cc:333] T 9c0d192cc9cf47c1ba111cde01fad070 P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:09:36.857448 18827 raft_consensus.cc:2243] T 9c0d192cc9cf47c1ba111cde01fad070 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:36.858464 18827 raft_consensus.cc:2272] T 9c0d192cc9cf47c1ba111cde01fad070 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:36.862172 18810 raft_consensus.cc:2955] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:36.870559 18827 ts_tablet_manager.cc:1916] T 9c0d192cc9cf47c1ba111cde01fad070 P c5ffa786c8fb43f7864fa8fbe76534cb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:36.875712 17933 tablet_service.cc:1558] Processing DeleteTablet for tablet e46c78c4c90c48cd9221b9e9f0a327bc with delete_type TABLET_DATA_TOMBSTONED (TS 63f5bddeebd84e5788d671a176cfa8e1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50326
I20260709 12:09:36.876613 18825 tablet_replica.cc:333] T e46c78c4c90c48cd9221b9e9f0a327bc P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:09:36.875233 18021 raft_consensus.cc:2955] T c592029696004db48d68a9e4c3f45004 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:36.902302 18643 raft_consensus.cc:2955] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:36.908288 18825 raft_consensus.cc:2243] T e46c78c4c90c48cd9221b9e9f0a327bc P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:36.909209 18825 raft_consensus.cc:2272] T e46c78c4c90c48cd9221b9e9f0a327bc P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:36.912985 18825 ts_tablet_manager.cc:1916] T e46c78c4c90c48cd9221b9e9f0a327bc P 63f5bddeebd84e5788d671a176cfa8e1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:36.931859 17947 raft_consensus.cc:2955] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:36.936472 17843 catalog_manager.cc:5697] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:36.940987 18827 ts_tablet_manager.cc:1929] T 9c0d192cc9cf47c1ba111cde01fad070 P c5ffa786c8fb43f7864fa8fbe76534cb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:36.941527 18827 log.cc:1199] T 9c0d192cc9cf47c1ba111cde01fad070 P c5ffa786c8fb43f7864fa8fbe76534cb: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-1-root/wals/9c0d192cc9cf47c1ba111cde01fad070
I20260709 12:09:36.960915 18825 ts_tablet_manager.cc:1929] T e46c78c4c90c48cd9221b9e9f0a327bc P 63f5bddeebd84e5788d671a176cfa8e1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:36.961467 18825 log.cc:1199] T e46c78c4c90c48cd9221b9e9f0a327bc P 63f5bddeebd84e5788d671a176cfa8e1: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-0-root/wals/e46c78c4c90c48cd9221b9e9f0a327bc
I20260709 12:09:36.963248 17832 catalog_manager.cc:5028] TS 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): tablet e46c78c4c90c48cd9221b9e9f0a327bc (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:09:36.973382 17832 catalog_manager.cc:5028] TS c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): tablet 9c0d192cc9cf47c1ba111cde01fad070 (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:09:36.995477 18097 consensus_queue.cc:237] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:37.000276 18643 raft_consensus.cc:1275] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:37.000515 17947 raft_consensus.cc:1275] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:37.001785 18810 consensus_queue.cc:1048] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:37.002717 18822 consensus_queue.cc:1048] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:37.010025 18810 raft_consensus.cc:2955] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:37.011873 18643 raft_consensus.cc:2955] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:37.028066 17940 raft_consensus.cc:2955] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:37.029320 17843 catalog_manager.cc:5697] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:37.042095 17833 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c592029696004db48d68a9e4c3f45004 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:37.044224 18005 tablet_service.cc:1558] Processing DeleteTablet for tablet c592029696004db48d68a9e4c3f45004 with delete_type TABLET_DATA_TOMBSTONED (TS c5ffa786c8fb43f7864fa8fbe76534cb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45450
I20260709 12:09:37.045812 18827 tablet_replica.cc:333] T c592029696004db48d68a9e4c3f45004 P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:09:37.087175 18827 raft_consensus.cc:2243] T c592029696004db48d68a9e4c3f45004 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:37.088177 18827 raft_consensus.cc:2272] T c592029696004db48d68a9e4c3f45004 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:09:37.092322 17833 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 50257.7us
I20260709 12:09:37.104230 18827 ts_tablet_manager.cc:1916] T c592029696004db48d68a9e4c3f45004 P c5ffa786c8fb43f7864fa8fbe76534cb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:37.127202 18827 ts_tablet_manager.cc:1929] T c592029696004db48d68a9e4c3f45004 P c5ffa786c8fb43f7864fa8fbe76534cb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:37.127556 18827 log.cc:1199] T c592029696004db48d68a9e4c3f45004 P c5ffa786c8fb43f7864fa8fbe76534cb: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-1-root/wals/c592029696004db48d68a9e4c3f45004
I20260709 12:09:37.129068 17832 catalog_manager.cc:5028] TS c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): tablet c592029696004db48d68a9e4c3f45004 (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:09:38.176185 17947 consensus_queue.cc:237] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:38.184504 18090 raft_consensus.cc:1275] T 7201987495494cf8a78424cb721d1c88 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:38.185755 18838 consensus_queue.cc:1048] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:38.187425 18021 raft_consensus.cc:1275] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:38.189602 18838 consensus_queue.cc:1048] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:38.197677 18739 raft_consensus.cc:2955] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
W20260709 12:09:38.198679 17912 consensus_peers.cc:597] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7201987495494cf8a78424cb721d1c88. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:38.202004 18090 raft_consensus.cc:2955] T 7201987495494cf8a78424cb721d1c88 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:38.208437 18021 raft_consensus.cc:2955] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:38.216930 17843 catalog_manager.cc:5697] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 1 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:38.228278 18018 consensus_queue.cc:237] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:38.237470 18097 raft_consensus.cc:1275] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:38.238792 17987 consensus_peers.cc:597] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 49c83fd6efbc4c8a92e2e65890ffafd2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:38.240198 18833 consensus_queue.cc:1048] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:38.252359 17940 raft_consensus.cc:1275] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:38.253927 18833 consensus_queue.cc:1048] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:38.273332 18794 raft_consensus.cc:2955] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:38.278311 17940 raft_consensus.cc:2955] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:38.281185 18097 raft_consensus.cc:2955] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:38.288710 18090 consensus_queue.cc:237] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:38.299559 17846 catalog_manager.cc:5697] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
W20260709 12:09:38.302333 18061 consensus_peers.cc:597] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c345cb34fc6343e98baf0b21aac6d4d7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:38.303349 18018 raft_consensus.cc:1275] T c345cb34fc6343e98baf0b21aac6d4d7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:38.304675 17940 raft_consensus.cc:1275] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:38.304980 18831 consensus_queue.cc:1048] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:38.307942 18831 consensus_queue.cc:1048] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:38.318882 18796 raft_consensus.cc:2955] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:38.320453 18019 raft_consensus.cc:2955] T c345cb34fc6343e98baf0b21aac6d4d7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:38.326357 17947 raft_consensus.cc:2955] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:38.335863 17940 consensus_queue.cc:237] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
W20260709 12:09:38.343541 17912 consensus_peers.cc:597] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 13f69f8ad8c84e4f9fdacc0e26cb2bc0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:38.345665 17846 catalog_manager.cc:5697] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:38.346534 18090 raft_consensus.cc:1275] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:38.347888 18832 consensus_queue.cc:1048] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:38.348663 18019 raft_consensus.cc:1275] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:38.351783 18832 consensus_queue.cc:1048] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:38.358314 18838 raft_consensus.cc:2955] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:38.361915 18097 raft_consensus.cc:2955] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:38.369912 18019 raft_consensus.cc:2955] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:38.381129 17845 catalog_manager.cc:5697] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 1 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:38.656358 18856 ts_tablet_manager.cc:933] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:38.658725 18856 tablet_copy_client.cc:323] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.194:36297
I20260709 12:09:38.660429 18033 tablet_copy_service.cc:140] P c5ffa786c8fb43f7864fa8fbe76534cb: Received BeginTabletCopySession request for tablet 49c83fd6efbc4c8a92e2e65890ffafd2 from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:53022)
I20260709 12:09:38.660878 18033 tablet_copy_service.cc:161] P c5ffa786c8fb43f7864fa8fbe76534cb: Beginning new tablet copy session on tablet 49c83fd6efbc4c8a92e2e65890ffafd2 from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:53022: session id = e28f77912a9c4ba2b9841f6fedddc2db-49c83fd6efbc4c8a92e2e65890ffafd2
I20260709 12:09:38.667248 18033 tablet_copy_source_session.cc:215] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:38.669667 18858 ts_tablet_manager.cc:933] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123)
I20260709 12:09:38.670424 18856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49c83fd6efbc4c8a92e2e65890ffafd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:38.671801 18858 tablet_copy_client.cc:323] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.193:39123
I20260709 12:09:38.686714 17959 tablet_copy_service.cc:140] P 63f5bddeebd84e5788d671a176cfa8e1: Received BeginTabletCopySession request for tablet 7201987495494cf8a78424cb721d1c88 from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:44668)
I20260709 12:09:38.687299 17959 tablet_copy_service.cc:161] P 63f5bddeebd84e5788d671a176cfa8e1: Beginning new tablet copy session on tablet 7201987495494cf8a78424cb721d1c88 from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:44668: session id = e28f77912a9c4ba2b9841f6fedddc2db-7201987495494cf8a78424cb721d1c88
I20260709 12:09:38.693113 18856 tablet_copy_client.cc:806] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:38.694535 18856 tablet_copy_client.cc:670] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:38.694891 17959 tablet_copy_source_session.cc:215] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:38.698390 18858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7201987495494cf8a78424cb721d1c88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:38.698933 18856 tablet_copy_client.cc:538] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:38.711289 18858 tablet_copy_client.cc:806] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:38.711885 18858 tablet_copy_client.cc:670] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:38.712221 18856 tablet_bootstrap.cc:492] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:09:38.717917 18858 tablet_copy_client.cc:538] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:38.728256 18858 tablet_bootstrap.cc:492] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:09:38.737327 18856 tablet_bootstrap.cc:492] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:38.738775 18856 tablet_bootstrap.cc:492] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:09:38.739554 18856 ts_tablet_manager.cc:1403] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.028s	user 0.020s	sys 0.004s
I20260709 12:09:38.743163 18856 raft_consensus.cc:359] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:38.744109 18856 raft_consensus.cc:740] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:09:38.745018 18856 consensus_queue.cc:260] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:38.751972 18862 ts_tablet_manager.cc:933] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123)
I20260709 12:09:38.755091 18862 tablet_copy_client.cc:323] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.193:39123
I20260709 12:09:38.756778 17959 tablet_copy_service.cc:140] P 63f5bddeebd84e5788d671a176cfa8e1: Received BeginTabletCopySession request for tablet 13f69f8ad8c84e4f9fdacc0e26cb2bc0 from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:44668)
I20260709 12:09:38.757264 17959 tablet_copy_service.cc:161] P 63f5bddeebd84e5788d671a176cfa8e1: Beginning new tablet copy session on tablet 13f69f8ad8c84e4f9fdacc0e26cb2bc0 from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:44668: session id = e28f77912a9c4ba2b9841f6fedddc2db-13f69f8ad8c84e4f9fdacc0e26cb2bc0
I20260709 12:09:38.764671 17959 tablet_copy_source_session.cc:215] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:38.765547 18856 ts_tablet_manager.cc:1434] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.026s	user 0.014s	sys 0.004s
I20260709 12:09:38.787025 18862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13f69f8ad8c84e4f9fdacc0e26cb2bc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:38.799853 18033 tablet_copy_service.cc:342] P c5ffa786c8fb43f7864fa8fbe76534cb: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-49c83fd6efbc4c8a92e2e65890ffafd2 received from {username='slave'} at 127.0.0.1:53022
I20260709 12:09:38.800392 18033 tablet_copy_service.cc:434] P c5ffa786c8fb43f7864fa8fbe76534cb: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-49c83fd6efbc4c8a92e2e65890ffafd2 on tablet 49c83fd6efbc4c8a92e2e65890ffafd2 with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:38.803419 18862 tablet_copy_client.cc:806] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:38.803947 18862 tablet_copy_client.cc:670] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:38.811540 18858 tablet_bootstrap.cc:492] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:38.812424 18858 tablet_bootstrap.cc:492] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:09:38.813077 18858 ts_tablet_manager.cc:1403] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.085s	user 0.021s	sys 0.000s
I20260709 12:09:38.815303 18862 tablet_copy_client.cc:538] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:38.816099 18858 raft_consensus.cc:359] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:38.816912 18858 raft_consensus.cc:740] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:09:38.817553 18858 consensus_queue.cc:260] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:38.822943 18858 ts_tablet_manager.cc:1434] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:09:38.826330 18856 ts_tablet_manager.cc:933] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:38.828226 17959 tablet_copy_service.cc:342] P 63f5bddeebd84e5788d671a176cfa8e1: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-7201987495494cf8a78424cb721d1c88 received from {username='slave'} at 127.0.0.1:44668
I20260709 12:09:38.828681 17959 tablet_copy_service.cc:434] P 63f5bddeebd84e5788d671a176cfa8e1: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-7201987495494cf8a78424cb721d1c88 on tablet 7201987495494cf8a78424cb721d1c88 with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:38.829002 18862 tablet_bootstrap.cc:492] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:09:38.854888 18856 tablet_copy_client.cc:323] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.195:41931
I20260709 12:09:38.858016 18108 tablet_copy_service.cc:140] P 4813437da0a74e65b61eb7bd1d18f110: Received BeginTabletCopySession request for tablet c345cb34fc6343e98baf0b21aac6d4d7 from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:41818)
I20260709 12:09:38.858562 18108 tablet_copy_service.cc:161] P 4813437da0a74e65b61eb7bd1d18f110: Beginning new tablet copy session on tablet c345cb34fc6343e98baf0b21aac6d4d7 from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:41818: session id = e28f77912a9c4ba2b9841f6fedddc2db-c345cb34fc6343e98baf0b21aac6d4d7
I20260709 12:09:38.864027 18862 tablet_bootstrap.cc:492] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:38.864923 18862 tablet_bootstrap.cc:492] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:09:38.865572 18862 ts_tablet_manager.cc:1403] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.008s
I20260709 12:09:38.871147 18862 raft_consensus.cc:359] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:38.871961 18862 raft_consensus.cc:740] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:09:38.873046 18862 consensus_queue.cc:260] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:38.875612 18862 ts_tablet_manager.cc:1434] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 12:09:38.876186 18108 tablet_copy_source_session.cc:215] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:38.877507 17959 tablet_copy_service.cc:342] P 63f5bddeebd84e5788d671a176cfa8e1: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-13f69f8ad8c84e4f9fdacc0e26cb2bc0 received from {username='slave'} at 127.0.0.1:44668
I20260709 12:09:38.877979 17959 tablet_copy_service.cc:434] P 63f5bddeebd84e5788d671a176cfa8e1: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-13f69f8ad8c84e4f9fdacc0e26cb2bc0 on tablet 13f69f8ad8c84e4f9fdacc0e26cb2bc0 with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:38.901263 18856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c345cb34fc6343e98baf0b21aac6d4d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:38.920802 18856 tablet_copy_client.cc:806] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:38.921362 18856 tablet_copy_client.cc:670] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:38.925660 18856 tablet_copy_client.cc:538] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:38.931389 18856 tablet_bootstrap.cc:492] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:09:38.948137 18856 tablet_bootstrap.cc:492] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:38.949041 18856 tablet_bootstrap.cc:492] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:09:38.949728 18856 ts_tablet_manager.cc:1403] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.002s
I20260709 12:09:38.952527 18856 raft_consensus.cc:359] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:38.953346 18856 raft_consensus.cc:740] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:09:38.953948 18856 consensus_queue.cc:260] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:38.956343 18856 ts_tablet_manager.cc:1434] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:09:38.958294 18108 tablet_copy_service.cc:342] P 4813437da0a74e65b61eb7bd1d18f110: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-c345cb34fc6343e98baf0b21aac6d4d7 received from {username='slave'} at 127.0.0.1:41818
I20260709 12:09:38.958711 18108 tablet_copy_service.cc:434] P 4813437da0a74e65b61eb7bd1d18f110: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-c345cb34fc6343e98baf0b21aac6d4d7 on tablet c345cb34fc6343e98baf0b21aac6d4d7 with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:39.053164 18642 raft_consensus.cc:1217] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:39.229177 18642 raft_consensus.cc:1217] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:39.257319 18642 raft_consensus.cc:1217] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:39.318485 18642 raft_consensus.cc:1217] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:39.573838 18872 raft_consensus.cc:1064] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:09:39.577476 18872 consensus_queue.cc:237] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:39.584949 18642 raft_consensus.cc:1275] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.586221 17946 raft_consensus.cc:1275] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.586711 18872 consensus_queue.cc:1048] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:39.587666 18794 consensus_queue.cc:1048] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:39.587898 18090 raft_consensus.cc:1275] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.589568 18794 consensus_queue.cc:1048] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:09:39.606873 18874 raft_consensus.cc:2955] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:39.611907 18642 raft_consensus.cc:2955] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:39.655055 17845 catalog_manager.cc:5697] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:39.670897 18869 raft_consensus.cc:1064] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:09:39.673377 18869 consensus_queue.cc:237] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:39.681975 17944 raft_consensus.cc:2955] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:39.697755 18019 raft_consensus.cc:1275] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.699242 18739 consensus_queue.cc:1048] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:39.700152 18090 raft_consensus.cc:1275] T 7201987495494cf8a78424cb721d1c88 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.701391 18739 consensus_queue.cc:1048] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:39.708776 18642 raft_consensus.cc:1275] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.710546 18869 consensus_queue.cc:1048] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:09:39.715531 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 92432.9us
I20260709 12:09:39.719079 18097 raft_consensus.cc:2955] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:39.740470 18868 raft_consensus.cc:2955] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:39.744266 18643 raft_consensus.cc:2955] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:39.750986 18831 raft_consensus.cc:1064] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:09:39.753466 18831 consensus_queue.cc:237] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:39.760146 18019 raft_consensus.cc:2955] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:39.771864 18642 raft_consensus.cc:1275] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.774794 18873 consensus_queue.cc:1048] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:39.780593 18097 raft_consensus.cc:2955] T 7201987495494cf8a78424cb721d1c88 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:39.789165 17944 raft_consensus.cc:1275] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.794795 18019 consensus_queue.cc:237] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:39.799777 18018 raft_consensus.cc:1275] T c345cb34fc6343e98baf0b21aac6d4d7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:39.799046 17843 catalog_manager.cc:5697] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:39.802949 18834 consensus_queue.cc:1048] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:39.804996 18873 consensus_queue.cc:1048] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:39.807255 18097 raft_consensus.cc:1275] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:39.809959 18881 consensus_queue.cc:1048] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:39.813123 18642 raft_consensus.cc:1275] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:39.818713 18794 consensus_queue.cc:1048] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:39.825523 18642 raft_consensus.cc:2955] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:39.822558 18097 raft_consensus.cc:2955] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:39.851742 17946 consensus_queue.cc:237] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:39.837646 18796 raft_consensus.cc:2955] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:39.843786 18019 raft_consensus.cc:2955] T c345cb34fc6343e98baf0b21aac6d4d7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:39.817960 18880 raft_consensus.cc:2955] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:39.858632 18644 raft_consensus.cc:1275] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:39.860515 18838 consensus_queue.cc:1048] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:39.865386 17944 raft_consensus.cc:2955] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:39.867835 17832 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 49c83fd6efbc4c8a92e2e65890ffafd2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:39.868059 18869 raft_consensus.cc:2955] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:39.869683 18644 raft_consensus.cc:2955] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:39.870421 17843 catalog_manager.cc:5697] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:39.877692 18018 raft_consensus.cc:1275] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:39.879056 17832 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7201987495494cf8a78424cb721d1c88 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:39.885352 17933 tablet_service.cc:1558] Processing DeleteTablet for tablet 49c83fd6efbc4c8a92e2e65890ffafd2 with delete_type TABLET_DATA_TOMBSTONED (TS 63f5bddeebd84e5788d671a176cfa8e1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50326
I20260709 12:09:39.879294 18869 consensus_queue.cc:1048] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:09:39.895255 18894 tablet_replica.cc:333] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:09:39.896366 18894 raft_consensus.cc:2243] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:39.897058 18894 raft_consensus.cc:2272] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:39.904367 18644 raft_consensus.cc:2955] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:39.907882 17844 catalog_manager.cc:5697] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New cstate: current_term: 1 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:39.927453 18870 raft_consensus.cc:1064] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:09:39.895466 18019 raft_consensus.cc:2955] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:39.930006 18870 consensus_queue.cc:237] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:39.932932 18080 tablet_service.cc:1558] Processing DeleteTablet for tablet 7201987495494cf8a78424cb721d1c88 with delete_type TABLET_DATA_TOMBSTONED (TS 4813437da0a74e65b61eb7bd1d18f110 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53944
I20260709 12:09:39.940488 18894 ts_tablet_manager.cc:1916] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 63f5bddeebd84e5788d671a176cfa8e1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:39.940936 17844 catalog_manager.cc:5697] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:39.966248 18896 tablet_replica.cc:333] T 7201987495494cf8a78424cb721d1c88 P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:09:39.992717 18896 raft_consensus.cc:2243] T 7201987495494cf8a78424cb721d1c88 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:39.993479 18896 raft_consensus.cc:2272] T 7201987495494cf8a78424cb721d1c88 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:39.997265 18896 ts_tablet_manager.cc:1916] T 7201987495494cf8a78424cb721d1c88 P 4813437da0a74e65b61eb7bd1d18f110: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:40.003639 18894 ts_tablet_manager.cc:1929] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 63f5bddeebd84e5788d671a176cfa8e1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:40.013522 18894 log.cc:1199] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 63f5bddeebd84e5788d671a176cfa8e1: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-0-root/wals/49c83fd6efbc4c8a92e2e65890ffafd2
I20260709 12:09:40.014544 18896 ts_tablet_manager.cc:1929] T 7201987495494cf8a78424cb721d1c88 P 4813437da0a74e65b61eb7bd1d18f110: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:40.015291 17832 catalog_manager.cc:5028] TS 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): tablet 49c83fd6efbc4c8a92e2e65890ffafd2 (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:09:40.016105 18896 log.cc:1199] T 7201987495494cf8a78424cb721d1c88 P 4813437da0a74e65b61eb7bd1d18f110: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-2-root/wals/7201987495494cf8a78424cb721d1c88
I20260709 12:09:40.017732 17833 catalog_manager.cc:5028] TS 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): tablet 7201987495494cf8a78424cb721d1c88 (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:09:40.017985 18090 consensus_queue.cc:237] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:40.025625 18644 raft_consensus.cc:1275] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:40.026296 17946 raft_consensus.cc:1275] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:40.029219 18644 raft_consensus.cc:1275] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:40.030138 18090 raft_consensus.cc:1275] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:40.032305 18796 consensus_queue.cc:1048] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:40.032320 18868 consensus_queue.cc:1048] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:40.038172 18869 consensus_queue.cc:1048] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:40.041770 18831 raft_consensus.cc:2955] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:40.042827 18642 raft_consensus.cc:2955] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:40.042372 18895 consensus_queue.cc:1048] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:40.044082 18019 raft_consensus.cc:1275] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:40.060165 17946 raft_consensus.cc:2955] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:40.068003 17833 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c345cb34fc6343e98baf0b21aac6d4d7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:40.071427 17845 catalog_manager.cc:5697] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:40.077913 18739 consensus_queue.cc:1048] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:40.084326 18019 raft_consensus.cc:2955] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:40.087771 18838 raft_consensus.cc:2955] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:40.092545 18005 tablet_service.cc:1558] Processing DeleteTablet for tablet c345cb34fc6343e98baf0b21aac6d4d7 with delete_type TABLET_DATA_TOMBSTONED (TS c5ffa786c8fb43f7864fa8fbe76534cb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45450
I20260709 12:09:40.097024 18090 raft_consensus.cc:2955] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:40.100901 18902 tablet_replica.cc:333] T c345cb34fc6343e98baf0b21aac6d4d7 P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:09:40.103201 18642 raft_consensus.cc:2955] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:40.106065 17845 catalog_manager.cc:5697] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:40.110702 18902 raft_consensus.cc:2243] T c345cb34fc6343e98baf0b21aac6d4d7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:40.120004 18902 raft_consensus.cc:2272] T c345cb34fc6343e98baf0b21aac6d4d7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:40.127888 18902 ts_tablet_manager.cc:1916] T c345cb34fc6343e98baf0b21aac6d4d7 P c5ffa786c8fb43f7864fa8fbe76534cb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:40.146075 18902 ts_tablet_manager.cc:1929] T c345cb34fc6343e98baf0b21aac6d4d7 P c5ffa786c8fb43f7864fa8fbe76534cb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:40.146374 18902 log.cc:1199] T c345cb34fc6343e98baf0b21aac6d4d7 P c5ffa786c8fb43f7864fa8fbe76534cb: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-1-root/wals/c345cb34fc6343e98baf0b21aac6d4d7
I20260709 12:09:40.147730 17832 catalog_manager.cc:5028] TS c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): tablet c345cb34fc6343e98baf0b21aac6d4d7 (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:09:40.634136 17944 consensus_queue.cc:237] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:40.639338 18018 raft_consensus.cc:1275] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:40.639376 18642 raft_consensus.cc:1275] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:40.640518 18838 consensus_queue.cc:1048] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:40.641265 18869 consensus_queue.cc:1048] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:40.646925 18838 raft_consensus.cc:2955] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:40.649711 18018 raft_consensus.cc:2955] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:40.650120 18642 raft_consensus.cc:2955] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:40.669520 17844 catalog_manager.cc:5697] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New cstate: current_term: 1 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:40.671939 17832 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 13f69f8ad8c84e4f9fdacc0e26cb2bc0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:40.703388 18080 tablet_service.cc:1558] Processing DeleteTablet for tablet 13f69f8ad8c84e4f9fdacc0e26cb2bc0 with delete_type TABLET_DATA_TOMBSTONED (TS 4813437da0a74e65b61eb7bd1d18f110 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53944
I20260709 12:09:40.705164 18907 tablet_replica.cc:333] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:09:40.706180 18907 raft_consensus.cc:2243] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:40.707010 18907 raft_consensus.cc:2272] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:40.711167 18907 ts_tablet_manager.cc:1916] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 4813437da0a74e65b61eb7bd1d18f110: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:40.725775 18907 ts_tablet_manager.cc:1929] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 4813437da0a74e65b61eb7bd1d18f110: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:40.726102 18907 log.cc:1199] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 4813437da0a74e65b61eb7bd1d18f110: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-2-root/wals/13f69f8ad8c84e4f9fdacc0e26cb2bc0
I20260709 12:09:40.727313 17833 catalog_manager.cc:5028] TS 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): tablet 13f69f8ad8c84e4f9fdacc0e26cb2bc0 (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:09:41.769043 18018 consensus_queue.cc:237] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:41.776749 18090 raft_consensus.cc:1275] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:41.777868 18910 consensus_queue.cc:1048] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:41.778316 17947 raft_consensus.cc:1275] T 75c1f6edbec54664bbafbe9c9385ff6c P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:41.779142 17987 consensus_peers.cc:597] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 75c1f6edbec54664bbafbe9c9385ff6c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:41.779667 18880 consensus_queue.cc:1048] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:41.785995 18910 raft_consensus.cc:2955] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:41.788018 18093 raft_consensus.cc:2955] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:41.795866 17944 raft_consensus.cc:2955] T 75c1f6edbec54664bbafbe9c9385ff6c P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:41.801266 18090 consensus_queue.cc:237] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:41.805540 17846 catalog_manager.cc:5697] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:41.813910 18018 raft_consensus.cc:1275] T 1f6ed08238924344ac4e43e997223ac9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:41.814010 18061 consensus_peers.cc:597] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1f6ed08238924344ac4e43e997223ac9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:41.815372 18900 consensus_queue.cc:1048] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:41.817031 17944 raft_consensus.cc:1275] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:41.819773 18900 consensus_queue.cc:1048] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:41.850018 18900 raft_consensus.cc:2955] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:41.874399 18019 consensus_queue.cc:237] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:41.890864 18018 raft_consensus.cc:2955] T 1f6ed08238924344ac4e43e997223ac9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:41.891227 17944 raft_consensus.cc:2955] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:41.895889 17947 raft_consensus.cc:1275] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:41.897516 18872 consensus_queue.cc:1048] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:41.902972 17987 consensus_peers.cc:597] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 57fe00fa09a54eb295024fca83b933ec. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:41.902145 17843 catalog_manager.cc:5697] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:41.906682 18093 raft_consensus.cc:1275] T 57fe00fa09a54eb295024fca83b933ec P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:41.910251 18910 consensus_queue.cc:1048] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:41.919008 17944 raft_consensus.cc:2955] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:41.916780 18872 raft_consensus.cc:2955] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:41.931030 18093 raft_consensus.cc:2955] T 57fe00fa09a54eb295024fca83b933ec P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:41.939193 17844 catalog_manager.cc:5697] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:41.947422 18018 consensus_queue.cc:237] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
W20260709 12:09:41.957130 17987 consensus_peers.cc:597] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 320059eb6db148929cae07ba683cfe1f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:41.959319 18093 raft_consensus.cc:1275] T 320059eb6db148929cae07ba683cfe1f P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:41.960717 17944 raft_consensus.cc:1275] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:41.961551 18872 consensus_queue.cc:1048] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:41.963321 18928 consensus_queue.cc:1048] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:41.975215 18880 raft_consensus.cc:2955] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:41.976943 18093 raft_consensus.cc:2955] T 320059eb6db148929cae07ba683cfe1f P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:41.979086 17947 raft_consensus.cc:2955] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:41.996030 17846 catalog_manager.cc:5697] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:42.247453 18934 ts_tablet_manager.cc:933] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:42.250862 18934 tablet_copy_client.cc:323] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.194:36297
I20260709 12:09:42.252337 18033 tablet_copy_service.cc:140] P c5ffa786c8fb43f7864fa8fbe76534cb: Received BeginTabletCopySession request for tablet 75c1f6edbec54664bbafbe9c9385ff6c from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:53022)
I20260709 12:09:42.252857 18033 tablet_copy_service.cc:161] P c5ffa786c8fb43f7864fa8fbe76534cb: Beginning new tablet copy session on tablet 75c1f6edbec54664bbafbe9c9385ff6c from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:53022: session id = e28f77912a9c4ba2b9841f6fedddc2db-75c1f6edbec54664bbafbe9c9385ff6c
I20260709 12:09:42.260174 18033 tablet_copy_source_session.cc:215] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:42.263001 18934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75c1f6edbec54664bbafbe9c9385ff6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:42.275619 18934 tablet_copy_client.cc:806] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:42.276192 18934 tablet_copy_client.cc:670] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:42.279433 18934 tablet_copy_client.cc:538] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:42.286876 18934 tablet_bootstrap.cc:492] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:09:42.311954 18934 tablet_bootstrap.cc:492] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:42.313141 18934 tablet_bootstrap.cc:492] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:09:42.313789 18934 ts_tablet_manager.cc:1403] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.027s	user 0.019s	sys 0.007s
I20260709 12:09:42.317294 18934 raft_consensus.cc:359] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:42.318089 18934 raft_consensus.cc:740] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:09:42.318789 18934 consensus_queue.cc:260] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:42.321868 18934 ts_tablet_manager.cc:1434] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:09:42.324180 18033 tablet_copy_service.cc:342] P c5ffa786c8fb43f7864fa8fbe76534cb: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-75c1f6edbec54664bbafbe9c9385ff6c received from {username='slave'} at 127.0.0.1:53022
I20260709 12:09:42.324599 18033 tablet_copy_service.cc:434] P c5ffa786c8fb43f7864fa8fbe76534cb: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-75c1f6edbec54664bbafbe9c9385ff6c on tablet 75c1f6edbec54664bbafbe9c9385ff6c with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:42.366252 18934 ts_tablet_manager.cc:933] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:42.369189 18934 tablet_copy_client.cc:323] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.195:41931
I20260709 12:09:42.371006 18108 tablet_copy_service.cc:140] P 4813437da0a74e65b61eb7bd1d18f110: Received BeginTabletCopySession request for tablet 1f6ed08238924344ac4e43e997223ac9 from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:41818)
I20260709 12:09:42.371466 18108 tablet_copy_service.cc:161] P 4813437da0a74e65b61eb7bd1d18f110: Beginning new tablet copy session on tablet 1f6ed08238924344ac4e43e997223ac9 from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:41818: session id = e28f77912a9c4ba2b9841f6fedddc2db-1f6ed08238924344ac4e43e997223ac9
I20260709 12:09:42.376812 18108 tablet_copy_source_session.cc:215] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:42.379357 18934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f6ed08238924344ac4e43e997223ac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:42.396503 18934 tablet_copy_client.cc:806] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:42.397081 18934 tablet_copy_client.cc:670] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:42.400779 18934 tablet_copy_client.cc:538] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:42.412375 18934 tablet_bootstrap.cc:492] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:09:42.430938 18934 tablet_bootstrap.cc:492] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:42.431782 18934 tablet_bootstrap.cc:492] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:09:42.432432 18934 ts_tablet_manager.cc:1403] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.007s
I20260709 12:09:42.435515 18934 raft_consensus.cc:359] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:42.436321 18934 raft_consensus.cc:740] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:09:42.436968 18934 consensus_queue.cc:260] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:42.441515 18934 ts_tablet_manager.cc:1434] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:09:42.443207 18108 tablet_copy_service.cc:342] P 4813437da0a74e65b61eb7bd1d18f110: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-1f6ed08238924344ac4e43e997223ac9 received from {username='slave'} at 127.0.0.1:41818
I20260709 12:09:42.443564 18108 tablet_copy_service.cc:434] P 4813437da0a74e65b61eb7bd1d18f110: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-1f6ed08238924344ac4e43e997223ac9 on tablet 1f6ed08238924344ac4e43e997223ac9 with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:42.447165 18940 ts_tablet_manager.cc:933] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:42.452703 18940 tablet_copy_client.cc:323] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.194:36297
I20260709 12:09:42.454120 18033 tablet_copy_service.cc:140] P c5ffa786c8fb43f7864fa8fbe76534cb: Received BeginTabletCopySession request for tablet 57fe00fa09a54eb295024fca83b933ec from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:53022)
I20260709 12:09:42.454548 18033 tablet_copy_service.cc:161] P c5ffa786c8fb43f7864fa8fbe76534cb: Beginning new tablet copy session on tablet 57fe00fa09a54eb295024fca83b933ec from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:53022: session id = e28f77912a9c4ba2b9841f6fedddc2db-57fe00fa09a54eb295024fca83b933ec
I20260709 12:09:42.460435 18033 tablet_copy_source_session.cc:215] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:42.463908 18940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57fe00fa09a54eb295024fca83b933ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:42.478776 18940 tablet_copy_client.cc:806] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:42.479315 18940 tablet_copy_client.cc:670] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:42.482586 18940 tablet_copy_client.cc:538] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:42.488445 18940 tablet_bootstrap.cc:492] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:09:42.508770 18940 tablet_bootstrap.cc:492] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:42.509605 18940 tablet_bootstrap.cc:492] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:09:42.510216 18940 ts_tablet_manager.cc:1403] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.006s
I20260709 12:09:42.512610 18940 raft_consensus.cc:359] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:42.513211 18940 raft_consensus.cc:740] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:09:42.513716 18940 consensus_queue.cc:260] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:42.515770 18940 ts_tablet_manager.cc:1434] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.004s
I20260709 12:09:42.517273 18033 tablet_copy_service.cc:342] P c5ffa786c8fb43f7864fa8fbe76534cb: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-57fe00fa09a54eb295024fca83b933ec received from {username='slave'} at 127.0.0.1:53022
I20260709 12:09:42.517673 18033 tablet_copy_service.cc:434] P c5ffa786c8fb43f7864fa8fbe76534cb: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-57fe00fa09a54eb295024fca83b933ec on tablet 57fe00fa09a54eb295024fca83b933ec with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:42.544486 18940 ts_tablet_manager.cc:933] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:42.546075 18940 tablet_copy_client.cc:323] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.194:36297
I20260709 12:09:42.547549 18033 tablet_copy_service.cc:140] P c5ffa786c8fb43f7864fa8fbe76534cb: Received BeginTabletCopySession request for tablet 320059eb6db148929cae07ba683cfe1f from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:53022)
I20260709 12:09:42.548090 18033 tablet_copy_service.cc:161] P c5ffa786c8fb43f7864fa8fbe76534cb: Beginning new tablet copy session on tablet 320059eb6db148929cae07ba683cfe1f from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:53022: session id = e28f77912a9c4ba2b9841f6fedddc2db-320059eb6db148929cae07ba683cfe1f
I20260709 12:09:42.553412 18033 tablet_copy_source_session.cc:215] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:42.556216 18940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 320059eb6db148929cae07ba683cfe1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:42.571765 18940 tablet_copy_client.cc:806] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:42.572439 18940 tablet_copy_client.cc:670] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:42.576912 18940 tablet_copy_client.cc:538] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:42.585345 18940 tablet_bootstrap.cc:492] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:09:42.604663 18940 tablet_bootstrap.cc:492] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:42.605924 18940 tablet_bootstrap.cc:492] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:09:42.606570 18940 ts_tablet_manager.cc:1403] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.021s	user 0.021s	sys 0.001s
I20260709 12:09:42.609488 18940 raft_consensus.cc:359] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:42.610250 18940 raft_consensus.cc:740] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:09:42.610880 18940 consensus_queue.cc:260] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:42.613044 18940 ts_tablet_manager.cc:1434] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:42.615521 18033 tablet_copy_service.cc:342] P c5ffa786c8fb43f7864fa8fbe76534cb: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-320059eb6db148929cae07ba683cfe1f received from {username='slave'} at 127.0.0.1:53022
I20260709 12:09:42.615939 18033 tablet_copy_service.cc:434] P c5ffa786c8fb43f7864fa8fbe76534cb: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-320059eb6db148929cae07ba683cfe1f on tablet 320059eb6db148929cae07ba683cfe1f with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:42.791066 18642 raft_consensus.cc:1217] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:42.942245 18642 raft_consensus.cc:1217] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:42.989444 18642 raft_consensus.cc:1217] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:43.169430 18642 raft_consensus.cc:1217] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:43.201447 18872 raft_consensus.cc:1064] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:09:43.203943 18872 consensus_queue.cc:237] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:43.211128 18642 raft_consensus.cc:1275] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.211295 18090 raft_consensus.cc:1275] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.212740 18928 consensus_queue.cc:1048] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:43.213591 17946 raft_consensus.cc:1275] T 75c1f6edbec54664bbafbe9c9385ff6c P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.213697 18872 consensus_queue.cc:1048] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:43.214991 18945 consensus_queue.cc:1048] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:43.226678 18945 raft_consensus.cc:2955] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:43.229224 18090 raft_consensus.cc:2955] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:43.230248 17946 raft_consensus.cc:2955] T 75c1f6edbec54664bbafbe9c9385ff6c P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:43.238626 18642 raft_consensus.cc:2955] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:43.245237 17844 catalog_manager.cc:5697] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:43.276733 18019 consensus_queue.cc:237] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:43.281801 18642 raft_consensus.cc:1275] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:43.283100 18872 consensus_queue.cc:1048] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:43.286877 18093 raft_consensus.cc:1275] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:43.289980 18880 consensus_queue.cc:1048] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:43.292250 18928 raft_consensus.cc:2955] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:43.295128 18644 raft_consensus.cc:2955] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:43.302901 18093 raft_consensus.cc:2955] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:43.313483 17832 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 75c1f6edbec54664bbafbe9c9385ff6c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:43.315964 17846 catalog_manager.cc:5697] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:43.327967 17933 tablet_service.cc:1558] Processing DeleteTablet for tablet 75c1f6edbec54664bbafbe9c9385ff6c with delete_type TABLET_DATA_TOMBSTONED (TS 63f5bddeebd84e5788d671a176cfa8e1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50326
I20260709 12:09:43.329823 18954 tablet_replica.cc:333] T 75c1f6edbec54664bbafbe9c9385ff6c P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:09:43.330921 18954 raft_consensus.cc:2243] T 75c1f6edbec54664bbafbe9c9385ff6c P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:43.331882 18954 raft_consensus.cc:2272] T 75c1f6edbec54664bbafbe9c9385ff6c P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:43.335207 18954 ts_tablet_manager.cc:1916] T 75c1f6edbec54664bbafbe9c9385ff6c P 63f5bddeebd84e5788d671a176cfa8e1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:43.351943 18954 ts_tablet_manager.cc:1929] T 75c1f6edbec54664bbafbe9c9385ff6c P 63f5bddeebd84e5788d671a176cfa8e1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:43.352331 18954 log.cc:1199] T 75c1f6edbec54664bbafbe9c9385ff6c P 63f5bddeebd84e5788d671a176cfa8e1: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-0-root/wals/75c1f6edbec54664bbafbe9c9385ff6c
I20260709 12:09:43.353917 17832 catalog_manager.cc:5028] TS 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): tablet 75c1f6edbec54664bbafbe9c9385ff6c (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:09:43.420693 18925 raft_consensus.cc:1064] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:09:43.423360 18925 consensus_queue.cc:237] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:43.434799 18644 raft_consensus.cc:1275] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.436074 18900 consensus_queue.cc:1048] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:43.456900 18019 raft_consensus.cc:1275] T 1f6ed08238924344ac4e43e997223ac9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.463781 18921 consensus_queue.cc:1048] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:43.467830 17947 raft_consensus.cc:1275] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.477240 18921 consensus_queue.cc:1048] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:43.482894 18880 raft_consensus.cc:1064] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:09:43.488664 18880 consensus_queue.cc:237] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:43.506179 18642 raft_consensus.cc:1275] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.508539 18900 raft_consensus.cc:2955] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:43.510761 18928 consensus_queue.cc:1048] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:43.516808 18642 raft_consensus.cc:2955] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:43.521502 17946 raft_consensus.cc:1275] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.523733 18093 raft_consensus.cc:1275] T 57fe00fa09a54eb295024fca83b933ec P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.525911 18945 consensus_queue.cc:1048] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:43.530941 18872 consensus_queue.cc:1048] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:43.541196 18019 raft_consensus.cc:2955] T 1f6ed08238924344ac4e43e997223ac9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:43.541813 17845 catalog_manager.cc:5697] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:43.549944 17947 raft_consensus.cc:2955] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:43.565397 18644 raft_consensus.cc:2955] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:43.559669 18961 raft_consensus.cc:2955] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:43.577442 17946 raft_consensus.cc:2955] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:43.581813 18093 consensus_queue.cc:237] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:43.584496 17845 catalog_manager.cc:5697] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:43.589865 18642 raft_consensus.cc:1275] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:43.591089 18900 consensus_queue.cc:1048] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:43.600255 18925 raft_consensus.cc:2955] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:43.601765 18643 raft_consensus.cc:2955] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:43.605837 17947 raft_consensus.cc:1275] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:43.608698 18900 consensus_queue.cc:1048] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:43.612449 17947 raft_consensus.cc:2955] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:43.618283 18093 raft_consensus.cc:2955] T 57fe00fa09a54eb295024fca83b933ec P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:43.622116 17846 catalog_manager.cc:5697] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:43.628736 18018 consensus_queue.cc:237] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:43.630656 17833 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1f6ed08238924344ac4e43e997223ac9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:43.636389 18005 tablet_service.cc:1558] Processing DeleteTablet for tablet 1f6ed08238924344ac4e43e997223ac9 with delete_type TABLET_DATA_TOMBSTONED (TS c5ffa786c8fb43f7864fa8fbe76534cb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45450
I20260709 12:09:43.645532 18643 raft_consensus.cc:1275] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:43.649830 18961 consensus_queue.cc:1048] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:43.655932 17947 raft_consensus.cc:1275] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:43.660351 18928 consensus_queue.cc:1048] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:43.664184 18928 raft_consensus.cc:2955] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:43.668625 18643 raft_consensus.cc:2955] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:43.673900 18966 tablet_replica.cc:333] T 1f6ed08238924344ac4e43e997223ac9 P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:09:43.675028 18966 raft_consensus.cc:2243] T 1f6ed08238924344ac4e43e997223ac9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:43.675803 18966 raft_consensus.cc:2272] T 1f6ed08238924344ac4e43e997223ac9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:43.679349 17832 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 57fe00fa09a54eb295024fca83b933ec with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:43.689795 18966 ts_tablet_manager.cc:1916] T 1f6ed08238924344ac4e43e997223ac9 P c5ffa786c8fb43f7864fa8fbe76534cb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:43.692883 17845 catalog_manager.cc:5697] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
W20260709 12:09:43.695742 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 58969.8us
I20260709 12:09:43.696705 17947 raft_consensus.cc:2955] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:43.703255 18080 tablet_service.cc:1558] Processing DeleteTablet for tablet 57fe00fa09a54eb295024fca83b933ec with delete_type TABLET_DATA_TOMBSTONED (TS 4813437da0a74e65b61eb7bd1d18f110 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53944
I20260709 12:09:43.715591 18967 tablet_replica.cc:333] T 57fe00fa09a54eb295024fca83b933ec P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:09:43.719412 18967 raft_consensus.cc:2243] T 57fe00fa09a54eb295024fca83b933ec P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:43.720101 18967 raft_consensus.cc:2272] T 57fe00fa09a54eb295024fca83b933ec P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:43.718356 18966 ts_tablet_manager.cc:1929] T 1f6ed08238924344ac4e43e997223ac9 P c5ffa786c8fb43f7864fa8fbe76534cb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:43.721192 18966 log.cc:1199] T 1f6ed08238924344ac4e43e997223ac9 P c5ffa786c8fb43f7864fa8fbe76534cb: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-1-root/wals/1f6ed08238924344ac4e43e997223ac9
I20260709 12:09:43.722940 17832 catalog_manager.cc:5028] TS c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): tablet 1f6ed08238924344ac4e43e997223ac9 (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:09:43.724754 18967 ts_tablet_manager.cc:1916] T 57fe00fa09a54eb295024fca83b933ec P 4813437da0a74e65b61eb7bd1d18f110: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:43.735126 18967 ts_tablet_manager.cc:1929] T 57fe00fa09a54eb295024fca83b933ec P 4813437da0a74e65b61eb7bd1d18f110: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:43.735606 18967 log.cc:1199] T 57fe00fa09a54eb295024fca83b933ec P 4813437da0a74e65b61eb7bd1d18f110: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-2-root/wals/57fe00fa09a54eb295024fca83b933ec
I20260709 12:09:43.737257 17833 catalog_manager.cc:5028] TS 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): tablet 57fe00fa09a54eb295024fca83b933ec (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:09:43.788587 18928 raft_consensus.cc:1064] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:09:43.791124 18928 consensus_queue.cc:237] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:43.797910 18643 raft_consensus.cc:1275] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.798571 18097 raft_consensus.cc:1275] T 320059eb6db148929cae07ba683cfe1f P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.799904 17947 raft_consensus.cc:1275] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:43.799795 18928 consensus_queue.cc:1048] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:43.800736 18961 consensus_queue.cc:1048] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:43.801628 18945 consensus_queue.cc:1048] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:43.819751 18928 raft_consensus.cc:2955] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:43.825112 18643 raft_consensus.cc:2955] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:43.834265 17947 raft_consensus.cc:2955] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:43.839231 18090 raft_consensus.cc:2955] T 320059eb6db148929cae07ba683cfe1f P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:43.844086 17846 catalog_manager.cc:5697] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:43.862040 18024 consensus_queue.cc:237] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:43.867903 17946 raft_consensus.cc:1275] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:43.869558 18945 consensus_queue.cc:1048] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:43.875612 18643 raft_consensus.cc:1275] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:43.878448 18872 consensus_queue.cc:1048] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:43.880136 18872 raft_consensus.cc:2955] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:43.883188 17946 raft_consensus.cc:2955] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:43.889401 18642 raft_consensus.cc:2955] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:43.896831 17832 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 320059eb6db148929cae07ba683cfe1f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:43.902560 17845 catalog_manager.cc:5697] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:43.914572 18080 tablet_service.cc:1558] Processing DeleteTablet for tablet 320059eb6db148929cae07ba683cfe1f with delete_type TABLET_DATA_TOMBSTONED (TS 4813437da0a74e65b61eb7bd1d18f110 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53944
I20260709 12:09:43.915494 18967 tablet_replica.cc:333] T 320059eb6db148929cae07ba683cfe1f P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:09:43.916512 18967 raft_consensus.cc:2243] T 320059eb6db148929cae07ba683cfe1f P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:43.917097 18967 raft_consensus.cc:2272] T 320059eb6db148929cae07ba683cfe1f P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:43.919901 18967 ts_tablet_manager.cc:1916] T 320059eb6db148929cae07ba683cfe1f P 4813437da0a74e65b61eb7bd1d18f110: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:43.930612 18967 ts_tablet_manager.cc:1929] T 320059eb6db148929cae07ba683cfe1f P 4813437da0a74e65b61eb7bd1d18f110: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:43.931015 18967 log.cc:1199] T 320059eb6db148929cae07ba683cfe1f P 4813437da0a74e65b61eb7bd1d18f110: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-2-root/wals/320059eb6db148929cae07ba683cfe1f
I20260709 12:09:43.932448 17833 catalog_manager.cc:5028] TS 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): tablet 320059eb6db148929cae07ba683cfe1f (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:09:44.978895 18093 consensus_queue.cc:237] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
W20260709 12:09:44.984417 18061 consensus_peers.cc:597] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f9b0c864d78846698db31224c547a091. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:44.984901 18019 raft_consensus.cc:1275] T f9b0c864d78846698db31224c547a091 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:44.985360 17946 raft_consensus.cc:1275] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:44.986028 18921 consensus_queue.cc:1048] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:44.986821 18956 consensus_queue.cc:1048] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:44.994843 18900 raft_consensus.cc:2955] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:44.996023 17946 raft_consensus.cc:2955] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:44.997242 18019 raft_consensus.cc:2955] T f9b0c864d78846698db31224c547a091 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:45.010562 18024 consensus_queue.cc:237] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:45.014231 17843 catalog_manager.cc:5697] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:45.038925 17987 consensus_peers.cc:597] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 40f9c84f7e9940ce943e3ad8e2888beb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:45.040755 18090 raft_consensus.cc:1275] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:45.042304 18872 consensus_queue.cc:1048] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:45.044425 17944 raft_consensus.cc:1275] T 40f9c84f7e9940ce943e3ad8e2888beb P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:45.045608 18872 consensus_queue.cc:1048] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:45.055087 18978 raft_consensus.cc:2955] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:45.056685 17944 raft_consensus.cc:2955] T 40f9c84f7e9940ce943e3ad8e2888beb P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:45.070292 18093 consensus_queue.cc:237] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:45.070899 18090 raft_consensus.cc:2955] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:45.100101 17846 catalog_manager.cc:5697] T 40f9c84f7e9940ce943e3ad8e2888beb P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
W20260709 12:09:45.108588 18061 consensus_peers.cc:597] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b03f131254e14da2918c02bf0fcf9c5c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:45.109227 18024 raft_consensus.cc:1275] T b03f131254e14da2918c02bf0fcf9c5c P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:45.110504 18900 consensus_queue.cc:1048] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:45.111058 17947 raft_consensus.cc:1275] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:45.113348 18900 consensus_queue.cc:1048] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:45.127453 18956 raft_consensus.cc:2955] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:45.131078 17947 raft_consensus.cc:2955] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:45.131117 18019 raft_consensus.cc:2955] T b03f131254e14da2918c02bf0fcf9c5c P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:45.148151 18019 consensus_queue.cc:237] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:45.148918 17846 catalog_manager.cc:5697] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
W20260709 12:09:45.155741 17987 consensus_peers.cc:597] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 16728addc56e43129f085b3bfd185dcb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:45.157146 18093 raft_consensus.cc:1275] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:45.158449 18872 consensus_queue.cc:1048] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:45.158769 17947 raft_consensus.cc:1275] T 16728addc56e43129f085b3bfd185dcb P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:45.161365 18978 consensus_queue.cc:1048] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:45.183730 18872 raft_consensus.cc:2955] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:45.185890 18093 raft_consensus.cc:2955] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:45.187458 17946 raft_consensus.cc:2955] T 16728addc56e43129f085b3bfd185dcb P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:45.204959 17846 catalog_manager.cc:5697] T 16728addc56e43129f085b3bfd185dcb P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:45.467949 18992 ts_tablet_manager.cc:933] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:45.470326 18992 tablet_copy_client.cc:323] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.195:41931
I20260709 12:09:45.471947 18108 tablet_copy_service.cc:140] P 4813437da0a74e65b61eb7bd1d18f110: Received BeginTabletCopySession request for tablet f9b0c864d78846698db31224c547a091 from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:41818)
I20260709 12:09:45.472491 18108 tablet_copy_service.cc:161] P 4813437da0a74e65b61eb7bd1d18f110: Beginning new tablet copy session on tablet f9b0c864d78846698db31224c547a091 from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:41818: session id = e28f77912a9c4ba2b9841f6fedddc2db-f9b0c864d78846698db31224c547a091
I20260709 12:09:45.479915 18108 tablet_copy_source_session.cc:215] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:45.482839 18992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9b0c864d78846698db31224c547a091. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:45.494084 18992 tablet_copy_client.cc:806] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:45.494740 18992 tablet_copy_client.cc:670] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:45.500782 18992 tablet_copy_client.cc:538] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:45.501561 18994 ts_tablet_manager.cc:933] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:45.503652 18994 tablet_copy_client.cc:323] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.194:36297
I20260709 12:09:45.505151 18033 tablet_copy_service.cc:140] P c5ffa786c8fb43f7864fa8fbe76534cb: Received BeginTabletCopySession request for tablet 40f9c84f7e9940ce943e3ad8e2888beb from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:53022)
I20260709 12:09:45.505662 18033 tablet_copy_service.cc:161] P c5ffa786c8fb43f7864fa8fbe76534cb: Beginning new tablet copy session on tablet 40f9c84f7e9940ce943e3ad8e2888beb from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:53022: session id = e28f77912a9c4ba2b9841f6fedddc2db-40f9c84f7e9940ce943e3ad8e2888beb
I20260709 12:09:45.513468 18992 tablet_bootstrap.cc:492] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:09:45.516775 18033 tablet_copy_source_session.cc:215] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:45.519888 18994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40f9c84f7e9940ce943e3ad8e2888beb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:45.537191 18994 tablet_copy_client.cc:806] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:45.537811 18994 tablet_copy_client.cc:670] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:45.541802 18994 tablet_copy_client.cc:538] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:45.543612 18992 tablet_bootstrap.cc:492] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:45.544416 18992 tablet_bootstrap.cc:492] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:09:45.545089 18992 ts_tablet_manager.cc:1403] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.032s	user 0.022s	sys 0.003s
I20260709 12:09:45.547423 18992 raft_consensus.cc:359] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:45.548202 18992 raft_consensus.cc:740] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:09:45.548846 18992 consensus_queue.cc:260] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:45.550388 18994 tablet_bootstrap.cc:492] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:09:45.590082 18994 tablet_bootstrap.cc:492] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:45.591058 18994 tablet_bootstrap.cc:492] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:09:45.591758 18994 ts_tablet_manager.cc:1403] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.042s	user 0.020s	sys 0.012s
I20260709 12:09:45.595825 18992 ts_tablet_manager.cc:1434] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.050s	user 0.012s	sys 0.030s
I20260709 12:09:45.596855 18994 raft_consensus.cc:359] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:45.597584 18108 tablet_copy_service.cc:342] P 4813437da0a74e65b61eb7bd1d18f110: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-f9b0c864d78846698db31224c547a091 received from {username='slave'} at 127.0.0.1:41818
I20260709 12:09:45.597760 18994 raft_consensus.cc:740] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:09:45.598089 18108 tablet_copy_service.cc:434] P 4813437da0a74e65b61eb7bd1d18f110: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-f9b0c864d78846698db31224c547a091 on tablet f9b0c864d78846698db31224c547a091 with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:45.598502 18994 consensus_queue.cc:260] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:45.605376 18992 ts_tablet_manager.cc:933] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:45.606287 18994 ts_tablet_manager.cc:1434] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:09:45.608078 18992 tablet_copy_client.cc:323] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.195:41931
I20260709 12:09:45.608390 18033 tablet_copy_service.cc:342] P c5ffa786c8fb43f7864fa8fbe76534cb: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-40f9c84f7e9940ce943e3ad8e2888beb received from {username='slave'} at 127.0.0.1:53022
I20260709 12:09:45.608856 18033 tablet_copy_service.cc:434] P c5ffa786c8fb43f7864fa8fbe76534cb: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-40f9c84f7e9940ce943e3ad8e2888beb on tablet 40f9c84f7e9940ce943e3ad8e2888beb with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:45.609637 18108 tablet_copy_service.cc:140] P 4813437da0a74e65b61eb7bd1d18f110: Received BeginTabletCopySession request for tablet b03f131254e14da2918c02bf0fcf9c5c from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:41818)
I20260709 12:09:45.610175 18108 tablet_copy_service.cc:161] P 4813437da0a74e65b61eb7bd1d18f110: Beginning new tablet copy session on tablet b03f131254e14da2918c02bf0fcf9c5c from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:41818: session id = e28f77912a9c4ba2b9841f6fedddc2db-b03f131254e14da2918c02bf0fcf9c5c
I20260709 12:09:45.618144 18108 tablet_copy_source_session.cc:215] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:45.621315 18992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b03f131254e14da2918c02bf0fcf9c5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:45.628717 18994 ts_tablet_manager.cc:933] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:45.631865 18994 tablet_copy_client.cc:323] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.194:36297
I20260709 12:09:45.633279 18033 tablet_copy_service.cc:140] P c5ffa786c8fb43f7864fa8fbe76534cb: Received BeginTabletCopySession request for tablet 16728addc56e43129f085b3bfd185dcb from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:53022)
I20260709 12:09:45.633777 18033 tablet_copy_service.cc:161] P c5ffa786c8fb43f7864fa8fbe76534cb: Beginning new tablet copy session on tablet 16728addc56e43129f085b3bfd185dcb from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:53022: session id = e28f77912a9c4ba2b9841f6fedddc2db-16728addc56e43129f085b3bfd185dcb
I20260709 12:09:45.644281 18992 tablet_copy_client.cc:806] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:45.644917 18992 tablet_copy_client.cc:670] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:45.648731 18992 tablet_copy_client.cc:538] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:45.658895 18033 tablet_copy_source_session.cc:215] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:45.662381 18994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16728addc56e43129f085b3bfd185dcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:45.671082 18992 tablet_bootstrap.cc:492] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:09:45.680648 18994 tablet_copy_client.cc:806] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:45.681282 18994 tablet_copy_client.cc:670] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:45.686086 18994 tablet_copy_client.cc:538] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:45.695870 18992 tablet_bootstrap.cc:492] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:45.696812 18992 tablet_bootstrap.cc:492] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:09:45.697455 18992 ts_tablet_manager.cc:1403] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.011s
I20260709 12:09:45.698230 18994 tablet_bootstrap.cc:492] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:09:45.700395 18992 raft_consensus.cc:359] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:45.701328 18992 raft_consensus.cc:740] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:09:45.701946 18992 consensus_queue.cc:260] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:45.709801 18992 ts_tablet_manager.cc:1434] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:09:45.713879 18108 tablet_copy_service.cc:342] P 4813437da0a74e65b61eb7bd1d18f110: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-b03f131254e14da2918c02bf0fcf9c5c received from {username='slave'} at 127.0.0.1:41818
I20260709 12:09:45.714272 18108 tablet_copy_service.cc:434] P 4813437da0a74e65b61eb7bd1d18f110: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-b03f131254e14da2918c02bf0fcf9c5c on tablet b03f131254e14da2918c02bf0fcf9c5c with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:45.724025 18994 tablet_bootstrap.cc:492] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:45.724989 18994 tablet_bootstrap.cc:492] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:09:45.725693 18994 ts_tablet_manager.cc:1403] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.028s	user 0.024s	sys 0.000s
I20260709 12:09:45.728363 18994 raft_consensus.cc:359] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:45.729122 18994 raft_consensus.cc:740] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:09:45.729699 18994 consensus_queue.cc:260] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:45.732141 18994 ts_tablet_manager.cc:1434] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:09:45.733632 18033 tablet_copy_service.cc:342] P c5ffa786c8fb43f7864fa8fbe76534cb: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-16728addc56e43129f085b3bfd185dcb received from {username='slave'} at 127.0.0.1:53022
I20260709 12:09:45.734277 18033 tablet_copy_service.cc:434] P c5ffa786c8fb43f7864fa8fbe76534cb: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-16728addc56e43129f085b3bfd185dcb on tablet 16728addc56e43129f085b3bfd185dcb with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:45.897661 18642 raft_consensus.cc:1217] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:46.018612 18642 raft_consensus.cc:1217] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:46.135628 18643 raft_consensus.cc:1217] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:46.256887 18643 raft_consensus.cc:1217] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:46.446561 18921 raft_consensus.cc:1064] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:09:46.453328 18921 consensus_queue.cc:237] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:46.478480 18978 raft_consensus.cc:1064] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:09:46.482411 18978 consensus_queue.cc:237] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:46.511072 18643 raft_consensus.cc:1275] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:09:46.515743 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 50413.2us
I20260709 12:09:46.519022 19004 consensus_queue.cc:1048] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:46.520910 18019 raft_consensus.cc:1275] T f9b0c864d78846698db31224c547a091 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.532021 18987 consensus_queue.cc:1048] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:46.536700 18642 raft_consensus.cc:1275] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.538422 18991 consensus_queue.cc:1048] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:46.543301 17944 raft_consensus.cc:1275] T 40f9c84f7e9940ce943e3ad8e2888beb P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.546432 19006 consensus_queue.cc:1048] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:46.562124 18093 raft_consensus.cc:1275] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.564342 19005 consensus_queue.cc:1048] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:46.570919 17944 raft_consensus.cc:1275] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.573562 19012 consensus_queue.cc:1048] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:46.577071 18987 raft_consensus.cc:2955] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:46.580722 19006 raft_consensus.cc:2955] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:46.586869 18090 raft_consensus.cc:2955] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:46.598117 18019 raft_consensus.cc:2955] T f9b0c864d78846698db31224c547a091 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:46.593060 18643 raft_consensus.cc:2955] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:46.624439 17843 catalog_manager.cc:5697] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:46.636585 18642 raft_consensus.cc:2955] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:46.651978 19009 raft_consensus.cc:1064] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:09:46.651859 17947 raft_consensus.cc:2955] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
W20260709 12:09:46.654825 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 52646.6us
I20260709 12:09:46.656009 19009 consensus_queue.cc:237] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:46.660845 17944 raft_consensus.cc:2955] T 40f9c84f7e9940ce943e3ad8e2888beb P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:46.674533 18643 raft_consensus.cc:1275] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.676424 19008 consensus_queue.cc:1048] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:46.697608 18019 raft_consensus.cc:1275] T b03f131254e14da2918c02bf0fcf9c5c P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.699708 18987 consensus_queue.cc:1048] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:46.702425 18991 raft_consensus.cc:1064] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:09:46.707319 18991 consensus_queue.cc:237] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:46.701817 17845 catalog_manager.cc:5697] T f9b0c864d78846698db31224c547a091 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:46.717589 17947 raft_consensus.cc:1275] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.726454 18987 consensus_queue.cc:1048] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:46.754513 18093 raft_consensus.cc:1275] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.757902 18018 consensus_queue.cc:237] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:46.759505 19006 consensus_queue.cc:1048] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:46.762223 17945 raft_consensus.cc:1275] T 16728addc56e43129f085b3bfd185dcb P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.764542 18987 raft_consensus.cc:2955] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:46.754546 18644 raft_consensus.cc:1275] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:46.767138 18643 raft_consensus.cc:1275] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:46.768960 19019 consensus_queue.cc:1048] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:46.770673 19019 consensus_queue.cc:1048] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:46.772251 18097 raft_consensus.cc:1275] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:46.775511 18024 raft_consensus.cc:2955] T b03f131254e14da2918c02bf0fcf9c5c P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:46.781087 19006 consensus_queue.cc:1048] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:46.783159 18978 consensus_queue.cc:1048] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:46.787073 18093 consensus_queue.cc:237] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:46.787451 19005 raft_consensus.cc:2955] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:46.792994 18644 raft_consensus.cc:1275] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:46.794845 19009 consensus_queue.cc:1048] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:46.794306 18642 raft_consensus.cc:2955] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:46.804201 18091 raft_consensus.cc:2955] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:46.804018 18641 raft_consensus.cc:2955] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:46.807858 18921 raft_consensus.cc:2955] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:46.813774 17945 raft_consensus.cc:1275] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:46.814600 17944 raft_consensus.cc:2955] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:46.813412 18640 raft_consensus.cc:2955] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:46.825701 19004 consensus_queue.cc:1048] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:46.827600 17832 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 40f9c84f7e9940ce943e3ad8e2888beb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:46.840590 17945 raft_consensus.cc:2955] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:46.842042 17843 catalog_manager.cc:5697] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:46.841810 17847 catalog_manager.cc:5697] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:46.842864 18978 raft_consensus.cc:2955] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:46.852999 17833 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f9b0c864d78846698db31224c547a091 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:46.859812 17933 tablet_service.cc:1558] Processing DeleteTablet for tablet 40f9c84f7e9940ce943e3ad8e2888beb with delete_type TABLET_DATA_TOMBSTONED (TS 63f5bddeebd84e5788d671a176cfa8e1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50326
W20260709 12:09:46.877564 18921 consensus_queue.cc:1175] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "63f5bddeebd84e5788d671a176cfa8e1" responder_term: 1 status { last_received { term: 1 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 1 index: 3 } }
I20260709 12:09:46.879045 18090 consensus_queue.cc:237] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:46.878775 18641 raft_consensus.cc:2955] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:46.874022 17845 catalog_manager.cc:5697] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:46.883406 18093 raft_consensus.cc:2955] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:46.892145 19032 tablet_replica.cc:333] T 40f9c84f7e9940ce943e3ad8e2888beb P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:09:46.892061 18643 raft_consensus.cc:1275] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:46.893280 19032 raft_consensus.cc:2243] T 40f9c84f7e9940ce943e3ad8e2888beb P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:46.893666 18921 consensus_queue.cc:1048] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:46.894002 19032 raft_consensus.cc:2272] T 40f9c84f7e9940ce943e3ad8e2888beb P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:46.901496 19004 raft_consensus.cc:2955] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:46.906023 18005 tablet_service.cc:1558] Processing DeleteTablet for tablet f9b0c864d78846698db31224c547a091 with delete_type TABLET_DATA_TOMBSTONED (TS c5ffa786c8fb43f7864fa8fbe76534cb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45450
I20260709 12:09:46.923468 19032 ts_tablet_manager.cc:1916] T 40f9c84f7e9940ce943e3ad8e2888beb P 63f5bddeebd84e5788d671a176cfa8e1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:46.923696 17833 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b03f131254e14da2918c02bf0fcf9c5c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:46.927872 18644 raft_consensus.cc:2955] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:46.928617 17845 catalog_manager.cc:5697] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:46.944082 19034 tablet_replica.cc:333] T f9b0c864d78846698db31224c547a091 P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
W20260709 12:09:46.984524 18062 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.16.98.254:38823, user_credentials={real_user=slave}} blocked reactor thread for 70875.1us
I20260709 12:09:46.971168 17847 catalog_manager.cc:5697] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:47.035872 18018 consensus_queue.cc:237] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:47.041435 17945 raft_consensus.cc:1275] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:47.054343 19032 ts_tablet_manager.cc:1929] T 40f9c84f7e9940ce943e3ad8e2888beb P 63f5bddeebd84e5788d671a176cfa8e1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:47.055225 19032 log.cc:1199] T 40f9c84f7e9940ce943e3ad8e2888beb P 63f5bddeebd84e5788d671a176cfa8e1: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-0-root/wals/40f9c84f7e9940ce943e3ad8e2888beb
I20260709 12:09:47.055121 18987 consensus_queue.cc:1048] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:47.056665 18643 raft_consensus.cc:1275] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:47.058794 17832 catalog_manager.cc:5028] TS 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): tablet 40f9c84f7e9940ce943e3ad8e2888beb (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:09:47.060626 18005 tablet_service.cc:1558] Processing DeleteTablet for tablet b03f131254e14da2918c02bf0fcf9c5c with delete_type TABLET_DATA_TOMBSTONED (TS c5ffa786c8fb43f7864fa8fbe76534cb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45450
I20260709 12:09:47.061527 19034 raft_consensus.cc:2243] T f9b0c864d78846698db31224c547a091 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:47.062844 19005 consensus_queue.cc:1048] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:47.064523 18093 raft_consensus.cc:1275] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:47.065138 19034 raft_consensus.cc:2272] T f9b0c864d78846698db31224c547a091 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:47.068454 19034 ts_tablet_manager.cc:1916] T f9b0c864d78846698db31224c547a091 P c5ffa786c8fb43f7864fa8fbe76534cb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:47.068912 19005 consensus_queue.cc:1048] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:47.071369 19005 raft_consensus.cc:2955] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:47.074239 18643 raft_consensus.cc:2955] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:47.084132 17832 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 16728addc56e43129f085b3bfd185dcb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:47.089107 19034 ts_tablet_manager.cc:1929] T f9b0c864d78846698db31224c547a091 P c5ffa786c8fb43f7864fa8fbe76534cb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:47.089578 19034 log.cc:1199] T f9b0c864d78846698db31224c547a091 P c5ffa786c8fb43f7864fa8fbe76534cb: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-1-root/wals/f9b0c864d78846698db31224c547a091
I20260709 12:09:47.092914 18093 raft_consensus.cc:2955] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:47.097724 19034 tablet_replica.cc:333] T b03f131254e14da2918c02bf0fcf9c5c P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:09:47.098404 17832 catalog_manager.cc:5028] TS c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): tablet f9b0c864d78846698db31224c547a091 (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:09:47.098930 19034 raft_consensus.cc:2243] T b03f131254e14da2918c02bf0fcf9c5c P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:47.099702 19034 raft_consensus.cc:2272] T b03f131254e14da2918c02bf0fcf9c5c P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:47.108909 19034 ts_tablet_manager.cc:1916] T b03f131254e14da2918c02bf0fcf9c5c P c5ffa786c8fb43f7864fa8fbe76534cb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:47.114094 17945 raft_consensus.cc:2955] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:47.127046 17843 catalog_manager.cc:5697] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:47.136412 19034 ts_tablet_manager.cc:1929] T b03f131254e14da2918c02bf0fcf9c5c P c5ffa786c8fb43f7864fa8fbe76534cb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:47.136974 19034 log.cc:1199] T b03f131254e14da2918c02bf0fcf9c5c P c5ffa786c8fb43f7864fa8fbe76534cb: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-1-root/wals/b03f131254e14da2918c02bf0fcf9c5c
I20260709 12:09:47.138760 17832 catalog_manager.cc:5028] TS c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): tablet b03f131254e14da2918c02bf0fcf9c5c (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:09:47.150103 17933 tablet_service.cc:1558] Processing DeleteTablet for tablet 16728addc56e43129f085b3bfd185dcb with delete_type TABLET_DATA_TOMBSTONED (TS 63f5bddeebd84e5788d671a176cfa8e1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50326
I20260709 12:09:47.152047 19032 tablet_replica.cc:333] T 16728addc56e43129f085b3bfd185dcb P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:09:47.163226 19032 raft_consensus.cc:2243] T 16728addc56e43129f085b3bfd185dcb P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:47.163965 19032 pending_rounds.cc:70] T 16728addc56e43129f085b3bfd185dcb P 63f5bddeebd84e5788d671a176cfa8e1: Trying to abort 1 pending ops.
I20260709 12:09:47.164317 19032 pending_rounds.cc:77] T 16728addc56e43129f085b3bfd185dcb P 63f5bddeebd84e5788d671a176cfa8e1: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305621449537970176 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "16728addc56e43129f085b3bfd185dcb" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } } }
I20260709 12:09:47.165664 19032 raft_consensus.cc:2917] T 16728addc56e43129f085b3bfd185dcb P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 12:09:47.166899 19032 raft_consensus.cc:2889] T 16728addc56e43129f085b3bfd185dcb P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:09:47.167582 19032 raft_consensus.cc:2272] T 16728addc56e43129f085b3bfd185dcb P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:47.170962 19032 ts_tablet_manager.cc:1916] T 16728addc56e43129f085b3bfd185dcb P 63f5bddeebd84e5788d671a176cfa8e1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:47.183979 19032 ts_tablet_manager.cc:1929] T 16728addc56e43129f085b3bfd185dcb P 63f5bddeebd84e5788d671a176cfa8e1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:47.184301 19032 log.cc:1199] T 16728addc56e43129f085b3bfd185dcb P 63f5bddeebd84e5788d671a176cfa8e1: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-0-root/wals/16728addc56e43129f085b3bfd185dcb
I20260709 12:09:47.185612 17832 catalog_manager.cc:5028] TS 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): tablet 16728addc56e43129f085b3bfd185dcb (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:09:48.227793 17947 consensus_queue.cc:237] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:48.233209 18093 raft_consensus.cc:1275] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:48.233616 18024 raft_consensus.cc:1275] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:48.233551 17912 consensus_peers.cc:597] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 53fdd1cc63be4f3b8a533d34af81d0c6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:48.234462 19035 consensus_queue.cc:1048] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:48.235443 18933 consensus_queue.cc:1048] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:48.245263 18933 raft_consensus.cc:2955] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:48.247066 18024 raft_consensus.cc:2955] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:48.252007 18091 raft_consensus.cc:2955] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:48.265177 17947 consensus_queue.cc:237] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:48.265612 17845 catalog_manager.cc:5697] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 1 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:09:48.272127 17912 consensus_peers.cc:597] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1372b5e0da1c481fb926410510c94341. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:48.273192 18093 raft_consensus.cc:1275] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:48.274557 18870 consensus_queue.cc:1048] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:48.286616 18024 raft_consensus.cc:1275] T 1372b5e0da1c481fb926410510c94341 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:48.287147 19035 raft_consensus.cc:2955] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:48.289336 19037 consensus_queue.cc:1048] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:48.296443 18090 raft_consensus.cc:2955] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:48.302685 18018 raft_consensus.cc:2955] T 1372b5e0da1c481fb926410510c94341 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:48.315100 18093 consensus_queue.cc:237] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:48.325721 18018 raft_consensus.cc:1275] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:48.325914 18061 consensus_peers.cc:597] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6135c6398c3f4926b6f07433b6f63759. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:48.327105 19004 consensus_queue.cc:1048] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:48.327823 17947 raft_consensus.cc:1275] T 6135c6398c3f4926b6f07433b6f63759 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:48.329017 18921 consensus_queue.cc:1048] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:48.331099 17845 catalog_manager.cc:5697] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 1 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:48.341241 18921 raft_consensus.cc:2955] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:48.357831 18018 consensus_queue.cc:237] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:48.363036 18024 raft_consensus.cc:2955] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:48.385771 17847 catalog_manager.cc:5697] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:48.390619 17947 raft_consensus.cc:2955] T 6135c6398c3f4926b6f07433b6f63759 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
W20260709 12:09:48.397439 17987 consensus_peers.cc:597] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 92e1586ba70a4331be2a55f4a31dd687. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:48.404808 17945 raft_consensus.cc:1275] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:48.403987 18093 raft_consensus.cc:1275] T 92e1586ba70a4331be2a55f4a31dd687 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:48.407099 19005 consensus_queue.cc:1048] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:48.408883 19019 consensus_queue.cc:1048] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:48.419025 18978 raft_consensus.cc:2955] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:48.426105 17945 raft_consensus.cc:2955] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:48.436648 18091 raft_consensus.cc:2955] T 92e1586ba70a4331be2a55f4a31dd687 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:48.444988 17845 catalog_manager.cc:5697] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:48.702744 19056 ts_tablet_manager.cc:933] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123)
I20260709 12:09:48.705469 19056 tablet_copy_client.cc:323] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.193:39123
I20260709 12:09:48.707250 17959 tablet_copy_service.cc:140] P 63f5bddeebd84e5788d671a176cfa8e1: Received BeginTabletCopySession request for tablet 1372b5e0da1c481fb926410510c94341 from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:44668)
I20260709 12:09:48.707778 17959 tablet_copy_service.cc:161] P 63f5bddeebd84e5788d671a176cfa8e1: Beginning new tablet copy session on tablet 1372b5e0da1c481fb926410510c94341 from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:44668: session id = e28f77912a9c4ba2b9841f6fedddc2db-1372b5e0da1c481fb926410510c94341
I20260709 12:09:48.715982 17959 tablet_copy_source_session.cc:215] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:48.718909 19056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1372b5e0da1c481fb926410510c94341. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:48.732296 19056 tablet_copy_client.cc:806] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:48.733125 19056 tablet_copy_client.cc:670] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:48.737231 19056 tablet_copy_client.cc:538] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:48.744122 19056 tablet_bootstrap.cc:492] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:09:48.761866 19056 tablet_bootstrap.cc:492] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:48.762713 19056 tablet_bootstrap.cc:492] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:09:48.763336 19056 ts_tablet_manager.cc:1403] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.019s	user 0.005s	sys 0.014s
I20260709 12:09:48.766088 19056 raft_consensus.cc:359] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:48.766880 19056 raft_consensus.cc:740] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:09:48.767514 19056 consensus_queue.cc:260] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:48.784307 19056 ts_tablet_manager.cc:1434] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.021s	user 0.012s	sys 0.004s
I20260709 12:09:48.786036 17959 tablet_copy_service.cc:342] P 63f5bddeebd84e5788d671a176cfa8e1: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-1372b5e0da1c481fb926410510c94341 received from {username='slave'} at 127.0.0.1:44668
I20260709 12:09:48.786523 17959 tablet_copy_service.cc:434] P 63f5bddeebd84e5788d671a176cfa8e1: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-1372b5e0da1c481fb926410510c94341 on tablet 1372b5e0da1c481fb926410510c94341 with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:48.830260 19056 ts_tablet_manager.cc:933] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123)
I20260709 12:09:48.832397 19056 tablet_copy_client.cc:323] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.193:39123
I20260709 12:09:48.834050 17959 tablet_copy_service.cc:140] P 63f5bddeebd84e5788d671a176cfa8e1: Received BeginTabletCopySession request for tablet 53fdd1cc63be4f3b8a533d34af81d0c6 from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:44668)
I20260709 12:09:48.834559 17959 tablet_copy_service.cc:161] P 63f5bddeebd84e5788d671a176cfa8e1: Beginning new tablet copy session on tablet 53fdd1cc63be4f3b8a533d34af81d0c6 from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:44668: session id = e28f77912a9c4ba2b9841f6fedddc2db-53fdd1cc63be4f3b8a533d34af81d0c6
I20260709 12:09:48.840941 17959 tablet_copy_source_session.cc:215] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:48.843935 19056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53fdd1cc63be4f3b8a533d34af81d0c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:48.855901 19056 tablet_copy_client.cc:806] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:48.856511 19056 tablet_copy_client.cc:670] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:48.861702 19056 tablet_copy_client.cc:538] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:48.871475 19056 tablet_bootstrap.cc:492] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:09:48.888123 19056 tablet_bootstrap.cc:492] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:48.888967 19056 tablet_bootstrap.cc:492] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:09:48.889992 19056 ts_tablet_manager.cc:1403] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.007s
I20260709 12:09:48.892511 19056 raft_consensus.cc:359] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:48.893304 19056 raft_consensus.cc:740] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:09:48.893882 19056 consensus_queue.cc:260] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:48.896358 19056 ts_tablet_manager.cc:1434] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:09:48.898476 17959 tablet_copy_service.cc:342] P 63f5bddeebd84e5788d671a176cfa8e1: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-53fdd1cc63be4f3b8a533d34af81d0c6 received from {username='slave'} at 127.0.0.1:44668
I20260709 12:09:48.898890 17959 tablet_copy_service.cc:434] P 63f5bddeebd84e5788d671a176cfa8e1: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-53fdd1cc63be4f3b8a533d34af81d0c6 on tablet 53fdd1cc63be4f3b8a533d34af81d0c6 with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:48.925715 19056 ts_tablet_manager.cc:933] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:48.927241 19056 tablet_copy_client.cc:323] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.194:36297
I20260709 12:09:48.929435 18033 tablet_copy_service.cc:140] P c5ffa786c8fb43f7864fa8fbe76534cb: Received BeginTabletCopySession request for tablet 92e1586ba70a4331be2a55f4a31dd687 from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:53022)
I20260709 12:09:48.929988 18033 tablet_copy_service.cc:161] P c5ffa786c8fb43f7864fa8fbe76534cb: Beginning new tablet copy session on tablet 92e1586ba70a4331be2a55f4a31dd687 from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:53022: session id = e28f77912a9c4ba2b9841f6fedddc2db-92e1586ba70a4331be2a55f4a31dd687
I20260709 12:09:48.934070 19063 ts_tablet_manager.cc:933] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:48.940130 19063 tablet_copy_client.cc:323] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.195:41931
I20260709 12:09:48.942742 18108 tablet_copy_service.cc:140] P 4813437da0a74e65b61eb7bd1d18f110: Received BeginTabletCopySession request for tablet 6135c6398c3f4926b6f07433b6f63759 from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:41818)
I20260709 12:09:48.942900 18033 tablet_copy_source_session.cc:215] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:48.943265 18108 tablet_copy_service.cc:161] P 4813437da0a74e65b61eb7bd1d18f110: Beginning new tablet copy session on tablet 6135c6398c3f4926b6f07433b6f63759 from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:41818: session id = e28f77912a9c4ba2b9841f6fedddc2db-6135c6398c3f4926b6f07433b6f63759
I20260709 12:09:48.947578 19056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92e1586ba70a4331be2a55f4a31dd687. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:48.966218 18108 tablet_copy_source_session.cc:215] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:48.966296 19056 tablet_copy_client.cc:806] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:48.968050 19056 tablet_copy_client.cc:670] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:48.972059 19056 tablet_copy_client.cc:538] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:48.976733 19063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6135c6398c3f4926b6f07433b6f63759. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:48.978245 19056 tablet_bootstrap.cc:492] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:09:49.000247 19063 tablet_copy_client.cc:806] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:49.000874 19063 tablet_copy_client.cc:670] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:49.004454 19063 tablet_copy_client.cc:538] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:49.008769 19056 tablet_bootstrap.cc:492] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:49.010165 19056 tablet_bootstrap.cc:492] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:09:49.010789 19056 ts_tablet_manager.cc:1403] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.033s	user 0.019s	sys 0.006s
I20260709 12:09:49.012740 19063 tablet_bootstrap.cc:492] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:09:49.013391 19056 raft_consensus.cc:359] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:49.014163 19056 raft_consensus.cc:740] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:09:49.014750 19056 consensus_queue.cc:260] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:49.016781 19056 ts_tablet_manager.cc:1434] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:09:49.018462 18033 tablet_copy_service.cc:342] P c5ffa786c8fb43f7864fa8fbe76534cb: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-92e1586ba70a4331be2a55f4a31dd687 received from {username='slave'} at 127.0.0.1:53022
I20260709 12:09:49.018903 18033 tablet_copy_service.cc:434] P c5ffa786c8fb43f7864fa8fbe76534cb: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-92e1586ba70a4331be2a55f4a31dd687 on tablet 92e1586ba70a4331be2a55f4a31dd687 with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:49.042619 19063 tablet_bootstrap.cc:492] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:49.043671 19063 tablet_bootstrap.cc:492] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:09:49.044340 19063 ts_tablet_manager.cc:1403] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.032s	user 0.020s	sys 0.005s
I20260709 12:09:49.048177 19063 raft_consensus.cc:359] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:49.048991 19063 raft_consensus.cc:740] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:09:49.049662 19063 consensus_queue.cc:260] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:49.053659 19063 ts_tablet_manager.cc:1434] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:09:49.055328 18108 tablet_copy_service.cc:342] P 4813437da0a74e65b61eb7bd1d18f110: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-6135c6398c3f4926b6f07433b6f63759 received from {username='slave'} at 127.0.0.1:41818
I20260709 12:09:49.055771 18108 tablet_copy_service.cc:434] P 4813437da0a74e65b61eb7bd1d18f110: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-6135c6398c3f4926b6f07433b6f63759 on tablet 6135c6398c3f4926b6f07433b6f63759 with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:49.178037 18641 raft_consensus.cc:1217] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:49.303794 18641 raft_consensus.cc:1217] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:49.374707 18641 raft_consensus.cc:1217] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:49.463438 18641 raft_consensus.cc:1217] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:49.636734 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:49.701555 18091 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "137ed415b9d242989f28f349c1618c74"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
mode: GRACEFUL
new_leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:40154
I20260709 12:09:49.702106 18091 raft_consensus.cc:606] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Received request to transfer leadership to TS 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:49.725687 17945 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:09:49.726257 17945 raft_consensus.cc:606] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:09:49.728801 18091 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
mode: GRACEFUL
new_leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:40154
I20260709 12:09:49.729403 18091 raft_consensus.cc:606] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Received request to transfer leadership to TS e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:49.731819 18091 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a474344628f842a781e714727d867c3a"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
mode: GRACEFUL
new_leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:40154
I20260709 12:09:49.732362 18091 raft_consensus.cc:606] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Received request to transfer leadership to TS 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:49.750428 19035 raft_consensus.cc:1064] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:09:49.752671 19035 consensus_queue.cc:237] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:49.756654 18018 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
mode: GRACEFUL
new_leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:44098
I20260709 12:09:49.757172 18018 raft_consensus.cc:606] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Received request to transfer leadership to TS 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:49.760640 18093 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
mode: GRACEFUL
new_leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:40154
I20260709 12:09:49.761345 18093 raft_consensus.cc:606] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Received request to transfer leadership to TS e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:49.764930 18643 raft_consensus.cc:1275] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:49.766409 19037 consensus_queue.cc:1048] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:49.767910 18018 raft_consensus.cc:1275] T 1372b5e0da1c481fb926410510c94341 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:49.768257 18091 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
mode: GRACEFUL
new_leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:40154
I20260709 12:09:49.768818 18091 raft_consensus.cc:606] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Received request to transfer leadership to TS e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:49.770462 18093 raft_consensus.cc:1275] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:49.771845 19037 consensus_queue.cc:1048] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:49.772419 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 12:09:49.773980 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:49.775092 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:49.775846 19035 consensus_queue.cc:1048] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:49.787974 19035 raft_consensus.cc:2955] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:49.796278 18641 raft_consensus.cc:2955] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:49.820238 18093 raft_consensus.cc:2955] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:49.820611 17846 catalog_manager.cc:5697] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:49.828845 18921 raft_consensus.cc:993] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110: : Instructing follower 63f5bddeebd84e5788d671a176cfa8e1 to start an election
I20260709 12:09:49.829332 19068 raft_consensus.cc:1081] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Signalling peer 63f5bddeebd84e5788d671a176cfa8e1 to start an election
I20260709 12:09:49.832201 19005 raft_consensus.cc:1064] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:09:49.834303 19005 consensus_queue.cc:237] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:49.840629 17946 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "137ed415b9d242989f28f349c1618c74"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:50336
I20260709 12:09:49.841182 17946 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:49.841540 17946 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.833730 18018 raft_consensus.cc:2955] T 1372b5e0da1c481fb926410510c94341 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:49.850785 18870 raft_consensus.cc:1064] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
W20260709 12:09:49.851202 18870 raft_consensus.cc:1068] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1: Unable to promote non-voter e28f77912a9c4ba2b9841f6fedddc2db: Service unavailable: leader transfer in progress
I20260709 12:09:49.860575 17946 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:49.861771 18091 raft_consensus.cc:1275] T 92e1586ba70a4331be2a55f4a31dd687 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:49.863813 17946 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:49.863937 18641 raft_consensus.cc:1275] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:49.865644 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:49.866262 18091 raft_consensus.cc:3055] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.866551 18091 raft_consensus.cc:740] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:49.866468 19082 consensus_queue.cc:1048] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:49.867367 18091 consensus_queue.cc:260] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:49.868330 18091 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.868800 19082 consensus_queue.cc:1048] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:49.875638 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:49.876163 18018 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.879312 17944 raft_consensus.cc:1275] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:49.883870 19019 consensus_queue.cc:1048] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:49.890074 18018 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:09:49.895938 17913 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:49.896726 19078 raft_consensus.cc:2804] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:49.897210 19078 raft_consensus.cc:697] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:09:49.897982 19078 consensus_queue.cc:237] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:49.875916 18091 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:09:49.911509 17946 consensus_queue.cc:237] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:49.916699 18921 raft_consensus.cc:1064] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:09:49.919677 18921 consensus_queue.cc:237] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:49.924551 18978 raft_consensus.cc:2955] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:49.928654 18643 raft_consensus.cc:1275] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:49.928876 18644 raft_consensus.cc:2955] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:49.930465 19037 consensus_queue.cc:1048] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:49.939960 19035 raft_consensus.cc:2955] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:49.943917 18640 raft_consensus.cc:2955] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:49.949586 18091 raft_consensus.cc:1275] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:49.950133 17843 catalog_manager.cc:5697] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:49.952914 19069 raft_consensus.cc:993] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110: : Instructing follower e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:09:49.953397 19069 raft_consensus.cc:1081] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Signalling peer e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:09:49.955348 18644 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:60412
I20260709 12:09:49.955266 18870 consensus_queue.cc:1048] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:49.955958 18644 raft_consensus.cc:493] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:49.956305 18644 raft_consensus.cc:3060] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.961050 19037 raft_consensus.cc:993] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1: : Instructing follower 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:09:49.960369 18091 raft_consensus.cc:2955] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:49.967403 18641 raft_consensus.cc:1275] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:49.968900 18921 consensus_queue.cc:1048] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:49.970623 18644 raft_consensus.cc:515] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:49.970958 18018 raft_consensus.cc:1275] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:49.973193 17946 raft_consensus.cc:2955] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:49.980685 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:49.981230 18093 raft_consensus.cc:3055] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:49.981505 18093 raft_consensus.cc:740] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:49.982625 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:49.982267 18093 consensus_queue.cc:260] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:49.983170 17945 raft_consensus.cc:3060] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.983486 18093 raft_consensus.cc:3060] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:49.990403 18644 leader_election.cc:290] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:49.991027 18921 consensus_queue.cc:1048] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:49.991987 19037 raft_consensus.cc:1081] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Signalling peer 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:09:49.994165 18093 raft_consensus.cc:2468] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:09:49.995158 17945 raft_consensus.cc:2468] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:09:49.995568 18609 leader_election.cc:304] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:09:49.996517 19059 raft_consensus.cc:2804] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:49.998966 18093 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:53964
I20260709 12:09:50.002851 17832 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1372b5e0da1c481fb926410510c94341 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:49.999523 18093 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:50.004907 18093 raft_consensus.cc:3060] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.005890 17946 raft_consensus.cc:1275] T 6135c6398c3f4926b6f07433b6f63759 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:50.014422 19069 consensus_queue.cc:1048] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:50.020583 18093 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:50.025833 18093 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:50.026280 19050 raft_consensus.cc:993] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110: : Instructing follower e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:09:50.026859 19068 raft_consensus.cc:1081] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Signalling peer e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:09:50.028347 18640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:60412
I20260709 12:09:50.029211 18640 raft_consensus.cc:493] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:50.029561 18640 raft_consensus.cc:3060] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.031767 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:50.032341 17946 raft_consensus.cc:3055] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:50.032438 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:50.033077 18018 raft_consensus.cc:3060] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.036339 18640 raft_consensus.cc:515] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:50.037189 17847 catalog_manager.cc:5697] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New cstate: current_term: 1 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:50.032665 17946 raft_consensus.cc:740] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:09:50.039464 17946 consensus_queue.cc:260] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:50.041905 18640 leader_election.cc:290] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:50.042601 17946 raft_consensus.cc:3060] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:09:50.043212 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 95359us
I20260709 12:09:50.047284 18018 raft_consensus.cc:2468] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:09:50.049490 18024 consensus_queue.cc:237] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:50.050480 19050 raft_consensus.cc:2955] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:50.052938 18019 raft_consensus.cc:2955] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:50.039109 17847 catalog_manager.cc:5697] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 1 to 2, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:50.041013 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:50.059302 18093 raft_consensus.cc:3055] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:50.059633 18093 raft_consensus.cc:740] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:50.060343 18093 consensus_queue.cc:260] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:50.061589 18093 raft_consensus.cc:3060] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.064898 18640 raft_consensus.cc:1275] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:50.067548 17944 raft_consensus.cc:1275] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:50.068929 19082 consensus_queue.cc:1048] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:50.069654 19019 consensus_queue.cc:1048] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:50.073786 18093 raft_consensus.cc:2468] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:09:50.052665 18062 leader_election.cc:304] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:50.040653 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:50.083417 18021 raft_consensus.cc:3060] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.083568 19068 raft_consensus.cc:2804] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:50.084088 19068 raft_consensus.cc:697] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:50.085011 19068 consensus_queue.cc:237] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:50.079237 18978 raft_consensus.cc:2955] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:50.094856 17947 raft_consensus.cc:2955] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:50.103154 18609 leader_election.cc:304] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:09:50.104468 19094 raft_consensus.cc:2804] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:50.104939 19094 raft_consensus.cc:697] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:09:50.105777 19094 consensus_queue.cc:237] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:50.107297 18640 raft_consensus.cc:2955] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:50.116302 19059 raft_consensus.cc:697] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:09:50.105361 17845 catalog_manager.cc:5697] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:50.119657 19059 consensus_queue.cc:237] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:50.122051 17947 raft_consensus.cc:2955] T 6135c6398c3f4926b6f07433b6f63759 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:50.105425 18021 raft_consensus.cc:2468] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:09:50.130529 17832 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 92e1586ba70a4331be2a55f4a31dd687 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:50.131760 18640 raft_consensus.cc:2955] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:50.134994 19005 raft_consensus.cc:993] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb: : Instructing follower 63f5bddeebd84e5788d671a176cfa8e1 to start an election
I20260709 12:09:50.135452 19005 raft_consensus.cc:1081] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Signalling peer 63f5bddeebd84e5788d671a176cfa8e1 to start an election
I20260709 12:09:50.137920 17947 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:50334
I20260709 12:09:50.138574 17947 raft_consensus.cc:493] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:50.139001 17947 raft_consensus.cc:3060] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.145207 17947 raft_consensus.cc:515] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:50.156962 19050 raft_consensus.cc:993] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110: : Instructing follower e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:09:50.157773 19050 raft_consensus.cc:1081] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Signalling peer e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:09:50.152733 18005 tablet_service.cc:1558] Processing DeleteTablet for tablet 1372b5e0da1c481fb926410510c94341 with delete_type TABLET_DATA_TOMBSTONED (TS c5ffa786c8fb43f7864fa8fbe76534cb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45450
I20260709 12:09:50.149808 17946 raft_consensus.cc:2468] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:09:50.162542 17947 leader_election.cc:290] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:50.156447 17843 catalog_manager.cc:5697] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 1 to 2, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 2 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:50.163368 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:50.163940 18021 raft_consensus.cc:3055] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:50.164225 18021 raft_consensus.cc:740] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:09:50.164883 18021 consensus_queue.cc:260] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:50.165907 18021 raft_consensus.cc:3060] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.165855 18641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:60412
I20260709 12:09:50.166549 18641 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:50.166935 18641 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.173574 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:50.174113 18093 raft_consensus.cc:3060] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.176908 18021 raft_consensus.cc:2468] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:09:50.178036 17913 leader_election.cc:304] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:50.178790 18933 raft_consensus.cc:2804] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:50.179204 18933 raft_consensus.cc:697] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:09:50.179908 18933 consensus_queue.cc:237] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:50.181125 18093 raft_consensus.cc:2468] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:09:50.180800 17846 catalog_manager.cc:5697] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:50.185258 19068 raft_consensus.cc:993] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110: : Instructing follower 63f5bddeebd84e5788d671a176cfa8e1 to start an election
I20260709 12:09:50.186110 19050 raft_consensus.cc:1081] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Signalling peer 63f5bddeebd84e5788d671a176cfa8e1 to start an election
I20260709 12:09:50.187973 17947 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a474344628f842a781e714727d867c3a"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:50336
I20260709 12:09:50.188530 17947 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:50.188859 17947 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:50.194507 17947 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:50.194906 18641 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:50.199745 18641 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:50.200922 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:50.201519 18021 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:50.199776 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:50.202767 17947 leader_election.cc:290] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:50.202930 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:50.203255 17945 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.203459 18091 raft_consensus.cc:3055] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:50.203827 18091 raft_consensus.cc:740] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:50.204689 18091 consensus_queue.cc:260] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:50.205987 18091 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:50.208595 17844 catalog_manager.cc:5697] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 1 to 2, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 2 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:50.197041 19099 tablet_replica.cc:333] T 1372b5e0da1c481fb926410510c94341 P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:09:50.211308 18080 tablet_service.cc:1558] Processing DeleteTablet for tablet 92e1586ba70a4331be2a55f4a31dd687 with delete_type TABLET_DATA_TOMBSTONED (TS 4813437da0a74e65b61eb7bd1d18f110 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53944
I20260709 12:09:50.211790 19099 raft_consensus.cc:2243] T 1372b5e0da1c481fb926410510c94341 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:50.202198 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:50.213152 18093 raft_consensus.cc:3055] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:50.219110 18093 raft_consensus.cc:740] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:50.220078 18091 raft_consensus.cc:2468] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3.
I20260709 12:09:50.212630 19099 raft_consensus.cc:2272] T 1372b5e0da1c481fb926410510c94341 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:50.222944 18093 consensus_queue.cc:260] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:50.224550 18097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:53944
I20260709 12:09:50.224974 18093 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:50.225077 18097 raft_consensus.cc:606] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:09:50.225749 17914 leader_election.cc:304] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:09:50.226634 19078 raft_consensus.cc:2804] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:50.228726 18090 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:53944
I20260709 12:09:50.229290 18090 raft_consensus.cc:606] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:09:50.227133 19078 raft_consensus.cc:697] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
W20260709 12:09:50.231809 17833 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 53fdd1cc63be4f3b8a533d34af81d0c6 already in progress [suppressed 4 similar messages]
I20260709 12:09:50.232067 19078 consensus_queue.cc:237] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:50.237301 17847 catalog_manager.cc:5697] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 1 to 2, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:50.227075 17845 catalog_manager.cc:5697] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 1 to 2, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 2 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:50.243662 17945 raft_consensus.cc:2468] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:09:50.239459 19099 ts_tablet_manager.cc:1916] T 1372b5e0da1c481fb926410510c94341 P c5ffa786c8fb43f7864fa8fbe76534cb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:50.244772 18608 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:09:50.245656 19059 raft_consensus.cc:2804] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:50.246253 19059 raft_consensus.cc:697] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:09:50.247403 19059 consensus_queue.cc:237] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:50.249419 17940 raft_consensus.cc:1240] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:50.254527 18091 consensus_queue.cc:237] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:50.258889 18097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:53944
I20260709 12:09:50.259425 18097 raft_consensus.cc:606] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:09:50.263710 18021 raft_consensus.cc:2468] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3.
W20260709 12:09:50.264582 17894 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:09:50.265008 17894 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 53fdd1cc63be4f3b8a533d34af81d0c6 already in progress
W20260709 12:09:50.265311 17894 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 53fdd1cc63be4f3b8a533d34af81d0c6 already in progress
I20260709 12:09:50.278514 18640 raft_consensus.cc:1275] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:50.280511 19068 consensus_queue.cc:1048] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:50.290941 18921 raft_consensus.cc:2955] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:50.292512 18640 raft_consensus.cc:2955] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:50.290390 17847 catalog_manager.cc:5697] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 1 to 2, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 2 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:50.300800 18019 raft_consensus.cc:1275] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:50.302520 18018 raft_consensus.cc:1275] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:50.304134 19068 consensus_queue.cc:1048] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:50.304826 19078 consensus_queue.cc:1048] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.311220 17833 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6135c6398c3f4926b6f07433b6f63759 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:50.311220 18018 raft_consensus.cc:2955] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:50.316473 17845 catalog_manager.cc:5697] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 2 to 3, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 3 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:50.319422 19099 ts_tablet_manager.cc:1929] T 1372b5e0da1c481fb926410510c94341 P c5ffa786c8fb43f7864fa8fbe76534cb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:50.319904 19099 log.cc:1199] T 1372b5e0da1c481fb926410510c94341 P c5ffa786c8fb43f7864fa8fbe76534cb: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-1-root/wals/1372b5e0da1c481fb926410510c94341
I20260709 12:09:50.321846 17832 catalog_manager.cc:5028] TS c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): tablet 1372b5e0da1c481fb926410510c94341 (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:09:50.325680 17846 catalog_manager.cc:5697] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:50.335417 19101 tablet_replica.cc:333] T 92e1586ba70a4331be2a55f4a31dd687 P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:09:50.336501 19101 raft_consensus.cc:2243] T 92e1586ba70a4331be2a55f4a31dd687 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:50.337054 19101 pending_rounds.cc:70] T 92e1586ba70a4331be2a55f4a31dd687 P 4813437da0a74e65b61eb7bd1d18f110: Trying to abort 1 pending ops.
I20260709 12:09:50.337349 19101 pending_rounds.cc:77] T 92e1586ba70a4331be2a55f4a31dd687 P 4813437da0a74e65b61eb7bd1d18f110: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305621462356701184 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "92e1586ba70a4331be2a55f4a31dd687" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } } }
I20260709 12:09:50.339027 19101 raft_consensus.cc:2917] T 92e1586ba70a4331be2a55f4a31dd687 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 12:09:50.339444 19101 raft_consensus.cc:2889] T 92e1586ba70a4331be2a55f4a31dd687 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:09:50.339823 19101 raft_consensus.cc:2272] T 92e1586ba70a4331be2a55f4a31dd687 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:50.343333 19101 ts_tablet_manager.cc:1916] T 92e1586ba70a4331be2a55f4a31dd687 P 4813437da0a74e65b61eb7bd1d18f110: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:50.347491 17933 tablet_service.cc:1558] Processing DeleteTablet for tablet 6135c6398c3f4926b6f07433b6f63759 with delete_type TABLET_DATA_TOMBSTONED (TS 63f5bddeebd84e5788d671a176cfa8e1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50326
I20260709 12:09:50.350044 18093 raft_consensus.cc:2468] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:09:50.377712 19106 tablet_replica.cc:333] T 6135c6398c3f4926b6f07433b6f63759 P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:09:50.379007 19106 raft_consensus.cc:2243] T 6135c6398c3f4926b6f07433b6f63759 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:50.380779 19106 raft_consensus.cc:2272] T 6135c6398c3f4926b6f07433b6f63759 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:50.384639 19106 ts_tablet_manager.cc:1916] T 6135c6398c3f4926b6f07433b6f63759 P 63f5bddeebd84e5788d671a176cfa8e1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:50.395596 18093 raft_consensus.cc:1275] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:50.395723 19101 ts_tablet_manager.cc:1929] T 92e1586ba70a4331be2a55f4a31dd687 P 4813437da0a74e65b61eb7bd1d18f110: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:50.396468 19101 log.cc:1199] T 92e1586ba70a4331be2a55f4a31dd687 P 4813437da0a74e65b61eb7bd1d18f110: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-2-root/wals/92e1586ba70a4331be2a55f4a31dd687
I20260709 12:09:50.398173 17833 catalog_manager.cc:5028] TS 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): tablet 92e1586ba70a4331be2a55f4a31dd687 (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:09:50.398840 19035 consensus_queue.cc:1048] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.402098 19106 ts_tablet_manager.cc:1929] T 6135c6398c3f4926b6f07433b6f63759 P 63f5bddeebd84e5788d671a176cfa8e1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:50.402572 19106 log.cc:1199] T 6135c6398c3f4926b6f07433b6f63759 P 63f5bddeebd84e5788d671a176cfa8e1: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-0-root/wals/6135c6398c3f4926b6f07433b6f63759
I20260709 12:09:50.404749 17832 catalog_manager.cc:5028] TS 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): tablet 6135c6398c3f4926b6f07433b6f63759 (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:09:50.547899 17940 raft_consensus.cc:1275] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:50.548966 19059 consensus_queue.cc:1048] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:50.559891 18091 raft_consensus.cc:1275] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:50.560137 18024 raft_consensus.cc:1275] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:50.561393 19094 consensus_queue.cc:1048] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:50.561733 19068 consensus_queue.cc:1048] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:50.567696 18641 raft_consensus.cc:3060] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Advancing to term 2
I20260709 12:09:50.575395 18641 raft_consensus.cc:1275] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEARNER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:50.576215 17940 raft_consensus.cc:1275] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:50.579023 18921 consensus_queue.cc:1048] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:50.580183 19050 consensus_queue.cc:1048] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:50.584791 19050 raft_consensus.cc:993] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110: : Instructing follower c5ffa786c8fb43f7864fa8fbe76534cb to start an election
I20260709 12:09:50.585242 18921 raft_consensus.cc:1081] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Signalling peer c5ffa786c8fb43f7864fa8fbe76534cb to start an election
I20260709 12:09:50.587261 18018 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
 from {username='slave'} at 127.0.0.1:45472
I20260709 12:09:50.587733 18018 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:50.588061 18018 raft_consensus.cc:3060] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:50.592330 18021 raft_consensus.cc:1275] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:50.594170 19094 consensus_queue.cc:1048] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:50.601096 18018 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:50.605613 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:50.605784 18024 raft_consensus.cc:1240] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:50.607100 18921 consensus_queue.cc:1059] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:50.609000 18921 raft_consensus.cc:3055] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:50.609309 18921 raft_consensus.cc:740] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:50.610831 18921 consensus_queue.cc:260] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:50.612221 18921 raft_consensus.cc:3060] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:50.626834 18018 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:50.628939 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:50.639356 18093 raft_consensus.cc:1275] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:50.644501 19059 consensus_queue.cc:1048] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:50.646883 18093 raft_consensus.cc:1275] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:50.648053 18097 raft_consensus.cc:1275] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:50.650480 18933 consensus_queue.cc:1048] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.650730 19092 consensus_queue.cc:1048] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:50.667243 18021 raft_consensus.cc:1275] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:09:50.669116 18091 raft_consensus.cc:2468] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:09:50.669754 18933 consensus_queue.cc:1048] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.685945 17989 leader_election.cc:304] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:50.687565 19090 raft_consensus.cc:2804] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:50.688601 19090 raft_consensus.cc:697] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:09:50.690188 19090 consensus_queue.cc:237] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:50.701924 17940 raft_consensus.cc:1275] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:50.704689 19092 consensus_queue.cc:1048] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:50.717422 17846 catalog_manager.cc:5697] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 2 to 3, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 3 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:50.745015 18095 raft_consensus.cc:1275] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:50.746032 18933 consensus_queue.cc:1048] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.754534 18024 raft_consensus.cc:1275] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:50.756377 19037 consensus_queue.cc:1048] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:50.931605 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:50.971017 17940 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
mode: GRACEFUL
new_leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:09:50.971549 17940 raft_consensus.cc:606] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Received request to transfer leadership to TS e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:50.974076 17940 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3cdd445b25e5404da2f578c388210925"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:09:50.974521 17940 raft_consensus.cc:606] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:09:50.977447 18024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
mode: GRACEFUL
new_leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:44098
I20260709 12:09:50.977972 18024 raft_consensus.cc:606] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Received request to transfer leadership to TS 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:50.980399 17940 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:09:50.980962 17940 raft_consensus.cc:606] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:09:50.984089 18095 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
mode: GRACEFUL
new_leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:40154
I20260709 12:09:50.984611 18095 raft_consensus.cc:606] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Received request to transfer leadership to TS e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:50.986689 18095 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9b0c864d78846698db31224c547a091"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
mode: GRACEFUL
new_leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:40154
I20260709 12:09:50.987047 18095 raft_consensus.cc:606] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Received request to transfer leadership to TS e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:50.987860 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:09:50.988858 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:50.989346 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:51.041577 19068 raft_consensus.cc:993] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110: : Instructing follower e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:09:51.042080 18921 raft_consensus.cc:1081] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Signalling peer e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:09:51.043283 18643 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:60412
I20260709 12:09:51.043713 18643 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:51.043977 18643 raft_consensus.cc:3060] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.048148 18643 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:51.049582 18643 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:51.050258 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:51.050556 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:51.050872 17940 raft_consensus.cc:3060] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.051106 18095 raft_consensus.cc:3055] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:51.051416 18095 raft_consensus.cc:740] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:51.052026 18095 consensus_queue.cc:260] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:51.052852 18095 raft_consensus.cc:3060] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.055332 17940 raft_consensus.cc:2468] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:09:51.056247 18608 leader_election.cc:304] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:09:51.056938 19092 raft_consensus.cc:2804] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:51.057410 19092 raft_consensus.cc:697] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:09:51.057457 18095 raft_consensus.cc:2468] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:09:51.058262 19092 consensus_queue.cc:237] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:51.066931 19037 raft_consensus.cc:993] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1: : Instructing follower 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:09:51.067525 19035 raft_consensus.cc:1081] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Signalling peer 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:09:51.067443 17845 catalog_manager.cc:5697] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 1 to 2, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 2 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:51.068819 18095 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3cdd445b25e5404da2f578c388210925"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:53964
I20260709 12:09:51.069296 18095 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:51.069615 18095 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.075326 18095 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:51.078354 18095 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:51.079416 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:51.079448 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:51.079973 18024 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.080066 17947 raft_consensus.cc:3055] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:51.080470 17947 raft_consensus.cc:740] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:09:51.081038 17947 consensus_queue.cc:260] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:51.081769 17947 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.084597 18024 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:09:51.085644 18062 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:51.086174 17947 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:09:51.086272 18921 raft_consensus.cc:2804] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:51.086829 18921 raft_consensus.cc:697] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:51.087574 18921 consensus_queue.cc:237] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:51.096724 17845 catalog_manager.cc:5697] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 1 to 2, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 2 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:51.101712 18643 raft_consensus.cc:3060] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEARNER]: Advancing to term 3
I20260709 12:09:51.108881 19082 raft_consensus.cc:993] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb: : Instructing follower 63f5bddeebd84e5788d671a176cfa8e1 to start an election
I20260709 12:09:51.109390 19082 raft_consensus.cc:1081] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Signalling peer 63f5bddeebd84e5788d671a176cfa8e1 to start an election
I20260709 12:09:51.110821 17947 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:50334
I20260709 12:09:51.111267 18643 raft_consensus.cc:1275] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEARNER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:09:51.111307 17947 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:51.111846 17947 raft_consensus.cc:3060] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.112834 19127 consensus_queue.cc:1048] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:51.117753 19127 raft_consensus.cc:1064] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:09:51.117720 17947 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:09:51.118278 19127 raft_consensus.cc:1068] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb: Unable to promote non-voter e28f77912a9c4ba2b9841f6fedddc2db: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:09:51.119520 17947 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:51.120560 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:51.121096 18024 raft_consensus.cc:3055] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:51.121392 18024 raft_consensus.cc:740] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:09:51.122099 18024 consensus_queue.cc:260] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:51.123212 18024 raft_consensus.cc:3060] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.122864 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:51.124092 18095 raft_consensus.cc:3060] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.130180 18024 raft_consensus.cc:2468] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:09:51.130180 18095 raft_consensus.cc:2468] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:09:51.131305 17913 leader_election.cc:304] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:51.132011 19035 raft_consensus.cc:2804] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:51.132377 19035 raft_consensus.cc:697] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:09:51.132936 19035 consensus_queue.cc:237] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:51.142499 17845 catalog_manager.cc:5697] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 1 to 2, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:51.200162 17947 raft_consensus.cc:3060] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:51.205729 17947 raft_consensus.cc:1275] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:09:51.207177 19127 consensus_queue.cc:1048] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:51.214879 18093 raft_consensus.cc:1275] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:09:51.216178 19082 consensus_queue.cc:1048] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:51.256474 19127 raft_consensus.cc:1064] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:09:51.258378 19127 consensus_queue.cc:237] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:51.264043 18093 raft_consensus.cc:1275] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:09:51.265151 19129 consensus_queue.cc:1048] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:51.265872 18643 raft_consensus.cc:1275] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEARNER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:09:51.267545 17940 raft_consensus.cc:1275] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:09:51.268700 19129 consensus_queue.cc:1048] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:51.271983 19127 consensus_queue.cc:1048] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:51.281243 19090 raft_consensus.cc:2955] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 2 to 5, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:51.282887 17940 raft_consensus.cc:2955] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:51.296120 18093 raft_consensus.cc:2955] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:51.296763 18643 raft_consensus.cc:2955] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:51.309322 17847 catalog_manager.cc:5697] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: config changed from index 2 to 5, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:51.317299 19037 raft_consensus.cc:993] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1: : Instructing follower e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:09:51.317754 19037 raft_consensus.cc:1081] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Signalling peer e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:09:51.319228 18640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:60430
I20260709 12:09:51.319774 18640 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:51.320133 18640 raft_consensus.cc:3060] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.331749 18640 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:51.333483 18640 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:51.334028 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:51.334586 17940 raft_consensus.cc:3055] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:51.334889 17940 raft_consensus.cc:740] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:09:51.335368 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:51.335791 18021 raft_consensus.cc:3060] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.335561 17940 consensus_queue.cc:260] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:51.336843 17940 raft_consensus.cc:3060] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.338785 18024 consensus_queue.cc:237] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:51.340435 18021 raft_consensus.cc:2468] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:09:51.341300 18608 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:09:51.342046 19059 raft_consensus.cc:2804] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:51.342523 19059 raft_consensus.cc:697] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:09:51.343528 18640 raft_consensus.cc:1275] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:09:51.343384 19059 consensus_queue.cc:237] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:51.344606 17947 raft_consensus.cc:1275] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:09:51.346079 19127 consensus_queue.cc:1048] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:09:51.348116 19129 consensus_queue.cc:1048] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:09:51.349128 17940 raft_consensus.cc:2468] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:09:51.355654 19082 raft_consensus.cc:2955] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:51.356930 17940 raft_consensus.cc:2955] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:51.358513 18643 raft_consensus.cc:2955] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:51.366799 17832 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 53fdd1cc63be4f3b8a533d34af81d0c6 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:51.369159 17845 catalog_manager.cc:5697] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 1 to 2, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 2 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:51.379851 17846 catalog_manager.cc:5697] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: config changed from index 5 to 6, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New cstate: current_term: 3 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:51.394022 18080 tablet_service.cc:1558] Processing DeleteTablet for tablet 53fdd1cc63be4f3b8a533d34af81d0c6 with delete_type TABLET_DATA_TOMBSTONED (TS 4813437da0a74e65b61eb7bd1d18f110 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:53944
I20260709 12:09:51.398393 19134 tablet_replica.cc:333] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:09:51.399290 19134 raft_consensus.cc:2243] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:51.399820 19134 raft_consensus.cc:2272] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:51.402493 19134 ts_tablet_manager.cc:1916] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:51.416213 19068 raft_consensus.cc:993] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110: : Instructing follower e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:09:51.416707 19068 raft_consensus.cc:1081] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Signalling peer e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:09:51.417212 19134 ts_tablet_manager.cc:1929] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:09:51.417610 19134 log.cc:1199] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 4813437da0a74e65b61eb7bd1d18f110: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-2-root/wals/53fdd1cc63be4f3b8a533d34af81d0c6
I20260709 12:09:51.418509 18643 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f9b0c864d78846698db31224c547a091"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:60412
I20260709 12:09:51.419065 18643 raft_consensus.cc:493] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:51.419386 18643 raft_consensus.cc:3060] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.423121 17833 catalog_manager.cc:5028] TS 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): tablet 53fdd1cc63be4f3b8a533d34af81d0c6 (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:09:51.426606 18643 raft_consensus.cc:515] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:51.428102 18643 leader_election.cc:290] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:51.428804 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:51.429064 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:51.429358 17940 raft_consensus.cc:3060] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.429581 18093 raft_consensus.cc:3055] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:51.429951 18093 raft_consensus.cc:740] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:51.430629 18093 consensus_queue.cc:260] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:51.431458 18093 raft_consensus.cc:3060] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.435374 17940 raft_consensus.cc:2468] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:09:51.435745 18093 raft_consensus.cc:2468] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:09:51.436767 18608 leader_election.cc:304] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:09:51.437515 19059 raft_consensus.cc:2804] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:51.437935 19059 raft_consensus.cc:697] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:09:51.438802 19059 consensus_queue.cc:237] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:51.446976 17844 catalog_manager.cc:5697] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 1 to 2, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 2 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:51.457942 18024 consensus_queue.cc:237] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:51.463663 18093 raft_consensus.cc:1275] T 28dbc0f2cd704e82b686ffe4c9b9967e P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:51.463989 17987 consensus_peers.cc:597] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 28dbc0f2cd704e82b686ffe4c9b9967e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:51.463663 17940 raft_consensus.cc:1275] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:51.466426 19090 consensus_queue.cc:1048] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:51.467335 19082 consensus_queue.cc:1048] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:51.482563 19090 raft_consensus.cc:2955] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:51.484038 17947 raft_consensus.cc:2955] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:51.491710 18097 raft_consensus.cc:2955] T 28dbc0f2cd704e82b686ffe4c9b9967e P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:51.498075 18933 raft_consensus.cc:993] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1: : Instructing follower 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:09:51.498555 18933 raft_consensus.cc:1081] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Signalling peer 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:09:51.500294 18093 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:53964
I20260709 12:09:51.500772 18093 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:51.501103 18093 raft_consensus.cc:3060] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.501624 17947 raft_consensus.cc:1275] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:51.505025 19059 consensus_queue.cc:1048] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:51.518055 18097 raft_consensus.cc:1275] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:51.505455 17844 catalog_manager.cc:5697] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:51.519457 19059 consensus_queue.cc:1048] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:51.523017 18093 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:51.524883 18093 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:51.526571 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:51.527122 18024 raft_consensus.cc:3060] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.527670 18093 raft_consensus.cc:1275] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:51.530807 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:51.531850 17944 raft_consensus.cc:3055] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:51.532140 17944 raft_consensus.cc:740] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:09:51.532997 19037 consensus_queue.cc:1048] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:51.533512 17940 consensus_queue.cc:237] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:51.551915 18021 raft_consensus.cc:1275] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:51.532836 17944 consensus_queue.cc:260] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:09:51.554512 17912 consensus_peers.cc:597] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7b8822f4f1de477e8866529047a823b9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:51.555332 17944 raft_consensus.cc:3060] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:51.555859 18933 consensus_queue.cc:1048] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:51.561245 18097 raft_consensus.cc:1275] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:51.562822 18018 raft_consensus.cc:1275] T 7b8822f4f1de477e8866529047a823b9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:51.566025 18933 consensus_queue.cc:1048] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:51.572696 19035 consensus_queue.cc:1048] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:51.582198 18024 raft_consensus.cc:2468] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:09:51.592171 18062 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:51.593001 19130 raft_consensus.cc:2804] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:51.593654 19130 raft_consensus.cc:697] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:51.589902 17944 raft_consensus.cc:2468] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:09:51.594901 19130 consensus_queue.cc:237] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:51.622637 17947 raft_consensus.cc:1275] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:51.625532 19130 consensus_queue.cc:1048] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:51.633478 17844 catalog_manager.cc:5697] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 1 to 2, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 2 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:51.641307 19143 raft_consensus.cc:2955] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:51.657519 18024 raft_consensus.cc:2955] T 7b8822f4f1de477e8866529047a823b9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:51.667233 18018 raft_consensus.cc:1275] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:51.668812 19130 consensus_queue.cc:1048] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:51.683144 18093 consensus_queue.cc:237] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
W20260709 12:09:51.691004 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 53900.5us
I20260709 12:09:51.694763 18091 raft_consensus.cc:2955] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
W20260709 12:09:51.715747 18061 consensus_peers.cc:597] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4ccf0bcc20ae40e79c32530091613e1e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:51.715975 17847 catalog_manager.cc:5697] T 7b8822f4f1de477e8866529047a823b9 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 1 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:51.719475 17947 raft_consensus.cc:1275] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:51.720505 18018 raft_consensus.cc:1275] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:51.721107 19130 consensus_queue.cc:1048] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:51.725909 19068 consensus_queue.cc:1048] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:51.757544 19068 raft_consensus.cc:2955] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:51.759270 17944 raft_consensus.cc:2955] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:51.770427 18018 raft_consensus.cc:2955] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:51.776696 17944 consensus_queue.cc:237] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:51.777686 17844 catalog_manager.cc:5697] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
W20260709 12:09:51.784541 17912 consensus_peers.cc:597] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9bb1ec98e5b847df8a401343514ac12d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:51.785795 18091 raft_consensus.cc:1275] T 9bb1ec98e5b847df8a401343514ac12d P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:51.787880 18933 consensus_queue.cc:1048] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:51.788655 18018 raft_consensus.cc:1275] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:51.791391 18933 consensus_queue.cc:1048] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:51.798518 18933 raft_consensus.cc:2955] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:51.799235 18091 raft_consensus.cc:2955] T 9bb1ec98e5b847df8a401343514ac12d P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:51.821420 18018 raft_consensus.cc:2955] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:51.825341 17844 catalog_manager.cc:5697] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 1 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:51.913009 17944 raft_consensus.cc:1275] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:51.914091 19059 consensus_queue.cc:1048] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:51.924233 18018 raft_consensus.cc:1275] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:51.926728 19092 consensus_queue.cc:1048] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:51.933033 19159 ts_tablet_manager.cc:933] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:51.945953 17944 raft_consensus.cc:1275] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:51.947764 19059 consensus_queue.cc:1048] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:51.993909 18091 raft_consensus.cc:1275] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:51.996233 19094 consensus_queue.cc:1048] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:52.008682 18018 raft_consensus.cc:1275] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:52.011358 18921 consensus_queue.cc:1048] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:52.027602 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:52.043397 19159 tablet_copy_client.cc:323] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.194:36297
I20260709 12:09:52.051347 17947 raft_consensus.cc:1275] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:52.052474 18033 tablet_copy_service.cc:140] P c5ffa786c8fb43f7864fa8fbe76534cb: Received BeginTabletCopySession request for tablet 28dbc0f2cd704e82b686ffe4c9b9967e from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:53022)
I20260709 12:09:52.053030 18033 tablet_copy_service.cc:161] P c5ffa786c8fb43f7864fa8fbe76534cb: Beginning new tablet copy session on tablet 28dbc0f2cd704e82b686ffe4c9b9967e from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:53022: session id = e28f77912a9c4ba2b9841f6fedddc2db-28dbc0f2cd704e82b686ffe4c9b9967e
I20260709 12:09:52.060232 18033 tablet_copy_source_session.cc:215] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:52.065167 18921 consensus_queue.cc:1048] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:52.072980 19159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28dbc0f2cd704e82b686ffe4c9b9967e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:52.117157 19159 tablet_copy_client.cc:806] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:52.118139 19159 tablet_copy_client.cc:670] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:52.122063 19159 tablet_copy_client.cc:538] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:52.133719 19159 tablet_bootstrap.cc:492] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:09:52.147543 19166 ts_tablet_manager.cc:933] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123)
I20260709 12:09:52.160925 19166 tablet_copy_client.cc:323] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.193:39123
I20260709 12:09:52.162252 17944 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:09:52.162783 17944 raft_consensus.cc:606] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:09:52.162847 17959 tablet_copy_service.cc:140] P 63f5bddeebd84e5788d671a176cfa8e1: Received BeginTabletCopySession request for tablet 7b8822f4f1de477e8866529047a823b9 from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:44668)
I20260709 12:09:52.163400 17959 tablet_copy_service.cc:161] P 63f5bddeebd84e5788d671a176cfa8e1: Beginning new tablet copy session on tablet 7b8822f4f1de477e8866529047a823b9 from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:44668: session id = e28f77912a9c4ba2b9841f6fedddc2db-7b8822f4f1de477e8866529047a823b9
I20260709 12:09:52.167451 19159 tablet_bootstrap.cc:492] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:52.168327 19159 tablet_bootstrap.cc:492] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:09:52.168797 17959 tablet_copy_source_session.cc:215] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:52.169019 19159 ts_tablet_manager.cc:1403] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.036s	user 0.028s	sys 0.001s
I20260709 12:09:52.171628 18018 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
mode: GRACEFUL
new_leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:44098
I20260709 12:09:52.172149 18018 raft_consensus.cc:606] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Received request to transfer leadership to TS e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:52.172412 19166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b8822f4f1de477e8866529047a823b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:52.172966 19159 raft_consensus.cc:359] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:52.174098 19159 raft_consensus.cc:740] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:09:52.174741 19159 consensus_queue.cc:260] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:52.177466 19159 ts_tablet_manager.cc:1434] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:09:52.180714 18033 tablet_copy_service.cc:342] P c5ffa786c8fb43f7864fa8fbe76534cb: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-28dbc0f2cd704e82b686ffe4c9b9967e received from {username='slave'} at 127.0.0.1:53022
I20260709 12:09:52.181125 18033 tablet_copy_service.cc:434] P c5ffa786c8fb43f7864fa8fbe76534cb: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-28dbc0f2cd704e82b686ffe4c9b9967e on tablet 28dbc0f2cd704e82b686ffe4c9b9967e with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:52.180953 18091 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
mode: GRACEFUL
new_leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:40154
I20260709 12:09:52.181653 18091 raft_consensus.cc:606] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Received request to transfer leadership to TS e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:52.185807 18091 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
mode: GRACEFUL
new_leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:40154
I20260709 12:09:52.186342 18091 raft_consensus.cc:606] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Received request to transfer leadership to TS 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:52.190505 18018 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:44098
I20260709 12:09:52.191033 18018 raft_consensus.cc:606] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:09:52.193432 19166 tablet_copy_client.cc:806] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:52.194025 19166 tablet_copy_client.cc:670] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:52.199842 19143 raft_consensus.cc:993] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1: : Instructing follower 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:09:52.200269 19143 raft_consensus.cc:1081] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Signalling peer 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:09:52.201377 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:09:52.201453 19159 ts_tablet_manager.cc:933] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:52.204970 19159 tablet_copy_client.cc:323] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.195:41931
I20260709 12:09:52.205615 18095 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:53964
I20260709 12:09:52.206367 18095 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:52.206471 18108 tablet_copy_service.cc:140] P 4813437da0a74e65b61eb7bd1d18f110: Received BeginTabletCopySession request for tablet 4ccf0bcc20ae40e79c32530091613e1e from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:41818)
I20260709 12:09:52.206979 18095 raft_consensus.cc:3060] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.207132 18108 tablet_copy_service.cc:161] P 4813437da0a74e65b61eb7bd1d18f110: Beginning new tablet copy session on tablet 4ccf0bcc20ae40e79c32530091613e1e from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:41818: session id = e28f77912a9c4ba2b9841f6fedddc2db-4ccf0bcc20ae40e79c32530091613e1e
I20260709 12:09:52.212052 19166 tablet_copy_client.cc:538] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:52.215492 18095 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:52.217397 18095 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:52.218393 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:52.219316 18018 raft_consensus.cc:3060] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.219540 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:52.220081 17940 raft_consensus.cc:3055] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.220441 17940 raft_consensus.cc:740] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:09:52.221133 17940 consensus_queue.cc:260] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:52.222219 17940 raft_consensus.cc:3060] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.223218 18108 tablet_copy_source_session.cc:215] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:52.232234 19166 tablet_bootstrap.cc:492] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:09:52.233094 19159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ccf0bcc20ae40e79c32530091613e1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:52.233732 18018 raft_consensus.cc:2468] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:09:52.234931 18062 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:52.235653 18921 raft_consensus.cc:2804] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:52.236086 18921 raft_consensus.cc:697] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:52.236848 18921 consensus_queue.cc:237] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:52.249382 17940 raft_consensus.cc:2468] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:09:52.251210 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:52.251989 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:52.259414 19159 tablet_copy_client.cc:806] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:52.260008 19159 tablet_copy_client.cc:670] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:52.268241 19159 tablet_copy_client.cc:538] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:52.274209 19127 raft_consensus.cc:993] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb: : Instructing follower 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:09:52.274753 19127 raft_consensus.cc:1081] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Signalling peer 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:09:52.275310 17846 catalog_manager.cc:5697] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 1 to 2, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 2 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:52.276620 18095 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:53954
I20260709 12:09:52.277137 18095 raft_consensus.cc:493] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:52.277452 18095 raft_consensus.cc:3060] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.277463 19166 tablet_bootstrap.cc:492] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:52.278476 19166 tablet_bootstrap.cc:492] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:09:52.279117 19166 ts_tablet_manager.cc:1403] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.047s	user 0.030s	sys 0.004s
I20260709 12:09:52.281999 19166 raft_consensus.cc:359] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:52.282791 19166 raft_consensus.cc:740] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:09:52.286491 19166 consensus_queue.cc:260] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:52.288731 19159 tablet_bootstrap.cc:492] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:09:52.294468 19166 ts_tablet_manager.cc:1434] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.005s
I20260709 12:09:52.297427 17959 tablet_copy_service.cc:342] P 63f5bddeebd84e5788d671a176cfa8e1: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-7b8822f4f1de477e8866529047a823b9 received from {username='slave'} at 127.0.0.1:44668
I20260709 12:09:52.297853 17959 tablet_copy_service.cc:434] P 63f5bddeebd84e5788d671a176cfa8e1: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-7b8822f4f1de477e8866529047a823b9 on tablet 7b8822f4f1de477e8866529047a823b9 with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:52.292114 18095 raft_consensus.cc:515] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:52.300839 19172 ts_tablet_manager.cc:933] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123)
I20260709 12:09:52.301994 18095 leader_election.cc:290] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:52.303397 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:52.303447 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:52.304054 17940 raft_consensus.cc:3060] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.304107 18018 raft_consensus.cc:3055] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.312065 18018 raft_consensus.cc:740] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:09:52.313200 18018 consensus_queue.cc:260] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:52.314327 18018 raft_consensus.cc:3060] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.323451 17940 raft_consensus.cc:2468] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:09:52.324621 18062 leader_election.cc:304] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:09:52.325417 19130 raft_consensus.cc:2804] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:52.325882 19130 raft_consensus.cc:697] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:52.326990 18018 raft_consensus.cc:2468] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:09:52.327812 19130 consensus_queue.cc:237] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:52.334345 19172 tablet_copy_client.cc:323] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.193:39123
I20260709 12:09:52.336828 17959 tablet_copy_service.cc:140] P 63f5bddeebd84e5788d671a176cfa8e1: Received BeginTabletCopySession request for tablet 9bb1ec98e5b847df8a401343514ac12d from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:44668)
I20260709 12:09:52.337517 17959 tablet_copy_service.cc:161] P 63f5bddeebd84e5788d671a176cfa8e1: Beginning new tablet copy session on tablet 9bb1ec98e5b847df8a401343514ac12d from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:44668: session id = e28f77912a9c4ba2b9841f6fedddc2db-9bb1ec98e5b847df8a401343514ac12d
I20260709 12:09:52.351794 17959 tablet_copy_source_session.cc:215] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:52.359184 17847 catalog_manager.cc:5697] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 1 to 2, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 2 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:52.362784 19172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bb1ec98e5b847df8a401343514ac12d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:52.369298 19159 tablet_bootstrap.cc:492] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:52.370234 19159 tablet_bootstrap.cc:492] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:09:52.371610 19159 ts_tablet_manager.cc:1403] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.083s	user 0.015s	sys 0.022s
I20260709 12:09:52.375128 19159 raft_consensus.cc:359] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:52.376035 19159 raft_consensus.cc:740] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:09:52.376703 19159 consensus_queue.cc:260] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:52.380820 19159 ts_tablet_manager.cc:1434] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.005s
I20260709 12:09:52.385613 18108 tablet_copy_service.cc:342] P 4813437da0a74e65b61eb7bd1d18f110: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-4ccf0bcc20ae40e79c32530091613e1e received from {username='slave'} at 127.0.0.1:41818
I20260709 12:09:52.386009 18108 tablet_copy_service.cc:434] P 4813437da0a74e65b61eb7bd1d18f110: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-4ccf0bcc20ae40e79c32530091613e1e on tablet 4ccf0bcc20ae40e79c32530091613e1e with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:52.398058 19172 tablet_copy_client.cc:806] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:52.398715 19172 tablet_copy_client.cc:670] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:52.406459 18643 raft_consensus.cc:1217] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:52.408962 19172 tablet_copy_client.cc:538] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:52.417178 19172 tablet_bootstrap.cc:492] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:09:52.436475 19172 tablet_bootstrap.cc:492] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:52.437290 19172 tablet_bootstrap.cc:492] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:09:52.437817 19172 ts_tablet_manager.cc:1403] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.009s
I20260709 12:09:52.439975 19172 raft_consensus.cc:359] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:52.440552 19172 raft_consensus.cc:740] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:09:52.441074 19172 consensus_queue.cc:260] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:52.442914 19172 ts_tablet_manager.cc:1434] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:09:52.445138 17959 tablet_copy_service.cc:342] P 63f5bddeebd84e5788d671a176cfa8e1: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-9bb1ec98e5b847df8a401343514ac12d received from {username='slave'} at 127.0.0.1:44668
I20260709 12:09:52.445535 17959 tablet_copy_service.cc:434] P 63f5bddeebd84e5788d671a176cfa8e1: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-9bb1ec98e5b847df8a401343514ac12d on tablet 9bb1ec98e5b847df8a401343514ac12d with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:52.556259 19130 raft_consensus.cc:993] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110: : Instructing follower e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:09:52.556742 18921 raft_consensus.cc:1081] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Signalling peer e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:09:52.558305 18643 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:60412
I20260709 12:09:52.558903 18643 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:52.559232 18643 raft_consensus.cc:3060] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.563706 18641 raft_consensus.cc:1217] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:52.574088 18643 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:52.583501 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:52.584914 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:52.585487 18018 raft_consensus.cc:3060] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.584954 18095 raft_consensus.cc:3055] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.586690 18095 raft_consensus.cc:740] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:52.591043 18095 consensus_queue.cc:260] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:52.594775 18095 raft_consensus.cc:3060] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.596669 19090 raft_consensus.cc:993] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb: : Instructing follower e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:09:52.597155 19090 raft_consensus.cc:1081] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Signalling peer e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:09:52.599241 18640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:60424
I20260709 12:09:52.599977 18640 raft_consensus.cc:493] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:52.600450 18640 raft_consensus.cc:3060] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.613610 18643 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:52.617411 18018 raft_consensus.cc:2468] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:09:52.620575 18608 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:09:52.622248 19059 raft_consensus.cc:2804] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:52.622735 19059 raft_consensus.cc:697] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:09:52.623564 19059 consensus_queue.cc:237] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:52.635180 18640 raft_consensus.cc:515] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:52.637377 18640 leader_election.cc:290] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:52.638352 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:52.640511 18093 raft_consensus.cc:3060] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.643385 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:52.643950 18018 raft_consensus.cc:3055] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.644228 18018 raft_consensus.cc:740] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:09:52.644912 18018 consensus_queue.cc:260] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:52.650679 18018 raft_consensus.cc:3060] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.654197 18093 raft_consensus.cc:2468] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:09:52.655354 18609 leader_election.cc:304] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:09:52.656167 19094 raft_consensus.cc:2804] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:52.656634 19094 raft_consensus.cc:697] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:09:52.649978 18095 raft_consensus.cc:2468] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:09:52.657437 19094 consensus_queue.cc:237] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:52.666132 18018 raft_consensus.cc:2468] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:09:52.677502 17847 catalog_manager.cc:5697] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 1 to 2, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 2 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:52.686082 19130 raft_consensus.cc:993] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110: : Instructing follower 63f5bddeebd84e5788d671a176cfa8e1 to start an election
I20260709 12:09:52.686712 19178 raft_consensus.cc:1081] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Signalling peer 63f5bddeebd84e5788d671a176cfa8e1 to start an election
I20260709 12:09:52.690171 17940 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:50336
I20260709 12:09:52.690887 17940 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:52.691972 17940 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.698128 17940 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:52.700204 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:52.700441 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:52.700692 18024 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.699572 17940 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:52.706981 18093 raft_consensus.cc:3055] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:52.707326 18093 raft_consensus.cc:740] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:52.708129 18093 consensus_queue.cc:260] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:52.709504 18093 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:52.711042 18024 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:09:52.712270 18018 raft_consensus.cc:1240] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 1. Current term is 2. Ops: []
I20260709 12:09:52.714867 17847 catalog_manager.cc:5697] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 1 to 2, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 2 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:52.718503 17913 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:52.720041 18933 raft_consensus.cc:2804] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:52.720470 18933 raft_consensus.cc:697] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:09:52.721156 18933 consensus_queue.cc:237] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:52.727402 18093 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:09:52.734338 17847 catalog_manager.cc:5697] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 1 to 2, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:52.739503 17940 raft_consensus.cc:1275] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:52.743396 19130 consensus_queue.cc:1048] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:52.743681 17940 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50326
I20260709 12:09:52.744256 17940 raft_consensus.cc:606] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:09:52.745267 18640 raft_consensus.cc:1217] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:52.749459 17944 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50326
I20260709 12:09:52.749979 17944 raft_consensus.cc:606] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:09:52.759023 17947 raft_consensus.cc:1275] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:52.760190 19178 consensus_queue.cc:1048] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:52.760756 17944 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:50326
I20260709 12:09:52.761333 17944 raft_consensus.cc:606] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:09:52.772648 18024 raft_consensus.cc:1275] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:52.775983 18921 consensus_queue.cc:1048] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:52.784943 17894 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:09:52.785468 17894 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 4ccf0bcc20ae40e79c32530091613e1e already in progress
W20260709 12:09:52.786504 17894 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 4ccf0bcc20ae40e79c32530091613e1e already in progress
I20260709 12:09:52.800432 18018 raft_consensus.cc:1275] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:52.803781 19130 consensus_queue.cc:1048] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:52.815739 19082 raft_consensus.cc:1064] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:09:52.819573 19082 consensus_queue.cc:237] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:52.841125 18640 raft_consensus.cc:1275] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.841782 18093 raft_consensus.cc:1275] T 28dbc0f2cd704e82b686ffe4c9b9967e P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.842284 17940 raft_consensus.cc:1275] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:52.842603 19082 consensus_queue.cc:1048] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:52.844679 19127 consensus_queue.cc:1048] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:52.846426 19127 consensus_queue.cc:1048] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:52.860076 19090 raft_consensus.cc:2955] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:52.863876 17940 raft_consensus.cc:2955] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:52.862666 18093 raft_consensus.cc:2955] T 28dbc0f2cd704e82b686ffe4c9b9967e P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:52.872645 18640 raft_consensus.cc:2955] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:52.901628 17846 catalog_manager.cc:5697] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:52.917481 18024 consensus_queue.cc:237] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:52.931104 18640 raft_consensus.cc:1275] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:52.931648 17947 raft_consensus.cc:1275] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:52.933202 19090 consensus_queue.cc:1048] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:09:52.942256 19194 consensus_queue.cc:1048] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:52.944285 19127 raft_consensus.cc:2955] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:52.951977 18640 raft_consensus.cc:2955] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:52.956564 17940 raft_consensus.cc:2955] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:52.967674 17847 catalog_manager.cc:5697] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:52.979599 17832 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 28dbc0f2cd704e82b686ffe4c9b9967e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:52.982932 18080 tablet_service.cc:1558] Processing DeleteTablet for tablet 28dbc0f2cd704e82b686ffe4c9b9967e with delete_type TABLET_DATA_TOMBSTONED (TS 4813437da0a74e65b61eb7bd1d18f110 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53944
I20260709 12:09:52.984418 19195 tablet_replica.cc:333] T 28dbc0f2cd704e82b686ffe4c9b9967e P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:09:52.985858 19195 raft_consensus.cc:2243] T 28dbc0f2cd704e82b686ffe4c9b9967e P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:52.986629 19195 raft_consensus.cc:2272] T 28dbc0f2cd704e82b686ffe4c9b9967e P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:52.989719 19195 ts_tablet_manager.cc:1916] T 28dbc0f2cd704e82b686ffe4c9b9967e P 4813437da0a74e65b61eb7bd1d18f110: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:53.004835 19195 ts_tablet_manager.cc:1929] T 28dbc0f2cd704e82b686ffe4c9b9967e P 4813437da0a74e65b61eb7bd1d18f110: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:53.005288 19195 log.cc:1199] T 28dbc0f2cd704e82b686ffe4c9b9967e P 4813437da0a74e65b61eb7bd1d18f110: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-2-root/wals/28dbc0f2cd704e82b686ffe4c9b9967e
I20260709 12:09:53.006855 17833 catalog_manager.cc:5028] TS 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): tablet 28dbc0f2cd704e82b686ffe4c9b9967e (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:09:53.050808 18024 raft_consensus.cc:1275] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:53.052093 19092 consensus_queue.cc:1048] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:53.064944 18095 raft_consensus.cc:1275] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:53.066359 19180 consensus_queue.cc:1048] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:53.124140 18641 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Advancing to term 2
I20260709 12:09:53.129261 18641 raft_consensus.cc:1275] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEARNER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:53.130468 18933 consensus_queue.cc:1048] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:53.134462 18093 raft_consensus.cc:1275] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:53.135658 18933 consensus_queue.cc:1048] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:53.137796 19035 raft_consensus.cc:1064] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
W20260709 12:09:53.138144 19035 raft_consensus.cc:1068] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1: Unable to promote non-voter e28f77912a9c4ba2b9841f6fedddc2db: Service unavailable: leader transfer in progress
I20260709 12:09:53.154742 18933 raft_consensus.cc:993] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1: : Instructing follower 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:09:53.155148 18933 raft_consensus.cc:1081] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Signalling peer 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:09:53.157598 18095 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:53964
I20260709 12:09:53.158103 18095 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:53.158416 18095 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:53.161195 18024 raft_consensus.cc:1275] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:53.164151 19035 consensus_queue.cc:1048] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:53.168902 18095 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:53.171721 19035 raft_consensus.cc:1064] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:09:53.173367 18095 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:53.173928 19035 consensus_queue.cc:237] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:53.175673 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:53.178448 18933 raft_consensus.cc:1064] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:09:53.180763 18933 consensus_queue.cc:237] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:53.186924 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:53.188067 18093 raft_consensus.cc:1240] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:09:53.196678 19201 consensus_queue.cc:1059] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:53.201109 17940 raft_consensus.cc:3055] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:53.201479 17940 raft_consensus.cc:740] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:09:53.202232 17940 consensus_queue.cc:260] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:53.214269 18641 raft_consensus.cc:1275] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:53.220902 19202 consensus_queue.cc:1048] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:53.221927 17940 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:53.231523 18095 raft_consensus.cc:1275] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:53.236392 18024 raft_consensus.cc:1275] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:53.238847 19092 consensus_queue.cc:1048] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:53.239102 19208 consensus_queue.cc:1048] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:53.245378 17940 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:09:53.245853 18093 raft_consensus.cc:1275] T 9bb1ec98e5b847df8a401343514ac12d P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:53.247452 18641 raft_consensus.cc:1275] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:53.247609 19206 consensus_queue.cc:1048] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:53.250353 18093 raft_consensus.cc:1275] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:53.251776 19092 consensus_queue.cc:1048] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:53.264983 18021 raft_consensus.cc:1275] T 7b8822f4f1de477e8866529047a823b9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:53.267566 18021 raft_consensus.cc:1275] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:53.279639 19209 consensus_queue.cc:1048] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:53.281237 19201 raft_consensus.cc:1064] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:09:53.282608 19205 consensus_queue.cc:1048] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:09:53.297693 19037 raft_consensus.cc:2955] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:53.308650 19209 consensus_queue.cc:1048] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:09:53.309433 19201 raft_consensus.cc:1068] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1: Unable to promote non-voter e28f77912a9c4ba2b9841f6fedddc2db: Illegal state: Replica 63f5bddeebd84e5788d671a176cfa8e1 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:53.304819 18021 raft_consensus.cc:2955] T 7b8822f4f1de477e8866529047a823b9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
W20260709 12:09:53.316533 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 63184.4us
I20260709 12:09:53.359789 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:53.364133 19202 raft_consensus.cc:2955] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:53.366700 18062 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:53.367476 19178 raft_consensus.cc:2804] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:53.367926 19178 raft_consensus.cc:697] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 3 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:53.368741 19178 consensus_queue.cc:237] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:53.371683 17847 catalog_manager.cc:5697] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:53.372596 18640 raft_consensus.cc:2955] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:53.384102 18641 raft_consensus.cc:2955] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:53.391579 18093 raft_consensus.cc:2955] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:53.397360 18091 raft_consensus.cc:2955] T 9bb1ec98e5b847df8a401343514ac12d P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:53.436026 17940 consensus_queue.cc:237] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:53.439149 17845 catalog_manager.cc:5697] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 2 to 3, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 3 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:53.448064 18640 raft_consensus.cc:1275] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:53.449898 18024 raft_consensus.cc:2955] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:53.462613 19214 consensus_queue.cc:1048] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:53.473086 18021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:44098
I20260709 12:09:53.473644 18021 raft_consensus.cc:606] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:09:53.476138 18021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:44098
I20260709 12:09:53.476629 18021 raft_consensus.cc:606] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:09:53.480899 18093 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
mode: GRACEFUL
new_leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:40154
I20260709 12:09:53.481462 18093 raft_consensus.cc:606] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 3 LEADER]: Received request to transfer leadership to TS 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:53.482764 17845 catalog_manager.cc:5697] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
W20260709 12:09:53.483991 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 55975us
I20260709 12:09:53.485992 19214 raft_consensus.cc:2955] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:53.487555 18640 raft_consensus.cc:2955] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:53.490574 18093 raft_consensus.cc:1275] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:53.496163 18933 consensus_queue.cc:1048] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:53.508585 18091 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
mode: GRACEFUL
new_leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:40154
I20260709 12:09:53.509171 18091 raft_consensus.cc:606] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Received request to transfer leadership to TS e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:53.510388 17947 consensus_queue.cc:237] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:53.514766 18091 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
mode: GRACEFUL
new_leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:40154
I20260709 12:09:53.515313 18091 raft_consensus.cc:606] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Received request to transfer leadership to TS 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:53.516417 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:09:53.517961 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:53.518735 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:53.521742 19090 raft_consensus.cc:993] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb: : Instructing follower 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:09:53.522166 19090 raft_consensus.cc:1081] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Signalling peer 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:09:53.526911 17832 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7b8822f4f1de477e8866529047a823b9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:53.528205 18091 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:53954
I20260709 12:09:53.528755 18091 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:53.529107 18091 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.542747 18091 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:53.543622 18095 raft_consensus.cc:2955] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:53.544494 18091 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:09:53.543810 17844 catalog_manager.cc:5697] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New cstate: current_term: 1 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:53.556401 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:09:53.557443 18640 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.561997 18643 raft_consensus.cc:1275] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:53.565925 18018 raft_consensus.cc:1275] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:53.565990 18640 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:09:53.567373 18061 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:09:53.567490 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:53.568041 19221 raft_consensus.cc:2804] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:53.568471 18024 raft_consensus.cc:3055] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:53.568616 19221 raft_consensus.cc:697] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:53.568764 18024 raft_consensus.cc:740] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:09:53.569541 19221 consensus_queue.cc:237] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:53.569515 18024 consensus_queue.cc:260] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:53.575430 19201 consensus_queue.cc:1048] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:53.574908 18024 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.580320 19202 consensus_queue.cc:1048] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:53.584924 19214 raft_consensus.cc:2955] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:53.589565 18024 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:09:53.591228 18005 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b8822f4f1de477e8866529047a823b9 with delete_type TABLET_DATA_TOMBSTONED (TS c5ffa786c8fb43f7864fa8fbe76534cb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45450
I20260709 12:09:53.593077 18019 raft_consensus.cc:2955] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:53.605890 17832 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9bb1ec98e5b847df8a401343514ac12d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:53.612519 18640 raft_consensus.cc:2955] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:53.621650 17844 catalog_manager.cc:5697] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New cstate: current_term: 1 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:53.624910 19223 tablet_replica.cc:333] T 7b8822f4f1de477e8866529047a823b9 P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:09:53.625929 19223 raft_consensus.cc:2243] T 7b8822f4f1de477e8866529047a823b9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:53.626525 19223 raft_consensus.cc:2272] T 7b8822f4f1de477e8866529047a823b9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:53.627110 17847 catalog_manager.cc:5697] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 1 to 2, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 2 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:53.633113 19127 raft_consensus.cc:993] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb: : Instructing follower 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:09:53.633952 19127 raft_consensus.cc:1081] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Signalling peer 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:09:53.635504 18091 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:53954
I20260709 12:09:53.635986 18091 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:53.636315 18091 raft_consensus.cc:3060] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.640697 19223 ts_tablet_manager.cc:1916] T 7b8822f4f1de477e8866529047a823b9 P c5ffa786c8fb43f7864fa8fbe76534cb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:53.642736 18091 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:53.645668 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:53.646179 18019 raft_consensus.cc:3055] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:53.646453 18019 raft_consensus.cc:740] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:09:53.647137 18019 consensus_queue.cc:260] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:53.647780 18080 tablet_service.cc:1558] Processing DeleteTablet for tablet 9bb1ec98e5b847df8a401343514ac12d with delete_type TABLET_DATA_TOMBSTONED (TS 4813437da0a74e65b61eb7bd1d18f110 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53944
I20260709 12:09:53.648132 18019 raft_consensus.cc:3060] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.656968 18019 raft_consensus.cc:2468] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:09:53.657899 18062 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:53.658548 19130 raft_consensus.cc:2804] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:53.659052 19130 raft_consensus.cc:697] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:53.659570 19224 tablet_replica.cc:333] T 9bb1ec98e5b847df8a401343514ac12d P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:09:53.659715 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:09:53.660290 18640 raft_consensus.cc:3060] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.659993 19130 consensus_queue.cc:237] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:53.659265 18091 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:09:53.668982 18640 raft_consensus.cc:2468] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:09:53.677920 19224 raft_consensus.cc:2243] T 9bb1ec98e5b847df8a401343514ac12d P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:53.678886 19224 raft_consensus.cc:2272] T 9bb1ec98e5b847df8a401343514ac12d P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:53.683120 19223 ts_tablet_manager.cc:1929] T 7b8822f4f1de477e8866529047a823b9 P c5ffa786c8fb43f7864fa8fbe76534cb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:53.683697 19223 log.cc:1199] T 7b8822f4f1de477e8866529047a823b9 P c5ffa786c8fb43f7864fa8fbe76534cb: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-1-root/wals/7b8822f4f1de477e8866529047a823b9
I20260709 12:09:53.685209 19224 ts_tablet_manager.cc:1916] T 9bb1ec98e5b847df8a401343514ac12d P 4813437da0a74e65b61eb7bd1d18f110: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:53.685343 17832 catalog_manager.cc:5028] TS c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): tablet 7b8822f4f1de477e8866529047a823b9 (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:09:53.691918 17844 catalog_manager.cc:5697] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 1 to 2, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 2 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:53.697211 19224 ts_tablet_manager.cc:1929] T 9bb1ec98e5b847df8a401343514ac12d P 4813437da0a74e65b61eb7bd1d18f110: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:53.697643 19224 log.cc:1199] T 9bb1ec98e5b847df8a401343514ac12d P 4813437da0a74e65b61eb7bd1d18f110: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-2-root/wals/9bb1ec98e5b847df8a401343514ac12d
I20260709 12:09:53.699193 17833 catalog_manager.cc:5028] TS 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): tablet 9bb1ec98e5b847df8a401343514ac12d (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:09:53.771078 19177 raft_consensus.cc:993] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110: : Instructing follower e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:09:53.771605 19177 raft_consensus.cc:1081] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Signalling peer e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:09:53.773633 18641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:60412
I20260709 12:09:53.774154 18641 raft_consensus.cc:493] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:53.774505 18641 raft_consensus.cc:3060] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.778968 18641 raft_consensus.cc:515] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:53.780319 18641 leader_election.cc:290] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:53.780949 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:53.781267 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:53.781539 18018 raft_consensus.cc:3060] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.781785 18091 raft_consensus.cc:3055] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:53.782099 18091 raft_consensus.cc:740] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:53.782873 18091 consensus_queue.cc:260] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:53.783975 18091 raft_consensus.cc:3060] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.787524 19177 raft_consensus.cc:993] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110: : Instructing follower 63f5bddeebd84e5788d671a176cfa8e1 to start an election
I20260709 12:09:53.787562 18018 raft_consensus.cc:2468] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:09:53.788180 19130 raft_consensus.cc:1081] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Signalling peer 63f5bddeebd84e5788d671a176cfa8e1 to start an election
I20260709 12:09:53.788673 18608 leader_election.cc:304] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:09:53.789389 19094 raft_consensus.cc:2804] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:53.789640 17944 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:50336
I20260709 12:09:53.789901 19094 raft_consensus.cc:697] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:09:53.790179 17944 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:53.790562 17944 raft_consensus.cc:3060] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.791163 18091 raft_consensus.cc:2468] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:09:53.790899 19094 consensus_queue.cc:237] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:53.797925 17944 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:53.799770 17944 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:53.800884 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:53.801450 18091 raft_consensus.cc:3055] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:53.801735 18091 raft_consensus.cc:740] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:53.801831 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:53.801687 17844 catalog_manager.cc:5697] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 1 to 2, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 2 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:53.802559 18018 raft_consensus.cc:3060] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.802904 18091 consensus_queue.cc:260] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:53.804378 18091 raft_consensus.cc:3060] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:53.809257 18018 raft_consensus.cc:2468] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:09:53.810173 17913 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:53.810611 18091 raft_consensus.cc:2468] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:09:53.811297 19202 raft_consensus.cc:2804] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:53.811784 19202 raft_consensus.cc:697] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:09:53.812515 19202 consensus_queue.cc:237] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:53.834359 17844 catalog_manager.cc:5697] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 1 to 2, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:53.873104 18018 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:53.874943 18641 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEARNER]: Advancing to term 3
I20260709 12:09:53.883272 18641 raft_consensus.cc:1275] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEARNER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:09:53.884532 17944 raft_consensus.cc:1275] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:09:53.886744 18921 consensus_queue.cc:1048] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:53.889027 18921 consensus_queue.cc:1048] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:53.892100 18018 raft_consensus.cc:1275] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:09:53.895538 19178 consensus_queue.cc:1048] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:53.922325 19178 raft_consensus.cc:1064] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:09:53.922585 19177 raft_consensus.cc:993] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110: : Instructing follower 63f5bddeebd84e5788d671a176cfa8e1 to start an election
W20260709 12:09:53.922765 19178 raft_consensus.cc:1068] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110: Unable to promote non-voter e28f77912a9c4ba2b9841f6fedddc2db: Service unavailable: leader transfer in progress
I20260709 12:09:53.923323 19178 raft_consensus.cc:1081] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 3 LEADER]: Signalling peer 63f5bddeebd84e5788d671a176cfa8e1 to start an election
I20260709 12:09:53.931033 17944 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:50336
I20260709 12:09:53.941543 17944 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:53.941926 17944 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:53.947448 19221 raft_consensus.cc:1064] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
W20260709 12:09:53.947841 19221 raft_consensus.cc:1068] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110: Unable to promote non-voter e28f77912a9c4ba2b9841f6fedddc2db: Service unavailable: leader transfer in progress
I20260709 12:09:53.948096 17944 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:53.952262 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:53.952394 17944 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:53.952592 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:53.952831 18018 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:53.953171 18095 raft_consensus.cc:3055] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:09:53.953478 18095 raft_consensus.cc:740] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:53.954181 18095 consensus_queue.cc:260] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:53.955611 18095 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:09:53.960572 18018 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 4.
I20260709 12:09:53.962344 17913 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:53.963073 19212 raft_consensus.cc:2804] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:09:53.963553 19212 raft_consensus.cc:697] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:09:53.964380 19212 consensus_queue.cc:237] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:53.963500 18095 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 4.
I20260709 12:09:53.977797 17844 catalog_manager.cc:5697] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 3 to 4, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 4 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:53.984100 18643 raft_consensus.cc:1275] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:53.985368 19178 consensus_queue.cc:1048] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:53.992856 18024 raft_consensus.cc:1275] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:53.993909 18921 consensus_queue.cc:1048] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:54.075639 18024 raft_consensus.cc:1275] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:54.076691 18921 consensus_queue.cc:1048] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:54.085625 18643 raft_consensus.cc:1275] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:54.086879 18921 consensus_queue.cc:1048] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:54.184290 18095 raft_consensus.cc:1275] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:54.185483 19180 consensus_queue.cc:1048] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:54.193781 18024 raft_consensus.cc:1275] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:54.194948 19180 consensus_queue.cc:1048] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:54.228603 18091 raft_consensus.cc:1275] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:54.230360 19202 consensus_queue.cc:1048] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:54.241794 18018 raft_consensus.cc:1275] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:54.243084 19202 consensus_queue.cc:1048] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:54.350075 18643 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEARNER]: Advancing to term 4
I20260709 12:09:54.354344 18643 raft_consensus.cc:1275] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 4 LEARNER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:09:54.355430 19202 consensus_queue.cc:1048] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:54.360046 19202 raft_consensus.cc:1064] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
W20260709 12:09:54.360392 19202 raft_consensus.cc:1068] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1: Unable to promote non-voter e28f77912a9c4ba2b9841f6fedddc2db: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:09:54.486779 18018 raft_consensus.cc:1275] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:09:54.488530 19202 consensus_queue.cc:1048] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:54.497459 18091 raft_consensus.cc:1275] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:09:54.503660 19239 consensus_queue.cc:1048] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:54.509042 19240 raft_consensus.cc:1064] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:09:54.520085 19240 consensus_queue.cc:237] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:54.525735 18643 raft_consensus.cc:1275] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 4 LEARNER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:09:54.527114 19239 consensus_queue.cc:1048] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:09:54.530728 18024 raft_consensus.cc:1275] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:09:54.532019 18091 raft_consensus.cc:1275] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:09:54.534212 19212 consensus_queue.cc:1048] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:09:54.537528 19240 consensus_queue.cc:1048] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:09:54.539403 19212 raft_consensus.cc:2955] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 2 to 6, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:54.544126 18018 raft_consensus.cc:2955] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 2 to 6, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:54.540946 18091 raft_consensus.cc:2955] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 2 to 6, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:54.555172 18643 raft_consensus.cc:2955] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 2 to 6, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:54.560945 17847 catalog_manager.cc:5697] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: config changed from index 2 to 6, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:54.683532 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:54.729053 18091 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05a4983c833c415a94a4c285b408b305"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
mode: GRACEFUL
new_leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
 from {username='slave'} at 127.0.0.1:40154
I20260709 12:09:54.733309 18091 raft_consensus.cc:606] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Received request to transfer leadership to TS c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:54.735975 18024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
mode: GRACEFUL
new_leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:44098
I20260709 12:09:54.736513 18024 raft_consensus.cc:606] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Received request to transfer leadership to TS 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:54.740514 18091 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
mode: GRACEFUL
new_leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:40154
I20260709 12:09:54.743501 18091 raft_consensus.cc:606] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Received request to transfer leadership to TS e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:54.744376 18095 consensus_queue.cc:237] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:54.747323 17947 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:09:54.747960 17947 raft_consensus.cc:606] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:09:54.749917 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:09:54.751235 18024 raft_consensus.cc:1275] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:54.751534 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:09:54.751488 18061 consensus_peers.cc:597] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 17e56ed7b94d4185a4f7dd88f922e17d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:54.752394 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:54.752950 19178 consensus_queue.cc:1048] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:54.755120 17945 raft_consensus.cc:1275] T 17e56ed7b94d4185a4f7dd88f922e17d P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:54.757591 19130 consensus_queue.cc:1048] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:54.767135 19178 raft_consensus.cc:2955] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:54.769239 18024 raft_consensus.cc:2955] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:54.770817 17945 raft_consensus.cc:2955] T 17e56ed7b94d4185a4f7dd88f922e17d P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:54.786618 17844 catalog_manager.cc:5697] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 2 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:54.792523 18095 consensus_queue.cc:237] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
W20260709 12:09:54.814390 18061 consensus_peers.cc:597] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5379a078a5d24d8cba5cb4e56eee5b5f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:54.820899 18024 raft_consensus.cc:1275] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:54.821071 17945 raft_consensus.cc:1275] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:54.822322 19178 consensus_queue.cc:1048] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:54.823132 19130 consensus_queue.cc:1048] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:54.832563 19178 raft_consensus.cc:2955] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:54.834457 18024 raft_consensus.cc:2955] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:54.834468 17944 raft_consensus.cc:2955] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:54.840009 19130 raft_consensus.cc:993] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110: : Instructing follower e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:09:54.840479 18921 raft_consensus.cc:1081] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Signalling peer e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:09:54.841925 18643 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:60412
I20260709 12:09:54.842347 18643 raft_consensus.cc:493] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:54.842706 18643 raft_consensus.cc:3060] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.847632 18643 raft_consensus.cc:515] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:54.849088 17845 catalog_manager.cc:5697] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: config changed from index -1 to 3, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 2 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:54.849915 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:54.850468 18018 raft_consensus.cc:3060] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.855762 18643 leader_election.cc:290] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:54.857384 18095 consensus_queue.cc:237] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:54.859658 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:54.860205 18091 raft_consensus.cc:3055] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:54.860523 18091 raft_consensus.cc:740] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:54.861186 18091 consensus_queue.cc:260] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:54.862376 18091 raft_consensus.cc:3060] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.857867 18018 raft_consensus.cc:2468] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:09:54.865713 18608 leader_election.cc:304] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:09:54.866534 19180 raft_consensus.cc:2804] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:54.867014 19180 raft_consensus.cc:697] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:09:54.867861 19180 consensus_queue.cc:237] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:54.869963 18091 raft_consensus.cc:2468] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:09:54.873327 18018 raft_consensus.cc:1275] T a8c7e98721a04c9690aef2689338516a P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:54.874014 17944 raft_consensus.cc:1275] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:54.875077 18921 consensus_queue.cc:1048] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:54.876781 19221 consensus_queue.cc:1048] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:54.888604 18061 consensus_peers.cc:597] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a8c7e98721a04c9690aef2689338516a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:54.894035 17845 catalog_manager.cc:5697] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 1 to 2, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 2 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:54.896077 19221 raft_consensus.cc:2955] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:54.899521 17944 raft_consensus.cc:2955] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:54.901281 18024 raft_consensus.cc:2955] T a8c7e98721a04c9690aef2689338516a P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:54.920116 17845 catalog_manager.cc:5697] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:54.921657 18024 consensus_queue.cc:237] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:54.935199 19202 raft_consensus.cc:993] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1: : Instructing follower 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:09:54.935635 19212 raft_consensus.cc:1081] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Signalling peer 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:09:54.936582 17944 raft_consensus.cc:1275] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:54.937371 18095 raft_consensus.cc:1275] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:54.937446 18091 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:53964
I20260709 12:09:54.938050 18091 raft_consensus.cc:493] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:54.938380 18091 raft_consensus.cc:3060] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.939471 19090 consensus_queue.cc:1048] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:54.942678 17987 consensus_peers.cc:597] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 66bde4bf25ea49f2b5f4b768cba4cdd0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:54.944813 19082 consensus_queue.cc:1048] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:54.947827 18091 raft_consensus.cc:515] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:54.950479 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:54.950989 17945 raft_consensus.cc:3055] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:54.951241 18091 leader_election.cc:290] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:09:54.951272 17945 raft_consensus.cc:740] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:09:54.951871 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:09:54.952384 18641 raft_consensus.cc:3060] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.952195 17945 consensus_queue.cc:260] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:54.953238 17945 raft_consensus.cc:3060] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:54.955583 19090 raft_consensus.cc:2955] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:54.957355 18641 raft_consensus.cc:2468] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:09:54.958941 18061 leader_election.cc:304] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:09:54.959663 18921 raft_consensus.cc:2804] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:54.960114 18921 raft_consensus.cc:697] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:54.960922 18921 consensus_queue.cc:237] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:54.961714 17945 raft_consensus.cc:2468] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:09:54.964439 18091 raft_consensus.cc:2955] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:54.991674 17944 raft_consensus.cc:2955] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:55.007572 19082 raft_consensus.cc:993] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb: : Instructing follower 63f5bddeebd84e5788d671a176cfa8e1 to start an election
I20260709 12:09:55.008001 19259 raft_consensus.cc:1081] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Signalling peer 63f5bddeebd84e5788d671a176cfa8e1 to start an election
I20260709 12:09:55.008919 17846 catalog_manager.cc:5697] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:55.011845 17944 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:50334
I20260709 12:09:55.012768 17845 catalog_manager.cc:5697] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 1 to 2, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 2 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:55.027006 17944 raft_consensus.cc:493] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:55.030974 17944 raft_consensus.cc:3060] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.043776 17944 raft_consensus.cc:515] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:55.045583 17944 leader_election.cc:290] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:55.046154 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:55.046895 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:55.046965 18024 raft_consensus.cc:3055] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:55.047746 18091 raft_consensus.cc:3060] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.047861 18024 raft_consensus.cc:740] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:09:55.048581 18024 consensus_queue.cc:260] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:55.049419 18024 raft_consensus.cc:3060] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.055200 18024 raft_consensus.cc:2468] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:09:55.055505 18091 raft_consensus.cc:2468] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:09:55.056152 17913 leader_election.cc:304] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:55.056960 19212 raft_consensus.cc:2804] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:55.057432 19212 raft_consensus.cc:697] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:09:55.058259 19212 consensus_queue.cc:237] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:55.070542 19130 raft_consensus.cc:993] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110: : Instructing follower c5ffa786c8fb43f7864fa8fbe76534cb to start an election
I20260709 12:09:55.071075 19221 raft_consensus.cc:1081] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Signalling peer c5ffa786c8fb43f7864fa8fbe76534cb to start an election
I20260709 12:09:55.074873 18018 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05a4983c833c415a94a4c285b408b305"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
 from {username='slave'} at 127.0.0.1:45472
I20260709 12:09:55.075404 18018 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:55.075753 18018 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.082399 17845 catalog_manager.cc:5697] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 1 to 2, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:55.088912 18018 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:55.092204 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:55.093390 18018 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:55.094177 18091 raft_consensus.cc:3055] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:55.094877 18091 raft_consensus.cc:740] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:55.095669 18091 consensus_queue.cc:260] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:55.096832 18091 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.098837 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:55.099370 17944 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:55.102536 18091 raft_consensus.cc:2468] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 2.
I20260709 12:09:55.103693 17989 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:55.104487 19259 raft_consensus.cc:2804] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:55.104931 19259 raft_consensus.cc:697] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:09:55.105166 17944 raft_consensus.cc:2468] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 2.
I20260709 12:09:55.105785 19259 consensus_queue.cc:237] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:55.116856 17845 catalog_manager.cc:5697] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 1 to 2, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 2 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:55.300124 19262 ts_tablet_manager.cc:933] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:55.301934 19262 tablet_copy_client.cc:323] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.195:41931
I20260709 12:09:55.303351 18108 tablet_copy_service.cc:140] P 4813437da0a74e65b61eb7bd1d18f110: Received BeginTabletCopySession request for tablet a8c7e98721a04c9690aef2689338516a from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:41818)
I20260709 12:09:55.303800 18108 tablet_copy_service.cc:161] P 4813437da0a74e65b61eb7bd1d18f110: Beginning new tablet copy session on tablet a8c7e98721a04c9690aef2689338516a from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:41818: session id = e28f77912a9c4ba2b9841f6fedddc2db-a8c7e98721a04c9690aef2689338516a
I20260709 12:09:55.312065 18108 tablet_copy_source_session.cc:215] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:55.314265 18091 raft_consensus.cc:1275] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:55.315824 19092 consensus_queue.cc:1048] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:55.316314 19262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c7e98721a04c9690aef2689338516a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:55.335582 19262 tablet_copy_client.cc:806] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:55.336146 19262 tablet_copy_client.cc:670] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:55.344091 19262 tablet_copy_client.cc:538] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:55.353428 18018 raft_consensus.cc:1275] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:55.354203 19262 tablet_bootstrap.cc:492] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:09:55.355121 19180 consensus_queue.cc:1048] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:55.415117 19266 ts_tablet_manager.cc:933] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:55.424199 19266 tablet_copy_client.cc:323] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.195:41931
I20260709 12:09:55.425017 19271 ts_tablet_manager.cc:933] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:55.425895 18108 tablet_copy_service.cc:140] P 4813437da0a74e65b61eb7bd1d18f110: Received BeginTabletCopySession request for tablet 17e56ed7b94d4185a4f7dd88f922e17d from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:41818)
I20260709 12:09:55.426433 18108 tablet_copy_service.cc:161] P 4813437da0a74e65b61eb7bd1d18f110: Beginning new tablet copy session on tablet 17e56ed7b94d4185a4f7dd88f922e17d from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:41818: session id = e28f77912a9c4ba2b9841f6fedddc2db-17e56ed7b94d4185a4f7dd88f922e17d
I20260709 12:09:55.439323 19262 tablet_bootstrap.cc:492] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:55.439688 18024 raft_consensus.cc:1275] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:55.440258 19262 tablet_bootstrap.cc:492] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:09:55.440990 19262 ts_tablet_manager.cc:1403] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.087s	user 0.034s	sys 0.029s
I20260709 12:09:55.441046 18933 consensus_queue.cc:1048] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:55.443076 18108 tablet_copy_source_session.cc:215] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:55.443940 19262 raft_consensus.cc:359] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:55.444828 19262 raft_consensus.cc:740] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:09:55.445469 19262 consensus_queue.cc:260] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:55.446635 19266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17e56ed7b94d4185a4f7dd88f922e17d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:55.450794 19271 tablet_copy_client.cc:323] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.195:41931
I20260709 12:09:55.453466 18108 tablet_copy_service.cc:140] P 4813437da0a74e65b61eb7bd1d18f110: Received BeginTabletCopySession request for tablet 5379a078a5d24d8cba5cb4e56eee5b5f from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:41818)
I20260709 12:09:55.453971 18108 tablet_copy_service.cc:161] P 4813437da0a74e65b61eb7bd1d18f110: Beginning new tablet copy session on tablet 5379a078a5d24d8cba5cb4e56eee5b5f from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:41818: session id = e28f77912a9c4ba2b9841f6fedddc2db-5379a078a5d24d8cba5cb4e56eee5b5f
I20260709 12:09:55.454344 19262 ts_tablet_manager.cc:1434] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 12:09:55.457333 18107 tablet_copy_service.cc:342] P 4813437da0a74e65b61eb7bd1d18f110: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-a8c7e98721a04c9690aef2689338516a received from {username='slave'} at 127.0.0.1:41818
I20260709 12:09:55.457739 18107 tablet_copy_service.cc:434] P 4813437da0a74e65b61eb7bd1d18f110: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-a8c7e98721a04c9690aef2689338516a on tablet a8c7e98721a04c9690aef2689338516a with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:55.491833 19266 tablet_copy_client.cc:806] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:55.492475 19266 tablet_copy_client.cc:670] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:55.498894 17944 raft_consensus.cc:1275] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:55.495277 18108 tablet_copy_source_session.cc:215] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:55.500540 19127 consensus_queue.cc:1048] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:55.499759 19266 tablet_copy_client.cc:538] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:55.501796 17944 raft_consensus.cc:1275] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:55.502926 19130 consensus_queue.cc:1048] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:55.507139 19271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5379a078a5d24d8cba5cb4e56eee5b5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:55.517083 19262 ts_tablet_manager.cc:933] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:55.522199 18095 raft_consensus.cc:1275] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:55.523725 19202 consensus_queue.cc:1048] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:55.537029 19262 tablet_copy_client.cc:323] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.194:36297
I20260709 12:09:55.538516 18033 tablet_copy_service.cc:140] P c5ffa786c8fb43f7864fa8fbe76534cb: Received BeginTabletCopySession request for tablet 66bde4bf25ea49f2b5f4b768cba4cdd0 from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:53022)
I20260709 12:09:55.539050 18033 tablet_copy_service.cc:161] P c5ffa786c8fb43f7864fa8fbe76534cb: Beginning new tablet copy session on tablet 66bde4bf25ea49f2b5f4b768cba4cdd0 from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:53022: session id = e28f77912a9c4ba2b9841f6fedddc2db-66bde4bf25ea49f2b5f4b768cba4cdd0
I20260709 12:09:55.550186 18033 tablet_copy_source_session.cc:215] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:55.556881 19262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66bde4bf25ea49f2b5f4b768cba4cdd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:55.588881 18643 raft_consensus.cc:1275] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:55.594758 19221 consensus_queue.cc:1048] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:55.636938 18091 raft_consensus.cc:1275] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:55.639074 19257 consensus_queue.cc:1048] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:55.644737 19262 tablet_copy_client.cc:806] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:55.645406 19262 tablet_copy_client.cc:670] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:55.648167 19266 tablet_bootstrap.cc:492] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:09:55.676666 19266 tablet_bootstrap.cc:492] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:55.676972 19271 tablet_copy_client.cc:806] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:55.677587 19266 tablet_bootstrap.cc:492] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:09:55.678609 19266 ts_tablet_manager.cc:1403] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.007s
I20260709 12:09:55.677601 19271 tablet_copy_client.cc:670] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:55.681571 19266 raft_consensus.cc:359] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:55.682422 19266 raft_consensus.cc:740] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:09:55.683265 19271 tablet_copy_client.cc:538] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:55.683457 19266 consensus_queue.cc:260] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:55.685026 18643 raft_consensus.cc:1217] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:55.686013 19266 ts_tablet_manager.cc:1434] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:09:55.687623 18108 tablet_copy_service.cc:342] P 4813437da0a74e65b61eb7bd1d18f110: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-17e56ed7b94d4185a4f7dd88f922e17d received from {username='slave'} at 127.0.0.1:41818
I20260709 12:09:55.688025 18108 tablet_copy_service.cc:434] P 4813437da0a74e65b61eb7bd1d18f110: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-17e56ed7b94d4185a4f7dd88f922e17d on tablet 17e56ed7b94d4185a4f7dd88f922e17d with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:55.697101 19271 tablet_bootstrap.cc:492] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:09:55.702526 19262 tablet_copy_client.cc:538] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:55.717285 19262 tablet_bootstrap.cc:492] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:09:55.733093 18643 raft_consensus.cc:1217] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:09:55.745671 19271 tablet_bootstrap.cc:492] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:55.746728 19271 tablet_bootstrap.cc:492] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:09:55.747442 19271 ts_tablet_manager.cc:1403] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.051s	user 0.023s	sys 0.005s
I20260709 12:09:55.750451 19271 raft_consensus.cc:359] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:55.751250 19271 raft_consensus.cc:740] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:09:55.751837 19271 consensus_queue.cc:260] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:55.758534 19271 ts_tablet_manager.cc:1434] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:09:55.760684 18108 tablet_copy_service.cc:342] P 4813437da0a74e65b61eb7bd1d18f110: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-5379a078a5d24d8cba5cb4e56eee5b5f received from {username='slave'} at 127.0.0.1:41818
I20260709 12:09:55.761082 18108 tablet_copy_service.cc:434] P 4813437da0a74e65b61eb7bd1d18f110: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-5379a078a5d24d8cba5cb4e56eee5b5f on tablet 5379a078a5d24d8cba5cb4e56eee5b5f with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:55.772699 19262 tablet_bootstrap.cc:492] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:55.775341 19262 tablet_bootstrap.cc:492] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:09:55.775995 19262 ts_tablet_manager.cc:1403] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.059s	user 0.024s	sys 0.002s
I20260709 12:09:55.778877 19262 raft_consensus.cc:359] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:55.779691 19262 raft_consensus.cc:740] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:09:55.781181 19262 consensus_queue.cc:260] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:55.783632 19262 ts_tablet_manager.cc:1434] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:09:55.785141 18033 tablet_copy_service.cc:342] P c5ffa786c8fb43f7864fa8fbe76534cb: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-66bde4bf25ea49f2b5f4b768cba4cdd0 received from {username='slave'} at 127.0.0.1:53022
I20260709 12:09:55.785547 18033 tablet_copy_service.cc:434] P c5ffa786c8fb43f7864fa8fbe76534cb: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-66bde4bf25ea49f2b5f4b768cba4cdd0 on tablet 66bde4bf25ea49f2b5f4b768cba4cdd0 with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:55.805302 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:55.858465 18095 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
mode: GRACEFUL
new_leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
 from {username='slave'} at 127.0.0.1:40154
I20260709 12:09:55.859094 18095 raft_consensus.cc:606] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Received request to transfer leadership to TS c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:55.861662 17945 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:09:55.862198 17945 raft_consensus.cc:606] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:09:55.864713 18024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
mode: GRACEFUL
new_leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:44098
I20260709 12:09:55.865242 18024 raft_consensus.cc:606] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Received request to transfer leadership to TS 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:55.866412 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:09:55.867936 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:55.868674 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:55.936992 19221 raft_consensus.cc:993] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110: : Instructing follower c5ffa786c8fb43f7864fa8fbe76534cb to start an election
I20260709 12:09:55.937459 19130 raft_consensus.cc:1081] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Signalling peer c5ffa786c8fb43f7864fa8fbe76534cb to start an election
I20260709 12:09:55.938941 18024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
 from {username='slave'} at 127.0.0.1:45472
I20260709 12:09:55.939363 18024 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:55.939649 18024 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:55.946763 18024 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:55.948365 18024 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:09:55.949352 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:09:55.949942 18643 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:55.953154 18641 raft_consensus.cc:1217] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:09:55.966966 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:55.967525 18095 raft_consensus.cc:3055] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:55.967763 18095 raft_consensus.cc:740] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:55.968418 18095 consensus_queue.cc:260] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:55.969467 18095 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:55.975859 18643 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:09:55.977007 17987 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:09:55.977643 19127 raft_consensus.cc:2804] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:55.978091 19127 raft_consensus.cc:697] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:09:55.978924 19127 consensus_queue.cc:237] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:55.985481 18095 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:09:55.995728 18643 raft_consensus.cc:1217] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:55.998034 19257 raft_consensus.cc:993] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb: : Instructing follower 63f5bddeebd84e5788d671a176cfa8e1 to start an election
I20260709 12:09:55.998553 19257 raft_consensus.cc:1081] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Signalling peer 63f5bddeebd84e5788d671a176cfa8e1 to start an election
I20260709 12:09:56.007481 17944 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:50334
I20260709 12:09:56.007998 17944 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:56.008349 17944 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.012009 17845 catalog_manager.cc:5697] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 2 to 3, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 3 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:56.014859 17944 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:56.016728 17944 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:56.017467 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:56.017963 18024 raft_consensus.cc:3055] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:56.018210 18024 raft_consensus.cc:740] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:09:56.018911 18024 consensus_queue.cc:260] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:56.020262 18024 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.034255 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:56.034874 18095 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.035813 18024 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:09:56.043535 18095 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:09:56.045784 17913 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:56.046536 19202 raft_consensus.cc:2804] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:56.047032 19202 raft_consensus.cc:697] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:09:56.047816 19202 consensus_queue.cc:237] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:56.058635 17845 catalog_manager.cc:5697] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 1 to 2, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:56.171399 18933 raft_consensus.cc:993] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1: : Instructing follower 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:09:56.171823 18933 raft_consensus.cc:1081] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Signalling peer 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:09:56.173226 18091 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:53964
I20260709 12:09:56.173761 18091 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:56.174117 18091 raft_consensus.cc:3060] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.179239 18091 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:56.181439 18091 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:56.182315 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:56.182317 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:56.183141 17944 raft_consensus.cc:3055] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:56.183637 17944 raft_consensus.cc:740] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:09:56.183205 18024 raft_consensus.cc:3060] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.185050 17944 consensus_queue.cc:260] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:56.189672 17944 raft_consensus.cc:3060] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:56.192535 18024 raft_consensus.cc:2468] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:09:56.193663 18062 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:56.193979 19130 raft_consensus.cc:1064] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:09:56.194730 18921 raft_consensus.cc:2804] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:56.195188 18921 raft_consensus.cc:697] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:56.196136 17944 raft_consensus.cc:2468] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:09:56.195984 18921 consensus_queue.cc:237] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:56.196240 19130 consensus_queue.cc:237] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:56.202366 18643 raft_consensus.cc:1275] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:56.215962 17945 raft_consensus.cc:1275] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:56.215660 19293 consensus_queue.cc:1048] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:56.219277 19293 consensus_queue.cc:1048] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:56.221472 18024 raft_consensus.cc:1275] T a8c7e98721a04c9690aef2689338516a P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:56.227185 17844 catalog_manager.cc:5697] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 1 to 2, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 2 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:56.232177 18921 consensus_queue.cc:1048] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:56.240492 19293 raft_consensus.cc:2955] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:56.243372 17945 raft_consensus.cc:2955] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:56.255538 18643 raft_consensus.cc:2955] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:56.259012 18024 raft_consensus.cc:2955] T a8c7e98721a04c9690aef2689338516a P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:56.261569 17844 catalog_manager.cc:5697] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:56.283306 18091 consensus_queue.cc:237] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:56.290964 17945 raft_consensus.cc:1275] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:56.292840 18643 raft_consensus.cc:1275] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:56.293329 19293 consensus_queue.cc:1048] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:56.295176 19130 consensus_queue.cc:1048] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:56.301287 19221 raft_consensus.cc:1064] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:09:56.303701 19221 consensus_queue.cc:237] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:56.304013 18921 raft_consensus.cc:2955] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:56.311985 18641 raft_consensus.cc:2955] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:56.316875 17945 raft_consensus.cc:2955] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:56.320988 18643 raft_consensus.cc:1275] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEARNER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:56.325806 19293 consensus_queue.cc:1048] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:56.331732 18024 raft_consensus.cc:1275] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:56.332887 19221 consensus_queue.cc:1048] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:56.333274 17944 raft_consensus.cc:1275] T 17e56ed7b94d4185a4f7dd88f922e17d P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:56.336781 17833 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a8c7e98721a04c9690aef2689338516a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:56.348953 19293 consensus_queue.cc:1048] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:56.350550 17845 catalog_manager.cc:5697] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:56.373082 18005 tablet_service.cc:1558] Processing DeleteTablet for tablet a8c7e98721a04c9690aef2689338516a with delete_type TABLET_DATA_TOMBSTONED (TS c5ffa786c8fb43f7864fa8fbe76534cb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45450
I20260709 12:09:56.383091 18641 raft_consensus.cc:1275] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:09:56.384537 19259 consensus_queue.cc:1048] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:09:56.387456 19221 raft_consensus.cc:2955] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:56.392825 18018 raft_consensus.cc:2955] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:56.392000 18643 raft_consensus.cc:2955] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:56.427595 19301 tablet_replica.cc:333] T a8c7e98721a04c9690aef2689338516a P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:09:56.438482 17844 catalog_manager.cc:5697] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:56.456715 19301 raft_consensus.cc:2243] T a8c7e98721a04c9690aef2689338516a P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:56.492573 18095 raft_consensus.cc:1275] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:56.442759 19259 raft_consensus.cc:1064] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:09:56.493872 19301 raft_consensus.cc:2272] T a8c7e98721a04c9690aef2689338516a P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:56.469314 19221 raft_consensus.cc:1064] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:09:56.479003 18091 consensus_queue.cc:237] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:56.466236 17944 raft_consensus.cc:2955] T 17e56ed7b94d4185a4f7dd88f922e17d P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:56.508868 18643 raft_consensus.cc:1275] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:56.508586 18933 consensus_queue.cc:1048] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:56.510778 18921 consensus_queue.cc:1048] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:56.496176 19259 consensus_queue.cc:237] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:56.517881 19301 ts_tablet_manager.cc:1916] T a8c7e98721a04c9690aef2689338516a P c5ffa786c8fb43f7864fa8fbe76534cb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:56.521523 18643 raft_consensus.cc:2955] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:56.528717 18024 raft_consensus.cc:1275] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:56.518318 19130 raft_consensus.cc:2955] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:56.506313 19221 consensus_queue.cc:237] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:56.520587 18018 raft_consensus.cc:1275] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:56.602886 19301 ts_tablet_manager.cc:1929] T a8c7e98721a04c9690aef2689338516a P c5ffa786c8fb43f7864fa8fbe76534cb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:56.631163 19301 log.cc:1199] T a8c7e98721a04c9690aef2689338516a P c5ffa786c8fb43f7864fa8fbe76534cb: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-1-root/wals/a8c7e98721a04c9690aef2689338516a
I20260709 12:09:56.607971 18091 raft_consensus.cc:1275] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:09:56.620755 17846 catalog_manager.cc:5697] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New cstate: current_term: 2 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:56.594874 18933 consensus_queue.cc:1048] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:56.629901 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 98950.1us
I20260709 12:09:56.647787 19293 consensus_queue.cc:1048] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:56.650565 19257 consensus_queue.cc:1048] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:09:56.654768 18019 raft_consensus.cc:2955] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:56.658241 18024 raft_consensus.cc:1275] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:56.659240 18641 raft_consensus.cc:1275] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEARNER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:56.661011 19221 consensus_queue.cc:1048] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:56.662446 17945 raft_consensus.cc:1275] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:09:56.669739 18921 consensus_queue.cc:1048] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:56.670715 19221 consensus_queue.cc:1048] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:09:56.722837 17833 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 17e56ed7b94d4185a4f7dd88f922e17d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:56.725312 17832 catalog_manager.cc:5028] TS c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): tablet a8c7e98721a04c9690aef2689338516a (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:09:56.740159 17933 tablet_service.cc:1558] Processing DeleteTablet for tablet 17e56ed7b94d4185a4f7dd88f922e17d with delete_type TABLET_DATA_TOMBSTONED (TS 63f5bddeebd84e5788d671a176cfa8e1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50326
I20260709 12:09:56.757220 19324 tablet_replica.cc:333] T 17e56ed7b94d4185a4f7dd88f922e17d P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:09:56.765385 17947 raft_consensus.cc:1275] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:56.771821 19324 raft_consensus.cc:2243] T 17e56ed7b94d4185a4f7dd88f922e17d P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:56.808455 18097 raft_consensus.cc:1275] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:56.798214 19127 consensus_queue.cc:1048] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:09:56.820405 19306 consensus_queue.cc:1048] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:56.843073 18641 raft_consensus.cc:1275] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:09:56.846570 19324 raft_consensus.cc:2272] T 17e56ed7b94d4185a4f7dd88f922e17d P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:56.878345 17947 raft_consensus.cc:1275] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:56.884361 19324 ts_tablet_manager.cc:1916] T 17e56ed7b94d4185a4f7dd88f922e17d P 63f5bddeebd84e5788d671a176cfa8e1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:56.887383 19259 consensus_queue.cc:1048] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:09:56.901597 18019 raft_consensus.cc:1275] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:56.884920 19309 raft_consensus.cc:2955] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:57.037848 19293 consensus_queue.cc:1048] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:09:57.054463 19293 consensus_queue.cc:1048] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:09:56.982993 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 156617us
I20260709 12:09:57.087822 18019 raft_consensus.cc:2955] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:57.113425 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:57.120985 19306 raft_consensus.cc:2955] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:57.126659 18643 raft_consensus.cc:2955] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:57.151510 17947 raft_consensus.cc:2955] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:57.175943 18642 raft_consensus.cc:2955] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:57.183723 18097 raft_consensus.cc:2955] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:57.199106 19324 ts_tablet_manager.cc:1929] T 17e56ed7b94d4185a4f7dd88f922e17d P 63f5bddeebd84e5788d671a176cfa8e1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:09:57.199754 19324 log.cc:1199] T 17e56ed7b94d4185a4f7dd88f922e17d P 63f5bddeebd84e5788d671a176cfa8e1: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-0-root/wals/17e56ed7b94d4185a4f7dd88f922e17d
I20260709 12:09:57.204373 17832 catalog_manager.cc:5028] TS 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): tablet 17e56ed7b94d4185a4f7dd88f922e17d (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:09:57.352900 17845 catalog_manager.cc:5697] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: config changed from index 3 to 4, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:57.378715 17946 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:09:57.379423 17946 raft_consensus.cc:606] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:09:57.384666 17946 raft_consensus.cc:2955] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:57.392499 18097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
mode: GRACEFUL
new_leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
 from {username='slave'} at 127.0.0.1:40154
I20260709 12:09:57.393105 18097 raft_consensus.cc:606] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Received request to transfer leadership to TS c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:57.398240 18022 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
mode: GRACEFUL
new_leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:44098
I20260709 12:09:57.398765 18022 raft_consensus.cc:606] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Received request to transfer leadership to TS 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:57.400115 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:09:57.401736 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:57.402697 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:57.406275 17847 catalog_manager.cc:5697] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:57.437839 18097 consensus_queue.cc:237] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:57.444523 18643 raft_consensus.cc:1275] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:57.445822 18024 raft_consensus.cc:1275] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:57.446817 18921 consensus_queue.cc:1048] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:57.447981 19221 consensus_queue.cc:1048] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:57.454269 19309 raft_consensus.cc:2955] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:57.457463 18643 raft_consensus.cc:2955] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:57.463016 18024 consensus_queue.cc:237] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:57.466081 18022 raft_consensus.cc:2955] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:57.469311 18642 raft_consensus.cc:1275] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:57.470683 18091 raft_consensus.cc:1275] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:09:57.472623 19257 consensus_queue.cc:1048] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:57.474568 19127 consensus_queue.cc:1048] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:09:57.482533 19259 raft_consensus.cc:2955] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:57.492329 18091 raft_consensus.cc:2955] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:57.499861 18642 raft_consensus.cc:2955] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:57.506299 17846 catalog_manager.cc:5697] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: config changed from index 4 to 5, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New cstate: current_term: 2 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:57.517765 17933 tablet_service.cc:1558] Processing DeleteTablet for tablet 5379a078a5d24d8cba5cb4e56eee5b5f with delete_type TABLET_DATA_TOMBSTONED (TS 63f5bddeebd84e5788d671a176cfa8e1 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:50326
I20260709 12:09:57.518898 19324 tablet_replica.cc:333] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:09:57.531684 17833 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5379a078a5d24d8cba5cb4e56eee5b5f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:57.540613 17832 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 66bde4bf25ea49f2b5f4b768cba4cdd0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:09:57.550117 19306 raft_consensus.cc:993] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb: : Instructing follower 63f5bddeebd84e5788d671a176cfa8e1 to start an election
I20260709 12:09:57.550827 19127 raft_consensus.cc:1081] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Signalling peer 63f5bddeebd84e5788d671a176cfa8e1 to start an election
I20260709 12:09:57.551246 17846 catalog_manager.cc:5697] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:09:57.552529 17946 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:50334
I20260709 12:09:57.553102 17946 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:57.553412 17946 raft_consensus.cc:3060] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.558512 19324 raft_consensus.cc:2243] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:57.559286 19324 raft_consensus.cc:2272] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:57.559994 17946 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:57.562386 19326 raft_consensus.cc:993] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1: : Instructing follower 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:09:57.562758 17946 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:09:57.562846 19326 raft_consensus.cc:1081] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Signalling peer 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:09:57.564060 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:57.564657 18024 raft_consensus.cc:3055] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:57.564932 18024 raft_consensus.cc:740] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:09:57.565723 18024 consensus_queue.cc:260] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:57.568157 19324 ts_tablet_manager.cc:1916] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:57.568847 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:09:57.568958 18024 raft_consensus.cc:3060] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.570286 18643 raft_consensus.cc:3060] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.587847 17933 tablet_service.cc:1558] Processing DeleteTablet for tablet 66bde4bf25ea49f2b5f4b768cba4cdd0 with delete_type TABLET_DATA_TOMBSTONED (TS 63f5bddeebd84e5788d671a176cfa8e1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50326
I20260709 12:09:57.600318 18094 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:53964
I20260709 12:09:57.602229 18094 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:57.602583 18094 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.601109 18643 raft_consensus.cc:2468] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:09:57.607702 17912 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:09:57.608754 19326 raft_consensus.cc:2804] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:57.609217 19326 raft_consensus.cc:697] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:09:57.610095 19326 consensus_queue.cc:237] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:57.614974 18024 raft_consensus.cc:2468] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:09:57.618959 18094 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:57.620862 18094 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:57.621699 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:57.621907 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:57.622479 17946 raft_consensus.cc:3055] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:57.622395 18024 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.622908 17946 raft_consensus.cc:740] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:09:57.623585 17946 consensus_queue.cc:260] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:57.624570 17946 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:57.629369 18024 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:09:57.630961 18062 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:57.630605 17946 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:09:57.631193 19324 ts_tablet_manager.cc:1929] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:09:57.632470 19324 log.cc:1199] T 5379a078a5d24d8cba5cb4e56eee5b5f P 63f5bddeebd84e5788d671a176cfa8e1: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-0-root/wals/5379a078a5d24d8cba5cb4e56eee5b5f
I20260709 12:09:57.633301 19309 raft_consensus.cc:2804] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:57.634097 19324 tablet_replica.cc:333] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:09:57.633477 17846 catalog_manager.cc:5697] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 1 to 2, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:57.634260 19309 raft_consensus.cc:697] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:57.635231 19324 raft_consensus.cc:2243] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:09:57.634302 17832 catalog_manager.cc:5028] TS 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): tablet 5379a078a5d24d8cba5cb4e56eee5b5f (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:09:57.636126 19324 raft_consensus.cc:2272] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:09:57.635769 19309 consensus_queue.cc:237] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:57.639956 19324 ts_tablet_manager.cc:1916] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 63f5bddeebd84e5788d671a176cfa8e1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:09:57.652338 17846 catalog_manager.cc:5697] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 1 to 2, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 2 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:57.656539 19324 ts_tablet_manager.cc:1929] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 63f5bddeebd84e5788d671a176cfa8e1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:09:57.657049 19324 log.cc:1199] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 63f5bddeebd84e5788d671a176cfa8e1: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-0-root/wals/66bde4bf25ea49f2b5f4b768cba4cdd0
I20260709 12:09:57.658553 17832 catalog_manager.cc:5028] TS 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): tablet 66bde4bf25ea49f2b5f4b768cba4cdd0 (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:09:57.861127 19309 raft_consensus.cc:993] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110: : Instructing follower c5ffa786c8fb43f7864fa8fbe76534cb to start an election
I20260709 12:09:57.861667 18921 raft_consensus.cc:1081] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Signalling peer c5ffa786c8fb43f7864fa8fbe76534cb to start an election
I20260709 12:09:57.863106 18024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
 from {username='slave'} at 127.0.0.1:45472
I20260709 12:09:57.863538 18024 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:57.863862 18024 raft_consensus.cc:3060] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:57.869242 18024 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:57.871026 18024 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:57.871258 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:57.871544 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:57.871836 17946 raft_consensus.cc:3060] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:57.872154 18094 raft_consensus.cc:3055] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:57.872398 18094 raft_consensus.cc:740] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:57.873050 18094 consensus_queue.cc:260] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:57.874055 18094 raft_consensus.cc:3060] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:57.877414 17946 raft_consensus.cc:2468] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:09:57.878572 17988 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:57.879276 19259 raft_consensus.cc:2804] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:57.879700 19259 raft_consensus.cc:697] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:09:57.879776 18094 raft_consensus.cc:2468] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:09:57.880594 19259 consensus_queue.cc:237] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:57.888942 17846 catalog_manager.cc:5697] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 2 to 3, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 3 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:57.989310 18643 raft_consensus.cc:1275] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:57.990381 19326 consensus_queue.cc:1048] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:09:58.003840 18022 raft_consensus.cc:1275] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:09:58.006385 19317 consensus_queue.cc:1048] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:09:58.094312 18022 raft_consensus.cc:1275] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:58.137111 19309 consensus_queue.cc:1048] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:58.159966 17946 raft_consensus.cc:1275] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:58.165521 19309 consensus_queue.cc:1048] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:58.397672 17946 raft_consensus.cc:1275] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:58.398936 19259 consensus_queue.cc:1048] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:58.408804 18094 raft_consensus.cc:1275] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:58.410228 19357 consensus_queue.cc:1048] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:58.518076 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:58.559998 18094 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
mode: GRACEFUL
new_leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:40154
I20260709 12:09:58.560617 18094 raft_consensus.cc:606] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Received request to transfer leadership to TS e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:58.563555 17945 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:09:58.564090 17945 raft_consensus.cc:606] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:09:58.567585 17945 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:09:58.568130 17945 raft_consensus.cc:606] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:09:58.571135 18024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4f794e5675049b284921052a24eea37"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
mode: GRACEFUL
new_leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:44098
I20260709 12:09:58.571738 18024 raft_consensus.cc:606] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Received request to transfer leadership to TS 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:09:58.575579 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:09:58.577170 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:58.577934 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:58.630396 19212 raft_consensus.cc:993] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1: : Instructing follower 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:09:58.630995 19317 raft_consensus.cc:1081] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Signalling peer 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:09:58.632846 18094 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:53964
I20260709 12:09:58.639097 18094 raft_consensus.cc:493] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:58.639472 18094 raft_consensus.cc:3060] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.646617 18094 raft_consensus.cc:515] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:58.648612 18094 leader_election.cc:290] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:58.649173 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:58.649740 17946 raft_consensus.cc:3055] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:58.650031 17946 raft_consensus.cc:740] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:09:58.650759 17946 consensus_queue.cc:260] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:58.651845 17946 raft_consensus.cc:3060] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.655115 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:58.655727 18024 raft_consensus.cc:3060] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.659866 17946 raft_consensus.cc:2468] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:09:58.661094 18062 leader_election.cc:304] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:09:58.661877 19353 raft_consensus.cc:2804] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:58.662189 18024 raft_consensus.cc:2468] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:09:58.662309 19353 raft_consensus.cc:697] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:58.663298 19353 consensus_queue.cc:237] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:58.675911 17946 consensus_queue.cc:237] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:58.677208 17846 catalog_manager.cc:5697] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 1 to 2, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 2 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:58.683116 18094 raft_consensus.cc:1275] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:58.684302 19212 consensus_queue.cc:1048] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:09:58.685285 17912 consensus_peers.cc:597] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 45c29a91be76451a9328d8cd9e3eecab. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:58.685597 18024 raft_consensus.cc:1275] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:09:58.687350 19317 consensus_queue.cc:1048] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:58.694181 19212 raft_consensus.cc:2955] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:58.697474 18024 raft_consensus.cc:2955] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:58.698959 18094 raft_consensus.cc:2955] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:58.711108 18019 consensus_queue.cc:237] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:58.713405 17846 catalog_manager.cc:5697] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: config changed from index -1 to 3, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 2 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:58.727888 18094 raft_consensus.cc:1275] T 59c85902a99e4edabb1fa20b800476fc P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:58.729300 17987 consensus_peers.cc:597] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 59c85902a99e4edabb1fa20b800476fc. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:58.732059 19259 consensus_queue.cc:1048] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:58.734954 17946 raft_consensus.cc:1275] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:58.736420 19259 consensus_queue.cc:1048] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:58.741062 19127 raft_consensus.cc:2955] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:58.744678 18097 raft_consensus.cc:2955] T 59c85902a99e4edabb1fa20b800476fc P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:58.762125 18093 consensus_queue.cc:237] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:58.774569 17847 catalog_manager.cc:5697] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:58.777712 17946 raft_consensus.cc:2955] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:58.790048 18019 raft_consensus.cc:1275] T 158a286025af4eddba6fb641c128cd25 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:09:58.792601 18061 consensus_peers.cc:597] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 158a286025af4eddba6fb641c128cd25. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:09:58.793308 17946 raft_consensus.cc:1275] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:09:58.794826 19221 consensus_queue.cc:1048] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:58.796391 19221 consensus_queue.cc:1048] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:58.805003 19309 raft_consensus.cc:2955] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:58.806542 18024 raft_consensus.cc:2955] T 158a286025af4eddba6fb641c128cd25 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:58.808436 17946 raft_consensus.cc:2955] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:09:58.825735 17847 catalog_manager.cc:5697] T 158a286025af4eddba6fb641c128cd25 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
W20260709 12:09:58.828492 17894 auto_rebalancer.cc:629] Failed to schedule move for tablet b8e1f5339f9042c5935e082c5f212b35: Remote error: Service unavailable: leader transfer in progress
I20260709 12:09:58.881664 19357 raft_consensus.cc:993] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb: : Instructing follower 63f5bddeebd84e5788d671a176cfa8e1 to start an election
I20260709 12:09:58.882184 19357 raft_consensus.cc:1081] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Signalling peer 63f5bddeebd84e5788d671a176cfa8e1 to start an election
I20260709 12:09:58.883752 17945 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4f794e5675049b284921052a24eea37"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:50334
I20260709 12:09:58.884181 17945 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:58.884480 17945 raft_consensus.cc:3060] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.889276 17945 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:58.891479 17945 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:58.892692 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:58.892874 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:58.893263 18024 raft_consensus.cc:3055] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:58.893455 18093 raft_consensus.cc:3060] T c4f794e5675049b284921052a24eea37 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.893610 18024 raft_consensus.cc:740] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:09:58.894385 18024 consensus_queue.cc:260] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:58.897486 18024 raft_consensus.cc:3060] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:58.900882 18093 raft_consensus.cc:2468] T c4f794e5675049b284921052a24eea37 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:09:58.902704 17914 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:09:58.903489 19316 raft_consensus.cc:2804] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:58.903932 19316 raft_consensus.cc:697] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:09:58.904697 19316 consensus_queue.cc:237] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:58.913358 18024 raft_consensus.cc:2468] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:09:58.924549 17845 catalog_manager.cc:5697] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 1 to 2, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:58.974586 19309 raft_consensus.cc:993] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110: : Instructing follower e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:09:58.975836 19309 raft_consensus.cc:1081] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Signalling peer e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:09:58.977291 18643 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:60412
I20260709 12:09:58.977790 18643 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:58.978132 18643 raft_consensus.cc:3060] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.984676 18643 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:58.987484 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:58.988021 18024 raft_consensus.cc:3060] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.991547 19212 raft_consensus.cc:993] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1: : Instructing follower 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:09:58.991997 19212 raft_consensus.cc:1081] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Signalling peer 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:09:58.992118 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:58.992687 18097 raft_consensus.cc:3055] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:58.992976 18097 raft_consensus.cc:740] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:58.993646 18097 consensus_queue.cc:260] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:58.993966 18093 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:53964
I20260709 12:09:58.994596 18093 raft_consensus.cc:493] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:58.994755 18097 raft_consensus.cc:3060] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:58.995107 18093 raft_consensus.cc:3060] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.003881 18093 raft_consensus.cc:515] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:59.005498 18024 raft_consensus.cc:2468] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 3.
I20260709 12:09:59.005684 18093 leader_election.cc:290] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:59.006680 18608 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:09:59.007891 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:59.008198 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:09:59.008455 17945 raft_consensus.cc:3055] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:59.008713 18019 raft_consensus.cc:3060] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.008754 17945 raft_consensus.cc:740] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:09:59.007930 19372 raft_consensus.cc:2804] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:59.010520 17945 consensus_queue.cc:260] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:59.011337 19372 raft_consensus.cc:697] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:09:59.011608 17945 raft_consensus.cc:3060] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.012279 19372 consensus_queue.cc:237] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:59.011031 18643 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:59.018352 18097 raft_consensus.cc:2468] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 3.
I20260709 12:09:59.021903 17945 raft_consensus.cc:2468] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:09:59.023182 18062 leader_election.cc:304] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:09:59.024888 19221 raft_consensus.cc:2804] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:59.026849 19221 raft_consensus.cc:697] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:59.027396 18019 raft_consensus.cc:2468] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:09:59.027716 19221 consensus_queue.cc:237] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:59.046821 17845 catalog_manager.cc:5697] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 2 to 3, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 3 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:09:59.048245 17847 catalog_manager.cc:5697] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 2 to 3, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 3 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:09:59.068212 19378 ts_tablet_manager.cc:933] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123)
I20260709 12:09:59.069932 19378 tablet_copy_client.cc:323] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.193:39123
I20260709 12:09:59.071643 17959 tablet_copy_service.cc:140] P 63f5bddeebd84e5788d671a176cfa8e1: Received BeginTabletCopySession request for tablet 45c29a91be76451a9328d8cd9e3eecab from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:44668)
I20260709 12:09:59.072100 17959 tablet_copy_service.cc:161] P 63f5bddeebd84e5788d671a176cfa8e1: Beginning new tablet copy session on tablet 45c29a91be76451a9328d8cd9e3eecab from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:44668: session id = e28f77912a9c4ba2b9841f6fedddc2db-45c29a91be76451a9328d8cd9e3eecab
I20260709 12:09:59.078022 17959 tablet_copy_source_session.cc:215] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:59.080945 19378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45c29a91be76451a9328d8cd9e3eecab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:59.097374 19378 tablet_copy_client.cc:806] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:59.098439 19378 tablet_copy_client.cc:670] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:59.102223 19378 tablet_copy_client.cc:538] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:59.108512 19378 tablet_bootstrap.cc:492] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:09:59.111953 17945 raft_consensus.cc:1275] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:59.113289 19221 consensus_queue.cc:1048] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:59.131250 19381 ts_tablet_manager.cc:933] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:09:59.156158 19378 tablet_bootstrap.cc:492] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:59.157352 19378 tablet_bootstrap.cc:492] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:09:59.158242 19378 ts_tablet_manager.cc:1403] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.050s	user 0.019s	sys 0.012s
I20260709 12:09:59.159053 19381 tablet_copy_client.cc:323] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.194:36297
I20260709 12:09:59.160892 18033 tablet_copy_service.cc:140] P c5ffa786c8fb43f7864fa8fbe76534cb: Received BeginTabletCopySession request for tablet 59c85902a99e4edabb1fa20b800476fc from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:53022)
I20260709 12:09:59.161456 18033 tablet_copy_service.cc:161] P c5ffa786c8fb43f7864fa8fbe76534cb: Beginning new tablet copy session on tablet 59c85902a99e4edabb1fa20b800476fc from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:53022: session id = e28f77912a9c4ba2b9841f6fedddc2db-59c85902a99e4edabb1fa20b800476fc
I20260709 12:09:59.161549 18019 raft_consensus.cc:1275] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:59.168798 19309 consensus_queue.cc:1048] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:59.170765 18033 tablet_copy_source_session.cc:215] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:59.175284 19378 raft_consensus.cc:359] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:59.176187 19378 raft_consensus.cc:740] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:09:59.176841 19378 consensus_queue.cc:260] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:59.182140 19378 ts_tablet_manager.cc:1434] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.000s
I20260709 12:09:59.184011 19381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59c85902a99e4edabb1fa20b800476fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:59.195717 17959 tablet_copy_service.cc:342] P 63f5bddeebd84e5788d671a176cfa8e1: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-45c29a91be76451a9328d8cd9e3eecab received from {username='slave'} at 127.0.0.1:44668
I20260709 12:09:59.196271 17959 tablet_copy_service.cc:434] P 63f5bddeebd84e5788d671a176cfa8e1: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-45c29a91be76451a9328d8cd9e3eecab on tablet 45c29a91be76451a9328d8cd9e3eecab with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:59.207358 19381 tablet_copy_client.cc:806] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:59.208186 19381 tablet_copy_client.cc:670] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:59.225633 19381 tablet_copy_client.cc:538] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:59.241775 19381 tablet_bootstrap.cc:492] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:09:59.263080 19381 tablet_bootstrap.cc:492] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:59.263892 19381 tablet_bootstrap.cc:492] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:09:59.264541 19381 ts_tablet_manager.cc:1403] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.006s
I20260709 12:09:59.267349 19381 raft_consensus.cc:359] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:59.268146 19381 raft_consensus.cc:740] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:09:59.268682 19381 consensus_queue.cc:260] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:59.271202 19381 ts_tablet_manager.cc:1434] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.006s
I20260709 12:09:59.272998 18033 tablet_copy_service.cc:342] P c5ffa786c8fb43f7864fa8fbe76534cb: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-59c85902a99e4edabb1fa20b800476fc received from {username='slave'} at 127.0.0.1:53022
I20260709 12:09:59.273447 18033 tablet_copy_service.cc:434] P c5ffa786c8fb43f7864fa8fbe76534cb: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-59c85902a99e4edabb1fa20b800476fc on tablet 59c85902a99e4edabb1fa20b800476fc with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:59.306022 19381 ts_tablet_manager.cc:933] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:59.312876 19381 tablet_copy_client.cc:323] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.195:41931
I20260709 12:09:59.314581 18108 tablet_copy_service.cc:140] P 4813437da0a74e65b61eb7bd1d18f110: Received BeginTabletCopySession request for tablet 158a286025af4eddba6fb641c128cd25 from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:41818)
I20260709 12:09:59.315162 18108 tablet_copy_service.cc:161] P 4813437da0a74e65b61eb7bd1d18f110: Beginning new tablet copy session on tablet 158a286025af4eddba6fb641c128cd25 from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:41818: session id = e28f77912a9c4ba2b9841f6fedddc2db-158a286025af4eddba6fb641c128cd25
I20260709 12:09:59.323061 18108 tablet_copy_source_session.cc:215] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:09:59.326061 19381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 158a286025af4eddba6fb641c128cd25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:09:59.340835 19381 tablet_copy_client.cc:806] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:09:59.341408 19381 tablet_copy_client.cc:670] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:09:59.344940 19381 tablet_copy_client.cc:538] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:09:59.359601 19381 tablet_bootstrap.cc:492] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:09:59.386063 19381 tablet_bootstrap.cc:492] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:09:59.387002 19381 tablet_bootstrap.cc:492] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:09:59.387666 19381 ts_tablet_manager.cc:1403] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.010s
I20260709 12:09:59.389940 19381 raft_consensus.cc:359] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:59.390563 19381 raft_consensus.cc:740] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:09:59.391261 19381 consensus_queue.cc:260] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:09:59.393401 19381 ts_tablet_manager.cc:1434] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:09:59.394999 18108 tablet_copy_service.cc:342] P 4813437da0a74e65b61eb7bd1d18f110: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-158a286025af4eddba6fb641c128cd25 received from {username='slave'} at 127.0.0.1:41818
I20260709 12:09:59.395345 18108 tablet_copy_service.cc:434] P 4813437da0a74e65b61eb7bd1d18f110: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-158a286025af4eddba6fb641c128cd25 on tablet 158a286025af4eddba6fb641c128cd25 with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:09:59.416497 18024 raft_consensus.cc:1275] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:59.417632 19212 consensus_queue.cc:1048] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:59.431154 18097 raft_consensus.cc:1275] T c4f794e5675049b284921052a24eea37 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:09:59.432652 19317 consensus_queue.cc:1048] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:09:59.473563 18093 raft_consensus.cc:1275] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:09:59.474823 19372 consensus_queue.cc:1048] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:09:59.490085 18024 raft_consensus.cc:1275] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:09:59.494894 19370 consensus_queue.cc:1048] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:09:59.536859 17948 raft_consensus.cc:1275] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:59.540242 19221 consensus_queue.cc:1048] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:59.569347 18024 raft_consensus.cc:1275] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:09:59.571349 19353 consensus_queue.cc:1048] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:09:59.615854 18641 raft_consensus.cc:1217] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:09:59.623972 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:59.641547 18641 raft_consensus.cc:1217] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:09:59.682169 18097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
mode: GRACEFUL
new_leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
 from {username='slave'} at 127.0.0.1:40154
I20260709 12:09:59.682691 18097 raft_consensus.cc:606] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Received request to transfer leadership to TS c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:59.685071 17946 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:09:59.685590 17946 raft_consensus.cc:606] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:09:59.689357 18097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
mode: GRACEFUL
new_leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
 from {username='slave'} at 127.0.0.1:40154
I20260709 12:09:59.689844 18097 raft_consensus.cc:606] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Received request to transfer leadership to TS c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:09:59.690964 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:09:59.692566 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:09:59.693228 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:09:59.746500 19221 raft_consensus.cc:993] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110: : Instructing follower c5ffa786c8fb43f7864fa8fbe76534cb to start an election
I20260709 12:09:59.747110 19309 raft_consensus.cc:1081] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Signalling peer c5ffa786c8fb43f7864fa8fbe76534cb to start an election
I20260709 12:09:59.748526 18024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
 from {username='slave'} at 127.0.0.1:45472
I20260709 12:09:59.749043 18024 raft_consensus.cc:493] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:59.749402 18024 raft_consensus.cc:3060] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.756019 18024 raft_consensus.cc:515] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:59.758821 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:09:59.759370 17946 raft_consensus.cc:3060] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.760040 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:59.760578 18097 raft_consensus.cc:3055] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:09:59.760861 18097 raft_consensus.cc:740] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:59.761579 18097 consensus_queue.cc:260] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:59.762553 18097 raft_consensus.cc:3060] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:09:59.766698 17946 raft_consensus.cc:2468] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 2.
I20260709 12:09:59.767956 17988 leader_election.cc:304] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:09:59.768765 18024 leader_election.cc:290] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:09:59.768843 19127 raft_consensus.cc:2804] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:09:59.771533 19127 raft_consensus.cc:697] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:09:59.772408 19127 consensus_queue.cc:237] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:09:59.771521 18097 raft_consensus.cc:2468] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 2.
I20260709 12:09:59.784584 17847 catalog_manager.cc:5697] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 1 to 2, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 2 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:59.801071 19221 raft_consensus.cc:993] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110: : Instructing follower c5ffa786c8fb43f7864fa8fbe76534cb to start an election
I20260709 12:09:59.801585 19309 raft_consensus.cc:1081] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Signalling peer c5ffa786c8fb43f7864fa8fbe76534cb to start an election
I20260709 12:09:59.803124 18024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
 from {username='slave'} at 127.0.0.1:45472
I20260709 12:09:59.803622 18024 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:09:59.803921 18024 raft_consensus.cc:3060] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.810551 18024 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:59.813604 18024 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:09:59.813748 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:09:59.814355 18641 raft_consensus.cc:3060] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.816787 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:09:59.817379 18097 raft_consensus.cc:3055] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:09:59.819160 18097 raft_consensus.cc:740] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:09:59.819921 18097 consensus_queue.cc:260] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:59.821089 18097 raft_consensus.cc:3060] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:09:59.821188 18641 raft_consensus.cc:2468] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:09:59.822501 17987 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:09:59.823223 19127 raft_consensus.cc:2804] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:09:59.823640 19127 raft_consensus.cc:697] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:09:59.824801 19127 consensus_queue.cc:237] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:09:59.828174 18097 raft_consensus.cc:2468] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:09:59.845091 17847 catalog_manager.cc:5697] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 2 to 3, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 3 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:09:59.873672 18641 raft_consensus.cc:1217] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:10:00.022753 19357 raft_consensus.cc:1064] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:10:00.025055 19357 consensus_queue.cc:237] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:00.032065 18097 raft_consensus.cc:1275] T 59c85902a99e4edabb1fa20b800476fc P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:10:00.032080 18643 raft_consensus.cc:1275] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:10:00.033198 17946 raft_consensus.cc:1275] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:10:00.033874 19127 consensus_queue.cc:1048] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:00.034724 19259 consensus_queue.cc:1048] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:00.035663 19357 consensus_queue.cc:1048] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:00.064184 19259 raft_consensus.cc:2955] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:00.079296 18643 raft_consensus.cc:2955] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:00.255587 19412 raft_consensus.cc:1064] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:10:00.257920 19412 consensus_queue.cc:237] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:00.282099 18643 raft_consensus.cc:1275] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEARNER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:00.283972 19317 consensus_queue.cc:1048] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:00.294963 18024 raft_consensus.cc:1275] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:00.296777 17847 catalog_manager.cc:5697] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:00.304090 18093 raft_consensus.cc:1275] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:00.306828 17946 raft_consensus.cc:2955] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:00.304204 19212 raft_consensus.cc:993] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1: : Instructing follower 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:10:00.341455 19412 raft_consensus.cc:1081] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Signalling peer 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:10:00.353813 19316 consensus_queue.cc:1048] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:10:00.369431 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 54061.9us
W20260709 12:10:00.382535 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 46943us
I20260709 12:10:00.388331 18093 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:53964
I20260709 12:10:00.388939 18642 raft_consensus.cc:1275] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:00.389674 18094 raft_consensus.cc:2955] T 59c85902a99e4edabb1fa20b800476fc P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:00.400542 18093 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:00.400995 18093 raft_consensus.cc:3060] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:00.404902 19411 raft_consensus.cc:1064] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:10:00.407078 19411 consensus_queue.cc:237] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:00.409044 18093 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:00.384478 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 65573.5us
I20260709 12:10:00.421730 19317 consensus_queue.cc:1048] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:00.425168 18094 raft_consensus.cc:1275] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:00.425269 18024 consensus_queue.cc:237] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:00.436066 19127 consensus_queue.cc:1048] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:00.436409 18093 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:00.441809 19414 consensus_queue.cc:1048] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:00.444465 18642 raft_consensus.cc:1275] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:10:00.442844 18094 raft_consensus.cc:1275] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:00.448737 19414 consensus_queue.cc:1048] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:00.461339 19414 consensus_queue.cc:1048] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:00.471104 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:00.471716 18024 raft_consensus.cc:3060] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:00.473031 18090 raft_consensus.cc:2955] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:00.469959 19212 raft_consensus.cc:2955] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:00.478715 18024 raft_consensus.cc:2468] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:00.480046 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:00.480625 17947 raft_consensus.cc:3055] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:00.480937 17947 raft_consensus.cc:740] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:00.481626 17947 consensus_queue.cc:260] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:00.482717 17947 raft_consensus.cc:3060] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:00.484340 18062 leader_election.cc:304] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:00.485201 19221 raft_consensus.cc:2804] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:00.485725 19221 raft_consensus.cc:697] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:00.486507 19221 consensus_queue.cc:237] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:00.492514 18641 raft_consensus.cc:2955] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:00.495373 19416 raft_consensus.cc:2955] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:00.493427 17946 raft_consensus.cc:1275] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:00.508244 18643 raft_consensus.cc:2955] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:00.555820 17940 raft_consensus.cc:1275] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:10:00.572770 18643 raft_consensus.cc:1275] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:10:00.574436 19418 consensus_queue.cc:1048] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:00.594563 18019 raft_consensus.cc:1275] T 158a286025af4eddba6fb641c128cd25 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:10:00.596426 19408 consensus_queue.cc:1048] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:00.603478 17832 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 59c85902a99e4edabb1fa20b800476fc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:00.608378 19408 raft_consensus.cc:2955] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:00.610112 18019 raft_consensus.cc:2955] T 158a286025af4eddba6fb641c128cd25 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:00.613049 17845 catalog_manager.cc:5697] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:00.622120 17847 catalog_manager.cc:5697] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: config changed from index 3 to 4, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:00.625265 17847 catalog_manager.cc:5697] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 2 to 3, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 3 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:00.627954 18080 tablet_service.cc:1558] Processing DeleteTablet for tablet 59c85902a99e4edabb1fa20b800476fc with delete_type TABLET_DATA_TOMBSTONED (TS 4813437da0a74e65b61eb7bd1d18f110 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53944
I20260709 12:10:00.631227 18643 raft_consensus.cc:2955] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:00.635586 19357 consensus_queue.cc:1048] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:00.633154 19414 consensus_queue.cc:1048] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:00.632542 17947 raft_consensus.cc:2468] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:00.653901 19433 tablet_replica.cc:333] T 59c85902a99e4edabb1fa20b800476fc P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:10:00.655030 19433 raft_consensus.cc:2243] T 59c85902a99e4edabb1fa20b800476fc P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:00.661648 17846 catalog_manager.cc:5697] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:00.667302 17940 raft_consensus.cc:1275] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:10:00.687041 19433 raft_consensus.cc:2272] T 59c85902a99e4edabb1fa20b800476fc P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:00.683773 17944 raft_consensus.cc:2955] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:00.694798 17947 consensus_queue.cc:237] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:00.700078 19408 consensus_queue.cc:1048] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:00.701258 19433 ts_tablet_manager.cc:1916] T 59c85902a99e4edabb1fa20b800476fc P 4813437da0a74e65b61eb7bd1d18f110: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:00.702848 18024 raft_consensus.cc:2955] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:00.714879 18093 raft_consensus.cc:1275] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:00.716212 18642 raft_consensus.cc:1275] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:00.716553 19212 consensus_queue.cc:1048] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:00.717833 19407 consensus_queue.cc:1048] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:00.727805 19316 raft_consensus.cc:2955] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:00.731722 18642 raft_consensus.cc:2955] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:00.743593 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:00.742547 18094 raft_consensus.cc:2955] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:00.758658 19433 ts_tablet_manager.cc:1929] T 59c85902a99e4edabb1fa20b800476fc P 4813437da0a74e65b61eb7bd1d18f110: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:10:00.759214 19433 log.cc:1199] T 59c85902a99e4edabb1fa20b800476fc P 4813437da0a74e65b61eb7bd1d18f110: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-2-root/wals/59c85902a99e4edabb1fa20b800476fc
I20260709 12:10:00.763262 17833 catalog_manager.cc:5028] TS 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): tablet 59c85902a99e4edabb1fa20b800476fc (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:10:00.767958 17846 catalog_manager.cc:5697] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: config changed from index 4 to 5, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New cstate: current_term: 2 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:00.801985 18005 tablet_service.cc:1558] Processing DeleteTablet for tablet 45c29a91be76451a9328d8cd9e3eecab with delete_type TABLET_DATA_TOMBSTONED (TS c5ffa786c8fb43f7864fa8fbe76534cb not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:45450
I20260709 12:10:00.806615 17832 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 45c29a91be76451a9328d8cd9e3eecab with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:00.817617 19439 tablet_replica.cc:333] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:10:00.819734 19439 raft_consensus.cc:2243] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:00.819514 17944 raft_consensus.cc:2955] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:00.820639 19439 raft_consensus.cc:2272] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:00.825093 19439 ts_tablet_manager.cc:1916] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:00.850023 19439 ts_tablet_manager.cc:1929] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:10:00.850545 19439 log.cc:1199] T 45c29a91be76451a9328d8cd9e3eecab P c5ffa786c8fb43f7864fa8fbe76534cb: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-1-root/wals/45c29a91be76451a9328d8cd9e3eecab
I20260709 12:10:00.853556 17832 catalog_manager.cc:5028] TS c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): tablet 45c29a91be76451a9328d8cd9e3eecab (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:10:00.870947 18024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05a4983c833c415a94a4c285b408b305"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:44098
I20260709 12:10:00.871544 18024 raft_consensus.cc:606] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 LEADER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:00.874200 18093 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
mode: GRACEFUL
new_leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:40154
I20260709 12:10:00.874755 18093 raft_consensus.cc:606] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Received request to transfer leadership to TS 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:00.877103 18024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48619849881f46989095c1f3642592b7"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:44098
I20260709 12:10:00.877538 18024 raft_consensus.cc:606] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:00.879030 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:10:00.880339 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:00.881048 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:01.014006 18024 raft_consensus.cc:1275] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:01.015354 19221 consensus_queue.cc:1048] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:01.025019 17944 raft_consensus.cc:1275] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:01.026403 19309 consensus_queue.cc:1048] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:01.177806 19408 raft_consensus.cc:993] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110: : Instructing follower 63f5bddeebd84e5788d671a176cfa8e1 to start an election
I20260709 12:10:01.178272 19309 raft_consensus.cc:1081] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Signalling peer 63f5bddeebd84e5788d671a176cfa8e1 to start an election
I20260709 12:10:01.179721 17944 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:50336
I20260709 12:10:01.180162 17944 raft_consensus.cc:493] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:01.180426 17944 raft_consensus.cc:3060] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.184617 17944 raft_consensus.cc:515] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:01.186583 17944 leader_election.cc:290] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:01.186856 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:01.187163 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:01.187502 18093 raft_consensus.cc:3055] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:01.187723 18643 raft_consensus.cc:3060] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.187840 18093 raft_consensus.cc:740] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:01.188704 18093 consensus_queue.cc:260] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:01.189917 18093 raft_consensus.cc:3060] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.192869 18643 raft_consensus.cc:2468] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:10:01.193943 17912 leader_election.cc:304] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:01.194574 19212 raft_consensus.cc:2804] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:01.195039 19212 raft_consensus.cc:697] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:01.196014 19212 consensus_queue.cc:237] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:01.196506 18093 raft_consensus.cc:2468] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:10:01.209683 17845 catalog_manager.cc:5697] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 1 to 2, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:01.237591 19357 raft_consensus.cc:993] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb: : Instructing follower 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:10:01.238046 19357 raft_consensus.cc:1081] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Signalling peer 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:10:01.239905 18093 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "48619849881f46989095c1f3642592b7"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:53954
I20260709 12:10:01.240795 18093 raft_consensus.cc:493] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:01.241199 18093 raft_consensus.cc:3060] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.239825 18094 consensus_queue.cc:237] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:01.248526 18643 raft_consensus.cc:1275] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:10:01.249933 19408 consensus_queue.cc:1048] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:01.256057 17946 raft_consensus.cc:1275] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:10:01.258157 19410 raft_consensus.cc:2955] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:01.259863 18643 raft_consensus.cc:2955] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:01.262789 19309 consensus_queue.cc:1048] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:01.268945 17946 raft_consensus.cc:2955] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:01.279685 18093 raft_consensus.cc:515] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:01.282243 18093 leader_election.cc:290] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:01.288755 17833 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 158a286025af4eddba6fb641c128cd25 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:01.288985 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:01.289564 18024 raft_consensus.cc:3055] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:01.289835 18024 raft_consensus.cc:740] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:01.282310 17845 catalog_manager.cc:5697] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: config changed from index 3 to 4, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New cstate: current_term: 1 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:01.290709 18024 consensus_queue.cc:260] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:01.291900 18024 raft_consensus.cc:3060] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.287088 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:01.294662 17946 raft_consensus.cc:3060] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:01.301401 19434 raft_consensus.cc:993] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb: : Instructing follower 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:10:01.301946 19434 raft_consensus.cc:1081] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 LEADER]: Signalling peer 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:10:01.303848 17946 raft_consensus.cc:2468] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:10:01.311972 18005 tablet_service.cc:1558] Processing DeleteTablet for tablet 158a286025af4eddba6fb641c128cd25 with delete_type TABLET_DATA_TOMBSTONED (TS c5ffa786c8fb43f7864fa8fbe76534cb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45450
I20260709 12:10:01.312227 18024 raft_consensus.cc:2468] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:10:01.313292 19439 tablet_replica.cc:333] T 158a286025af4eddba6fb641c128cd25 P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:10:01.320576 18094 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05a4983c833c415a94a4c285b408b305"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:53954
I20260709 12:10:01.333467 18094 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:01.333850 18094 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.333916 19439 raft_consensus.cc:2243] T 158a286025af4eddba6fb641c128cd25 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:01.334992 19439 raft_consensus.cc:2272] T 158a286025af4eddba6fb641c128cd25 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:01.328106 18062 leader_election.cc:304] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:01.338760 19439 ts_tablet_manager.cc:1916] T 158a286025af4eddba6fb641c128cd25 P c5ffa786c8fb43f7864fa8fbe76534cb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:01.339221 19408 raft_consensus.cc:2804] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:01.347164 19408 raft_consensus.cc:697] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:01.348418 19408 consensus_queue.cc:237] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:01.351219 18094 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:01.360572 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:01.361151 18024 raft_consensus.cc:3055] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:01.361482 18024 raft_consensus.cc:740] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:01.362368 18024 consensus_queue.cc:260] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:01.363528 19416 consensus_queue.cc:1175] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "63f5bddeebd84e5788d671a176cfa8e1" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 2 index: 2 } }
I20260709 12:10:01.363528 18024 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.374389 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:01.375057 17944 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:01.379340 19439 ts_tablet_manager.cc:1929] T 158a286025af4eddba6fb641c128cd25 P c5ffa786c8fb43f7864fa8fbe76534cb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:10:01.379792 19439 log.cc:1199] T 158a286025af4eddba6fb641c128cd25 P c5ffa786c8fb43f7864fa8fbe76534cb: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-1-root/wals/158a286025af4eddba6fb641c128cd25
I20260709 12:10:01.378041 17847 catalog_manager.cc:5697] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 1 to 2, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 2 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:01.381372 17944 raft_consensus.cc:2468] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:01.383188 17832 catalog_manager.cc:5028] TS c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): tablet 158a286025af4eddba6fb641c128cd25 (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:10:01.384941 18062 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:01.385689 19408 raft_consensus.cc:2804] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:01.386185 19408 raft_consensus.cc:697] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:01.386849 18094 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:01.387079 19408 consensus_queue.cc:237] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:01.388926 18024 raft_consensus.cc:2468] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:01.397976 17847 catalog_manager.cc:5697] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 2 to 3, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 3 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:01.588362 18094 raft_consensus.cc:1275] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:01.589483 19445 consensus_queue.cc:1048] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:01.599725 18643 raft_consensus.cc:1275] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:01.601046 19445 consensus_queue.cc:1048] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:01.797845 17944 raft_consensus.cc:1275] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:01.798944 19408 consensus_queue.cc:1048] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:01.807528 18022 raft_consensus.cc:1275] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:01.810047 19309 consensus_queue.cc:1048] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:01.845716 17944 raft_consensus.cc:1275] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:01.847103 19454 consensus_queue.cc:1048] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:01.861617 18022 raft_consensus.cc:1275] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:01.862866 19454 consensus_queue.cc:1048] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:01.922930 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:01.959358 18094 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
mode: GRACEFUL
new_leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
 from {username='slave'} at 127.0.0.1:40154
I20260709 12:10:01.959853 18094 raft_consensus.cc:606] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Received request to transfer leadership to TS c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:01.961982 17944 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:10:01.962469 17944 raft_consensus.cc:606] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:01.964570 18094 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
mode: GRACEFUL
new_leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:40154
I20260709 12:10:01.964984 18094 raft_consensus.cc:606] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Received request to transfer leadership to TS e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:01.965878 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:10:01.967000 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:01.967538 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:02.154458 19316 raft_consensus.cc:993] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1: : Instructing follower 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:10:02.155099 19445 raft_consensus.cc:1081] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Signalling peer 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:10:02.156390 18097 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:53964
I20260709 12:10:02.156956 18097 raft_consensus.cc:493] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:02.157244 18097 raft_consensus.cc:3060] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.161556 18097 raft_consensus.cc:515] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:02.163288 18097 leader_election.cc:290] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:02.163833 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:02.164249 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:02.164469 17948 raft_consensus.cc:3055] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:02.164894 17948 raft_consensus.cc:740] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:02.165045 18642 raft_consensus.cc:3060] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.165642 17948 consensus_queue.cc:260] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:02.166819 17948 raft_consensus.cc:3060] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.169159 19454 raft_consensus.cc:993] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110: : Instructing follower c5ffa786c8fb43f7864fa8fbe76534cb to start an election
I20260709 12:10:02.169643 19410 raft_consensus.cc:1081] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Signalling peer c5ffa786c8fb43f7864fa8fbe76534cb to start an election
I20260709 12:10:02.171067 18022 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
 from {username='slave'} at 127.0.0.1:45472
I20260709 12:10:02.171553 18022 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:02.171887 18022 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.179319 18022 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:02.173676 17948 raft_consensus.cc:2468] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:02.181466 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:02.181740 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:02.182018 17944 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.182193 18642 raft_consensus.cc:2468] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:02.182089 18062 leader_election.cc:304] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:02.183207 18022 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:02.182330 18097 raft_consensus.cc:3055] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:02.183966 19410 raft_consensus.cc:2804] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:02.184103 18097 raft_consensus.cc:740] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:02.184582 19410 raft_consensus.cc:697] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:02.185074 18097 consensus_queue.cc:260] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:02.185460 19410 consensus_queue.cc:237] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:02.186189 18097 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.190804 17944 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:02.191836 17988 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:02.192476 18097 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:02.193006 19357 raft_consensus.cc:2804] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:02.196437 19357 raft_consensus.cc:697] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:02.197386 19357 consensus_queue.cc:237] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:02.210816 17845 catalog_manager.cc:5697] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 2 to 3, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 3 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:02.220322 17847 catalog_manager.cc:5697] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 2 to 3, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 3 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:02.236231 19454 raft_consensus.cc:993] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110: : Instructing follower e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:10:02.236748 19454 raft_consensus.cc:1081] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Signalling peer e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:10:02.238183 18642 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:60412
I20260709 12:10:02.238620 18642 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:02.238925 18642 raft_consensus.cc:3060] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.245113 18642 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:02.249892 18642 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:02.250461 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:02.250765 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:02.251049 18022 raft_consensus.cc:3060] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.251310 18097 raft_consensus.cc:3055] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:02.251603 18097 raft_consensus.cc:740] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:02.252224 18097 consensus_queue.cc:260] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:02.252964 18097 raft_consensus.cc:3060] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:02.255939 18022 raft_consensus.cc:2468] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 3.
I20260709 12:10:02.257077 18608 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:02.257795 19444 raft_consensus.cc:2804] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:02.258205 18097 raft_consensus.cc:2468] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 3.
I20260709 12:10:02.258292 19444 raft_consensus.cc:697] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:02.259294 19444 consensus_queue.cc:237] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:02.271287 17845 catalog_manager.cc:5697] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 2 to 3, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 3 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:02.384639 18022 consensus_queue.cc:237] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:10:02.390503 18094 raft_consensus.cc:1275] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:10:02.390749 17987 consensus_peers.cc:597] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9ae30b26b2734033a87c3e1ba937a39f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:02.391721 19416 consensus_queue.cc:1048] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:02.392313 17944 raft_consensus.cc:1275] T 9ae30b26b2734033a87c3e1ba937a39f P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:10:02.393371 19416 consensus_queue.cc:1048] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:02.399192 19459 raft_consensus.cc:2955] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:10:02.400708 18094 raft_consensus.cc:2955] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:10:02.406126 17944 raft_consensus.cc:2955] T 9ae30b26b2734033a87c3e1ba937a39f P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:10:02.415936 17845 catalog_manager.cc:5697] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:10:02.416661 17948 consensus_queue.cc:237] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
W20260709 12:10:02.429298 17912 consensus_peers.cc:597] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c4f794e5675049b284921052a24eea37. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:02.430356 18022 raft_consensus.cc:1275] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:10:02.432107 19443 consensus_queue.cc:1048] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:02.432498 18094 raft_consensus.cc:1275] T c4f794e5675049b284921052a24eea37 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:10:02.434605 19443 consensus_queue.cc:1048] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:02.448599 19316 raft_consensus.cc:2955] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:10:02.450001 18094 raft_consensus.cc:2955] T c4f794e5675049b284921052a24eea37 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:10:02.459622 18024 raft_consensus.cc:2955] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:10:02.464757 18022 consensus_queue.cc:237] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:10:02.474759 17846 catalog_manager.cc:5697] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: config changed from index -1 to 3, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 2 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:02.481400 18094 raft_consensus.cc:1275] T ca33c22be72d48f79260f24a00a8f8bb P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:10:02.482342 17948 raft_consensus.cc:1275] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:10:02.482678 17987 consensus_peers.cc:597] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ca33c22be72d48f79260f24a00a8f8bb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:02.482887 19416 consensus_queue.cc:1048] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:02.484119 19357 consensus_queue.cc:1048] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:02.490826 19416 raft_consensus.cc:2955] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:10:02.500387 18094 raft_consensus.cc:2955] T ca33c22be72d48f79260f24a00a8f8bb P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:10:02.505988 17944 raft_consensus.cc:2955] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:10:02.512686 17845 catalog_manager.cc:5697] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: config changed from index -1 to 2, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:02.524008 18093 consensus_queue.cc:237] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
W20260709 12:10:02.543733 18061 consensus_peers.cc:597] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3cdd445b25e5404da2f578c388210925. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:02.544471 18022 raft_consensus.cc:1275] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:10:02.545482 17944 raft_consensus.cc:1275] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:10:02.545990 19410 consensus_queue.cc:1048] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:02.546900 19408 consensus_queue.cc:1048] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:02.554049 19410 raft_consensus.cc:2955] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:10:02.555768 18022 raft_consensus.cc:2955] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:10:02.563773 17944 raft_consensus.cc:2955] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:10:02.583320 17847 catalog_manager.cc:5697] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: config changed from index -1 to 3, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 2 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:10:02.624207 18094 raft_consensus.cc:1275] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:02.625459 19474 consensus_queue.cc:1048] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:02.655802 18093 raft_consensus.cc:1275] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:02.657850 17944 raft_consensus.cc:1275] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:02.657851 17946 raft_consensus.cc:1275] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:02.662612 19419 consensus_queue.cc:1048] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:02.664026 19410 consensus_queue.cc:1048] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:02.666043 19474 consensus_queue.cc:1048] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:02.678934 18642 raft_consensus.cc:1275] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:02.680400 19410 consensus_queue.cc:1048] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:02.792598 18022 raft_consensus.cc:1275] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:02.794353 19419 consensus_queue.cc:1048] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:02.835597 19489 ts_tablet_manager.cc:933] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:02.839604 19489 tablet_copy_client.cc:323] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.194:36297
I20260709 12:10:02.841184 18033 tablet_copy_service.cc:140] P c5ffa786c8fb43f7864fa8fbe76534cb: Received BeginTabletCopySession request for tablet 9ae30b26b2734033a87c3e1ba937a39f from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:53022)
I20260709 12:10:02.841733 18033 tablet_copy_service.cc:161] P c5ffa786c8fb43f7864fa8fbe76534cb: Beginning new tablet copy session on tablet 9ae30b26b2734033a87c3e1ba937a39f from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:53022: session id = e28f77912a9c4ba2b9841f6fedddc2db-9ae30b26b2734033a87c3e1ba937a39f
I20260709 12:10:02.851977 18033 tablet_copy_source_session.cc:215] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:10:02.855327 19489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ae30b26b2734033a87c3e1ba937a39f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:10:02.859267 19491 ts_tablet_manager.cc:933] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123)
I20260709 12:10:02.863389 19491 tablet_copy_client.cc:323] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.193:39123
I20260709 12:10:02.865310 17959 tablet_copy_service.cc:140] P 63f5bddeebd84e5788d671a176cfa8e1: Received BeginTabletCopySession request for tablet c4f794e5675049b284921052a24eea37 from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:44668)
I20260709 12:10:02.865833 17959 tablet_copy_service.cc:161] P 63f5bddeebd84e5788d671a176cfa8e1: Beginning new tablet copy session on tablet c4f794e5675049b284921052a24eea37 from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:44668: session id = e28f77912a9c4ba2b9841f6fedddc2db-c4f794e5675049b284921052a24eea37
I20260709 12:10:02.873521 17959 tablet_copy_source_session.cc:215] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:10:02.879070 19491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4f794e5675049b284921052a24eea37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:10:02.875741 19489 tablet_copy_client.cc:806] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:02.883854 19489 tablet_copy_client.cc:670] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:10:02.896533 19489 tablet_copy_client.cc:538] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:02.904870 19489 tablet_bootstrap.cc:492] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:10:02.910229 19491 tablet_copy_client.cc:806] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:02.910863 19491 tablet_copy_client.cc:670] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:10:02.914615 19491 tablet_copy_client.cc:538] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:02.934909 19493 ts_tablet_manager.cc:933] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:02.939649 19491 tablet_bootstrap.cc:492] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:10:02.953290 19493 tablet_copy_client.cc:323] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.194:36297
I20260709 12:10:02.954969 18033 tablet_copy_service.cc:140] P c5ffa786c8fb43f7864fa8fbe76534cb: Received BeginTabletCopySession request for tablet ca33c22be72d48f79260f24a00a8f8bb from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:53022)
I20260709 12:10:02.955497 18033 tablet_copy_service.cc:161] P c5ffa786c8fb43f7864fa8fbe76534cb: Beginning new tablet copy session on tablet ca33c22be72d48f79260f24a00a8f8bb from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:53022: session id = e28f77912a9c4ba2b9841f6fedddc2db-ca33c22be72d48f79260f24a00a8f8bb
I20260709 12:10:02.963651 19489 tablet_bootstrap.cc:492] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:10:02.964593 19489 tablet_bootstrap.cc:492] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:10:02.965255 19489 ts_tablet_manager.cc:1403] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.061s	user 0.015s	sys 0.015s
I20260709 12:10:02.968182 19489 raft_consensus.cc:359] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:10:02.969007 19489 raft_consensus.cc:740] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:10:02.969628 19489 consensus_queue.cc:260] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:10:02.970652 18033 tablet_copy_source_session.cc:215] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:10:02.973816 19493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca33c22be72d48f79260f24a00a8f8bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:10:02.981833 19489 ts_tablet_manager.cc:1434] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:10:02.986912 18033 tablet_copy_service.cc:342] P c5ffa786c8fb43f7864fa8fbe76534cb: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-9ae30b26b2734033a87c3e1ba937a39f received from {username='slave'} at 127.0.0.1:53022
I20260709 12:10:02.987322 18033 tablet_copy_service.cc:434] P c5ffa786c8fb43f7864fa8fbe76534cb: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-9ae30b26b2734033a87c3e1ba937a39f on tablet 9ae30b26b2734033a87c3e1ba937a39f with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:02.996951 19493 tablet_copy_client.cc:806] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:02.997573 19493 tablet_copy_client.cc:670] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:10:02.999699 19497 ts_tablet_manager.cc:933] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:03.002410 19493 tablet_copy_client.cc:538] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:03.004633 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:03.015825 19493 tablet_bootstrap.cc:492] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:10:03.017320 19491 tablet_bootstrap.cc:492] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:10:03.018477 19491 tablet_bootstrap.cc:492] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:10:03.019178 19491 ts_tablet_manager.cc:1403] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.080s	user 0.032s	sys 0.014s
I20260709 12:10:03.022969 19491 raft_consensus.cc:359] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:10:03.023883 19491 raft_consensus.cc:740] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:10:03.030553 19491 consensus_queue.cc:260] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:10:03.034358 19491 ts_tablet_manager.cc:1434] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:10:03.036324 17959 tablet_copy_service.cc:342] P 63f5bddeebd84e5788d671a176cfa8e1: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-c4f794e5675049b284921052a24eea37 received from {username='slave'} at 127.0.0.1:44668
I20260709 12:10:03.036754 17959 tablet_copy_service.cc:434] P 63f5bddeebd84e5788d671a176cfa8e1: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-c4f794e5675049b284921052a24eea37 on tablet c4f794e5675049b284921052a24eea37 with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:03.040705 19497 tablet_copy_client.cc:323] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.195:41931
I20260709 12:10:03.042325 18108 tablet_copy_service.cc:140] P 4813437da0a74e65b61eb7bd1d18f110: Received BeginTabletCopySession request for tablet 3cdd445b25e5404da2f578c388210925 from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:41818)
I20260709 12:10:03.042865 18108 tablet_copy_service.cc:161] P 4813437da0a74e65b61eb7bd1d18f110: Beginning new tablet copy session on tablet 3cdd445b25e5404da2f578c388210925 from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:41818: session id = e28f77912a9c4ba2b9841f6fedddc2db-3cdd445b25e5404da2f578c388210925
I20260709 12:10:03.049870 18108 tablet_copy_source_session.cc:215] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:10:03.060087 19497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cdd445b25e5404da2f578c388210925. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:10:03.063591 19493 tablet_bootstrap.cc:492] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:10:03.064572 19493 tablet_bootstrap.cc:492] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:10:03.083137 19493 ts_tablet_manager.cc:1403] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.068s	user 0.025s	sys 0.000s
I20260709 12:10:03.086093 19493 raft_consensus.cc:359] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:10:03.089686 19493 raft_consensus.cc:740] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:10:03.090848 19493 consensus_queue.cc:260] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:10:03.096902 19493 ts_tablet_manager.cc:1434] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:10:03.098702 18033 tablet_copy_service.cc:342] P c5ffa786c8fb43f7864fa8fbe76534cb: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-ca33c22be72d48f79260f24a00a8f8bb received from {username='slave'} at 127.0.0.1:53022
I20260709 12:10:03.099105 18033 tablet_copy_service.cc:434] P c5ffa786c8fb43f7864fa8fbe76534cb: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-ca33c22be72d48f79260f24a00a8f8bb on tablet ca33c22be72d48f79260f24a00a8f8bb with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:03.100286 19497 tablet_copy_client.cc:806] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:03.101403 19497 tablet_copy_client.cc:670] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:10:03.107687 19497 tablet_copy_client.cc:538] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:03.109263 18024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:44098
I20260709 12:10:03.109848 18024 raft_consensus.cc:606] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:03.116109 18097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
mode: GRACEFUL
new_leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:40154
I20260709 12:10:03.116680 18097 raft_consensus.cc:606] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Received request to transfer leadership to TS 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:03.117074 19497 tablet_bootstrap.cc:492] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:10:03.118151 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:10:03.119751 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:03.120568 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:03.140403 19497 tablet_bootstrap.cc:492] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:10:03.141460 19497 tablet_bootstrap.cc:492] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:10:03.142020 19497 ts_tablet_manager.cc:1403] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.006s
I20260709 12:10:03.144995 19497 raft_consensus.cc:359] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:10:03.145845 19497 raft_consensus.cc:740] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:10:03.146476 19497 consensus_queue.cc:260] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:10:03.148646 19497 ts_tablet_manager.cc:1434] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.003s
I20260709 12:10:03.150215 18108 tablet_copy_service.cc:342] P 4813437da0a74e65b61eb7bd1d18f110: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-3cdd445b25e5404da2f578c388210925 received from {username='slave'} at 127.0.0.1:41818
I20260709 12:10:03.150579 18108 tablet_copy_service.cc:434] P 4813437da0a74e65b61eb7bd1d18f110: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-3cdd445b25e5404da2f578c388210925 on tablet 3cdd445b25e5404da2f578c388210925 with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:03.172350 19357 raft_consensus.cc:993] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb: : Instructing follower 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:10:03.172912 19357 raft_consensus.cc:1081] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Signalling peer 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:10:03.174816 18097 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:53954
I20260709 12:10:03.175367 18097 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:03.175649 19454 raft_consensus.cc:993] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110: : Instructing follower 63f5bddeebd84e5788d671a176cfa8e1 to start an election
I20260709 12:10:03.175693 18097 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:03.176143 19454 raft_consensus.cc:1081] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Signalling peer 63f5bddeebd84e5788d671a176cfa8e1 to start an election
I20260709 12:10:03.177767 17944 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:50336
I20260709 12:10:03.178239 17944 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:03.178565 17944 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.187371 17944 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:03.189785 17944 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:03.190266 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:03.192319 18643 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.194437 18097 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:03.196448 18097 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:03.197243 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:03.196390 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:03.197772 18024 raft_consensus.cc:3055] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:03.197937 17944 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:03.198097 18024 raft_consensus.cc:740] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:03.191131 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:03.199072 18094 raft_consensus.cc:3055] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:03.198835 18024 consensus_queue.cc:260] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:03.200325 18024 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:03.199509 18094 raft_consensus.cc:740] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:03.202826 18643 raft_consensus.cc:2468] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:10:03.203202 18094 consensus_queue.cc:260] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:03.204401 17912 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:03.204470 18094 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:03.205212 19316 raft_consensus.cc:2804] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:03.205644 19316 raft_consensus.cc:697] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:03.206367 17944 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:03.206420 19316 consensus_queue.cc:237] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:03.208842 18062 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:03.209530 19410 raft_consensus.cc:2804] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:03.210034 19410 raft_consensus.cc:697] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 4 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:03.210806 19410 consensus_queue.cc:237] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:03.211635 18094 raft_consensus.cc:2468] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:10:03.219575 18024 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:03.223261 17846 catalog_manager.cc:5697] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 3 to 4, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 4 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:03.229312 17845 catalog_manager.cc:5697] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 1 to 2, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:03.336000 18642 raft_consensus.cc:1217] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:10:03.343443 18642 raft_consensus.cc:1217] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:10:03.455174 18642 raft_consensus.cc:1217] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:10:03.499511 18642 raft_consensus.cc:1217] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:10:03.623260 18642 raft_consensus.cc:1275] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:03.624442 19508 consensus_queue.cc:1048] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:03.639057 18097 raft_consensus.cc:1275] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:03.640895 19316 consensus_queue.cc:1048] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:03.712376 18024 raft_consensus.cc:1275] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:03.713646 19454 consensus_queue.cc:1048] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:03.730345 19357 raft_consensus.cc:1064] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:10:03.732788 19357 consensus_queue.cc:237] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:03.738255 17946 raft_consensus.cc:1275] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:03.740850 19408 consensus_queue.cc:1048] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:10:03.756865 18642 raft_consensus.cc:1275] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:10:03.760743 19474 consensus_queue.cc:1048] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:03.771999 18097 raft_consensus.cc:1275] T ca33c22be72d48f79260f24a00a8f8bb P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:10:03.772315 17944 raft_consensus.cc:1275] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:10:03.783084 19416 consensus_queue.cc:1048] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:03.795269 19416 consensus_queue.cc:1048] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:10:03.862823 18094 raft_consensus.cc:2955] T ca33c22be72d48f79260f24a00a8f8bb P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:03.873315 19474 raft_consensus.cc:2955] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:03.895177 18642 raft_consensus.cc:2955] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:03.906507 19518 raft_consensus.cc:1064] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:10:03.908644 19518 consensus_queue.cc:237] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:03.915406 17845 catalog_manager.cc:5697] T ca33c22be72d48f79260f24a00a8f8bb P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:03.931239 17944 raft_consensus.cc:2955] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:03.932631 19316 raft_consensus.cc:1064] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:10:03.935379 19316 consensus_queue.cc:237] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:03.945938 18642 raft_consensus.cc:1275] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 1 LEARNER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:10:03.947743 19520 consensus_queue.cc:1048] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:03.957036 18094 raft_consensus.cc:1275] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:10:03.961541 19518 consensus_queue.cc:1048] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:03.962116 17946 raft_consensus.cc:1275] T 9ae30b26b2734033a87c3e1ba937a39f P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:10:03.964533 18024 raft_consensus.cc:1275] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:03.964896 18642 raft_consensus.cc:1275] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEARNER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:03.966291 19507 consensus_queue.cc:1048] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:03.967432 19474 consensus_queue.cc:1048] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:03.968236 19507 consensus_queue.cc:1048] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:03.983407 18097 raft_consensus.cc:1275] T c4f794e5675049b284921052a24eea37 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:03.998796 19508 consensus_queue.cc:1048] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:04.014938 19507 raft_consensus.cc:2955] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:04.015509 19518 raft_consensus.cc:2955] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:04.020334 18094 raft_consensus.cc:2955] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:04.030709 18022 consensus_queue.cc:237] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:04.031869 18642 raft_consensus.cc:2955] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:04.035230 17946 raft_consensus.cc:2955] T 9ae30b26b2734033a87c3e1ba937a39f P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:04.038605 18643 raft_consensus.cc:2955] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:04.033972 18019 raft_consensus.cc:2955] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:04.050863 18097 raft_consensus.cc:2955] T c4f794e5675049b284921052a24eea37 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:04.063689 17946 raft_consensus.cc:1275] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:10:04.065361 18643 raft_consensus.cc:1275] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:10:04.066740 19518 consensus_queue.cc:1048] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:04.067322 17846 catalog_manager.cc:5697] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: config changed from index 2 to 3, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:04.072999 19520 consensus_queue.cc:1048] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:04.077826 19357 raft_consensus.cc:2955] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:04.079272 18642 raft_consensus.cc:2955] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:04.087204 17832 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ca33c22be72d48f79260f24a00a8f8bb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:04.088358 17845 catalog_manager.cc:5697] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: config changed from index 3 to 4, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:04.090569 17944 raft_consensus.cc:2955] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:04.101609 19526 raft_consensus.cc:1064] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:10:04.105202 19526 consensus_queue.cc:237] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:04.126191 17944 consensus_queue.cc:237] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:04.131404 17847 catalog_manager.cc:5697] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: config changed from index 3 to 4, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:04.126191 18019 consensus_queue.cc:237] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:04.148304 18643 raft_consensus.cc:1275] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:04.152282 18080 tablet_service.cc:1558] Processing DeleteTablet for tablet ca33c22be72d48f79260f24a00a8f8bb with delete_type TABLET_DATA_TOMBSTONED (TS 4813437da0a74e65b61eb7bd1d18f110 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53944
I20260709 12:10:04.152423 18019 raft_consensus.cc:1275] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:04.152725 18097 raft_consensus.cc:1275] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:10:04.153650 18642 raft_consensus.cc:1275] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:10:04.155041 19526 consensus_queue.cc:1048] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:04.155248 19474 consensus_queue.cc:1048] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:04.156877 17946 raft_consensus.cc:1275] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:04.157033 19474 consensus_queue.cc:1048] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:04.158185 18019 raft_consensus.cc:1275] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:04.161926 19507 consensus_queue.cc:1048] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:04.163810 19507 consensus_queue.cc:1048] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:04.166496 19454 consensus_queue.cc:1048] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:04.170791 18643 raft_consensus.cc:1275] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEARNER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:10:04.172096 19410 consensus_queue.cc:1048] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:04.173947 19357 raft_consensus.cc:2955] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:04.176175 19443 raft_consensus.cc:2955] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:04.180827 18641 raft_consensus.cc:2955] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:04.185086 18644 raft_consensus.cc:2955] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:04.187083 18097 raft_consensus.cc:2955] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:04.195318 18019 raft_consensus.cc:2955] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:04.208231 17832 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9ae30b26b2734033a87c3e1ba937a39f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:04.230680 17832 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c4f794e5675049b284921052a24eea37 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:04.233048 19537 tablet_replica.cc:333] T ca33c22be72d48f79260f24a00a8f8bb P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:10:04.235494 19537 raft_consensus.cc:2243] T ca33c22be72d48f79260f24a00a8f8bb P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:04.236287 19537 raft_consensus.cc:2272] T ca33c22be72d48f79260f24a00a8f8bb P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:04.237308 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:04.244975 17845 catalog_manager.cc:5697] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: config changed from index 4 to 5, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New cstate: current_term: 2 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:04.243551 19537 ts_tablet_manager.cc:1916] T ca33c22be72d48f79260f24a00a8f8bb P 4813437da0a74e65b61eb7bd1d18f110: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:04.274864 19454 raft_consensus.cc:2955] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:04.279589 18640 raft_consensus.cc:2955] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:04.322338 18019 raft_consensus.cc:2955] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:04.335546 19537 ts_tablet_manager.cc:1929] T ca33c22be72d48f79260f24a00a8f8bb P 4813437da0a74e65b61eb7bd1d18f110: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:10:04.336045 19537 log.cc:1199] T ca33c22be72d48f79260f24a00a8f8bb P 4813437da0a74e65b61eb7bd1d18f110: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-2-root/wals/ca33c22be72d48f79260f24a00a8f8bb
I20260709 12:10:04.337803 17833 catalog_manager.cc:5028] TS 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): tablet ca33c22be72d48f79260f24a00a8f8bb (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:10:05.477463 19444 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:05.478082 19444 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:05.480733 19545 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:05.481038 19444 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:05.481547 19545 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:05.484616 19545 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:05.546676 19542 raft_consensus.cc:493] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:05.547541 19542 raft_consensus.cc:515] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:05.550556 19542 leader_election.cc:290] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:05.551414 19444 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:05.552984 19444 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:05.555620 19444 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:05.577204 19544 raft_consensus.cc:493] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:05.578048 19544 raft_consensus.cc:515] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:05.580883 19544 leader_election.cc:290] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:05.607580 19541 raft_consensus.cc:493] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:05.608482 19541 raft_consensus.cc:515] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:05.611225 19541 leader_election.cc:290] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:05.631963 19545 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:04.235658 17847 catalog_manager.cc:5697] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: config changed from index 3 to 4, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New cstate: current_term: 1 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:05.632463 19545 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:05.634493 19545 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:05.616935 19444 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:05.629006 19506 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:05.639472 19506 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:05.641920 19506 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:05.642076 19547 raft_consensus.cc:493] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:05.642452 19506 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:05.642558 19547 raft_consensus.cc:515] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:05.642947 19506 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:05.644704 19547 leader_election.cc:290] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:05.644865 19506 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:05.645522 19444 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:05.649466 19444 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:05.649672 19552 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:05.650592 19552 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:05.652789 19552 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:05.657634 19518 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:05.667472 19518 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:05.669966 19518 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:05.646296 19551 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:05.671947 19444 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:05.673235 19506 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:05.673959 19506 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:05.674955 19518 raft_consensus.cc:493] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:05.675616 19518 raft_consensus.cc:515] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:05.672698 19444 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:05.677724 19518 leader_election.cc:290] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:05.681942 19558 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:05.682085 19553 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:05.684978 19544 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:05.694042 19558 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:10:05.694775 19545 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:05.694185 19544 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:05.695271 19545 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:05.696255 19558 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123)
I20260709 12:10:05.696508 19506 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:05.697127 19544 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:05.697353 19545 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:05.670961 19551 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:05.697973 19553 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:05.700016 19551 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:05.702064 19555 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:05.702520 19555 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:05.704504 19555 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:05.704968 19555 raft_consensus.cc:493] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:05.705363 19555 raft_consensus.cc:515] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:05.705821 19552 raft_consensus.cc:493] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:05.707260 19545 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:05.707754 19545 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:05.691335 19554 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:05.709683 19544 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:05.710428 19444 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:05.710312 19544 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:05.709692 19545 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:05.717051 19518 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:05.720068 19518 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:05.719492 19560 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:05.721760 19560 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:05.718118 19474 raft_consensus.cc:493] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:05.723634 19556 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:05.723848 19518 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:05.728391 19474 raft_consensus.cc:515] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:05.730351 19474 leader_election.cc:290] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:05.715045 19544 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:05.706302 19552 raft_consensus.cc:515] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:05.719152 19558 raft_consensus.cc:493] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:05.741983 19558 raft_consensus.cc:515] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:05.744499 19558 leader_election.cc:290] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:05.746693 19552 leader_election.cc:290] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:05.736099 19560 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:05.707307 19557 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:05.753499 19557 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:05.756009 19557 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:05.762670 19557 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:05.769624 19557 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:05.700016 19553 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:05.709220 19554 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:05.732043 19556 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:05.776981 19554 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:05.777544 19554 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:05.778048 19554 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:05.779716 19556 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:05.780089 19554 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:05.759842 19565 raft_consensus.cc:493] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:05.813572 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:05.813786 19545 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:05.814170 18641 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 1.
I20260709 12:10:05.814361 19545 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:05.816380 19545 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:05.817857 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:05.818445 18641 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:05.819528 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:05.819669 17846 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40276 (request call id 250) took 1580 ms. Trace:
I20260709 12:10:05.820946 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:05.821501 18644 raft_consensus.cc:1813] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Handling vote request from an unknown peer 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:05.822124 18644 raft_consensus.cc:2410] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:10:05.780532 19556 raft_consensus.cc:493] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:05.823143 19474 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:05.822927 19556 raft_consensus.cc:515] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:05.823626 19474 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:05.824517 19545 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:05.825057 19545 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:05.826977 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:05.827564 18640 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:10:05.827591 19545 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:05.757257 19562 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:05.828173 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:05.828354 19562 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:05.820077 17846 rpcz_store.cc:276] 0709 12:10:04.239039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.239165 (+   126us) service_pool.cc:224] Handling call
0709 12:10:05.819587 (+1580422us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 12:10:05.831820 19545 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:05.825059 19556 leader_election.cc:290] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:05.830461 19562 leader_election.cc:290] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:05.832537 19545 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:05.833549 17845 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45910 (request call id 349) took 1596 ms. Trace:
I20260709 12:10:05.834846 19545 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:05.833995 17845 rpcz_store.cc:276] 0709 12:10:04.237070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.237975 (+   905us) service_pool.cc:224] Handling call
0709 12:10:05.833477 (+1595502us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:04.987455 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:05.483911 (+496456us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:05.483946 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:10:05.483976 (+    30us) tablet.cc:662] Decoding operations
0709 12:10:05.484348 (+   372us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:05.484404 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:05.484440 (+    36us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:10:05.484619 (+   179us) tablet.cc:701] Row locks acquired
0709 12:10:05.484639 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:10:05.484774 (+   135us) write_op.cc:270] Start()
0709 12:10:05.484886 (+   112us) write_op.cc:276] Timestamp: P: 1783599005484734 usec, L: 0
0709 12:10:05.484912 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:10:05.486868 (+  1956us) log.cc:844] Serialized 536 byte log entry
0709 12:10:05.807944 (+321076us) op_driver.cc:464] REPLICATION: finished
0709 12:10:05.809592 (+  1648us) write_op.cc:301] APPLY: starting
0709 12:10:05.809691 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:05.809816 (+   125us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:05.809953 (+   137us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:05.810186 (+   233us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:05.810375 (+   189us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:10:05.810449 (+    74us) write_op.cc:312] APPLY: finished
0709 12:10:05.810678 (+   229us) log.cc:844] Serialized 23 byte log entry
0709 12:10:05.810877 (+   199us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:05.810968 (+    91us) write_op.cc:454] Released schema lock
0709 12:10:05.811025 (+    57us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":1426,"num_ops":1,"prepare.queue_time_us":6445,"prepare.run_cpu_time_us":27753,"prepare.run_wall_time_us":650598,"raft.queue_time_us":203535,"raft.run_cpu_time_us":1109,"raft.run_wall_time_us":28661,"replication_time_us":322880,"thread_start_us":365671,"threads_started":4,"wal-append.queue_time_us":142517}]]}
I20260709 12:10:05.838515 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:05.839411 18092 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:10:05.782968 19557 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:05.724771 19551 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:05.784921 19558 raft_consensus.cc:493] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:05.841205 19563 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:05.841527 19558 raft_consensus.cc:515] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:05.841818 19563 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:05.841238 19551 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:05.844878 19551 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:05.790056 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:05.845562 18094 raft_consensus.cc:2468] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 2.
I20260709 12:10:05.845739 19568 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:05.790350 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:05.797627 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:05.800487 19518 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:05.847129 18090 raft_consensus.cc:2468] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 1.
I20260709 12:10:05.847237 19518 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:05.849238 19558 leader_election.cc:290] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:05.849735 19518 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:05.802299 19544 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:05.803580 19444 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:05.805879 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:05.850921 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:05.807502 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:05.808843 19570 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:05.850945 19544 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:05.852344 19570 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:05.853847 19544 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:05.813709 19565 raft_consensus.cc:515] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:05.788123 19566 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:05.856283 19565 leader_election.cc:290] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:05.787066 19560 raft_consensus.cc:493] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:05.772799 19555 leader_election.cc:290] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:05.846266 19568 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:05.856912 19560 raft_consensus.cc:515] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:05.843039 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:05.858573 19568 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:05.851243 19444 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:05.841871 19573 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:05.856001 19566 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:05.858935 18092 raft_consensus.cc:2468] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 1.
I20260709 12:10:05.859825 19560 leader_election.cc:290] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:05.863811 18641 raft_consensus.cc:2468] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 1.
I20260709 12:10:05.874665 17842 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45928 (request call id 364) took 1629 ms. Trace:
I20260709 12:10:05.862926 19573 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:05.868196 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:05.878209 18095 raft_consensus.cc:2468] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:10:05.869608 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:05.869786 17847 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45912 (request call id 376) took 1654 ms. Trace:
I20260709 12:10:05.870841 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:05.871218 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:05.871501 19444 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:05.888025 19573 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:05.890218 18609 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:05.879422 17847 rpcz_store.cc:276] 0709 12:10:04.215764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.216589 (+   825us) service_pool.cc:224] Handling call
0709 12:10:05.869709 (+1653120us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:05.653324 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:05.653923 (+   599us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:05.653956 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:10:05.653975 (+    19us) tablet.cc:662] Decoding operations
0709 12:10:05.654300 (+   325us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:05.654343 (+    43us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:05.654367 (+    24us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:10:05.654540 (+   173us) tablet.cc:701] Row locks acquired
0709 12:10:05.654557 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:10:05.654692 (+   135us) write_op.cc:270] Start()
0709 12:10:05.654805 (+   113us) write_op.cc:276] Timestamp: P: 1783599005654634 usec, L: 0
0709 12:10:05.654829 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:10:05.711850 (+ 57021us) log.cc:844] Serialized 536 byte log entry
0709 12:10:05.836644 (+124794us) op_driver.cc:464] REPLICATION: finished
0709 12:10:05.842826 (+  6182us) write_op.cc:301] APPLY: starting
0709 12:10:05.842896 (+    70us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:05.842998 (+   102us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:05.843099 (+   101us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:05.843273 (+   174us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:05.843420 (+   147us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:10:05.843464 (+    44us) write_op.cc:312] APPLY: finished
0709 12:10:05.843669 (+   205us) log.cc:844] Serialized 23 byte log entry
0709 12:10:05.843818 (+   149us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:05.843898 (+    80us) write_op.cc:454] Released schema lock
0709 12:10:05.843932 (+    34us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":15105,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":5999,"apply.run_cpu_time_us":1411,"apply.run_wall_time_us":6362,"num_ops":1,"prepare.queue_time_us":14810,"prepare.run_cpu_time_us":2384,"prepare.run_wall_time_us":58767,"replication_time_us":181680,"threads_started":1}]]}
I20260709 12:10:05.850733 18061 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:05.875211 17842 rpcz_store.cc:276] 0709 12:10:04.244255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:04.244598 (+   343us) service_pool.cc:224] Handling call
0709 12:10:04.252500 (+  7902us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b5400030890. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4988e640 00007f7f52765846 00007f7f5286f90e 00007f7f50d302a4 00007f7f50d30232 00007f7f50d30161 00007f7f50d300dc 00007f7f50d2f392 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:05.873664 (+1621164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3973,"reported_tablets":1,"spinlock_wait_cycles":4427392}
I20260709 12:10:05.854482 19570 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:05.882623 19566 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:05.884891 18089 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:10:05.864773 19552 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:05.891330 19444 raft_consensus.cc:2804] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:05.894009 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:05.898499 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 47855us
I20260709 12:10:05.898999 19569 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:05.899142 19572 raft_consensus.cc:2804] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:05.899446 19553 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
W20260709 12:10:05.898998 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 57336.5us
I20260709 12:10:05.900743 17933 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ae30b26b2734033a87c3e1ba937a39f with delete_type TABLET_DATA_TOMBSTONED (TS 63f5bddeebd84e5788d671a176cfa8e1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:50326
I20260709 12:10:05.900419 19552 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:05.902258 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:05.912600 18644 raft_consensus.cc:2468] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 1.
I20260709 12:10:05.904232 18641 raft_consensus.cc:2468] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3.
I20260709 12:10:05.923740 17989 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:05.924607 18609 leader_election.cc:304] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:05.925793 18609 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:05.825902 19474 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:05.925707 17912 leader_election.cc:304] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:05.932567 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:05.932812 19541 raft_consensus.cc:2804] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:05.933396 19541 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:05.933862 19541 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.902769 19444 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:05.941569 18061 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:05.911938 19573 raft_consensus.cc:493] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:05.914096 19570 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:05.913887 19555 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:05.958169 18061 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:05.922991 19572 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:05.961871 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:05.965714 17989 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:05.938880 19544 raft_consensus.cc:2804] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:05.967314 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:05.971802 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 46200.6us
I20260709 12:10:05.972208 18641 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:05.972429 17912 leader_election.cc:304] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:05.943897 19444 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:05.975678 18061 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:05.985258 19444 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:05.927340 19553 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:05.965581 19562 raft_consensus.cc:2804] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:06.012292 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 46659.9us
I20260709 12:10:05.964725 19518 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:05.964569 19474 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:05.971408 19556 raft_consensus.cc:2804] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:05.913434 19569 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:05.971925 19544 raft_consensus.cc:493] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:05.971338 19572 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:05.989085 19564 raft_consensus.cc:493] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:05.993842 19547 raft_consensus.cc:2804] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:06.026382 18641 raft_consensus.cc:1240] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:06.025161 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:06.029531 18090 raft_consensus.cc:2468] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 1.
I20260709 12:10:06.017593 18080 tablet_service.cc:1558] Processing DeleteTablet for tablet c4f794e5675049b284921052a24eea37 with delete_type TABLET_DATA_TOMBSTONED (TS 4813437da0a74e65b61eb7bd1d18f110 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:53944
I20260709 12:10:05.961503 19573 raft_consensus.cc:515] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:06.027444 19474 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:06.015774 19562 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:05.988173 19570 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:06.024632 19551 raft_consensus.cc:2804] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:06.025832 19560 raft_consensus.cc:2804] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:06.023128 19556 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:05.994693 19555 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:06.026907 19544 raft_consensus.cc:3060] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:06.034543 19577 raft_consensus.cc:493] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:06.075531 19576 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:06.028987 19547 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:06.043220 19562 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.090415 19581 tablet_replica.cc:333] T 9ae30b26b2734033a87c3e1ba937a39f P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:10:06.025656 19559 raft_consensus.cc:493] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:06.027330 19518 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:06.093498 19547 raft_consensus.cc:3060] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:06.136981 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 147975us
I20260709 12:10:06.081938 19575 raft_consensus.cc:493] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:06.046682 19560 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:06.044981 19551 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:06.042377 19564 raft_consensus.cc:515] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:06.193316 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 148387us
I20260709 12:10:06.281378 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:06.282848 18090 raft_consensus.cc:2468] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 1.
I20260709 12:10:06.092340 19576 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:06.076421 19556 raft_consensus.cc:3060] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:06.287408 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:06.092186 19584 raft_consensus.cc:2804] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:06.083421 19552 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:06.170001 19550 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:06.169675 19582 raft_consensus.cc:493] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:06.200567 19553 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:06.090953 19568 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:06.489449 19587 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:06.451277 19560 raft_consensus.cc:3060] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:06.490307 19587 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:06.452497 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:06.475030 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 202255us
I20260709 12:10:06.268153 19585 raft_consensus.cc:2804] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:06.602906 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:06.604631 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:06.451059 19551 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:06.155061 19559 raft_consensus.cc:515] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:06.528630 19584 raft_consensus.cc:493] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:06.258620 19578 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:06.618655 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:06.602172 19558 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:06.601202 19555 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:06.601768 19570 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:06.610317 19444 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:06.600075 19589 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:06.492626 19563 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:06.492362 19518 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:06.610071 19542 raft_consensus.cc:493] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:06.612295 19553 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:06.132992 19577 raft_consensus.cc:515] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:06.531409 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:06.617184 19545 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:06.636407 19585 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:06.653004 19474 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:06.490025 19568 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:06.665174 19584 raft_consensus.cc:3060] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:06.713385 19580 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:06.670259 19569 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:06.674276 19579 raft_consensus.cc:493] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:06.671542 19549 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:06.699249 19444 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:06.480849 19575 raft_consensus.cc:515] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:06.740556 19553 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:06.674511 19573 leader_election.cc:290] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:06.664824 19578 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:06.714565 19566 raft_consensus.cc:493] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:06.666095 19558 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:06.546396 19550 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:06.607103 19561 consensus_queue.cc:1059] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.634s
I20260709 12:10:06.727193 19542 raft_consensus.cc:515] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:06.726804 19589 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:06.546082 19582 raft_consensus.cc:515] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:06.774498 18061 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.798s	user 0.012s	sys 0.009s
W20260709 12:10:07.015153 18061 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.039s	user 0.019s	sys 0.021s
W20260709 12:10:07.015458 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 1.0398e+06us
I20260709 12:10:07.015918 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:06.770709 19577 leader_election.cc:290] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:07.043794 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:07.045614 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:07.046950 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:07.047524 18017 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:10:07.048353 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:07.049454 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:07.051126 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:07.053153 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:07.053788 18024 raft_consensus.cc:2468] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
W20260709 12:10:06.952993 19562 consensus_meta.cc:287] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.519s	user 0.011s	sys 0.007s
I20260709 12:10:06.753089 19585 raft_consensus.cc:3060] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:06.738969 19592 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:06.779234 19594 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
W20260709 12:10:06.778182 19541 consensus_meta.cc:287] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.844s	user 0.009s	sys 0.000s
I20260709 12:10:07.077900 19594 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:07.065097 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:07.072170 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:07.095100 18019 raft_consensus.cc:2468] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 1.
I20260709 12:10:06.950083 19596 raft_consensus.cc:493] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:07.064977 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:07.077997 19541 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:06.772745 18119 debug-util.cc:398] Leaking SignalData structure 0x7b08000c05c0 after lost signal to thread 16782
I20260709 12:10:06.950917 19590 tablet_replica.cc:333] T c4f794e5675049b284921052a24eea37 P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:10:06.842880 19552 raft_consensus.cc:493] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:07.077020 19592 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:06.978376 19595 raft_consensus.cc:493] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
W20260709 12:10:07.105394 18119 debug-util.cc:398] Leaking SignalData structure 0x7b0800193a60 after lost signal to thread 17881
I20260709 12:10:07.116933 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:07.117501 18119 debug-util.cc:398] Leaking SignalData structure 0x7b08001bc380 after lost signal to thread 17973
W20260709 12:10:07.117805 18119 debug-util.cc:398] Leaking SignalData structure 0x7b08001bc340 after lost signal to thread 17974
W20260709 12:10:07.118732 18119 debug-util.cc:398] Leaking SignalData structure 0x7b08000e4d40 after lost signal to thread 18048
I20260709 12:10:06.772591 19583 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:07.108556 19550 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:07.045607 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:06.779026 19576 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:07.109978 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:07.013936 19568 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:06.761996 19545 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:07.119928 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:06.864253 19587 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:06.774567 19564 leader_election.cc:290] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:07.121788 18119 debug-util.cc:398] Leaking SignalData structure 0x7b08002ef620 after lost signal to thread 18122
I20260709 12:10:06.891240 19593 raft_consensus.cc:493] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:07.126971 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:07.129673 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:07.135304 18091 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
mode: GRACEFUL
new_leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
 from {username='slave'} at 127.0.0.1:40154
I20260709 12:10:07.120477 19577 raft_consensus.cc:493] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:07.059523 19566 raft_consensus.cc:515] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:07.054069 19444 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:06.928593 19560 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:07.101523 19562 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:06.772394 19598 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:07.140640 18091 raft_consensus.cc:606] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Received request to transfer leadership to TS c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:07.140636 18642 raft_consensus.cc:2468] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 2.
W20260709 12:10:07.135960 18119 debug-util.cc:398] Leaking SignalData structure 0x7b08002fb7e0 after lost signal to thread 18668
I20260709 12:10:07.148968 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:07.121845 19552 raft_consensus.cc:515] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:07.125660 19561 raft_consensus.cc:493] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:07.138818 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:07.151247 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:06.771212 19579 raft_consensus.cc:515] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:07.135032 18023 raft_consensus.cc:2468] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:10:07.134025 19559 leader_election.cc:290] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:07.153319 19552 leader_election.cc:290] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:07.152949 19575 leader_election.cc:290] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:07.148695 19544 consensus_meta.cc:287] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 1.016s	user 0.008s	sys 0.008s
I20260709 12:10:07.141999 19550 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:06.779484 19580 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:07.159231 18090 raft_consensus.cc:2393] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 3: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:07.119145 19549 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:07.161346 19600 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:07.144536 19564 raft_consensus.cc:493] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:07.156668 19577 raft_consensus.cc:515] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:07.134435 19583 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:07.124209 19596 raft_consensus.cc:515] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:07.156409 19594 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:07.170166 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 110169us
W20260709 12:10:07.167738 19551 consensus_meta.cc:287] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.518s	user 0.003s	sys 0.007s
I20260709 12:10:07.144582 19595 raft_consensus.cc:515] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:07.171489 19572 consensus_meta.cc:287] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 1.139s	user 0.010s	sys 0.000s
I20260709 12:10:07.160667 19544 raft_consensus.cc:515] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:07.173348 19582 leader_election.cc:290] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:07.173007 19551 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:07.177134 19560 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:07.179055 19553 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:07.171330 19589 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:07.164587 19550 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:07.150657 19593 raft_consensus.cc:515] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:07.166137 19564 raft_consensus.cc:515] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:07.160050 19561 raft_consensus.cc:515] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:07.179142 19583 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:07.184029 19590 raft_consensus.cc:2243] T c4f794e5675049b284921052a24eea37 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:07.184343 19562 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:07.178553 19566 leader_election.cc:290] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:07.178606 19572 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:07.169795 19600 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:07.184787 19590 raft_consensus.cc:2272] T c4f794e5675049b284921052a24eea37 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:07.189520 19599 raft_consensus.cc:3055] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:07.162622 19598 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:07.190310 19599 raft_consensus.cc:740] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:07.219173 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:07.219260 17914 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.083s	user 0.014s	sys 0.019s
W20260709 12:10:07.221474 17914 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.086s	user 0.015s	sys 0.019s
W20260709 12:10:07.220268 17990 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.987s	user 0.009s	sys 0.047s
W20260709 12:10:07.224874 17990 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.103s	user 0.009s	sys 0.047s
I20260709 12:10:07.012580 17842 catalog_manager.cc:5697] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: config changed from index 3 to 4, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:07.233741 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:07.235263 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:07.236888 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:07.236941 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:07.237892 18017 raft_consensus.cc:2468] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:10:07.238364 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:07.239037 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:07.239967 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:07.240710 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:07.241518 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:07.242273 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:07.242879 17989 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.970s	user 0.024s	sys 0.039s
W20260709 12:10:07.243325 17989 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.024s	sys 0.039s
I20260709 12:10:07.154147 18018 raft_consensus.cc:2468] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 1.
I20260709 12:10:07.247495 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:07.177276 19542 leader_election.cc:290] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:07.178542 19545 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:07.175513 19558 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:07.244098 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:07.255679 18016 raft_consensus.cc:2393] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 3: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:07.261742 19597 raft_consensus.cc:493] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:07.261871 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:07.260304 19589 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:07.264891 19444 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:07.266765 18015 raft_consensus.cc:2468] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 1.
W20260709 12:10:07.266804 19547 consensus_meta.cc:287] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.832s	user 0.017s	sys 0.000s
I20260709 12:10:07.269908 19592 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:07.270567 19541 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:07.270685 19582 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:07.272696 19608 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:07.274003 19563 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:07.290166 19586 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:07.290470 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:07.290778 19552 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:07.291502 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:07.278632 19556 consensus_meta.cc:287] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.811s	user 0.009s	sys 0.013s
I20260709 12:10:07.295012 19577 leader_election.cc:290] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:07.295316 19597 raft_consensus.cc:515] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:07.269925 19561 leader_election.cc:290] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:07.298436 19589 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:07.303561 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:07.260355 19553 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:07.303953 19595 leader_election.cc:290] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:07.304563 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:07.304654 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:07.307647 19544 leader_election.cc:290] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:07.313755 19579 leader_election.cc:290] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:07.304931 18018 raft_consensus.cc:1240] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:07.321616 19553 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:07.189070 19584 raft_consensus.cc:515] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:07.320142 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:07.187857 19578 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:07.323642 19599 consensus_queue.cc:260] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:07.326109 19564 leader_election.cc:290] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:07.326581 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:07.330765 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:07.331250 19600 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:07.303956 19596 leader_election.cc:290] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:07.335103 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:07.335397 19598 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:07.335923 18643 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:10:07.314086 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:07.331832 19586 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:07.337592 19593 leader_election.cc:290] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:07.337940 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:07.339212 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:07.318224 19552 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:07.347802 19552 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:07.353209 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:07.353518 19589 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:07.355034 18639 raft_consensus.cc:1240] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:07.358768 19608 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:07.359215 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.359694 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:07.360466 18642 raft_consensus.cc:2468] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3.
I20260709 12:10:07.360872 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.354738 17944 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
mode: GRACEFUL
new_leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:10:07.336993 18017 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:07.364400 18640 raft_consensus.cc:2468] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 1.
I20260709 12:10:07.368286 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.341060 19563 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:07.368633 17949 raft_consensus.cc:2468] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:07.369825 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:07.370456 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:07.370690 19563 leader_election.cc:290] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:07.371265 18097 raft_consensus.cc:2468] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 2.
I20260709 12:10:07.369949 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:07.375005 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:07.375887 18095 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:07.376526 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 59694.2us
I20260709 12:10:07.381757 19553 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:07.381958 19580 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:07.382678 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:07.325208 19547 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:07.383986 19549 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:07.385252 19547 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:07.363875 17944 raft_consensus.cc:606] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Received request to transfer leadership to TS e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:07.367125 19582 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:07.361135 19608 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:07.325053 19556 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:07.392939 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:07.380231 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:07.395581 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:07.395750 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:07.396909 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:07.399557 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:07.398499 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:07.400730 18644 raft_consensus.cc:2468] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:10:07.402354 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:07.403219 18089 raft_consensus.cc:3060] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.406934 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:07.410946 19584 leader_election.cc:290] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:07.412799 19551 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:07.414971 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:07.415486 19586 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:07.415735 18640 raft_consensus.cc:2468] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 1.
I20260709 12:10:07.416582 19599 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.417829 19550 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:07.419261 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:07.422281 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:07.427865 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:07.428846 18090 raft_consensus.cc:3060] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.426530 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:07.430990 19582 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:07.402179 19590 ts_tablet_manager.cc:1916] T c4f794e5675049b284921052a24eea37 P 4813437da0a74e65b61eb7bd1d18f110: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:07.431432 18097 raft_consensus.cc:2468] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 1.
I20260709 12:10:07.432420 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:07.432536 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:07.424337 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:07.433856 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:07.434101 18018 raft_consensus.cc:2468] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 1.
I20260709 12:10:07.436811 19581 raft_consensus.cc:2243] T 9ae30b26b2734033a87c3e1ba937a39f P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:10:07.440066 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.441109 17942 raft_consensus.cc:1240] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:07.441479 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.438375 19581 raft_consensus.cc:2272] T 9ae30b26b2734033a87c3e1ba937a39f P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:07.445704 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:07.447500 19551 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:07.448343 19551 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:07.447103 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:07.449921 19581 ts_tablet_manager.cc:1916] T 9ae30b26b2734033a87c3e1ba937a39f P 63f5bddeebd84e5788d671a176cfa8e1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:07.443642 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.451735 17944 raft_consensus.cc:2468] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:07.443786 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.444574 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.445382 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.455165 17989 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:07.455699 17942 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:07.456424 19577 raft_consensus.cc:2804] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:07.456921 19577 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:07.456965 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.457466 19577 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.457823 17947 raft_consensus.cc:2468] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 2.
I20260709 12:10:07.459658 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.459982 17940 raft_consensus.cc:1240] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:07.458834 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:07.462150 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:07.462833 18638 raft_consensus.cc:2468] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 1.
I20260709 12:10:07.463546 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:07.461571 18094 raft_consensus.cc:1240] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:07.466827 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:07.468055 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:07.466900 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:07.469076 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:07.469762 18098 raft_consensus.cc:1813] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Handling vote request from an unknown peer 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:07.469152 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:07.470340 18098 raft_consensus.cc:2410] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:10:07.471441 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:07.472528 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:07.474180 17989 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:07.474468 18640 raft_consensus.cc:1240] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:07.475665 18095 raft_consensus.cc:2468] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 3.
I20260709 12:10:07.472648 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:07.475090 19563 raft_consensus.cc:2804] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:07.479002 19563 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:07.479305 18096 raft_consensus.cc:1240] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:07.479382 19563 raft_consensus.cc:3060] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.480347 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:07.482220 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.484975 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.484838 19585 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:10:07.486014 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.488399 18090 raft_consensus.cc:2468] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:07.485589 17945 raft_consensus.cc:2468] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 1.
I20260709 12:10:07.487409 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:07.489702 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:07.490384 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.492550 18609 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:07.495425 18097 raft_consensus.cc:1240] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:07.481487 19551 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:07.496922 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:07.503358 19556 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:07.503495 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:07.503755 18024 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:10:07.504737 19597 leader_election.cc:290] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:07.506547 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:07.507155 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.507368 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:07.497063 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:07.507896 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:07.510007 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:07.512382 17941 raft_consensus.cc:2393] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 4: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:07.514125 18638 raft_consensus.cc:2468] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 1.
I20260709 12:10:07.515676 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:07.504773 18020 raft_consensus.cc:1240] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:07.504762 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:07.518868 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:07.519038 18093 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 2.
I20260709 12:10:07.524204 18643 raft_consensus.cc:2468] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 1.
I20260709 12:10:07.524442 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:07.524930 17912 leader_election.cc:304] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:07.525522 19572 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:07.526903 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:07.528297 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:07.497121 19544 raft_consensus.cc:2804] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:07.530005 19584 raft_consensus.cc:2804] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:07.530182 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:07.530478 19584 raft_consensus.cc:493] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:07.529770 19608 consensus_queue.cc:1059] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:07.531147 19550 raft_consensus.cc:993] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1: : Instructing follower e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:10:07.530992 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:07.531672 19608 raft_consensus.cc:3055] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:07.531713 17912 leader_election.cc:304] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:07.532878 19608 raft_consensus.cc:740] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:07.532958 19553 raft_consensus.cc:1081] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Signalling peer e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:10:07.533730 18089 raft_consensus.cc:2468] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:10:07.534482 18092 raft_consensus.cc:1240] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:07.534183 19608 consensus_queue.cc:260] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:07.535575 19608 raft_consensus.cc:3060] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.530182 17989 leader_election.cc:304] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:07.514003 19577 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:07.536168 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.530025 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:07.546011 18609 leader_election.cc:304] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:07.531006 19584 raft_consensus.cc:3060] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.546942 19542 raft_consensus.cc:2804] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:07.547478 19542 raft_consensus.cc:697] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:07.548463 19542 consensus_queue.cc:237] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:07.540648 19592 raft_consensus.cc:2804] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:07.541244 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.550830 19592 raft_consensus.cc:493] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:07.541711 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.551321 19592 raft_consensus.cc:3060] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.551406 17912 leader_election.cc:304] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:07.551717 17945 raft_consensus.cc:2468] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:07.541781 17989 leader_election.cc:304] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:07.542095 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.539052 19541 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:07.553912 17912 leader_election.cc:304] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:07.542745 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.543262 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.543386 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.539247 19544 raft_consensus.cc:697] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:07.545042 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.545544 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:07.543918 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.554773 19586 raft_consensus.cc:2804] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:07.557514 17989 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:07.574213 18019 raft_consensus.cc:1240] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:07.557891 19553 raft_consensus.cc:2804] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:07.576910 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.577734 17945 raft_consensus.cc:2468] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 2.
I20260709 12:10:07.578367 17946 raft_consensus.cc:2468] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 2.
I20260709 12:10:07.579197 19572 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:07.579782 19572 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:07.580861 18608 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:07.581857 19506 raft_consensus.cc:2804] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:07.582285 19506 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:07.582617 19506 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:07.586350 19560 raft_consensus.cc:2804] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:07.586951 19560 raft_consensus.cc:697] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:07.587109 19580 raft_consensus.cc:2804] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:07.587566 19580 raft_consensus.cc:493] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:07.587949 19560 consensus_queue.cc:237] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:07.587996 19580 raft_consensus.cc:3060] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.591696 17989 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:07.555043 19583 raft_consensus.cc:2804] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:07.574914 19586 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:07.576160 19553 raft_consensus.cc:493] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:07.593601 17912 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:07.594897 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.593601 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.596617 19586 raft_consensus.cc:3060] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.600808 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.602965 19582 raft_consensus.cc:2804] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:07.603989 19558 raft_consensus.cc:2804] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:07.604063 19582 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:07.604452 19558 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:07.604547 19582 raft_consensus.cc:3060] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.604864 19558 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.555029 19541 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:07.598591 17941 raft_consensus.cc:2393] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 2: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:07.608884 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.608983 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.598136 19583 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:07.598508 19553 raft_consensus.cc:3060] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.609134 17945 raft_consensus.cc:2468] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 2.
I20260709 12:10:07.612190 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.600329 19585 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123)
I20260709 12:10:07.613677 19550 consensus_queue.cc:1059] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:10:07.615518 18096 raft_consensus.cc:1240] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:07.617297 17944 raft_consensus.cc:2468] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 1.
I20260709 12:10:07.617486 19550 raft_consensus.cc:3055] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:07.613821 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:07.617918 19550 raft_consensus.cc:740] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:07.618149 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:07.618886 19550 consensus_queue.cc:260] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:07.616319 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.609843 18608 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:07.621236 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.622926 19585 consensus_queue.cc:1059] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:07.624226 19566 raft_consensus.cc:3055] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:07.624557 19566 raft_consensus.cc:740] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:07.620714 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.621424 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:07.625528 19566 consensus_queue.cc:260] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:07.626890 17942 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 3.
I20260709 12:10:07.627782 19566 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.631780 19550 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.632651 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:07.614259 19583 raft_consensus.cc:3060] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.646842 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.639783 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.645646 19572 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:07.615638 19544 consensus_queue.cc:237] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:07.650482 19444 raft_consensus.cc:2749] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:07.685588 19551 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
W20260709 12:10:07.710207 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 81026.1us
I20260709 12:10:07.712502 17912 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:07.713418 17912 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:07.714198 19597 raft_consensus.cc:2804] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:07.716800 19597 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:07.717258 19597 raft_consensus.cc:3060] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:07.718700 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 118886us
I20260709 12:10:07.730581 18093 raft_consensus.cc:1240] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:07.734622 17948 raft_consensus.cc:2955] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:07.721427 19599 raft_consensus.cc:2804] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:07.742375 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.724107 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.743510 18608 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
W20260709 12:10:07.747184 17988 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.98.193:39123 timed out after 1.547s (SENT) [suppressed 1 similar messages]
I20260709 12:10:07.739916 19599 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:07.747501 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.752429 18090 raft_consensus.cc:1240] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:07.730862 19563 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:07.727777 19551 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:07.746380 18640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:60430
W20260709 12:10:07.755822 19613 log.cc:927] Time spent T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:10:07.757706 18640 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:07.759202 19592 raft_consensus.cc:515] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:07.761762 19575 consensus_queue.cc:1059] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:10:07.764724 19551 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:07.765959 19558 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:07.767110 18640 raft_consensus.cc:3060] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.754835 19444 raft_consensus.cc:2804] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:07.754256 19599 raft_consensus.cc:3060] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.770717 18608 leader_election.cc:304] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:07.774994 19444 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:07.802461 19506 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:07.784588 19444 raft_consensus.cc:3060] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:07.775802 19585 consensus_queue.cc:1059] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:10:07.819758 18644 raft_consensus.cc:1240] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:07.821457 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 106690us
I20260709 12:10:07.828088 19584 raft_consensus.cc:515] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:07.829614 17941 raft_consensus.cc:1240] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:07.832229 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:07.832875 18643 raft_consensus.cc:3060] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:07.833132 18608 leader_election.cc:304] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:07.890748 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:07.847612 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:07.826740 19506 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:07.846026 19584 leader_election.cc:290] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:07.909796 17987 leader_election.cc:304] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:07.920872 19603 raft_consensus.cc:2804] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:07.921402 19603 raft_consensus.cc:493] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:07.921801 19603 raft_consensus.cc:3060] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:07.933368 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:07.943107 19618 raft_consensus.cc:2749] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:07.853013 19583 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:07.966570 19545 raft_consensus.cc:2749] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:07.972215 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 126728us
I20260709 12:10:07.969594 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:07.984273 19592 leader_election.cc:290] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:07.969128 19541 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:07.986677 17942 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 3.
I20260709 12:10:07.987483 19580 raft_consensus.cc:515] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:07.993599 18643 raft_consensus.cc:2468] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 4.
I20260709 12:10:07.998519 19597 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:08.004750 19615 raft_consensus.cc:3055] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:08.005208 19615 raft_consensus.cc:740] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:08.016404 19583 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:08.017810 19599 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:08.018280 19582 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:08.034924 19619 log.cc:927] Time spent T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:10:08.045339 17943 raft_consensus.cc:1240] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:08.052814 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:10:08.059875 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 276346us
I20260709 12:10:08.051937 18640 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:08.065454 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:08.065973 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:08.066308 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:08.067206 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 271578us
I20260709 12:10:08.066007 18643 raft_consensus.cc:3060] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.069585 17912 leader_election.cc:304] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:08.074604 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:08.058869 19582 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:08.063153 19558 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:08.078030 17944 raft_consensus.cc:1240] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:08.079035 18640 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:08.080643 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:08.006048 19615 consensus_queue.cc:260] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:08.082343 19615 raft_consensus.cc:3060] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.084002 17842 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45928 (request call id 365) took 2127 ms. Trace:
I20260709 12:10:08.064077 19563 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:08.072311 19584 raft_consensus.cc:2804] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:08.091856 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:08.095090 18608 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:08.095758 19553 raft_consensus.cc:515] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:08.099987 19590 ts_tablet_manager.cc:1929] T c4f794e5675049b284921052a24eea37 P 4813437da0a74e65b61eb7bd1d18f110: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:10:08.114856 18638 raft_consensus.cc:3060] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.115171 19590 log.cc:1199] T c4f794e5675049b284921052a24eea37 P 4813437da0a74e65b61eb7bd1d18f110: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-2-root/wals/c4f794e5675049b284921052a24eea37
I20260709 12:10:08.079149 19608 consensus_queue.cc:1059] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:10:08.118479 19608 raft_consensus.cc:3055] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:08.104636 19444 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:08.087749 17987 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:08.111271 19545 raft_consensus.cc:2749] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.111706 19597 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:08.112407 18608 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:08.084479 17842 rpcz_store.cc:276] 0709 12:10:05.956796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.957870 (+  1074us) service_pool.cc:224] Handling call
0709 12:10:08.083733 (+2125863us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:07.416624 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:07.417311 (+   687us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:07.417362 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:10:07.417401 (+    39us) tablet.cc:662] Decoding operations
0709 12:10:07.417863 (+   462us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:07.417945 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:07.417975 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:10:07.418293 (+   318us) tablet.cc:701] Row locks acquired
0709 12:10:07.418340 (+    47us) write_op.cc:260] PREPARE: finished
0709 12:10:07.418539 (+   199us) write_op.cc:270] Start()
0709 12:10:07.418717 (+   178us) write_op.cc:276] Timestamp: P: 1783599007418464 usec, L: 0
0709 12:10:07.418754 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 12:10:07.425784 (+  7030us) log.cc:844] Serialized 599 byte log entry
0709 12:10:07.726151 (+300367us) op_driver.cc:464] REPLICATION: finished
0709 12:10:07.936372 (+210221us) write_op.cc:301] APPLY: starting
0709 12:10:07.936507 (+   135us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:07.936626 (+   119us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:07.936753 (+   127us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:07.937078 (+   325us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:07.937385 (+   307us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:10:07.937478 (+    93us) write_op.cc:312] APPLY: finished
0709 12:10:07.937813 (+   335us) log.cc:844] Serialized 23 byte log entry
0709 12:10:07.938047 (+   234us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:07.938158 (+   111us) write_op.cc:454] Released schema lock
0709 12:10:07.938231 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:07.945525 (+  7294us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:07.947379 (+  1854us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":82440,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":178415,"apply.run_cpu_time_us":2362,"apply.run_wall_time_us":8535,"num_ops":1,"prepare.queue_time_us":147693,"prepare.run_cpu_time_us":21379,"prepare.run_wall_time_us":150324,"raft.queue_time_us":63774,"raft.run_cpu_time_us":10961,"raft.run_wall_time_us":67983,"replication_time_us":307237,"spinlock_wait_cycles":1920,"thread_start_us":268876,"threads_started":4,"wal-append.queue_time_us":171074}]]}
I20260709 12:10:08.114190 19553 leader_election.cc:290] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:08.113982 18090 consensus_queue.cc:237] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:08.114737 17946 raft_consensus.cc:2393] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 3: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
W20260709 12:10:08.116140 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.118938 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:08.123420 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:08.118871 19608 raft_consensus.cc:740] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:08.110291 19580 leader_election.cc:290] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:08.138798 18640 raft_consensus.cc:3060] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.138854 17987 leader_election.cc:304] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:08.138108 18642 raft_consensus.cc:3060] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:08.131378 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 50092.3us
I20260709 12:10:08.118956 19590 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53944 (request call id 89) took 2152 ms. Trace:
I20260709 12:10:08.141220 18644 raft_consensus.cc:1240] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:08.120229 19584 raft_consensus.cc:697] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:08.130930 19563 raft_consensus.cc:2804] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:08.138505 19586 consensus_meta.cc:287] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.525s	user 0.006s	sys 0.017s
I20260709 12:10:08.139183 19599 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:08.218964 19586 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:08.217785 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:08.198323 18643 raft_consensus.cc:2468] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:10:08.202935 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:08.222591 17912 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:08.196448 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:08.142107 19590 rpcz_store.cc:276] 0709 12:10:05.966286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.966403 (+   117us) service_pool.cc:224] Handling call
0709 12:10:06.657487 (+691084us) ts_tablet_manager.cc:1151] Deleting tablet c4f794e5675049b284921052a24eea37
0709 12:10:06.714345 (+ 56858us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:10:07.781241 (+1066896us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:08.099864 (+318623us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:08.118847 (+ 18983us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":129559,"tablet-delete.queue_time_us":585558,"thread_start_us":58028,"threads_started":1}
I20260709 12:10:08.218357 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:10:08.222685 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 80295.2us
I20260709 12:10:08.225888 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:10:08.225876 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 95320.3us
I20260709 12:10:08.213589 18639 raft_consensus.cc:1240] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:08.230265 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 117945us
I20260709 12:10:08.230392 19582 raft_consensus.cc:2804] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:08.231920 19582 raft_consensus.cc:697] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:08.232820 19582 consensus_queue.cc:237] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:08.214231 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:08.236073 19553 consensus_queue.cc:1059] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:08.215009 19618 raft_consensus.cc:2749] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.237161 18608 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:08.238380 18608 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:08.236572 18637 raft_consensus.cc:3060] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.221603 19563 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:08.242246 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:08.239392 19542 raft_consensus.cc:2749] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.241215 19544 raft_consensus.cc:2804] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:08.243067 19603 raft_consensus.cc:515] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:08.243774 19544 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:08.244215 19544 raft_consensus.cc:3060] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.244266 18641 raft_consensus.cc:1240] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:08.245167 19603 leader_election.cc:290] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:08.246047 19577 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:08.246472 19608 consensus_queue.cc:260] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:08.247970 19608 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:08.248442 19575 raft_consensus.cc:3055] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:08.248811 19575 raft_consensus.cc:740] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:08.249610 19575 consensus_queue.cc:260] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:08.250898 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:08.251570 18019 raft_consensus.cc:2468] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:08.250898 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:08.253229 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:08.254537 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:08.255649 19553 raft_consensus.cc:3055] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:08.256016 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:08.257726 17949 raft_consensus.cc:2468] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:10:08.269434 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:08.260208 17944 raft_consensus.cc:1240] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:08.260547 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:08.256009 19553 raft_consensus.cc:740] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:08.261721 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:08.254320 17914 leader_election.cc:304] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:08.291208 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.263347 19581 ts_tablet_manager.cc:1929] T 9ae30b26b2734033a87c3e1ba937a39f P 63f5bddeebd84e5788d671a176cfa8e1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:10:08.254400 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:10:08.267694 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.259613 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:08.224416 19541 raft_consensus.cc:2749] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:08.274123 18642 raft_consensus.cc:2468] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3.
W20260709 12:10:08.235500 19621 log.cc:927] Time spent T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:10:08.263892 19544 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:08.279395 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:10:08.223348 17941 raft_consensus.cc:2468] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 3.
I20260709 12:10:08.282151 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:08.284626 19599 consensus_queue.cc:1059] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:08.284849 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:08.285138 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:08.291937 17947 raft_consensus.cc:2393] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 3: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:08.251701 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:08.293259 18097 raft_consensus.cc:1275] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:08.284804 18608 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:08.296046 18640 raft_consensus.cc:2468] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:10:08.299450 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:08.299168 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:08.265573 19563 raft_consensus.cc:3060] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.240365 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:10:08.324597 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 70340.1us
I20260709 12:10:08.326803 17912 leader_election.cc:304] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
W20260709 12:10:08.331326 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 46624.3us
I20260709 12:10:08.321326 19580 raft_consensus.cc:2749] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.302178 19581 log.cc:1199] T 9ae30b26b2734033a87c3e1ba937a39f P 63f5bddeebd84e5788d671a176cfa8e1: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-0-root/wals/9ae30b26b2734033a87c3e1ba937a39f
I20260709 12:10:08.293963 18638 raft_consensus.cc:2468] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:10:08.339036 18093 raft_consensus.cc:1275] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:08.229980 17833 catalog_manager.cc:5028] TS 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): tablet c4f794e5675049b284921052a24eea37 (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:10:08.332888 19550 raft_consensus.cc:2804] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:08.334597 19506 raft_consensus.cc:2764] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:10:08.342744 19553 consensus_queue.cc:260] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:08.330005 19584 consensus_queue.cc:237] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:08.341822 18639 raft_consensus.cc:1240] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:08.349838 18608 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:08.363000 17913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:08.376745 17913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.377460 17913 leader_election.cc:304] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:08.354374 17847 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45912 (request call id 377) took 1277 ms. Trace:
I20260709 12:10:08.366786 17988 leader_election.cc:304] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:08.385557 17847 rpcz_store.cc:276] 0709 12:10:07.077104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:07.105887 (+ 28783us) service_pool.cc:224] Handling call
0709 12:10:08.354186 (+1248299us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":3}
I20260709 12:10:08.355037 19558 consensus_queue.cc:1059] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
W20260709 12:10:08.400245 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.400468 19558 raft_consensus.cc:3055] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:08.400969 19558 raft_consensus.cc:740] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:08.401873 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:08.355386 19594 consensus_queue.cc:1059] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 12:10:08.401984 19558 consensus_queue.cc:260] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:08.403996 19558 raft_consensus.cc:3060] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.404793 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:08.405166 18638 raft_consensus.cc:1240] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:08.405316 18092 raft_consensus.cc:1275] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:08.408099 19615 consensus_queue.cc:1048] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:08.405864 17912 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:08.406129 18096 raft_consensus.cc:1240] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:08.362277 17833 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 132472us
I20260709 12:10:08.363545 19553 raft_consensus.cc:3060] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.415320 19594 raft_consensus.cc:2804] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:08.416044 17913 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:08.416621 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 66901.7us
I20260709 12:10:08.423635 17912 leader_election.cc:304] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:08.359963 19575 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.417109 19544 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:08.424444 19630 raft_consensus.cc:2804] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:08.362555 19550 raft_consensus.cc:697] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:08.425140 19630 raft_consensus.cc:697] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:08.426016 19550 consensus_queue.cc:237] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:08.426801 19580 consensus_queue.cc:1059] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:08.428051 19580 raft_consensus.cc:2749] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.417691 19625 raft_consensus.cc:2749] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.359707 19603 consensus_queue.cc:1048] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 12:10:08.418519 19582 raft_consensus.cc:3055] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:08.432430 19582 raft_consensus.cc:740] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:08.433655 19582 consensus_queue.cc:260] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:08.435595 19582 raft_consensus.cc:3060] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.420209 19581 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50326 (request call id 80) took 2519 ms. Trace:
I20260709 12:10:08.437661 19581 rpcz_store.cc:276] 0709 12:10:05.900373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:05.900535 (+   162us) service_pool.cc:224] Handling call
0709 12:10:06.019452 (+118917us) ts_tablet_manager.cc:1151] Deleting tablet 9ae30b26b2734033a87c3e1ba937a39f
0709 12:10:06.023393 (+  3941us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:10:07.997189 (+1973796us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:08.263211 (+266022us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:08.420104 (+156893us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1209406,"tablet-delete.queue_time_us":81578,"thread_start_us":58639,"threads_started":1}
I20260709 12:10:08.440786 17832 catalog_manager.cc:5028] TS 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): tablet 9ae30b26b2734033a87c3e1ba937a39f (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
W20260709 12:10:08.422047 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 87419us
I20260709 12:10:08.426227 19630 consensus_queue.cc:237] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:08.442714 17913 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:08.443512 19608 raft_consensus.cc:2749] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:08.444892 19608 consensus_queue.cc:1059] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:08.446228 19631 raft_consensus.cc:3055] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:08.446601 19631 raft_consensus.cc:740] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:08.447161 19625 consensus_queue.cc:1048] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:08.447708 19631 consensus_queue.cc:260] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:08.449433 19631 raft_consensus.cc:3060] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:08.450317 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 121970us
I20260709 12:10:08.424365 19627 raft_consensus.cc:2804] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:08.467808 17914 leader_election.cc:304] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:08.480314 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 58128.7us
I20260709 12:10:08.344084 19444 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:10:08.494186 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 139628us
I20260709 12:10:08.422866 19594 raft_consensus.cc:493] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:08.471061 19615 raft_consensus.cc:2804] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:08.472040 19627 raft_consensus.cc:697] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:08.515676 19630 raft_consensus.cc:2749] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.528245 19594 raft_consensus.cc:3060] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.541908 18638 raft_consensus.cc:1240] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:08.544265 19627 consensus_queue.cc:237] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:08.548940 19563 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:08.550978 19566 consensus_queue.cc:1059] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:08.551414 17988 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:08.552181 19585 raft_consensus.cc:3055] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:08.552497 19566 raft_consensus.cc:2804] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:08.553017 19566 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:08.553388 19566 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.552542 19585 raft_consensus.cc:740] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:08.554720 17988 leader_election.cc:304] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
W20260709 12:10:08.565469 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 114438us
W20260709 12:10:08.526362 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 58655.7us
I20260709 12:10:08.599545 18640 raft_consensus.cc:1240] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:08.528663 19615 raft_consensus.cc:493] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:08.605686 18640 raft_consensus.cc:1240] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:08.608129 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 53525us
I20260709 12:10:08.610459 17913 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:08.602411 19558 raft_consensus.cc:2804] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:08.624208 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:08.626816 19585 consensus_queue.cc:260] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:08.628224 17989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.635445 17913 leader_election.cc:304] T 9ae30b26b2734033a87c3e1ba937a39f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:08.607550 19615 raft_consensus.cc:3060] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.641863 18642 raft_consensus.cc:2393] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 3: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:08.643988 17988 leader_election.cc:304] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:08.649433 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:08.650177 18644 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.650403 19563 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:08.653189 19585 raft_consensus.cc:3060] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.629714 19630 raft_consensus.cc:2804] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:08.659293 19630 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:08.659791 19630 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.631166 18637 raft_consensus.cc:2468] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:10:08.668992 18636 raft_consensus.cc:1275] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:10:08.670724 17913 raft_consensus.cc:2686] T 9ae30b26b2734033a87c3e1ba937a39f P 63f5bddeebd84e5788d671a176cfa8e1: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:10:08.671655 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.671545 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:08.671499 17913 leader_election.cc:304] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:08.672377 18640 raft_consensus.cc:2468] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:08.672672 19631 raft_consensus.cc:2749] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.673928 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:08.674620 18641 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:08.675375 19631 consensus_queue.cc:1059] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:10:08.676156 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:08.679531 17914 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:08.680467 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:08.681197 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:08.681799 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:08.682679 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:08.679455 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:08.707067 18642 raft_consensus.cc:3060] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.630065 19558 raft_consensus.cc:493] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:08.707263 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:08.710592 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:08.711052 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:08.681568 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:08.681499 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:08.677142 18638 raft_consensus.cc:1240] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:08.680848 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:08.715152 19572 consensus_queue.cc:1059] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:08.678521 19637 consensus_queue.cc:1059] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:10:08.718675 19636 consensus_queue.cc:1059] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:08.728322 19594 raft_consensus.cc:515] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:08.731287 18644 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
W20260709 12:10:08.693742 18608 connection.cc:256] RPC call timeout handler was delayed by -1.3359066459997848s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17930000000000001s for a response
W20260709 12:10:08.740206 18608 connection.cc:256] RPC call timeout handler was delayed by -1.3189552020000974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19720000000000001s for a response
W20260709 12:10:08.740525 18608 connection.cc:256] RPC call timeout handler was delayed by -1.290227368999922s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21000000000000002s for a response
I20260709 12:10:08.733914 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:10:08.735245 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 374104us
I20260709 12:10:08.743758 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:08.744508 17914 leader_election.cc:304] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:08.716747 19558 raft_consensus.cc:3060] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.746176 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:08.748466 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:08.749421 18642 raft_consensus.cc:2468] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:10:08.750456 17940 raft_consensus.cc:1275] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:08.752674 17912 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
W20260709 12:10:08.754941 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 111042us
I20260709 12:10:08.745328 19572 raft_consensus.cc:3055] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:08.739512 19563 raft_consensus.cc:2804] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:08.765640 19615 raft_consensus.cc:515] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:08.766933 17988 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:08.767834 19615 leader_election.cc:290] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:08.768002 17988 leader_election.cc:304] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:08.768443 19615 raft_consensus.cc:2804] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:08.768787 19615 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:08.769047 19636 raft_consensus.cc:3055] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:08.769160 19615 raft_consensus.cc:3060] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.769501 19636 raft_consensus.cc:740] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:08.770473 19636 consensus_queue.cc:260] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:08.771031 19575 raft_consensus.cc:2804] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:08.771425 19575 raft_consensus.cc:493] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:08.771733 19636 raft_consensus.cc:3060] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.772269 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:08.771821 19575 raft_consensus.cc:3060] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.735349 19566 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:08.776319 19566 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:08.778448 19594 leader_election.cc:290] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:08.779203 19594 raft_consensus.cc:2749] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.780112 19594 raft_consensus.cc:2804] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:08.780683 19594 raft_consensus.cc:697] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:08.714799 19622 consensus_queue.cc:1059] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:10:08.758016 19572 raft_consensus.cc:740] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:08.788460 19572 consensus_queue.cc:260] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:08.789294 19608 consensus_queue.cc:1059] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:08.789800 19572 raft_consensus.cc:3060] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.790258 19639 raft_consensus.cc:3055] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:08.790628 19639 raft_consensus.cc:740] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:08.791497 19639 consensus_queue.cc:260] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:08.792627 19639 raft_consensus.cc:3060] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.769069 17988 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:08.798242 18641 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:08.804567 19575 raft_consensus.cc:515] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:08.809617 19586 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:08.809948 19636 raft_consensus.cc:3055] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:08.810354 19636 raft_consensus.cc:740] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:08.811617 19575 leader_election.cc:290] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:08.781755 19594 consensus_queue.cc:237] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:08.813820 19597 raft_consensus.cc:3055] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:08.819977 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:08.828437 18641 raft_consensus.cc:3060] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:08.821646 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 52617.4us
I20260709 12:10:08.823709 19583 raft_consensus.cc:2749] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.829655 17988 leader_election.cc:304] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:08.759236 19631 raft_consensus.cc:2749] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.831491 17988 leader_election.cc:304] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:08.819833 19637 raft_consensus.cc:3055] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:08.795254 19563 raft_consensus.cc:493] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:08.823179 19615 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:08.833251 17988 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:08.836898 17988 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:08.832675 19637 raft_consensus.cc:740] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:08.839285 19637 consensus_queue.cc:260] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:08.842759 19585 raft_consensus.cc:2749] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.843446 19583 raft_consensus.cc:2749] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:08.833849 19577 raft_consensus.cc:2749] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.832883 19563 raft_consensus.cc:3060] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.848587 19629 raft_consensus.cc:493] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:08.849061 19629 raft_consensus.cc:515] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:08.851214 19629 leader_election.cc:290] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:08.853485 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:08.853663 17947 raft_consensus.cc:2468] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:08.854820 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:08.855829 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:08.837911 17988 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:08.828153 19597 raft_consensus.cc:740] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:08.833046 19575 raft_consensus.cc:2749] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:08.873056 18641 raft_consensus.cc:2468] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:10:08.874384 17912 leader_election.cc:304] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
W20260709 12:10:08.891932 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 173942us
W20260709 12:10:08.896761 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 146504us
I20260709 12:10:08.901151 18639 raft_consensus.cc:1275] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:10:08.901952 18608 connection.cc:256] RPC call timeout handler was delayed by -1.1632450489998973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20110000000000003s for a response
I20260709 12:10:08.902215 19597 consensus_queue.cc:260] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:08.902583 18608 connection.cc:256] RPC call timeout handler was delayed by -1.0455018269999528s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1899s for a response
W20260709 12:10:08.903231 18608 connection.cc:256] RPC call timeout handler was delayed by -1.0024940509999851s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22440000000000004s for a response
I20260709 12:10:08.878465 19583 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:08.904596 19583 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:08.905584 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:08.906201 17941 raft_consensus.cc:2468] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:08.878669 19577 raft_consensus.cc:2749] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:08.882968 19580 raft_consensus.cc:2804] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:08.913983 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:08.870223 19636 consensus_queue.cc:260] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:08.914877 18092 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 2.
I20260709 12:10:08.915509 19636 raft_consensus.cc:3060] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.915982 19615 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:08.916642 19634 raft_consensus.cc:3055] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:08.917028 19634 raft_consensus.cc:740] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:08.917879 19634 consensus_queue.cc:260] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:10:08.920408 19563 raft_consensus.cc:515] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:08.903491 19597 raft_consensus.cc:3060] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:08.924665 19583 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:08.910161 19630 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:08.926083 19558 raft_consensus.cc:515] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:08.927430 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 89575.2us
I20260709 12:10:08.928413 17988 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:08.947759 17989 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:10:08.951840 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 49338.6us
I20260709 12:10:08.956414 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
W20260709 12:10:08.957747 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 206819us
I20260709 12:10:08.951831 19583 raft_consensus.cc:2749] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:08.965333 17988 leader_election.cc:304] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:08.959782 19580 raft_consensus.cc:697] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:08.959563 19566 raft_consensus.cc:2804] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:08.969254 19566 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:08.969957 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:08.985900 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:08.963956 19558 leader_election.cc:290] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:08.987920 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:08.989885 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:08.990665 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:08.991783 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:08.992394 18641 raft_consensus.cc:1275] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:08.992875 18639 raft_consensus.cc:1275] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:08.994503 18642 raft_consensus.cc:1275] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:08.994431 19634 raft_consensus.cc:3060] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:08.995488 19630 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:08.996349 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:08.996411 19580 consensus_queue.cc:237] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:08.998080 19563 leader_election.cc:290] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:09.019903 19563 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:09.020581 19563 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:08.990671 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:08.962850 19584 consensus_queue.cc:1048] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:10:08.999751 19637 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:09.027566 19630 consensus_queue.cc:1048] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:08.972343 19583 raft_consensus.cc:2749] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:09.000680 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:09.001729 18608 leader_election.cc:304] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:08.972527 19566 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.002616 17988 leader_election.cc:304] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:08.967686 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
W20260709 12:10:09.015816 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.029188 17947 raft_consensus.cc:2468] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:10:09.100920 19544 raft_consensus.cc:3060] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:09.015934 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 56095.8us
W20260709 12:10:09.101716 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.100929 19597 consensus_queue.cc:1048] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:09.102452 18062 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:09.103183 19572 raft_consensus.cc:2804] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:09.103608 19572 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:09.104025 19572 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:09.097611 17946 raft_consensus.cc:2468] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:10:09.035948 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
W20260709 12:10:09.107187 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.103987 18062 leader_election.cc:304] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:10:09.095515 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:09.100234 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 97690.3us
I20260709 12:10:09.108417 17948 raft_consensus.cc:2468] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 3.
I20260709 12:10:09.113471 17988 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:09.115963 18062 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:09.119586 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:09.118891 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 117267us
I20260709 12:10:09.128651 19629 raft_consensus.cc:2804] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:09.110538 19630 consensus_queue.cc:1048] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:10:09.129307 19629 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:09.129812 19629 raft_consensus.cc:3060] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.130204 17988 leader_election.cc:304] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:09.109035 19575 raft_consensus.cc:2749] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.146620 17940 raft_consensus.cc:2468] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 3.
I20260709 12:10:09.148337 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:09.150355 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:09.113948 19622 raft_consensus.cc:2804] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:09.110282 19655 raft_consensus.cc:493] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:09.132993 19558 raft_consensus.cc:2749] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.154603 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:09.163972 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:09.164143 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 49620.7us
I20260709 12:10:09.164438 17948 raft_consensus.cc:1813] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Handling vote request from an unknown peer 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:09.164707 18019 raft_consensus.cc:2393] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 2: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:09.164994 17948 raft_consensus.cc:2393] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 3: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:09.166738 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:09.168241 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:10:09.169917 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 45119.5us
I20260709 12:10:09.144549 19585 raft_consensus.cc:2749] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:09.172333 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:09.173328 17948 raft_consensus.cc:2468] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:10:09.174791 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:09.177237 18062 connection.cc:256] RPC call timeout handler was delayed by -1.3782512010000119s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2066s for a response
W20260709 12:10:09.177627 18062 connection.cc:256] RPC call timeout handler was delayed by -1.3710512010000002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2074s for a response
W20260709 12:10:09.177956 18062 connection.cc:256] RPC call timeout handler was delayed by -1.2963512010001068s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2157s for a response
W20260709 12:10:09.178277 18062 connection.cc:256] RPC call timeout handler was delayed by -1.2522512010000355s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22060000000000002s for a response
I20260709 12:10:09.179076 18020 raft_consensus.cc:1813] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Handling vote request from an unknown peer 4813437da0a74e65b61eb7bd1d18f110
W20260709 12:10:09.179397 18062 connection.cc:256] RPC call timeout handler was delayed by -1.2367709330001162s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18180000000000002s for a response
I20260709 12:10:09.179950 18020 raft_consensus.cc:2410] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:10:09.182171 18021 raft_consensus.cc:1275] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:09.159507 19622 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:09.166150 19563 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:09.189973 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:09.190693 18023 raft_consensus.cc:2468] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:10:09.191138 17941 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
W20260709 12:10:09.191588 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.174919 19544 raft_consensus.cc:2749] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:09.167640 18015 raft_consensus.cc:2468] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:09.172830 19655 raft_consensus.cc:515] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:09.208530 17989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.210011 19655 leader_election.cc:290] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:09.201709 18642 raft_consensus.cc:1275] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:09.218806 17988 leader_election.cc:304] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:09.187104 19622 raft_consensus.cc:3060] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:09.182017 19636 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
W20260709 12:10:09.223099 18062 connection.cc:256] RPC call timeout handler was delayed by -1.2207512009999846s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22410000000000002s for a response
I20260709 12:10:09.226835 19636 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:10:09.228886 19615 consensus_queue.cc:1048] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:09.230293 19636 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123)
I20260709 12:10:09.226915 19560 raft_consensus.cc:2749] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.230888 19566 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:09.240633 17988 leader_election.cc:304] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:09.231725 18019 raft_consensus.cc:1240] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:09.241497 19563 raft_consensus.cc:2749] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.245731 19597 consensus_queue.cc:1048] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:09.247635 17940 raft_consensus.cc:2468] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:10:09.249153 19629 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:09.254580 18608 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:09.258924 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:09.262663 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:09.263242 18093 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.263846 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:09.263743 19572 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:09.264482 18022 raft_consensus.cc:2468] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:10:09.265046 18090 raft_consensus.cc:2393] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 5: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:09.265110 19544 raft_consensus.cc:2749] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.263221 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:09.262497 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:09.266836 18092 raft_consensus.cc:1240] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:09.267722 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:09.271646 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:09.273481 18608 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:09.262434 19655 raft_consensus.cc:493] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:09.278692 19655 raft_consensus.cc:515] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:09.279580 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:09.279735 19629 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:09.280602 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:09.280858 19655 leader_election.cc:290] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:09.282546 17913 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:09.283123 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:09.284212 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:09.284698 18020 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.285375 19637 raft_consensus.cc:2749] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.287881 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:09.288182 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:09.288862 17948 raft_consensus.cc:2393] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 3: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:09.289258 17940 raft_consensus.cc:1240] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:09.275151 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:09.291909 18015 raft_consensus.cc:1240] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:09.292919 19566 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:09.292932 18015 raft_consensus.cc:3055] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:09.293923 18015 raft_consensus.cc:740] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:09.294788 18015 consensus_queue.cc:260] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:09.295877 18015 raft_consensus.cc:3060] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:09.297238 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:09.297765 18021 raft_consensus.cc:2393] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 3: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:09.299062 19544 raft_consensus.cc:2749] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.299819 18024 raft_consensus.cc:1240] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:09.300982 18024 raft_consensus.cc:1240] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:09.302347 18016 raft_consensus.cc:1240] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:09.307600 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:09.311261 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:09.311890 17948 raft_consensus.cc:3060] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.316728 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:09.317337 17946 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:09.312414 18608 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:09.322687 17948 raft_consensus.cc:2468] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:09.299826 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:09.324679 17913 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:09.333973 18020 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3.
I20260709 12:10:09.328971 18018 raft_consensus.cc:2468] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:10:09.332283 18608 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:09.335960 17913 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:09.333428 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 152753us
W20260709 12:10:09.325690 17988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.337726 17946 raft_consensus.cc:2468] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:09.334926 17941 raft_consensus.cc:1240] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:09.331692 19625 raft_consensus.cc:2749] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.346189 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:09.347329 17948 raft_consensus.cc:2393] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 5: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:09.353927 18608 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:09.359875 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:09.359645 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:09.347577 19634 raft_consensus.cc:2749] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.362059 18021 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:09.362802 17945 raft_consensus.cc:2393] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 3: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:09.364490 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:09.365624 18018 raft_consensus.cc:3060] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:09.363873 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:09.372654 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:09.346832 19637 raft_consensus.cc:2804] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:09.371549 17946 raft_consensus.cc:3060] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.357066 19544 raft_consensus.cc:2749] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.375859 18608 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:09.380086 18093 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:09.427176 18018 raft_consensus.cc:2468] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:10:09.381004 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:09.433903 17989 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:09.435671 18022 raft_consensus.cc:2393] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 3: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:09.437170 17946 raft_consensus.cc:2468] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
W20260709 12:10:09.438061 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 62299.9us
I20260709 12:10:09.454751 18608 leader_election.cc:304] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:09.380335 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:09.363425 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:09.466958 17988 leader_election.cc:304] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:09.468071 17988 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:09.468998 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:09.442106 19560 raft_consensus.cc:2804] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:09.475723 18644 raft_consensus.cc:1275] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:09.477092 19551 consensus_queue.cc:1059] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:09.479277 19444 raft_consensus.cc:2749] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.435848 19545 raft_consensus.cc:2749] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:09.482124 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.391462 19637 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:09.483062 17988 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:09.373760 19644 raft_consensus.cc:2804] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:10:09.512449 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 70959.3us
W20260709 12:10:09.525467 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:09.555981 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.485808 19637 raft_consensus.cc:3060] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.485126 19572 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:09.611066 19566 consensus_queue.cc:1059] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:09.612171 19566 consensus_queue.cc:1243] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer 63f5bddeebd84e5788d671a176cfa8e1 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:10:09.613176 19575 raft_consensus.cc:3055] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:09.504510 17942 raft_consensus.cc:3060] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:09.482517 18016 raft_consensus.cc:3060] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:09.511929 19563 raft_consensus.cc:2804] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:09.507580 19655 raft_consensus.cc:3055] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:09.623202 19655 raft_consensus.cc:740] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:09.624110 19655 consensus_queue.cc:260] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:09.624689 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:09.627362 19663 log.cc:927] Time spent T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
W20260709 12:10:09.628639 19662 log.cc:927] Time spent T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:10:09.630990 19563 raft_consensus.cc:697] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:09.631956 19563 consensus_queue.cc:237] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:09.632781 19622 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:09.617105 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:09.602823 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 148203us
I20260709 12:10:09.619463 18021 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
I20260709 12:10:09.612349 19637 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:09.506449 19580 consensus_queue.cc:1048] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.109s
I20260709 12:10:09.520062 19615 raft_consensus.cc:2804] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:09.618889 19560 raft_consensus.cc:697] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
W20260709 12:10:09.641412 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 166125us
I20260709 12:10:09.644407 18608 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:09.616276 19575 raft_consensus.cc:740] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:09.655211 18608 leader_election.cc:304] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:09.617808 19644 raft_consensus.cc:697] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:09.658784 19560 consensus_queue.cc:237] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:09.659237 19575 consensus_queue.cc:260] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:09.661705 19545 raft_consensus.cc:2804] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:09.662056 18016 raft_consensus.cc:2468] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:10:09.662271 19545 raft_consensus.cc:697] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:09.666782 18017 raft_consensus.cc:2468] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 4.
I20260709 12:10:09.667393 19545 consensus_queue.cc:237] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:09.671062 18608 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:09.641690 19585 raft_consensus.cc:2749] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:09.673667 18608 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:09.651294 19622 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:09.687335 18062 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:09.657356 19670 raft_consensus.cc:2749] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.707808 18608 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:09.683859 19542 raft_consensus.cc:2804] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:10:09.736930 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 53553.1us
W20260709 12:10:09.747972 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 263438us
W20260709 12:10:09.750623 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.732357 17942 raft_consensus.cc:2468] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:09.756253 17988 leader_election.cc:304] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
W20260709 12:10:09.762064 17989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.775437 17988 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:09.776688 17988 leader_election.cc:304] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:09.747702 19622 raft_consensus.cc:2749] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:09.782689 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 75001.4us
I20260709 12:10:09.785097 19652 raft_consensus.cc:2749] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.785225 19542 raft_consensus.cc:697] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:09.785795 19652 raft_consensus.cc:2804] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:09.786262 19652 raft_consensus.cc:697] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:09.786212 19542 consensus_queue.cc:237] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:09.790797 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:09.756728 19669 raft_consensus.cc:2804] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:09.786935 19673 raft_consensus.cc:2749] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.793416 18062 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:09.796128 18642 raft_consensus.cc:1240] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:09.790125 19670 raft_consensus.cc:2804] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:09.799772 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:09.801237 18062 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:09.802593 19666 log.cc:927] Time spent T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:10:09.798851 19652 consensus_queue.cc:237] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:09.804314 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.807289 19637 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:09.792793 19644 consensus_queue.cc:237] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:09.811163 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:09.801919 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 171189us
W20260709 12:10:09.816188 17988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:09.797819 19629 raft_consensus.cc:2749] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:09.815294 19670 raft_consensus.cc:697] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:09.798029 19669 raft_consensus.cc:697] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:09.818926 18062 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:09.821087 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:09.817366 19622 raft_consensus.cc:2749] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:09.846374 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 190274us
I20260709 12:10:09.852419 18642 raft_consensus.cc:1275] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:09.870083 18641 raft_consensus.cc:1240] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:09.889570 18642 raft_consensus.cc:1240] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:09.894783 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 75980.9us
I20260709 12:10:09.848091 19615 raft_consensus.cc:697] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:09.902760 18062 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:09.903028 18642 raft_consensus.cc:1240] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:09.893178 19572 raft_consensus.cc:2749] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:09.912781 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 240234us
I20260709 12:10:09.911337 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:09.912282 19622 raft_consensus.cc:2749] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:09.939328 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:09.926296 19669 consensus_queue.cc:237] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:09.951442 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:10.023003 19691 log.cc:927] Time spent T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.064s	user 0.004s	sys 0.003s
I20260709 12:10:10.023308 19575 raft_consensus.cc:3060] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.054823 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:10.056156 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:10.025805 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:10.057690 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:10.058169 18642 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 2.
I20260709 12:10:10.058521 17945 raft_consensus.cc:2376] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 3. Re-sending same reply.
I20260709 12:10:09.946142 19615 consensus_queue.cc:237] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:10.028745 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:10.029433 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:10.059514 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:10.060269 17941 raft_consensus.cc:2393] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 2: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:10.024545 19655 raft_consensus.cc:3060] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.030088 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:10.031015 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:10.029709 19675 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.061586 18641 raft_consensus.cc:2393] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 5: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:10.031838 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
W20260709 12:10:10.035670 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:10.032541 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:10.039657 17943 raft_consensus.cc:1240] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:09.947686 19594 consensus_queue.cc:1048] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:10:10.048352 19622 consensus_queue.cc:1048] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
W20260709 12:10:10.072233 18015 consensus_meta.cc:287] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.776s	user 0.004s	sys 0.009s
I20260709 12:10:10.079834 18015 raft_consensus.cc:1275] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:10.081343 17942 raft_consensus.cc:1275] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:10.063067 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:10.085350 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:09.956051 19582 consensus_queue.cc:1059] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:10:10.048417 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:10.102582 17946 raft_consensus.cc:2376] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2. Re-sending same reply.
I20260709 12:10:09.929925 19670 consensus_queue.cc:237] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:09.938807 19681 consensus_queue.cc:1059] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.088s
I20260709 12:10:10.054574 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:10.054576 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:10.107077 17949 raft_consensus.cc:2376] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2. Re-sending same reply.
I20260709 12:10:09.957551 19688 consensus_queue.cc:1059] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.113s
I20260709 12:10:10.101101 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:10.119019 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 95409.6us
I20260709 12:10:10.119837 17913 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:10.122068 17913 leader_election.cc:304] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:10.032829 18062 leader_election.cc:304] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:10.107148 17947 raft_consensus.cc:2376] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 3. Re-sending same reply.
W20260709 12:10:10.068081 19679 log.cc:927] Time spent T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
W20260709 12:10:10.109123 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:10.114454 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:10.074152 18637 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:10.133019 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 100336us
I20260709 12:10:10.073488 19675 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:10.129648 19594 raft_consensus.cc:2749] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.134120 19622 raft_consensus.cc:2749] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.119087 19585 consensus_queue.cc:1059] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:10:10.166885 17987 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:10.195019 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 73033us
I20260709 12:10:10.196807 17913 leader_election.cc:304] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:10.203251 19686 raft_consensus.cc:2804] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:10.203867 19686 raft_consensus.cc:697] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:10.204834 19686 consensus_queue.cc:237] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:10.208771 18062 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:10.223489 19692 log.cc:927] Time spent T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:10:10.224113 19684 raft_consensus.cc:3055] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:10.224512 19684 raft_consensus.cc:740] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:10.225349 19684 consensus_queue.cc:260] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:10.226019 19675 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:10.230531 18062 raft_consensus.cc:2686] T c4f794e5675049b284921052a24eea37 P 4813437da0a74e65b61eb7bd1d18f110: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:10:10.231127 18062 leader_election.cc:304] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:10.227236 19688 raft_consensus.cc:2804] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:10.245208 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 78156us
I20260709 12:10:10.249212 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:10.258535 18062 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:10.260668 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:10.260329 17987 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:10.273229 18095 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:10.163235 19544 consensus_queue.cc:1059] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:10:10.255020 19684 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.248147 19622 raft_consensus.cc:2804] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:10.279476 17989 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:10.293053 19647 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.293753 19671 raft_consensus.cc:2804] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:10:10.294319 19700 log.cc:927] Time spent T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 12:10:10.227315 19685 consensus_queue.cc:1059] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.158s
I20260709 12:10:10.247484 19594 consensus_queue.cc:1048] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:10:10.297530 18096 raft_consensus.cc:3055] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:10.281064 19683 raft_consensus.cc:2749] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:10.325676 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:10.326483 18095 raft_consensus.cc:2468] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:10:10.328125 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:10.331295 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:10.333693 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:10.334661 18095 raft_consensus.cc:2468] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:10:10.335618 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:10.288563 19688 raft_consensus.cc:697] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:10.340777 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:10.343962 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:10.296955 19622 raft_consensus.cc:493] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:10.303026 19558 raft_consensus.cc:2749] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.348790 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:10.349217 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:10.349779 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:10.347781 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:10.320223 18096 raft_consensus.cc:740] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:10.351282 18096 consensus_queue.cc:260] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:10.352119 19696 raft_consensus.cc:493] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.352267 18096 raft_consensus.cc:3060] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.352588 19696 raft_consensus.cc:515] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:10.355304 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:10.300966 19553 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:10.350543 18094 raft_consensus.cc:2468] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3.
I20260709 12:10:10.355757 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:10.319846 19566 raft_consensus.cc:2804] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:10.316480 19671 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:10.360096 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:10.372378 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:10.374245 18090 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
mode: GRACEFUL
new_leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:40154
I20260709 12:10:10.355860 19622 raft_consensus.cc:3060] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.374766 18090 raft_consensus.cc:606] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Received request to transfer leadership to TS e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:10.368688 19566 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:10.367472 19597 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.371084 19671 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:10.388823 19664 log.cc:927] Time spent T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:10:10.388854 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:10.370517 19553 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:10.391559 19694 log.cc:927] Time spent T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 12:10:10.385419 19566 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:10.393544 19688 consensus_queue.cc:237] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:10.395694 19644 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:10.396312 19644 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:10.408784 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 101926us
I20260709 12:10:10.323798 19647 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:10.423374 17946 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a474344628f842a781e714727d867c3a"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
mode: GRACEFUL
new_leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:10:10.424510 17946 raft_consensus.cc:606] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 LEADER]: Received request to transfer leadership to TS c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:10.418282 18095 raft_consensus.cc:2468] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:10:10.385083 19696 leader_election.cc:290] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:10.427452 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:10.430250 19695 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.430912 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:10:10.430783 19695 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:10:10.430791 19553 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:10.404515 19597 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:10.436933 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:10.438779 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:10.448791 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:10.449615 18096 raft_consensus.cc:1275] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:10.455404 19597 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:10.456990 19647 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:10.461670 18098 raft_consensus.cc:2468] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:10:10.457036 19695 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:10.466675 18095 raft_consensus.cc:1275] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:10.469718 18637 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:10.477670 19695 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:10.478180 19695 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:10.480845 19644 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:10.481330 18097 raft_consensus.cc:2468] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 4.
I20260709 12:10:10.488060 19566 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:10.495326 19671 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:10.495815 19583 raft_consensus.cc:3055] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:10.496198 19582 raft_consensus.cc:3055] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:10.496240 19583 raft_consensus.cc:740] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:10.496672 19582 raft_consensus.cc:740] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:10.497239 19583 consensus_queue.cc:260] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:10.498229 19583 raft_consensus.cc:3060] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.498731 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:10.499322 18092 raft_consensus.cc:2376] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2. Re-sending same reply.
I20260709 12:10:10.500231 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:10.500840 18092 raft_consensus.cc:2376] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2. Re-sending same reply.
I20260709 12:10:10.500986 18089 raft_consensus.cc:1240] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:10.501729 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:10.502260 18092 raft_consensus.cc:2376] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2. Re-sending same reply.
I20260709 12:10:10.502975 19630 raft_consensus.cc:3055] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:10.503257 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:10.503329 19630 raft_consensus.cc:740] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:10.503571 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:10.503954 17947 raft_consensus.cc:2468] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:10:10.504277 17949 raft_consensus.cc:2393] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 2: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:10.504339 19630 consensus_queue.cc:260] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:10.502269 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:10.505447 19630 raft_consensus.cc:3060] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.506247 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:10.507151 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:10.508906 19566 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:10.509063 18091 raft_consensus.cc:2468] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3.
I20260709 12:10:10.507231 19622 raft_consensus.cc:515] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:10.509819 18094 raft_consensus.cc:1275] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:10.510877 18089 raft_consensus.cc:2376] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2. Re-sending same reply.
I20260709 12:10:10.511520 19622 leader_election.cc:290] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:10.511834 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:10.505375 19695 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:10.513692 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:10.514290 19637 raft_consensus.cc:3055] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:10.514761 19637 raft_consensus.cc:740] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:10.500128 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:10.515761 18096 raft_consensus.cc:2393] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 3: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:10.515918 19637 consensus_queue.cc:260] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:10.516559 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:10.517138 19637 raft_consensus.cc:3060] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.517788 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:10.516731 17946 raft_consensus.cc:1275] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:10.524725 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:10.527221 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:10.531819 17949 raft_consensus.cc:2393] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 5: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:10.532249 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:10.533193 18090 raft_consensus.cc:1240] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:10.533459 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:10.533531 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:10.527809 17988 leader_election.cc:304] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:10.535972 19615 raft_consensus.cc:2804] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:10.536177 19671 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:10.536489 19615 raft_consensus.cc:697] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:10.523730 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:10.537524 19615 consensus_queue.cc:237] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:10.541210 17942 raft_consensus.cc:1240] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:10.541904 17946 raft_consensus.cc:1240] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:10.532296 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:10.544329 17947 raft_consensus.cc:1240] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:10.545590 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:10.551159 17947 raft_consensus.cc:1240] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:10.554349 18015 raft_consensus.cc:1275] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:10.554353 17946 raft_consensus.cc:1240] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:10.557830 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:10.558503 18015 raft_consensus.cc:3060] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.523267 19545 raft_consensus.cc:3055] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:10.565963 19545 raft_consensus.cc:740] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
W20260709 12:10:10.567649 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:10.567679 17914 leader_election.cc:304] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:10.572906 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:10.573475 18643 raft_consensus.cc:2468] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 1.
I20260709 12:10:10.573767 17914 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:10.574045 19684 raft_consensus.cc:2749] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.574546 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:10.574573 19580 raft_consensus.cc:2749] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.576273 19580 consensus_queue.cc:1048] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:10.518615 19582 consensus_queue.cc:260] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:10.577165 19671 consensus_queue.cc:1048] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:10.578274 19585 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.578483 19582 raft_consensus.cc:3060] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.578840 19585 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:10.580972 19585 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:10.583266 17912 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:10.584378 19684 raft_consensus.cc:2804] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:10.584836 19684 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:10.585243 19684 raft_consensus.cc:3060] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.589875 18062 leader_election.cc:304] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:10.592355 19671 raft_consensus.cc:2804] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:10.592741 19671 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:10.593117 19671 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.595165 19684 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:10.597811 18017 raft_consensus.cc:1240] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:10.600097 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:10.603897 19671 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:10.605988 19671 leader_election.cc:290] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:10.607323 18095 raft_consensus.cc:1275] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:10.571576 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:10.611094 19707 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.611658 19707 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:10.611148 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:10.612933 18090 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:10.567257 18098 raft_consensus.cc:1275] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:10.572278 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:10.572398 18016 raft_consensus.cc:1275] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:10:10.607419 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 189955us
I20260709 12:10:10.567759 19545 consensus_queue.cc:260] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:10.617731 18608 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:10.618516 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:10.618857 17913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:10.619271 18021 raft_consensus.cc:2468] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:10:10.623139 19681 raft_consensus.cc:993] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1: : Instructing follower c5ffa786c8fb43f7864fa8fbe76534cb to start an election
I20260709 12:10:10.625002 19681 raft_consensus.cc:1081] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 LEADER]: Signalling peer c5ffa786c8fb43f7864fa8fbe76534cb to start an election
I20260709 12:10:10.628346 19707 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:10.631404 19684 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:10.632334 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:10.634979 18639 raft_consensus.cc:3060] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.638025 19670 raft_consensus.cc:2804] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:10.638700 18015 raft_consensus.cc:2468] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3.
I20260709 12:10:10.640522 19594 consensus_queue.cc:1048] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:10:10.641655 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 52112.8us
I20260709 12:10:10.642439 18092 raft_consensus.cc:1275] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:10.643229 18023 raft_consensus.cc:1240] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:10.643172 19675 consensus_queue.cc:1048] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:10.644897 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:10.646708 18017 raft_consensus.cc:1240] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:10.647239 19671 consensus_queue.cc:1059] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:10.648185 19671 raft_consensus.cc:3055] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:10.648486 19671 raft_consensus.cc:740] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
W20260709 12:10:10.649331 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:10.649230 19671 consensus_queue.cc:260] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:10.650283 19671 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.652035 18090 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 5.
I20260709 12:10:10.652433 17914 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:10.638593 19670 raft_consensus.cc:697] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:10.667546 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
W20260709 12:10:10.623297 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 204598us
I20260709 12:10:10.655807 19675 consensus_queue.cc:1048] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:10.658195 19545 raft_consensus.cc:3060] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.658902 19566 consensus_queue.cc:1048] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:10.660637 18062 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:10.680475 18062 leader_election.cc:304] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:10.665536 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:10.665763 17913 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:10.669238 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:10.670341 18097 raft_consensus.cc:1275] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:10.671372 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:10.671527 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:10.697875 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:10.698390 18019 raft_consensus.cc:1275] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:10.698927 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:10.672133 18092 raft_consensus.cc:3055] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:10.672948 17946 raft_consensus.cc:1275] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:10.670785 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:10.679526 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:10.686194 18021 raft_consensus.cc:1240] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:10.693148 17949 raft_consensus.cc:2468] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:10:10.693334 17914 leader_election.cc:304] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:10.694339 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:10.681398 18642 raft_consensus.cc:2376] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4. Re-sending same reply.
I20260709 12:10:10.709818 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:10.695873 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:10.699909 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:10.702518 18608 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:10.712128 17947 raft_consensus.cc:2468] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 2.
I20260709 12:10:10.704264 17989 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:10:10.717970 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 52311.7us
I20260709 12:10:10.718695 17913 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:10.719146 19714 raft_consensus.cc:2749] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.719566 19594 raft_consensus.cc:2804] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:10.719648 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:10.678848 19670 consensus_queue.cc:237] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:10.720515 18016 raft_consensus.cc:2393] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 3: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:10.720757 17914 leader_election.cc:304] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:10.721007 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:10.697556 19655 raft_consensus.cc:2804] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:10.721596 18642 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:10.721835 17914 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:10.722488 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:10.722867 19634 raft_consensus.cc:2749] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.723349 19681 raft_consensus.cc:3060] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.723531 19634 raft_consensus.cc:2749] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:10.697487 19622 raft_consensus.cc:2749] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.705346 19684 raft_consensus.cc:2749] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:10.725780 18638 raft_consensus.cc:2376] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2. Re-sending same reply.
I20260709 12:10:10.726454 18641 raft_consensus.cc:1275] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:10.726958 18608 leader_election.cc:304] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:10.727102 17914 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:10.727635 18641 raft_consensus.cc:1240] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:10.720060 19594 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:10.722501 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:10.728384 19655 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
W20260709 12:10:10.747669 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 67272.7us
I20260709 12:10:10.748162 18642 raft_consensus.cc:2368] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for earlier term 2. Current term is 3.
W20260709 12:10:10.748050 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 132925us
I20260709 12:10:10.751194 18062 leader_election.cc:304] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:10.694048 19707 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:10.767225 18018 raft_consensus.cc:1240] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:10.767855 18021 raft_consensus.cc:1240] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:10.768194 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:10.768517 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:10.768623 17914 leader_election.cc:304] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:10.751781 19655 raft_consensus.cc:3060] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.773135 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:10.802348 18018 raft_consensus.cc:2393] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 5: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:10.786952 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:10.747279 19584 raft_consensus.cc:2804] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:10.747936 19594 raft_consensus.cc:3060] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.750221 19708 raft_consensus.cc:2749] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:10.731722 17847 catalog_manager.cc:5697] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 1 to 2, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:10.831761 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:10.832469 17847 catalog_manager.cc:5697] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 3 to 4, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 4 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:10:10.798885 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 47742.6us
I20260709 12:10:10.752012 18017 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a474344628f842a781e714727d867c3a"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
 from {username='slave'} at 127.0.0.1:45464
I20260709 12:10:10.706384 18092 raft_consensus.cc:740] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:10.770740 19675 raft_consensus.cc:2804] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:10.785619 19684 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.786129 19667 raft_consensus.cc:2749] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.785308 19582 consensus_queue.cc:1048] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:10:10.808154 19637 raft_consensus.cc:2749] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:10.825448 17988 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:10.789505 17987 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:10.828920 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:10.850256 18019 raft_consensus.cc:2393] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 2: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:10.788812 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:10.850519 18095 raft_consensus.cc:1240] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:10.831951 19580 raft_consensus.cc:493] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:10.830439 18018 raft_consensus.cc:1240] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:10.789288 17914 leader_election.cc:304] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:10.831283 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 64692.1us
I20260709 12:10:10.834554 17847 catalog_manager.cc:5697] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 2 to 3, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 3 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:10.800347 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:10.765573 18639 raft_consensus.cc:2468] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:10:10.771136 19630 raft_consensus.cc:2749] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.786844 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:10.846278 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:10.857664 18644 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:10.837698 19584 raft_consensus.cc:697] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:10.824959 18020 raft_consensus.cc:1240] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:10.852041 18608 leader_election.cc:304] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:10.852489 18024 raft_consensus.cc:2393] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 2: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:10.785972 19701 consensus_queue.cc:1048] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:10:10.860237 18018 raft_consensus.cc:1240] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:10.853072 18640 raft_consensus.cc:1240] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:10.837354 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:10.852056 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 62839.4us
I20260709 12:10:10.854568 17847 catalog_manager.cc:5697] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 1 to 2, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:10.871596 17914 leader_election.cc:304] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:10.869020 18018 raft_consensus.cc:1275] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:10.872498 17847 catalog_manager.cc:5697] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 2 to 3, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 3 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } }
I20260709 12:10:10.843421 18017 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:10.829147 19707 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:10.870393 17946 raft_consensus.cc:2468] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:10:10.876605 17912 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:10.879855 17914 leader_election.cc:304] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:10.852780 19583 raft_consensus.cc:2804] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:10.877928 17847 catalog_manager.cc:5697] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 1 to 2, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:10.881538 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 93086.3us
I20260709 12:10:10.883731 17987 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:10.856258 19647 raft_consensus.cc:2749] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:10.856621 19563 raft_consensus.cc:493] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:10.860018 19683 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:10.887974 18019 raft_consensus.cc:1240] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:10:10.868513 19553 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:10.883737 17847 catalog_manager.cc:5697] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 1 to 2, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:10.848539 19684 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:10.872464 19675 raft_consensus.cc:697] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:10.900743 17847 catalog_manager.cc:5697] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 1 to 2, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:10.882071 18017 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:10.903178 19553 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:10.860878 19615 consensus_queue.cc:1048] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:10:10.911535 17987 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:10.884539 19696 raft_consensus.cc:2749] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.884259 19583 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:10.861097 19580 raft_consensus.cc:515] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:10.890203 19558 raft_consensus.cc:2749] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.884147 19706 raft_consensus.cc:3060] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:10.900602 19685 raft_consensus.cc:2804] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:10.913831 18016 raft_consensus.cc:2393] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 2: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:10.962395 18644 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 5.
I20260709 12:10:10.982403 18608 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:10.964083 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:10.953912 18019 raft_consensus.cc:1275] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:10:10.982435 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 70958.5us
I20260709 12:10:10.892535 19630 consensus_queue.cc:1048] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
W20260709 12:10:10.981348 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 207480us
I20260709 12:10:10.888018 19686 consensus_queue.cc:1048] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
W20260709 12:10:10.991971 18061 leader_election.cc:336] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Timed out: RequestConsensusVote RPC to 127.16.98.196:43647 timed out after 1.695s (SENT)
I20260709 12:10:10.950282 19566 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:10.949833 19652 raft_consensus.cc:493] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:10.985033 17987 leader_election.cc:304] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:11.011003 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 134493us
I20260709 12:10:10.903373 19644 consensus_queue.cc:1048] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 12:10:10.969717 19583 raft_consensus.cc:3060] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:10.902621 19563 raft_consensus.cc:515] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:10.965504 19597 raft_consensus.cc:2749] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:11.016461 18061 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:10.989913 19681 raft_consensus.cc:2749] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:10.908651 19683 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:11.006577 19685 raft_consensus.cc:697] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
W20260709 12:10:11.035733 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 43787.1us
W20260709 12:10:11.036548 18061 leader_election.cc:336] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Timed out: RequestConsensusVote RPC to 127.16.98.196:43647 timed out after 1.701s (SENT)
I20260709 12:10:11.036985 18061 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:11.038111 19667 raft_consensus.cc:2749] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:11.022755 19566 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:11.015065 19708 consensus_queue.cc:1059] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:10:11.041958 19708 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.042413 19708 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:11.034611 19675 consensus_queue.cc:237] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:11.044155 19558 raft_consensus.cc:2749] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:11.044432 19708 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:11.045065 19708 raft_consensus.cc:3055] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:11.045449 19708 raft_consensus.cc:740] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:11.045156 19685 consensus_queue.cc:237] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:11.047834 19726 log.cc:927] Time spent T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:10:11.023769 19541 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:11.057003 18061 leader_election.cc:304] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:11.060444 19671 raft_consensus.cc:2749] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:11.060904 19667 raft_consensus.cc:2749] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:11.061908 19563 leader_election.cc:290] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:11.034883 18015 raft_consensus.cc:1275] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:11.065842 19711 raft_consensus.cc:2749] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:11.042493 19566 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:11.006873 19669 consensus_queue.cc:1048] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:10:10.982791 19584 consensus_queue.cc:237] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:11.046283 19708 consensus_queue.cc:260] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:11.032774 19652 raft_consensus.cc:515] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:11.069665 19594 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:10:11.080096 19707 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:11.081151 19652 leader_election.cc:290] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:11.086619 18061 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:11.092163 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 257297us
I20260709 12:10:11.094775 18061 leader_election.cc:304] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:11.078619 19682 raft_consensus.cc:2749] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:11.096653 19667 raft_consensus.cc:2749] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:11.104413 19708 raft_consensus.cc:3060] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:11.120630 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:11.118469 19667 consensus_queue.cc:1059] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:10:11.146968 19684 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:11.162998 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 283196us
I20260709 12:10:11.121016 19671 consensus_queue.cc:1059] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
W20260709 12:10:11.172654 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 152636us
I20260709 12:10:11.178207 19730 raft_consensus.cc:2749] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:11.181363 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 86696.6us
I20260709 12:10:11.184048 18061 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:11.185014 18608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:11.192835 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 93673.8us
I20260709 12:10:11.197751 17945 raft_consensus.cc:1275] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:11.202885 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:11.224112 18061 leader_election.cc:400] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Vote denied by peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647) with higher term. Message: Invalid argument: T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for earlier term 2. Current term is 3.
I20260709 12:10:11.224489 18061 leader_election.cc:403] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:10:11.197558 19597 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.232963 17948 raft_consensus.cc:1240] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 LEADER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:11.200181 19683 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:11.201828 19706 raft_consensus.cc:2749] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:11.204624 19671 raft_consensus.cc:2804] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:11.197762 19684 consensus_queue.cc:1048] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:10:11.246428 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:11.254446 18095 raft_consensus.cc:1275] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:11.256536 18022 raft_consensus.cc:2468] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:10:11.197422 19630 consensus_queue.cc:1048] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:10:11.253659 19669 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.259146 19669 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:11.259687 19683 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.230758 19615 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:11.264021 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:11.238198 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:11.260196 19683 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:11.267166 17941 raft_consensus.cc:1275] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:11.281230 17949 raft_consensus.cc:2468] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:11.253717 19686 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.265751 19681 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.261765 19594 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:11.237701 19597 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:11.305895 19681 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:11.308799 18015 raft_consensus.cc:1275] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:11.311959 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:11.312665 18022 raft_consensus.cc:3060] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:11.272828 19669 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:11.355639 17945 raft_consensus.cc:1275] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:11.355672 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:11.301023 19615 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:11.380164 19698 log.cc:927] Time spent T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.072s	user 0.000s	sys 0.012s
I20260709 12:10:11.366634 17943 raft_consensus.cc:2393] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 3: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:11.306315 19686 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:11.387343 19681 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:11.392168 19735 log.cc:927] Time spent T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 12:10:11.401131 19683 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:11.401525 19615 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:11.399421 19744 consensus_queue.cc:1059] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:10:11.390939 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:11.407351 19545 consensus_meta.cc:287] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.711s	user 0.008s	sys 0.003s
W20260709 12:10:11.423115 19655 consensus_meta.cc:287] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.583s	user 0.002s	sys 0.018s
W20260709 12:10:11.443229 17847 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.025s	sys 0.060s
W20260709 12:10:11.443699 17847 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.025s	sys 0.060s
I20260709 12:10:11.447582 19743 raft_consensus.cc:2749] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647) with higher term. Message: Invalid argument: T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for earlier term 2. Current term is 3.
I20260709 12:10:11.463912 18022 raft_consensus.cc:2468] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3.
I20260709 12:10:11.477981 18643 raft_consensus.cc:2468] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
W20260709 12:10:11.482829 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 290457us
I20260709 12:10:11.446409 19655 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:10:11.457805 19583 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:11.505402 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 282218us
I20260709 12:10:11.506961 18608 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
W20260709 12:10:11.509402 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 524426us
I20260709 12:10:11.509683 19708 raft_consensus.cc:2804] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:11.510107 19708 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:11.510205 17987 leader_election.cc:304] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:11.510489 19708 raft_consensus.cc:3060] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:11.511751 17987 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:11.513837 19746 raft_consensus.cc:2749] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:11.515054 19717 consensus_queue.cc:1048] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:11.514422 19746 raft_consensus.cc:2749] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:11.517556 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:11.500643 19545 consensus_queue.cc:1048] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:10:11.521428 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:11.522819 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:11.523531 18642 raft_consensus.cc:2376] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3. Re-sending same reply.
I20260709 12:10:11.502420 19625 consensus_queue.cc:1048] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:10:11.528533 19655 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123)
I20260709 12:10:11.529160 19655 consensus_queue.cc:1059] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:11.530139 19553 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:11.532538 18017 consensus_meta.cc:287] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.565s	user 0.007s	sys 0.004s
I20260709 12:10:11.532944 18017 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:11.518332 19597 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:11.518989 19736 raft_consensus.cc:493] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.521371 19672 consensus_queue.cc:1048] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:10:11.521875 19686 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:11.588454 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
W20260709 12:10:11.590961 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 78529.9us
I20260709 12:10:11.626789 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:11.627230 18062 leader_election.cc:304] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
W20260709 12:10:11.630191 19732 log.cc:927] Time spent T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.493s	user 0.003s	sys 0.000s
I20260709 12:10:11.630843 18017 leader_election.cc:290] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:11.632057 19733 log.cc:927] Time spent T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.515s	user 0.002s	sys 0.000s
I20260709 12:10:11.633188 19545 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:11.633744 19545 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:11.634922 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:11.635679 17944 raft_consensus.cc:2393] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 3: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:11.637030 17944 raft_consensus.cc:1275] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:11.637553 19625 raft_consensus.cc:493] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:11.639289 19625 raft_consensus.cc:515] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:11.641512 19625 leader_election.cc:290] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:11.642684 19583 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:11.645197 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:11.648502 18018 raft_consensus.cc:3060] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:11.651131 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:11.651373 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:11.652488 18022 raft_consensus.cc:1275] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:11.662897 18018 raft_consensus.cc:1275] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:11.664228 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:11.635715 19545 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:11.669963 19763 raft_consensus.cc:3055] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:11.669853 19644 consensus_queue.cc:1048] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:11.670501 19763 raft_consensus.cc:740] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:11.671630 19763 consensus_queue.cc:260] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:11.679749 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:11.680563 18097 raft_consensus.cc:2468] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 3.
W20260709 12:10:11.677744 19541 consensus_meta.cc:287] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.618s	user 0.009s	sys 0.001s
I20260709 12:10:11.688114 19683 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.677819 19717 raft_consensus.cc:493] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.538697 19736 raft_consensus.cc:515] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:11.701684 19717 raft_consensus.cc:515] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:11.701144 19752 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.705188 19752 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:11.705860 19749 raft_consensus.cc:2955] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:11.700935 19683 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:11.760465 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:11.777727 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 150575us
I20260709 12:10:11.784430 18062 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:11.783912 18020 raft_consensus.cc:2468] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3.
I20260709 12:10:11.786760 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:11.700877 19541 raft_consensus.cc:2749] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:11.771288 19763 raft_consensus.cc:3060] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:11.768738 19736 leader_election.cc:290] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:11.702750 19669 consensus_queue.cc:1048] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.121s
I20260709 12:10:11.857908 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:11.707821 19580 leader_election.cc:290] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:11.859124 18608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:11.860185 19652 raft_consensus.cc:493] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.860324 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:11.734506 19622 raft_consensus.cc:2804] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:11.864435 18098 raft_consensus.cc:1240] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:11.866182 19708 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:11.868448 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:11.888947 18019 raft_consensus.cc:2368] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for earlier term 2. Current term is 3.
W20260709 12:10:11.869230 18062 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:11.869621 19730 raft_consensus.cc:3055] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:11.795306 19755 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.731740 19717 leader_election.cc:290] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:11.772789 19752 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:11.859320 19558 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.860944 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:11.893900 19671 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.049s	sys 0.083s
W20260709 12:10:11.899993 19671 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.049s	sys 0.083s
I20260709 12:10:11.899555 19558 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:11.879233 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:11.901572 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:11.901741 19553 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.882889 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:11.902254 19553 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:11.885677 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:11.903184 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:11.903550 19558 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:11.904235 19553 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:11.905151 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:11.886710 19758 log.cc:927] Time spent T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:10:11.890980 17913 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:11.891618 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:11.895198 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:11.897234 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:11.897969 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:11.900300 19671 raft_consensus.cc:697] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:11.863839 19744 raft_consensus.cc:2804] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:11.905532 18641 raft_consensus.cc:1275] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 12:10:12.292501 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 401549us
I20260709 12:10:11.971812 18018 raft_consensus.cc:1240] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:11.938633 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:12.292665 18642 raft_consensus.cc:1275] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:11.932713 18062 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:11.911464 18644 raft_consensus.cc:2393] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 3: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:11.946254 17987 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:12.296240 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 350040us
W20260709 12:10:12.294947 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 362315us
I20260709 12:10:11.941161 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:11.968312 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:12.298949 18095 raft_consensus.cc:2468] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:10:12.301852 18641 raft_consensus.cc:1275] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:11.976018 17947 raft_consensus.cc:1240] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:11.933998 17940 raft_consensus.cc:1275] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:10:11.943435 18643 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60412 (request call id 617) took 1276 ms (client timeout 1626 ms). Trace:
I20260709 12:10:12.312145 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:12.312515 17914 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:11.978892 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:12.305013 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 353742us
I20260709 12:10:11.962213 17949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 1814) took 1175 ms. Trace:
I20260709 12:10:11.890228 19730 raft_consensus.cc:740] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:12.317325 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:12.311347 18643 rpcz_store.cc:269] 0709 12:10:10.667183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.667280 (+    97us) service_pool.cc:224] Handling call
0709 12:10:11.943215 (+1275935us) spinlock_profiling.cc:243] Waited 771 ms on lock 0x7b54003bea54. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:11.943340 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1772223360}
I20260709 12:10:12.320544 17940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44668 (request call id 213) took 1108 ms. Trace:
I20260709 12:10:12.320472 17949 rpcz_store.cc:276] 0709 12:10:10.786613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.786748 (+   135us) service_pool.cc:224] Handling call
0709 12:10:11.961972 (+1175224us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b5400251cd4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:11.962112 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1053427584}
W20260709 12:10:12.327606 18608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:12.327899 18062 leader_election.cc:304] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:12.282315 19761 log.cc:927] Time spent T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:10:11.961014 19667 raft_consensus.cc:3055] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:11.883860 19652 raft_consensus.cc:515] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:11.939103 19553 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:12.326133 17940 rpcz_store.cc:276] 0709 12:10:11.195125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.195281 (+   156us) service_pool.cc:224] Handling call
0709 12:10:11.933352 (+738071us) spinlock_profiling.cc:243] Waited 946 us on lock 0x7b5800003698. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4988db71 00007f7f4988da22 00007f7f527a68d9 00007f7f51900ee0 00007f7f519ca0ab 00007f7f519ca131 00007f7f5198bfc0 00007f7f51976929 00007f7f519763d2 00007f7f4aeedbd4
0709 12:10:11.933594 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:12.303580 (+369986us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.303817 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2176896}
I20260709 12:10:11.937148 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:11.945398 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:11.931408 19762 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:11.934619 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:11.960595 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:12.063877 19655 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:12.317071 19707 raft_consensus.cc:2749] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:11.958954 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:12.310590 19580 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:12.317452 19647 raft_consensus.cc:2804] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:11.930938 19622 raft_consensus.cc:697] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:11.938072 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:12.318733 19688 raft_consensus.cc:493] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.363900 18018 raft_consensus.cc:1275] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:11.931854 19765 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:11.949527 19706 consensus_queue.cc:1048] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.405s
I20260709 12:10:11.896111 19582 consensus_queue.cc:1048] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.458s
I20260709 12:10:12.323410 19686 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:11.932463 19750 consensus_queue.cc:1059] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.423s
I20260709 12:10:11.910929 19755 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:12.330317 19746 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.317781 19760 raft_consensus.cc:2749] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:12.325955 19763 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:12.329891 19744 raft_consensus.cc:697] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:12.350088 19615 raft_consensus.cc:493] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.317322 19738 consensus_queue.cc:1059] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:10:12.354480 19717 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:12.356156 19667 raft_consensus.cc:740] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:12.376474 17942 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:12.349663 19742 consensus_queue.cc:1048] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:10:12.387583 18024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53022 (request call id 257) took 1156 ms. Trace:
I20260709 12:10:12.372798 19764 raft_consensus.cc:2749] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:12.461182 17947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44668 (request call id 217) took 1264 ms. Trace:
I20260709 12:10:12.399399 18016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45464 (request call id 1518) took 1164 ms. Trace:
I20260709 12:10:12.378100 19708 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:12.387156 18023 raft_consensus.cc:2468] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:10:12.368808 19669 consensus_queue.cc:1048] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:10:12.410005 19625 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:12.519696 19625 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:12.411288 19750 consensus_queue.cc:1243] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer c5ffa786c8fb43f7864fa8fbe76534cb log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:10:12.371210 19553 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:12.398904 18636 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60412 (request call id 612) took 1735 ms (client timeout 1921 ms). Trace:
I20260709 12:10:12.392133 19688 raft_consensus.cc:515] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:12.379042 19655 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:12.372470 19762 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:12.402755 19683 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:12.387897 19580 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:12.550454 19784 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:12.551023 19784 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:12.551761 19580 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:12.552436 19580 raft_consensus.cc:2749] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:12.463843 17943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50334 (request call id 1757) took 1269 ms. Trace:
I20260709 12:10:12.552984 19784 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:12.461477 17947 rpcz_store.cc:276] 0709 12:10:11.196417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.304148 (+107731us) service_pool.cc:224] Handling call
0709 12:10:11.975838 (+671690us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:12.303019 (+327181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.461044 (+158025us) spinlock_profiling.cc:243] Waited 625 ms on lock 0x7b5400251cd0. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b18ad 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:12.461137 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1437441920}
I20260709 12:10:12.463500 19615 raft_consensus.cc:515] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:12.516182 17912 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:12.460327 18024 rpcz_store.cc:276] 0709 12:10:11.223581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.223724 (+   143us) service_pool.cc:224] Handling call
0709 12:10:11.224062 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:11.234608 (+ 10546us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:11.234662 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:11.268164 (+ 33502us) log.cc:844] Serialized 26 byte log entry
0709 12:10:11.523645 (+255481us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:11.523689 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:11.523758 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:12.379633 (+855875us) raft_consensus.cc:1685] finished
0709 12:10:12.379661 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:12.379825 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6708,"raft.queue_time_us":33497,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":297,"spinlock_wait_cycles":441088,"thread_start_us":219109,"threads_started":1,"wal-append.queue_time_us":435435}
W20260709 12:10:12.517308 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 204871us
I20260709 12:10:12.467958 17942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50334 (request call id 1761) took 1273 ms. Trace:
I20260709 12:10:12.412773 19763 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:12.438859 19749 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:53944 (request call id 90) took 4329 ms. Trace:
W20260709 12:10:12.576781 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 60697.1us
W20260709 12:10:12.518448 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 190640us
I20260709 12:10:12.579993 18062 leader_election.cc:304] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:12.403332 19686 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:12.527844 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 234313us
W20260709 12:10:12.530877 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 199501us
I20260709 12:10:12.551422 19553 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:12.517362 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 165590us
I20260709 12:10:12.558151 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:12.588033 17949 raft_consensus.cc:2468] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 1.
I20260709 12:10:12.560607 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:12.563218 17945 raft_consensus.cc:1275] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:12.574106 19762 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:12.407079 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:12.574553 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:12.463116 19717 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:12.410259 19746 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:12.552984 19688 leader_election.cc:290] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:12.553138 17943 rpcz_store.cc:276] 0709 12:10:11.189587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.192728 (+  3141us) service_pool.cc:224] Handling call
0709 12:10:12.412592 (+1219864us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b54001fca54. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:12.458501 (+ 45909us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31265664}
I20260709 12:10:12.406127 19765 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:12.442203 19671 consensus_queue.cc:237] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:12.528266 19647 raft_consensus.cc:697] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:12.404821 19730 consensus_queue.cc:260] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:12.627300 18018 raft_consensus.cc:3060] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:12.633924 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 56255us
I20260709 12:10:12.592340 19774 raft_consensus.cc:2749] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:12.620260 19762 raft_consensus.cc:2749] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:12.478525 19622 consensus_queue.cc:237] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:12.635591 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 49702.7us
I20260709 12:10:12.558682 17942 rpcz_store.cc:276] 0709 12:10:11.190833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.193075 (+  2242us) service_pool.cc:224] Handling call
0709 12:10:11.934466 (+741391us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b5800003698. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4988de9c 00007f7f4988da5b 00007f7f527a68d9 00007f7f51900ee0 00007f7f519ca0ab 00007f7f519ca131 00007f7f519780a0 00007f7f51977984 00007f7f4aef26d4 00007f7f4aef2662
0709 12:10:12.463777 (+529311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42635008}
I20260709 12:10:12.628556 18017 raft_consensus.cc:2468] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:10:12.465643 18016 rpcz_store.cc:276] 0709 12:10:11.228677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.230569 (+  1892us) service_pool.cc:224] Handling call
0709 12:10:11.960428 (+729859us) spinlock_profiling.cc:243] Waited 6.91 ms on lock 0x7b5800055898. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4988de9c 00007f7f4988da5b 00007f7f527a68d9 00007f7f51900ee0 00007f7f519ca0ab 00007f7f519ca131 00007f7f519780a0 00007f7f51977984 00007f7f4aef26d4 00007f7f4aef2662
0709 12:10:12.393459 (+433031us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15888256}
I20260709 12:10:12.662535 18018 raft_consensus.cc:2468] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 3.
I20260709 12:10:12.664274 17913 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:10:12.549978 18636 rpcz_store.cc:269] 0709 12:10:10.663269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.668153 (+  4884us) service_pool.cc:224] Handling call
0709 12:10:11.945253 (+1277100us) spinlock_profiling.cc:243] Waited 26.2 ms on lock 0x7b58001c4a98. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4988db71 00007f7f4988deee 000000000036eb39 00007f7f519011e0 00007f7f519ca0c4 00007f7f519ca131 00007f7f519780a0 00007f7f51977984 00007f7f4aef26d4 00007f7f4aef2662
0709 12:10:12.392307 (+447054us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60279168}
I20260709 12:10:12.640394 19652 leader_election.cc:290] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:12.651335 17941 raft_consensus.cc:1275] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:12.636978 19736 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:12.574776 19749 rpcz_store.cc:276] 0709 12:10:08.081912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:08.087132 (+  5220us) service_pool.cc:224] Handling call
0709 12:10:08.236216 (+149084us) log.cc:844] Serialized 501 byte log entry
0709 12:10:12.407591 (+4171375us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1582,"raft.queue_time_us":21896,"raft.run_cpu_time_us":1397,"raft.run_wall_time_us":58638,"spinlock_wait_cycles":737536,"thread_start_us":70227,"threads_started":1,"wal-append.queue_time_us":111910,"wal-append.run_cpu_time_us":1720,"wal-append.run_wall_time_us":1005642}
I20260709 12:10:12.591874 19667 consensus_queue.cc:260] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:12.680341 19736 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:12.684310 19770 log.cc:927] Time spent T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
W20260709 12:10:12.686338 19766 log.cc:927] Time spent T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:10:12.670919 19780 consensus_queue.cc:1059] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
W20260709 12:10:12.687072 19769 log.cc:927] Time spent T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 12:10:12.687549 19780 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.639658 19779 consensus_queue.cc:1059] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
W20260709 12:10:12.687659 19772 log.cc:927] Time spent T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:10:12.655848 19760 consensus_queue.cc:1059] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
W20260709 12:10:12.719007 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 52253.6us
I20260709 12:10:12.669088 19625 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:10:12.718075 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 60946.2us
W20260709 12:10:12.714560 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 349043us
I20260709 12:10:12.688120 19780 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:12.632406 19744 consensus_queue.cc:237] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:12.688699 19776 raft_consensus.cc:2804] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:12.667903 19696 consensus_queue.cc:1048] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:10:12.668799 19582 consensus_queue.cc:1048] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:10:12.668605 19553 consensus_queue.cc:1048] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:10:12.721973 17913 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:12.728929 19779 consensus_queue.cc:1243] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Peer c5ffa786c8fb43f7864fa8fbe76534cb log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 12:10:12.739349 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 148263us
I20260709 12:10:12.740445 19749 raft_consensus.cc:3055] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:12.678994 19746 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:12.743028 17833 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3cdd445b25e5404da2f578c388210925 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:10:12.746615 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:12.750177 18643 raft_consensus.cc:2468] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 1.
I20260709 12:10:12.679562 19774 consensus_queue.cc:1059] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 12:10:12.737747 18609 leader_election.cc:304] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
W20260709 12:10:12.747539 17914 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.98.195:41931 timed out after 1.727s (SENT) [suppressed 59 similar messages]
I20260709 12:10:12.731514 19755 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:12.748121 19760 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:12.748180 19750 raft_consensus.cc:493] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:12.745273 19749 raft_consensus.cc:740] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:12.748100 19801 raft_consensus.cc:493] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.730015 18638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60424 (request call id 620) took 1072 ms. Trace:
I20260709 12:10:12.734226 19655 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:12.734031 19580 raft_consensus.cc:493] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:12.755559 17913 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:12.757158 19780 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:12.753691 19541 raft_consensus.cc:2804] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:12.758356 19553 raft_consensus.cc:2749] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:12.758389 18096 consensus_meta.cc:287] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.572s	user 0.004s	sys 0.006s
I20260709 12:10:12.759465 19688 consensus_queue.cc:1048] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:12.737479 19783 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:12.678452 19647 consensus_queue.cc:237] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:10:12.760875 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:12.763074 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:12.838944 19688 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:12.839442 19688 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:12.777859 19784 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.762517 19797 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.710949 19791 consensus_queue.cc:1059] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 12:10:12.778257 19774 raft_consensus.cc:3055] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:10:12.807432 17914 leader_election.cc:336] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Timed out: RequestConsensusVote RPC to 127.16.98.195:41931 timed out after 2.212s (SENT)
W20260709 12:10:12.809885 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 189865us
I20260709 12:10:12.763473 18636 raft_consensus.cc:1275] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:12.765635 19763 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:12.763818 19717 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:12.765532 19615 leader_election.cc:290] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:12.764376 19686 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:12.812534 18096 raft_consensus.cc:2468] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:10:12.838253 19783 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:12.841105 19553 raft_consensus.cc:2804] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:12.761860 19760 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:12.807304 19801 raft_consensus.cc:515] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:12.938655 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 131238us
W20260709 12:10:12.940189 17914 leader_election.cc:336] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Timed out: RequestConsensusVote RPC to 127.16.98.195:41931 timed out after 2.229s (SENT)
I20260709 12:10:12.940688 17914 leader_election.cc:304] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:12.807513 19696 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.946206 18062 leader_election.cc:400] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Vote denied by peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297) with higher term. Message: Invalid argument: T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for earlier term 2. Current term is 3.
I20260709 12:10:12.883101 19765 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:12.941176 19553 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:12.880074 19755 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.946010 19797 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:12.946738 18062 leader_election.cc:403] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:10:12.811678 19541 raft_consensus.cc:493] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:12.819977 19669 raft_consensus.cc:493] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:12.809319 19622 raft_consensus.cc:493] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:12.956692 18093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53964 (request call id 1471) took 1098 ms. Trace:
I20260709 12:10:12.779258 19750 raft_consensus.cc:515] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:12.807960 19795 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:12.959939 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:12.807758 19580 raft_consensus.cc:515] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:12.880172 19792 log.cc:927] Time spent T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 12:10:12.942492 19752 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.002s	sys 0.016s
I20260709 12:10:12.979702 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:12.980641 18019 raft_consensus.cc:1240] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:10:12.889510 19746 raft_consensus.cc:493] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:12.981359 18021 raft_consensus.cc:2393] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 3: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:12.955567 19696 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:13.003201 19746 raft_consensus.cc:515] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:12.950716 19542 raft_consensus.cc:3055] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:13.004093 19542 raft_consensus.cc:740] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:12.977355 19655 raft_consensus.cc:3060] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:12.774488 18638 rpcz_store.cc:276] 0709 12:10:11.652902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.654687 (+  1785us) service_pool.cc:224] Handling call
0709 12:10:11.667156 (+ 12469us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:11.703202 (+ 36046us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:11.704716 (+  1514us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:11.796461 (+ 91745us) log.cc:844] Serialized 26 byte log entry
0709 12:10:12.169755 (+373294us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:12.184810 (+ 15055us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.201464 (+ 16654us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:12.688672 (+487208us) raft_consensus.cc:1685] finished
0709 12:10:12.712626 (+ 23954us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:12.723948 (+ 11322us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9032,"raft.queue_time_us":18923,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":12064,"thread_start_us":203371,"threads_started":1,"wal-append.queue_time_us":667153}
I20260709 12:10:13.005208 19542 consensus_queue.cc:260] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:12.947849 19553 raft_consensus.cc:3060] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:12.983372 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:13.008347 19542 raft_consensus.cc:3060] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:12.937547 19774 raft_consensus.cc:740] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:12.948472 19688 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:12.948014 19756 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:12.984050 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 228541us
I20260709 12:10:12.841593 19784 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:12.962910 19541 raft_consensus.cc:3060] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:12.949864 19783 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:12.980795 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:13.018419 19763 raft_consensus.cc:493] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
W20260709 12:10:13.002758 19752 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.006s	sys 0.019s
I20260709 12:10:13.015679 19814 raft_consensus.cc:493] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:12.978858 18093 rpcz_store.cc:276] 0709 12:10:11.854159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.854265 (+   106us) service_pool.cc:224] Handling call
0709 12:10:11.879642 (+ 25377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:11.880068 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:11.880107 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:11.880654 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 12:10:12.331139 (+450485us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:12.738950 (+407811us) log.cc:844] Serialized 14 byte log entry
0709 12:10:12.951999 (+213049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.952058 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:12.952096 (+    38us) raft_consensus.cc:1685] finished
0709 12:10:12.952105 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:12.952191 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35026,"prepare.queue_time_us":320753,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":67063,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":7299,"thread_start_us":972015,"threads_started":3,"wal-append.queue_time_us":632727}
I20260709 12:10:12.984689 19669 raft_consensus.cc:515] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:12.981441 19686 raft_consensus.cc:2749] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:13.022344 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:13.005146 19746 leader_election.cc:290] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:12.949473 19755 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:13.022593 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:13.012501 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:13.040508 17940 raft_consensus.cc:1275] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:12.842705 19749 consensus_queue.cc:260] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:13.021540 19778 raft_consensus.cc:493] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.043308 18024 raft_consensus.cc:2368] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for earlier term 2. Current term is 3.
I20260709 12:10:12.951067 19797 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:13.112128 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:13.005261 19696 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:13.020179 19780 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:12.955013 19744 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:12.984849 19622 raft_consensus.cc:515] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:13.050367 19655 raft_consensus.cc:2749] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297) with higher term. Message: Invalid argument: T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for earlier term 2. Current term is 3.
I20260709 12:10:13.051766 19801 leader_election.cc:290] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:13.052367 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:13.131491 18019 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3.
I20260709 12:10:13.062227 19814 raft_consensus.cc:515] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:13.053169 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:13.132385 17947 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:13.060344 19580 leader_election.cc:290] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:13.061414 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:13.065091 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:13.048250 19763 raft_consensus.cc:515] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:12.997236 19795 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:13.075932 18062 leader_election.cc:304] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:13.079229 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:13.079478 17988 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:13.093899 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:13.022187 19688 consensus_queue.cc:1059] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:10:13.116441 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:10:13.139544 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 60138.7us
I20260709 12:10:13.117236 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:13.133524 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:13.069173 19803 raft_consensus.cc:493] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:13.115466 19765 consensus_queue.cc:1059] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:10:13.125521 19696 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:13.127907 19686 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
W20260709 12:10:13.147699 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 71866.5us
I20260709 12:10:13.149545 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:13.140491 17988 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:13.145488 17947 raft_consensus.cc:2468] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 2.
I20260709 12:10:13.120790 18023 raft_consensus.cc:2468] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3.
I20260709 12:10:13.140174 17940 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:13.156106 18098 raft_consensus.cc:2468] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:10:13.160017 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:13.161912 17948 raft_consensus.cc:3060] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.165791 19760 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:13.167596 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:13.161607 18095 raft_consensus.cc:2468] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3.
I20260709 12:10:13.156352 19655 raft_consensus.cc:2804] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:13.169137 19655 raft_consensus.cc:697] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:13.125782 19780 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:13.125720 19553 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:13.169875 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:13.168238 17947 raft_consensus.cc:2468] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:13.125931 19778 raft_consensus.cc:515] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:13.175158 17948 raft_consensus.cc:2468] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:13.176980 19778 leader_election.cc:290] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:13.173611 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:13.141749 17941 raft_consensus.cc:2468] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 2.
I20260709 12:10:13.133700 19744 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:13.180505 19808 raft_consensus.cc:2749] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:13.181273 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:13.171712 19795 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:13.019630 19756 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:13.131675 18092 consensus_queue.cc:260] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:13.185865 18024 raft_consensus.cc:2468] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:10:13.167136 19752 raft_consensus.cc:2804] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:13.163048 19686 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:13.157059 19696 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:13.174280 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:13.195788 19742 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:13.167486 19803 raft_consensus.cc:515] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:13.196089 19752 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:13.208190 17942 raft_consensus.cc:2468] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:13.208155 19742 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:13.209734 19783 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:13.240688 19780 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:13.240439 19783 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:13.231846 19784 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:13.244678 19763 leader_election.cc:290] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:13.244777 19783 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:13.206115 19553 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:13.200632 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:13.259297 18608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:13.259804 18608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.261732 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:13.263118 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:13.265174 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:13.267783 19744 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:13.268882 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:13.272413 18640 raft_consensus.cc:1240] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:13.224000 19752 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:13.207595 19669 leader_election.cc:290] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:13.272923 18642 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:13.233490 18092 raft_consensus.cc:3060] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.286571 19788 raft_consensus.cc:3055] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:13.286988 19788 raft_consensus.cc:740] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:13.283066 19742 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:13.290405 19788 consensus_queue.cc:260] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:13.291702 19788 raft_consensus.cc:3060] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:13.295006 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:13.272539 19738 raft_consensus.cc:493] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.256747 19545 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.255836 19780 raft_consensus.cc:493] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:13.206866 19655 consensus_queue.cc:237] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:13.280033 18023 raft_consensus.cc:2468] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:10:13.305579 19780 raft_consensus.cc:515] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:13.307224 19817 log.cc:927] Time spent T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:10:13.307386 19667 raft_consensus.cc:3060] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.297008 19738 raft_consensus.cc:515] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:13.308283 19696 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:13.313793 19756 leader_election.cc:290] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:13.312316 19755 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:13.301250 19622 leader_election.cc:290] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:13.317099 19686 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:13.318388 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:13.320438 17943 raft_consensus.cc:2468] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 1.
W20260709 12:10:13.319541 18644 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60424 (request call id 619) took 1668 ms (client timeout 1514 ms). Trace:
W20260709 12:10:13.321600 18644 rpcz_store.cc:269] 0709 12:10:11.650780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.650881 (+   101us) service_pool.cc:224] Handling call
0709 12:10:13.319304 (+1668423us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b5400722754. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:13.319465 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":596686592}
W20260709 12:10:13.331705 18062 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.301709 19814 leader_election.cc:290] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:13.337646 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:13.504096 19713 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
W20260709 12:10:13.546274 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.555387 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:13.558235 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.558846 19805 raft_consensus.cc:493] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:13.559551 19805 raft_consensus.cc:515] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:13.303970 19545 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:13.304637 19803 leader_election.cc:290] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:13.600673 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:13.506294 19708 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:13.605202 18097 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:10:13.553982 19791 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
W20260709 12:10:13.613077 18094 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.038s	sys 0.037s
W20260709 12:10:13.613423 18094 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.038s	sys 0.037s
W20260709 12:10:13.614398 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.622891 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:13.621146 19742 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:13.707358 17915 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.038s	sys 0.069s
W20260709 12:10:13.707901 17915 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.040s	sys 0.071s
W20260709 12:10:13.716202 19815 log.cc:927] Time spent T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
W20260709 12:10:13.734776 17987 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.060s	sys 0.095s
I20260709 12:10:13.616668 19708 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:13.736424 17987 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.060s	sys 0.095s
W20260709 12:10:13.737562 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 703266us
I20260709 12:10:13.627113 19791 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:13.504757 19713 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:13.755656 19780 leader_election.cc:290] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:13.757874 19736 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:13.726579 19738 leader_election.cc:290] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:10:13.736686 19541 consensus_meta.cc:287] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.642s	user 0.010s	sys 0.002s
W20260709 12:10:13.761408 18018 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.010s	sys 0.005s
I20260709 12:10:13.762885 18097 raft_consensus.cc:2468] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3.
W20260709 12:10:13.764500 18018 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.010s	sys 0.006s
I20260709 12:10:13.710748 19742 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:13.765902 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:13.766304 19541 raft_consensus.cc:515] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:13.790202 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 447428us
W20260709 12:10:13.794075 18090 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.021s	sys 0.081s
W20260709 12:10:13.794580 18090 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.022s	sys 0.081s
W20260709 12:10:13.796981 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 431374us
I20260709 12:10:13.791067 19545 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:13.800968 18062 leader_election.cc:400] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 pre-election: Vote denied by peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297) with higher term. Message: Invalid argument: T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for earlier term 2. Current term is 3.
I20260709 12:10:13.801275 18062 leader_election.cc:403] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:13.802783 19622 raft_consensus.cc:3060] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.805433 19708 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:13.806933 18092 consensus_meta.cc:287] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.521s	user 0.005s	sys 0.006s
I20260709 12:10:13.807583 18092 raft_consensus.cc:1275] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:10:13.808104 19743 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:10:13.808892 18092 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53954 (request call id 1627) took 3146 ms. Trace:
I20260709 12:10:13.809290 18092 rpcz_store.cc:276] 0709 12:10:10.662385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.666897 (+  4512us) service_pool.cc:224] Handling call
0709 12:10:10.672006 (+  5109us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:11.965303 (+1293297us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b4c0032b900. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4ac7ea20 00007f7f4ac8fa29 00007f7f4ac55644 00007f7f4ac7cf2d 00007f7f4ac7cb93 00007f7f4c9ad18b 00007f7f4c9adcb5 00007f7f4c9a8f30 00007f7f4c9aa7de 00007f7f4c9b4b49 00007f7f4c9b5416
0709 12:10:13.131290 (+1165987us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b54004d15a0. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c93006f 00007f7f4c9a8f60 00007f7f4c9aa7de 00007f7f4c9b4b49 00007f7f4c9b5416 00007f7f4c9b1d8f 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62
0709 12:10:13.807918 (+676628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.808810 (+   892us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1297488512}
I20260709 12:10:13.811213 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:13.812070 17946 raft_consensus.cc:2468] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 2.
I20260709 12:10:13.810607 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:13.801761 19788 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:13.803768 19805 leader_election.cc:290] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:13.834853 19788 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:13.836892 19768 log.cc:927] Time spent T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 1.273s	user 0.007s	sys 0.001s
I20260709 12:10:13.832186 19669 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:13.838724 19669 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:13.840478 19742 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:13.841147 19669 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:13.846501 19823 raft_consensus.cc:493] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.847038 19713 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:13.847007 19823 raft_consensus.cc:515] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:13.848124 19788 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:13.849196 19784 raft_consensus.cc:493] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:13.849777 19784 raft_consensus.cc:515] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:13.850505 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:13.851418 18092 raft_consensus.cc:2468] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:10:13.851850 19784 leader_election.cc:290] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:13.852283 19749 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.852895 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:13.853471 18609 leader_election.cc:304] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:13.853726 18092 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 3.
I20260709 12:10:13.855322 18609 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:13.855343 19738 raft_consensus.cc:2804] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:13.855568 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:13.855916 19738 raft_consensus.cc:493] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:13.856151 19713 raft_consensus.cc:2804] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:13.856331 19738 raft_consensus.cc:3060] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:13.856604 19713 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:13.857033 19713 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:13.856164 18093 raft_consensus.cc:2468] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 4.
I20260709 12:10:13.859094 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:13.811117 19813 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.876361 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:13.876803 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:13.877595 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:13.939942 19667 consensus_meta.cc:287] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.615s	user 0.009s	sys 0.001s
I20260709 12:10:13.941322 19823 leader_election.cc:290] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:13.910120 19791 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:13.868950 19813 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:13.942938 18093 raft_consensus.cc:2468] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3.
I20260709 12:10:13.944486 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:13.896718 19669 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:13.953877 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:13.952279 19752 consensus_meta.cc:287] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.663s	user 0.011s	sys 0.000s
I20260709 12:10:13.934612 19788 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:13.902575 19713 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:13.952438 18023 raft_consensus.cc:1240] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:13.970835 17912 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.971s	user 0.061s	sys 0.074s
I20260709 12:10:13.973420 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:13.975626 17912 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.976s	user 0.062s	sys 0.074s
I20260709 12:10:13.976140 18018 raft_consensus.cc:2393] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 3: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:13.983817 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:13.984622 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:13.985981 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:13.961757 19780 raft_consensus.cc:493] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:13.960363 19791 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:13.989156 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:13.991671 18608 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.009s	sys 0.036s
I20260709 12:10:13.954059 19669 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:13.992698 18608 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.009s	sys 0.036s
I20260709 12:10:13.962688 19667 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:13.989840 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:13.990447 19780 raft_consensus.cc:515] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:13.993815 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:13.974706 19541 leader_election.cc:290] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:13.997170 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:13.963055 19752 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:13.987213 19823 raft_consensus.cc:493] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.005926 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:14.007725 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:13.959965 19675 consensus_queue.cc:1048] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:10:14.003300 18019 raft_consensus.cc:1275] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:10:14.000085 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 726387us
I20260709 12:10:13.964907 19788 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:14.005241 18644 raft_consensus.cc:1813] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Handling vote request from an unknown peer 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:14.012040 18644 raft_consensus.cc:2410] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:10:13.991477 19622 raft_consensus.cc:2749] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297) with higher term. Message: Invalid argument: T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for earlier term 2. Current term is 3.
I20260709 12:10:14.014214 18019 raft_consensus.cc:1275] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:14.004351 17912 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:14.020344 18024 raft_consensus.cc:1240] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:14.021344 19652 raft_consensus.cc:493] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:13.999208 19791 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:14.019479 19814 raft_consensus.cc:2804] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:14.003978 19667 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:14.022785 18608 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:14.019717 19823 raft_consensus.cc:515] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:14.035552 19713 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:14.036298 19788 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:14.037142 19823 leader_election.cc:290] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:14.032624 19669 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:14.023061 19558 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:14.038160 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:14.036337 17947 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.859s	user 0.010s	sys 0.014s
I20260709 12:10:14.038854 19669 raft_consensus.cc:2804] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:10:14.039048 17947 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.862s	user 0.010s	sys 0.014s
I20260709 12:10:14.039326 19669 raft_consensus.cc:697] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:14.025343 19828 consensus_queue.cc:1048] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:10:14.040205 19669 consensus_queue.cc:237] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:14.028723 19814 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:14.042577 19814 raft_consensus.cc:3060] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.043996 19752 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:14.045202 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:14.045498 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:14.045768 18641 raft_consensus.cc:2468] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 2.
I20260709 12:10:14.047148 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:14.047716 18640 raft_consensus.cc:2468] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 2.
I20260709 12:10:14.037922 19558 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:14.026180 18639 raft_consensus.cc:1240] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:14.056711 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:14.057085 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:14.057812 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:14.048738 18094 raft_consensus.cc:2410] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
W20260709 12:10:14.251494 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 194072us
I20260709 12:10:14.253610 18608 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:14.024323 19652 raft_consensus.cc:515] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:14.254848 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:14.255468 18089 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41818 (request call id 448) took 1320 ms. Trace:
I20260709 12:10:14.255667 18640 raft_consensus.cc:2393] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 4: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:14.257092 18019 raft_consensus.cc:2468] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:14.245680 19814 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:14.249344 19752 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:14.250712 19736 raft_consensus.cc:493] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:14.256923 19816 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:14.270022 19749 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:14.269748 19622 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:14.255867 18089 rpcz_store.cc:276] 0709 12:10:12.935300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.940801 (+  5501us) service_pool.cc:224] Handling call
0709 12:10:12.947762 (+  6961us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:13.015510 (+ 67748us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:13.015550 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:13.015597 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:13.015632 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.255236 (+1239604us) spinlock_profiling.cc:243] Waited 66.2 ms on lock 0x7b54003a9b54. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:14.255279 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:14.255410 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":152271104}
I20260709 12:10:14.274060 19764 raft_consensus.cc:493] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:14.336995 18062 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.273746 19803 raft_consensus.cc:493] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:14.281131 19544 raft_consensus.cc:2804] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:14.276042 19675 raft_consensus.cc:493] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
W20260709 12:10:14.339841 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 312853us
I20260709 12:10:14.269723 19713 consensus_queue.cc:1048] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 12:10:14.281819 19708 consensus_queue.cc:1048] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:10:14.282083 19545 consensus_queue.cc:1048] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 12:10:14.284593 19833 consensus_queue.cc:1048] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
W20260709 12:10:14.352212 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 79652.5us
I20260709 12:10:14.353506 19544 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:14.340638 19752 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:14.402766 19823 raft_consensus.cc:493] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:14.338425 19736 raft_consensus.cc:515] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:14.350409 19749 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:14.407668 19788 raft_consensus.cc:493] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:14.354995 19622 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:14.355448 19803 raft_consensus.cc:515] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:14.399471 19675 raft_consensus.cc:515] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:14.441565 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.400499 19738 raft_consensus.cc:515] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:14.413890 19544 raft_consensus.cc:3060] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.353535 19764 raft_consensus.cc:515] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:14.416697 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:14.350637 19816 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:14.416390 19841 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:14.423324 19742 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:14.431602 19558 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:14.449510 18061 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:14.453819 19738 leader_election.cc:290] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:14.420154 19836 consensus_queue.cc:1059] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
W20260709 12:10:14.460837 18096 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53964 (request call id 1472) took 2606 ms (client timeout 2238 ms). Trace:
I20260709 12:10:14.463601 19749 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:14.463872 19845 raft_consensus.cc:2749] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.464648 19814 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:14.463884 19742 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:14.466527 19816 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:14.466773 19742 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:14.462432 19841 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:14.453891 19791 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:14.457576 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:14.459239 19736 leader_election.cc:290] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:14.459867 19834 log.cc:927] Time spent T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:10:14.453922 19844 raft_consensus.cc:493] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:14.437206 19788 raft_consensus.cc:515] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:14.463313 18096 rpcz_store.cc:269] 0709 12:10:11.854423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.855723 (+  1300us) service_pool.cc:224] Handling call
0709 12:10:14.460637 (+2604914us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b54001455d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:14.460748 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":613953792}
I20260709 12:10:14.430949 19823 raft_consensus.cc:515] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:14.462422 19752 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:14.469743 19784 raft_consensus.cc:3055] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:14.452855 19840 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
W20260709 12:10:14.475875 18608 connection.cc:256] RPC call timeout handler was delayed by -1.133543871000029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2026s for a response
I20260709 12:10:14.470666 19675 leader_election.cc:290] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:14.496116 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:14.498226 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
W20260709 12:10:14.479956 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.480742 19784 raft_consensus.cc:740] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:14.482512 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:14.477897 19844 raft_consensus.cc:515] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:14.484658 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:14.510555 19823 leader_election.cc:290] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:14.488003 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:14.498842 19840 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:14.511715 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:14.512637 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:14.508638 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:14.513623 19784 consensus_queue.cc:260] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:14.514595 18096 raft_consensus.cc:2468] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:14.515895 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:14.517376 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:14.494618 18017 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53022 (request call id 260) took 2846 ms (client timeout 2026 ms). Trace:
I20260709 12:10:14.512755 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:14.509548 19844 leader_election.cc:290] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:14.510507 18637 raft_consensus.cc:2468] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3.
I20260709 12:10:14.512939 19840 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:14.493753 19776 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:14.518864 18017 rpcz_store.cc:269] 0709 12:10:11.648556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.657732 (+  9176us) service_pool.cc:224] Handling call
0709 12:10:11.936627 (+278895us) spinlock_profiling.cc:243] Waited 9.63 ms on lock 0x7b5800055898. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4988db71 00007f7f4988da22 00007f7f527a68d9 00007f7f51900ee0 00007f7f519ca0ab 00007f7f519ca131 00007f7f519780a0 00007f7f51977984 00007f7f4aef26d4 00007f7f4aef2662
0709 12:10:14.494398 (+2557771us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b54001e3f54. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:14.494522 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":557840512}
I20260709 12:10:14.515915 18642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60412 (request call id 633) took 1251 ms. Trace:
I20260709 12:10:14.523557 17989 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:14.505805 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:14.524863 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:14.530507 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:14.519366 19730 raft_consensus.cc:3060] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.527995 18642 rpcz_store.cc:276] 0709 12:10:13.264697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.268591 (+  3894us) service_pool.cc:224] Handling call
0709 12:10:14.515760 (+1247169us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b54006707d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:14.515861 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7532288}
I20260709 12:10:14.532980 18637 raft_consensus.cc:1240] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:14.534001 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:14.535665 17912 leader_election.cc:304] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:14.536672 19823 raft_consensus.cc:2804] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:14.536820 19750 leader_election.cc:290] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:14.537261 19823 raft_consensus.cc:493] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:14.537683 19823 raft_consensus.cc:3060] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.518611 19852 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:14.539248 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:14.540520 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:14.540628 19852 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:14.542847 19852 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:14.543810 19841 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:14.546238 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:14.546434 17989 leader_election.cc:304] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:14.546957 18643 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:10:14.547024 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:14.547974 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:14.548089 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:14.549872 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:14.550570 18642 raft_consensus.cc:2468] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 1.
I20260709 12:10:14.548435 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:14.540040 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:14.557878 17914 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.572s	user 0.061s	sys 0.124s
I20260709 12:10:14.558195 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:14.558936 18096 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 2.
I20260709 12:10:14.559850 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:14.560406 18096 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 2.
I20260709 12:10:14.561264 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:14.562012 18096 raft_consensus.cc:2393] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 4: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:14.563313 17989 leader_election.cc:304] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:14.531471 19776 raft_consensus.cc:3060] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.564069 19675 raft_consensus.cc:2749] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:14.564692 19675 raft_consensus.cc:2804] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:14.565025 19675 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:14.565356 19675 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:14.569197 19544 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:14.539186 19840 raft_consensus.cc:2749] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:14.571269 19544 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:14.572008 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:14.573510 18018 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 3.
I20260709 12:10:14.551502 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:14.572050 18635 raft_consensus.cc:2393] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 2: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:14.553319 18061 leader_election.cc:304] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:14.576314 18061 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:14.577956 19791 raft_consensus.cc:2749] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.549593 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:14.577972 18061 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
W20260709 12:10:14.580910 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 136964us
W20260709 12:10:14.558197 17914 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.572s	user 0.061s	sys 0.124s
W20260709 12:10:14.581960 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 1.59627e+06us
I20260709 12:10:14.583767 17987 leader_election.cc:304] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:14.591928 19776 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:14.595201 17989 leader_election.cc:304] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:14.596014 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:14.595893 19776 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:14.600358 17987 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:14.600234 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:14.600607 18061 leader_election.cc:304] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
W20260709 12:10:14.602396 17914 connection.cc:256] RPC call timeout handler was delayed by -1.2204579750000448s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15810000000000002s for a response
I20260709 12:10:14.600610 17989 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:14.574285 19675 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:14.602844 17914 connection.cc:256] RPC call timeout handler was delayed by -1.0845579750000525s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17320000000000002s for a response
W20260709 12:10:14.603189 17914 connection.cc:256] RPC call timeout handler was delayed by -1.0197579750001751s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1804s for a response
I20260709 12:10:14.601955 18061 leader_election.cc:304] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:14.602049 19752 raft_consensus.cc:2804] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:14.603827 19707 raft_consensus.cc:2749] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.604140 19854 raft_consensus.cc:2804] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:14.604588 19854 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:14.604905 19854 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.605003 19841 raft_consensus.cc:2804] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:14.604086 19752 raft_consensus.cc:493] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:14.605464 19841 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:14.605697 19752 raft_consensus.cc:3060] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.605880 19841 raft_consensus.cc:3060] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:14.578706 19750 raft_consensus.cc:2804] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:14.606833 19750 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:14.607208 19750 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.599960 18017 raft_consensus.cc:2468] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
W20260709 12:10:14.608594 19773 log.cc:927] Time spent T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 2.035s	user 0.000s	sys 0.005s
I20260709 12:10:14.609257 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:14.609612 18020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53022 (request call id 266) took 2734 ms. Trace:
I20260709 12:10:14.611222 19762 raft_consensus.cc:2749] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.610038 18020 rpcz_store.cc:276] 0709 12:10:11.875547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.875905 (+   358us) service_pool.cc:224] Handling call
0709 12:10:11.885458 (+  9553us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:11.888747 (+  3289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:11.888789 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:11.893724 (+  4935us) log.cc:844] Serialized 26 byte log entry
0709 12:10:12.068247 (+174523us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b18003ebf60. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f498a7e07 00007f7f527029a9 00007f7f498c469b 00007f7f498c293f 00007f7f498c4c02 00007f7f4c54c20b 00007f7f4c551d23 00007f7f4c5520d1 00007f7f4c96da0f
0709 12:10:12.357894 (+289647us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:12.357937 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.357998 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:14.608072 (+2250074us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b4400022b4c. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f497ebc85 00007f7f497ec6a2 00007f7f4c55e1db 00007f7f4c559aaf 00007f7f4c54d86e 00007f7f4c54cbb6 00007f7f4c54c7d8 00007f7f4c556221 00007f7f4c5561d9 00007f7f4c556169
0709 12:10:14.609385 (+  1313us) raft_consensus.cc:1685] finished
0709 12:10:14.609409 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:14.609533 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2798,"raft.queue_time_us":4831,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":3593,"spinlock_wait_cycles":36459520,"thread_start_us":289474,"threads_started":1,"wal-append.queue_time_us":566238}
I20260709 12:10:14.574806 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:14.615147 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:14.616107 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:14.617331 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:14.619531 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:14.601240 19736 raft_consensus.cc:2749] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:14.612355 19852 raft_consensus.cc:2804] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:14.622241 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:14.610460 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:14.624334 17942 raft_consensus.cc:2393] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 2: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:14.626447 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:14.623696 19852 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:14.627211 18096 raft_consensus.cc:2393] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 4: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:14.627420 19852 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:14.624972 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:14.581990 19844 consensus_queue.cc:1059] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:10:14.628207 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:14.628448 19844 consensus_queue.cc:1243] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer e28f77912a9c4ba2b9841f6fedddc2db log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:10:14.628921 19844 raft_consensus.cc:3055] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:14.629227 19844 raft_consensus.cc:740] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:14.625948 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:14.627344 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:14.601857 19823 raft_consensus.cc:515] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:14.629990 19844 consensus_queue.cc:260] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:14.632753 19844 raft_consensus.cc:3060] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:14.633728 19823 leader_election.cc:290] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:14.631806 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:14.635483 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:14.636502 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:14.637444 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:14.625718 19675 leader_election.cc:290] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:14.626464 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:10:14.639894 17913 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.558s	user 0.007s	sys 0.013s
W20260709 12:10:14.640223 17913 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.559s	user 0.007s	sys 0.013s
I20260709 12:10:14.618247 19752 raft_consensus.cc:515] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:14.640842 17947 raft_consensus.cc:1240] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:10:14.628944 18096 raft_consensus.cc:2393] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 4: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:14.645390 17989 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:14.648836 19675 raft_consensus.cc:3060] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:14.652508 19780 leader_election.cc:290] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:14.653865 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:14.654080 17942 raft_consensus.cc:1240] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:10:14.647645 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:14.654523 18092 raft_consensus.cc:2468] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:14.655161 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:14.655772 17942 raft_consensus.cc:2468] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:14.655839 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:14.656104 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:14.656646 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:14.657074 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:14.644340 17914 leader_election.cc:304] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:14.657518 18095 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53964 (request call id 1475) took 1677 ms (client timeout 1581 ms). Trace:
I20260709 12:10:14.658522 17914 leader_election.cc:304] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:14.659662 17914 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:14.660725 17914 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:14.661903 17914 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
W20260709 12:10:14.657867 18095 rpcz_store.cc:269] 0709 12:10:12.982972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.983106 (+   134us) service_pool.cc:224] Handling call
0709 12:10:14.657338 (+1674232us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54000a8cd4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:14.657430 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":293290240}
I20260709 12:10:14.662814 17989 leader_election.cc:304] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:14.664252 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:14.669633 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:14.672365 18641 raft_consensus.cc:1240] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:14.673437 18095 raft_consensus.cc:2468] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:14.680943 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:14.662415 19750 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:14.677116 19583 raft_consensus.cc:2804] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:14.955600 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 352293us
W20260709 12:10:14.958281 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 287025us
I20260709 12:10:14.670754 19823 raft_consensus.cc:2749] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:10:14.822595 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.663616 19826 raft_consensus.cc:2749] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:14.676940 19814 raft_consensus.cc:2804] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:14.663444 19816 raft_consensus.cc:2749] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:14.674966 19582 raft_consensus.cc:2804] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:14.966688 17912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:14.967283 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 309651us
W20260709 12:10:14.987216 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:14.678838 18092 raft_consensus.cc:2468] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 2.
I20260709 12:10:14.959283 19583 raft_consensus.cc:493] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:14.959101 19776 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:15.119948 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:15.028026 19566 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:15.065485 19844 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.070187 19814 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:15.078709 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:15.121552 19583 raft_consensus.cc:3060] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.138331 18092 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53954 (request call id 1656) took 1186 ms. Trace:
I20260709 12:10:15.071678 19582 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:15.069028 19841 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:15.101368 19780 raft_consensus.cc:493] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.131966 19675 raft_consensus.cc:2749] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:15.189478 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:15.069290 19854 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:15.173978 19844 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:15.216637 19750 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:15.217140 19844 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:15.183300 18015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53022 (request call id 263) took 3527 ms. Trace:
I20260709 12:10:15.156128 19776 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:15.193399 19582 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.193534 18092 rpcz_store.cc:276] 0709 12:10:13.941996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.656830 (+714834us) service_pool.cc:224] Handling call
0709 12:10:15.128348 (+471518us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.214107 19780 raft_consensus.cc:515] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:15.174325 19828 consensus_queue.cc:1059] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:10:15.170616 19566 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:15.229640 18092 raft_consensus.cc:1275] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:15.230439 18092 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53964 (request call id 1480) took 2235 ms. Trace:
I20260709 12:10:15.230870 18092 rpcz_store.cc:276] 0709 12:10:12.995409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.228756 (+2233347us) service_pool.cc:224] Handling call
0709 12:10:15.229165 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.230112 (+   947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.230361 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.232929 18092 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41818 (request call id 452) took 1933 ms. Trace:
I20260709 12:10:15.175290 19814 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.220944 19752 leader_election.cc:290] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:15.180738 17942 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:14.680328 18018 raft_consensus.cc:2393] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 3: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
W20260709 12:10:15.250610 19860 log.cc:927] Time spent T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.220s	user 0.001s	sys 0.001s
I20260709 12:10:15.242033 19826 raft_consensus.cc:3055] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:15.233880 19841 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:15.316061 19854 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:15.286489 19826 raft_consensus.cc:740] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:15.323971 19826 consensus_queue.cc:260] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:15.325322 19826 raft_consensus.cc:3060] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.326078 19813 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:15.329182 19780 leader_election.cc:290] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:10:15.286011 19852 consensus_meta.cc:287] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.658s	user 0.009s	sys 0.002s
I20260709 12:10:15.286851 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:15.356041 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 301250us
I20260709 12:10:15.233364 18092 rpcz_store.cc:276] 0709 12:10:13.299081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.231881 (+1932800us) service_pool.cc:224] Handling call
0709 12:10:15.232252 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.232496 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.232537 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:15.232602 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:15.232648 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.232725 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.232864 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:15.362170 17914 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.002s	sys 0.019s
W20260709 12:10:15.364104 17912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:15.364300 17914 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.003s	sys 0.019s
I20260709 12:10:15.350466 18089 raft_consensus.cc:2468] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 2.
W20260709 12:10:15.364815 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 628571us
I20260709 12:10:15.345376 19852 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:15.368919 19852 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:15.354017 19675 consensus_queue.cc:1048] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:10:15.219177 18015 rpcz_store.cc:276] 0709 12:10:11.649393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.651528 (+  2135us) service_pool.cc:224] Handling call
0709 12:10:11.671723 (+ 20195us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:11.767536 (+ 95813us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:11.769116 (+  1580us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:11.888104 (+118988us) log.cc:844] Serialized 26 byte log entry
0709 12:10:12.367947 (+479843us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:12.371482 (+  3535us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:13.836135 (+1464653us) spinlock_profiling.cc:243] Waited 9.6 ms on lock 0x7b4400022b4c. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f497ebc85 00007f7f497ec6a2 00007f7f4c55e1db 00007f7f4c559aaf 00007f7f4c54d86e 00007f7f4c54cbb6 00007f7f4c54c7d8 00007f7f4c556221 00007f7f4c5561d9 00007f7f4c556169
0709 12:10:15.101273 (+1265138us) spinlock_profiling.cc:243] Waited 31.5 ms on lock 0x7b5400364a54. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:15.120940 (+ 19667us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:15.155102 (+ 34162us) raft_consensus.cc:1685] finished
0709 12:10:15.155129 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.177209 (+ 22080us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26090,"raft.queue_time_us":2793,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":4746,"spinlock_wait_cycles":94592640,"thread_start_us":452318,"threads_started":1,"wal-append.queue_time_us":564248,"wal-append.run_cpu_time_us":10776,"wal-append.run_wall_time_us":2451966}
W20260709 12:10:15.375979 18089 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53954 (request call id 1663) took 1427 ms (client timeout 1885 ms). Trace:
I20260709 12:10:15.366895 19836 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
W20260709 12:10:15.379141 18089 rpcz_store.cc:269] 0709 12:10:13.944165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.507847 (+563682us) service_pool.cc:224] Handling call
0709 12:10:15.268283 (+760436us) spinlock_profiling.cc:243] Waited 4.93 ms on lock 0x7b58001b0998. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4988db71 00007f7f4988da22 00007f7f527a68d9 00007f7f51900ee0 00007f7f519ca0ab 00007f7f519ca131 00007f7f519780a0 00007f7f51977984 00007f7f4aef26d4 00007f7f4aef2662
0709 12:10:15.371930 (+103647us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11335040}
I20260709 12:10:15.388047 18089 raft_consensus.cc:1275] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:15.389518 19776 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:15.377702 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:15.390251 18092 raft_consensus.cc:1240] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:15.390969 18092 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53954 (request call id 1639) took 1470 ms. Trace:
I20260709 12:10:15.391312 18092 rpcz_store.cc:276] 0709 12:10:13.920182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.375232 (+1455050us) service_pool.cc:224] Handling call
0709 12:10:15.383174 (+  7942us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.390713 (+  7539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.390914 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.392794 18092 raft_consensus.cc:1275] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:15.393364 18092 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53954 (request call id 1645) took 1455 ms. Trace:
I20260709 12:10:15.393697 18092 rpcz_store.cc:276] 0709 12:10:13.938409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.392131 (+1453722us) service_pool.cc:224] Handling call
0709 12:10:15.392459 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.393128 (+   669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.393314 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.388610 18089 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53954 (request call id 1642) took 1451 ms. Trace:
W20260709 12:10:15.395210 18094 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53954 (request call id 1647) took 1456 ms (client timeout 1677 ms). Trace:
W20260709 12:10:15.395731 18094 rpcz_store.cc:269] 0709 12:10:13.939015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.007490 (+ 68475us) service_pool.cc:224] Handling call
0709 12:10:15.394976 (+1387486us) spinlock_profiling.cc:243] Waited 40.1 ms on lock 0x7b54000bfed4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:15.395138 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":92138368}
W20260709 12:10:15.397235 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 44854.1us
I20260709 12:10:15.399875 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:15.394943 18089 rpcz_store.cc:276] 0709 12:10:13.937590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.387400 (+1449810us) service_pool.cc:224] Handling call
0709 12:10:15.387699 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.388384 (+   685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.388560 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.400508 18016 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3.
I20260709 12:10:15.401041 19788 leader_election.cc:290] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:15.401490 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:15.402057 18016 raft_consensus.cc:3060] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.404012 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:15.405128 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:15.405475 19764 leader_election.cc:290] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:15.406145 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:15.407085 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:15.407603 19667 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:15.407792 18020 raft_consensus.cc:2393] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 3: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:15.408252 18092 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53954 (request call id 1646) took 1469 ms. Trace:
I20260709 12:10:15.408597 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:15.401117 18089 raft_consensus.cc:1240] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:15.409858 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:15.382764 19566 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:15.441327 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:15.442523 18020 raft_consensus.cc:3060] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.442348 19868 consensus_queue.cc:1059] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:15.446465 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:15.446679 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:15.447338 18638 raft_consensus.cc:2393] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 4: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:15.408622 18092 rpcz_store.cc:276] 0709 12:10:13.938720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.394471 (+1455751us) service_pool.cc:224] Handling call
0709 12:10:15.407770 (+ 13299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.407957 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.407984 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:15.408024 (+    40us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:15.408063 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.408116 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.408206 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.448089 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:15.448676 18641 raft_consensus.cc:3060] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:10:15.437929 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 72221.5us
I20260709 12:10:15.451646 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:15.452981 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:15.453553 18096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53964 (request call id 1477) took 2467 ms. Trace:
I20260709 12:10:15.453933 18096 rpcz_store.cc:276] 0709 12:10:12.986587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.709154 (+1722567us) service_pool.cc:224] Handling call
0709 12:10:14.956945 (+247791us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:14.957656 (+   711us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:14.957690 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:15.078409 (+120719us) log.cc:844] Serialized 26 byte log entry
0709 12:10:15.382888 (+304479us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:15.453050 (+ 70162us) log.cc:844] Serialized 14 byte log entry
0709 12:10:15.453271 (+   221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.453337 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:15.453370 (+    33us) raft_consensus.cc:1685] finished
0709 12:10:15.453381 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.453498 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":640,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":175,"thread_start_us":269597,"threads_started":2,"wal-append.queue_time_us":244841}
I20260709 12:10:15.456710 18096 raft_consensus.cc:1240] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:15.458469 18020 raft_consensus.cc:2410] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:15.454234 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:15.459903 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:15.461397 18096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53954 (request call id 1653) took 1520 ms. Trace:
I20260709 12:10:15.461948 18096 rpcz_store.cc:276] 0709 12:10:13.940745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.456086 (+1515341us) service_pool.cc:224] Handling call
0709 12:10:15.456481 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.461058 (+  4577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.461321 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.465051 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:15.432698 19675 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.383416 19836 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:15.470505 18641 raft_consensus.cc:2468] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:10:15.471624 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:15.435026 19873 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.407625 19583 raft_consensus.cc:515] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:15.477532 18096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53954 (request call id 1655) took 1535 ms. Trace:
I20260709 12:10:15.439674 19625 consensus_queue.cc:1059] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:10:15.464339 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:15.432328 19582 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:15.470093 18089 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53954 (request call id 1650) took 1526 ms. Trace:
I20260709 12:10:15.478286 18096 rpcz_store.cc:276] 0709 12:10:13.941677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.464129 (+1522452us) service_pool.cc:224] Handling call
0709 12:10:15.477142 (+ 13013us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.477304 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.477327 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:15.477367 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:15.477384 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.477417 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.477486 (+    69us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.479282 19868 raft_consensus.cc:3055] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:15.483628 19868 raft_consensus.cc:740] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:15.484725 19868 consensus_queue.cc:260] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:15.485929 19868 raft_consensus.cc:3060] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.488647 18017 raft_consensus.cc:1240] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 3. Current term is 5. Ops: []
I20260709 12:10:15.475672 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:15.475513 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:15.493613 18020 raft_consensus.cc:2393] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 4: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:15.496989 17947 raft_consensus.cc:2368] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for earlier term 3. Current term is 4.
W20260709 12:10:15.497552 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 45754.9us
I20260709 12:10:15.476095 19675 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:10:15.498822 18608 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:15.503841 19836 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:15.501849 18016 raft_consensus.cc:2410] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:15.508911 19880 raft_consensus.cc:2749] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:15.509138 19583 leader_election.cc:290] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:15.499372 18638 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:15.500795 19582 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:15.518953 18017 raft_consensus.cc:1275] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:15.476667 19873 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:15.504663 18092 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53954 (request call id 1652) took 1564 ms. Trace:
W20260709 12:10:15.528079 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.531323 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:15.532984 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:15.533236 19814 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:15.535024 17943 raft_consensus.cc:2393] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 5: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:15.534941 18638 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
I20260709 12:10:15.481508 18089 rpcz_store.cc:276] 0709 12:10:13.939852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.400654 (+1460802us) service_pool.cc:224] Handling call
0709 12:10:15.400938 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.433126 (+ 32188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.466131 (+ 33005us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.539054 18608 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:15.541118 18608 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:15.541918 18022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53022 (request call id 264) took 3888 ms. Trace:
I20260709 12:10:15.542476 19868 raft_consensus.cc:2804] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:15.543251 19868 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:15.543769 19868 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.544610 18021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45464 (request call id 1530) took 2468 ms. Trace:
I20260709 12:10:15.542306 18022 rpcz_store.cc:276] 0709 12:10:11.653694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.653870 (+   176us) service_pool.cc:224] Handling call
0709 12:10:12.385549 (+731679us) spinlock_profiling.cc:243] Waited 4.14 ms on lock 0x7b5800055898. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4988db71 00007f7f4988da22 00007f7f527a68d9 00007f7f51900ee0 00007f7f519ca0ab 00007f7f519ca131 00007f7f5198bfc0 00007f7f51976929 00007f7f519763d2 00007f7f4aeedbd4
0709 12:10:12.477020 (+ 91471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:12.477436 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:12.477479 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:12.524499 (+ 47020us) log.cc:844] Serialized 26 byte log entry
0709 12:10:12.633078 (+108579us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:12.635773 (+  2695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:12.636068 (+   295us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:13.025048 (+388980us) raft_consensus.cc:1685] finished
0709 12:10:13.025070 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.541742 (+2516672us) spinlock_profiling.cc:243] Waited 91.2 ms on lock 0x7b54000b2550. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b18ad 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:15.541860 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97438,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":103,"spinlock_wait_cycles":219242752,"thread_start_us":39315,"threads_started":1,"wal-append.queue_time_us":164960,"wal-append.run_cpu_time_us":20750,"wal-append.run_wall_time_us":1312366}
I20260709 12:10:15.544991 18021 rpcz_store.cc:276] 0709 12:10:13.075992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.076132 (+   140us) service_pool.cc:224] Handling call
0709 12:10:14.494523 (+1418391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:14.494910 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:14.494938 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:14.495372 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 12:10:14.584003 (+ 88631us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:14.584047 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:14.584109 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:14.585800 (+  1691us) raft_consensus.cc:1685] finished
0709 12:10:14.585819 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.544381 (+958562us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54001e3f50. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b18ad 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:15.544555 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5296,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":5471,"spinlock_wait_cycles":3261065856,"thread_start_us":88298,"threads_started":1,"wal-append.queue_time_us":88617}
I20260709 12:10:15.546221 18022 raft_consensus.cc:1275] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:15.547911 18608 leader_election.cc:304] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:15.530012 18092 rpcz_store.cc:276] 0709 12:10:13.940414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.448094 (+1507680us) service_pool.cc:224] Handling call
0709 12:10:15.476759 (+ 28665us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.481718 (+  4959us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.492241 (+ 10523us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:15.494016 (+  1775us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:15.495873 (+  1857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.499170 (+  3297us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.504578 (+  5408us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.552163 19880 raft_consensus.cc:2804] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:15.553097 19880 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:15.553452 19880 raft_consensus.cc:3060] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.539997 19885 raft_consensus.cc:3060] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:15.554291 19873 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:15.558044 19814 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:15.558852 17949 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.514s	user 0.015s	sys 0.014s
I20260709 12:10:15.559209 19675 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123)
W20260709 12:10:15.559441 17949 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.514s	user 0.015s	sys 0.014s
I20260709 12:10:15.534514 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:15.551637 18608 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:15.560212 17949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50334 (request call id 1771) took 2537 ms. Trace:
I20260709 12:10:15.561103 18608 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:15.560539 17949 rpcz_store.cc:276] 0709 12:10:13.023086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.023254 (+   168us) service_pool.cc:224] Handling call
0709 12:10:13.023525 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:13.023741 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:13.044879 (+ 21138us) log.cc:844] Serialized 14 byte log entry
0709 12:10:15.559855 (+2514976us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:15.559906 (+    51us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:15.559946 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.560031 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.560148 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":8766,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"thread_start_us":2514668,"threads_started":1,"wal-append.queue_time_us":853513,"wal-append.run_cpu_time_us":1146,"wal-append.run_wall_time_us":1003892}
I20260709 12:10:15.563537 19647 raft_consensus.cc:493] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:15.564023 19647 raft_consensus.cc:515] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:15.564538 18098 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53964 (request call id 1483) took 2568 ms (client timeout 1529 ms). Trace:
W20260709 12:10:15.565062 18098 rpcz_store.cc:269] 0709 12:10:12.996240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.064803 (+ 68563us) service_pool.cc:224] Handling call
0709 12:10:15.564309 (+2499506us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b54001b3d54. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:15.564456 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49644800}
I20260709 12:10:15.562364 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:15.567941 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:15.571648 19647 leader_election.cc:290] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:15.572358 17949 raft_consensus.cc:2468] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:10:15.572885 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:15.573542 17946 raft_consensus.cc:2468] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:15.574039 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:15.574373 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:15.575169 17946 raft_consensus.cc:2468] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:15.575992 18018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53022 (request call id 277) took 1115 ms. Trace:
I20260709 12:10:15.577853 17949 raft_consensus.cc:2468] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:15.576372 18018 rpcz_store.cc:276] 0709 12:10:14.460725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.623211 (+162486us) service_pool.cc:224] Handling call
0709 12:10:15.575791 (+952580us) spinlock_profiling.cc:243] Waited 46.9 ms on lock 0x7b54001dc9d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:15.575933 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":107928960}
I20260709 12:10:15.568244 17942 raft_consensus.cc:2468] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:15.583909 19884 raft_consensus.cc:2749] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:15.593173 18015 raft_consensus.cc:1240] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:15.595607 19880 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:15.596457 19542 raft_consensus.cc:2749] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:15.599014 18097 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53964 (request call id 1479) took 2604 ms (client timeout 1804 ms). Trace:
W20260709 12:10:15.599418 18097 rpcz_store.cc:269] 0709 12:10:12.995100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.617099 (+621999us) service_pool.cc:224] Handling call
0709 12:10:15.598846 (+1981747us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b540024a254. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:15.598955 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":320152960}
I20260709 12:10:15.601094 18096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53954 (request call id 1659) took 1658 ms. Trace:
I20260709 12:10:15.601601 19868 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:15.601524 18096 rpcz_store.cc:276] 0709 12:10:13.942950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.481751 (+1538801us) service_pool.cc:224] Handling call
0709 12:10:15.599854 (+118103us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.600059 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.600082 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:15.600123 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:15.600152 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.600205 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.600949 (+   744us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b540024a250. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b18ad 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:15.601043 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":268091136}
I20260709 12:10:15.603904 19868 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:15.597931 19880 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:10:15.605854 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.607692 19885 raft_consensus.cc:2749] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:15.607801 19622 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:15.611846 18019 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45472 (request call id 1715) took 1574 ms (client timeout 1880 ms). Trace:
W20260709 12:10:15.612260 18019 rpcz_store.cc:269] 0709 12:10:14.037775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.037913 (+   138us) service_pool.cc:224] Handling call
0709 12:10:15.611700 (+1573787us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b54001c6bd4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:15.611797 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":502019456}
I20260709 12:10:15.612798 17942 raft_consensus.cc:1240] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:15.633422 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 72436.8us
W20260709 12:10:15.632948 19655 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.851s	user 0.001s	sys 0.022s
W20260709 12:10:15.640408 19655 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.863s	user 0.001s	sys 0.022s
I20260709 12:10:15.641621 18094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53954 (request call id 1649) took 1702 ms. Trace:
I20260709 12:10:15.645308 18024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 1702) took 1904 ms. Trace:
I20260709 12:10:15.645678 18024 rpcz_store.cc:276] 0709 12:10:13.741153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.741314 (+   161us) service_pool.cc:224] Handling call
0709 12:10:13.741696 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:14.020717 (+279021us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.645107 (+1624390us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b54001e5354. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:15.645255 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":640389888}
I20260709 12:10:15.642261 18094 rpcz_store.cc:276] 0709 12:10:13.939564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.396658 (+1457094us) service_pool.cc:224] Handling call
0709 12:10:15.628982 (+232324us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b58001b0998. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4988db71 00007f7f4988da22 00007f7f527a68d9 00007f7f51900ee0 00007f7f519ca0ab 00007f7f519ca131 00007f7f5198bfc0 00007f7f51976929 00007f7f519763d2 00007f7f4aeedbd4
0709 12:10:15.629250 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.629483 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:15.629779 (+   296us) log.cc:844] Serialized 14 byte log entry
0709 12:10:15.641282 (+ 11503us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:15.641352 (+    70us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:15.641388 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.641467 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.641569 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1481,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":88,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":177,"spinlock_wait_cycles":4458112,"thread_start_us":11146,"threads_started":1}
I20260709 12:10:15.645781 17946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44668 (request call id 243) took 1023 ms. Trace:
I20260709 12:10:15.650969 17946 rpcz_store.cc:276] 0709 12:10:14.622024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.576062 (+954038us) service_pool.cc:224] Handling call
0709 12:10:15.576454 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:15.576897 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.576938 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:15.577476 (+   538us) log.cc:844] Serialized 26 byte log entry
0709 12:10:15.615666 (+ 38190us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:15.615703 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.615771 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:15.645582 (+ 29811us) raft_consensus.cc:1685] finished
0709 12:10:15.645603 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.645729 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":115,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":137,"thread_start_us":31772,"threads_started":1,"wal-append.queue_time_us":46178}
W20260709 12:10:15.652871 18635 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60430 (request call id 355) took 2917 ms (client timeout 2055 ms). Trace:
W20260709 12:10:15.653311 18635 rpcz_store.cc:269] 0709 12:10:12.735242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.744003 (+  8761us) service_pool.cc:224] Handling call
0709 12:10:14.512416 (+1768413us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b58001c4a98. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4988db71 00007f7f4988da22 00007f7f527a68d9 00007f7f51900ee0 00007f7f519ca0ab 00007f7f519ca131 00007f7f519780a0 00007f7f51977984 00007f7f4aef26d4 00007f7f4aef2662
0709 12:10:15.652622 (+1140206us) spinlock_profiling.cc:243] Waited 58.4 ms on lock 0x7b54007602d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:15.652771 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":137364096}
I20260709 12:10:15.655378 17946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 1826) took 1007 ms. Trace:
I20260709 12:10:15.655858 17946 rpcz_store.cc:276] 0709 12:10:14.647614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.653374 (+1005760us) service_pool.cc:224] Handling call
0709 12:10:15.653760 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.654031 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.654065 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:15.654124 (+    59us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:15.654167 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.654241 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.655330 (+  1089us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:15.657032 17949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44668 (request call id 244) took 1034 ms. Trace:
I20260709 12:10:15.641405 18608 leader_election.cc:304] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:15.657760 17946 raft_consensus.cc:1275] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:10:15.658314 17940 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.477s	user 0.014s	sys 0.063s
I20260709 12:10:15.659190 19715 raft_consensus.cc:2749] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:15.659817 19887 consensus_queue.cc:1048] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
W20260709 12:10:15.659350 17940 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.479s	user 0.014s	sys 0.064s
I20260709 12:10:15.657413 17949 rpcz_store.cc:276] 0709 12:10:14.622750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.578680 (+955930us) service_pool.cc:224] Handling call
0709 12:10:15.579036 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:15.579427 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.579467 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:15.590247 (+ 10780us) log.cc:844] Serialized 26 byte log entry
0709 12:10:15.637199 (+ 46952us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:15.642229 (+  5030us) log.cc:844] Serialized 14 byte log entry
0709 12:10:15.645801 (+  3572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.645883 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:15.656848 (+ 10965us) raft_consensus.cc:1685] finished
0709 12:10:15.656866 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.656979 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5628,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":172,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":189,"thread_start_us":38235,"threads_started":1,"wal-append.queue_time_us":54008}
I20260709 12:10:15.659623 18608 leader_election.cc:304] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:15.664727 17940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50334 (request call id 1775) took 2640 ms. Trace:
W20260709 12:10:15.664765 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.659142 17946 raft_consensus.cc:1240] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:15.665350 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:15.665890 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.666292 19885 raft_consensus.cc:3060] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.667982 17942 raft_consensus.cc:1240] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:15.669649 19652 leader_election.cc:290] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:15.670231 19622 raft_consensus.cc:493] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
W20260709 12:10:15.670495 17912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:15.670979 17912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:15.670780 19622 raft_consensus.cc:515] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:15.665589 17940 rpcz_store.cc:276] 0709 12:10:13.024261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.172161 (+147900us) service_pool.cc:224] Handling call
0709 12:10:13.180160 (+  7999us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:13.180372 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:10:13.180644 (+   272us) log.cc:844] Serialized 14 byte log entry
0709 12:10:15.664365 (+2483721us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:15.664412 (+    47us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:15.664469 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.664550 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.664683 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3446,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":76,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":73,"thread_start_us":2483190,"threads_started":1,"wal-append.queue_time_us":813184,"wal-append.run_cpu_time_us":1092,"wal-append.run_wall_time_us":1034418}
I20260709 12:10:15.672780 19622 leader_election.cc:290] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:15.673219 19622 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.673719 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:15.673640 19622 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:15.675206 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:15.675793 18097 raft_consensus.cc:2468] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:10:15.678402 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:15.665370 17949 raft_consensus.cc:1275] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:10:15.678956 18094 raft_consensus.cc:3060] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.679890 19784 raft_consensus.cc:3060] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.680708 19774 consensus_queue.cc:260] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:15.681677 19774 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.685896 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:15.666347 19779 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.695482 19779 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:15.708626 19885 raft_consensus.cc:2749] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.714115 17941 raft_consensus.cc:2468] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:10:15.776021 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:15.777156 19625 raft_consensus.cc:3055] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:15.777228 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:15.777706 19625 raft_consensus.cc:740] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:15.777966 18096 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:15.778697 19625 consensus_queue.cc:260] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:15.781163 19625 raft_consensus.cc:3060] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.781744 19752 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:15.782274 19752 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:15.784307 19752 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:15.786938 18096 raft_consensus.cc:2468] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 5.
I20260709 12:10:15.788007 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:15.788475 17948 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50334 (request call id 1770) took 2766 ms (client timeout 3106 ms). Trace:
I20260709 12:10:15.788604 18096 raft_consensus.cc:2468] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 2.
W20260709 12:10:15.788873 17948 rpcz_store.cc:269] 0709 12:10:13.022010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.022115 (+   105us) service_pool.cc:224] Handling call
0709 12:10:15.788306 (+2766191us) spinlock_profiling.cc:243] Waited 70.2 ms on lock 0x7b5400291654. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:15.788401 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161532288}
I20260709 12:10:15.789382 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:15.789922 18096 raft_consensus.cc:2468] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:15.787592 17947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 1825) took 1142 ms. Trace:
I20260709 12:10:15.790443 17947 rpcz_store.cc:276] 0709 12:10:14.645114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.165270 (+520156us) service_pool.cc:224] Handling call
0709 12:10:15.787413 (+622143us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b5400253ad4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:15.787541 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":661906816}
I20260709 12:10:15.790889 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:15.791399 18096 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.791996 17943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 1822) took 1150 ms. Trace:
I20260709 12:10:15.792277 17943 rpcz_store.cc:276] 0709 12:10:14.641719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.370345 (+728626us) service_pool.cc:224] Handling call
0709 12:10:15.791795 (+421450us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54003e6054. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:15.791938 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":334127360}
I20260709 12:10:15.798605 18096 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:15.799607 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:15.800108 18096 raft_consensus.cc:3060] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.806686 18096 raft_consensus.cc:2468] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:15.807680 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:15.808148 18096 raft_consensus.cc:2376] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3. Re-sending same reply.
W20260709 12:10:15.809057 17989 leader_election.cc:336] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Timed out: RequestConsensusVote RPC to 127.16.98.195:41931 timed out after 1.885s (SENT)
I20260709 12:10:15.809443 17989 leader_election.cc:304] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:15.810070 19752 raft_consensus.cc:2749] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:15.849738 18090 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41818 (request call id 446) took 3093 ms. Trace:
I20260709 12:10:15.850196 18090 rpcz_store.cc:276] 0709 12:10:12.755977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:12.756074 (+    97us) service_pool.cc:224] Handling call
0709 12:10:12.756363 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:12.963200 (+206837us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:12.988083 (+ 24883us) log.cc:844] Serialized 14 byte log entry
0709 12:10:13.795242 (+807159us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:13.795308 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:13.795366 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.849466 (+2054100us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b5400358ed4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:15.849515 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.849659 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":47505,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":100,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":1498,"spinlock_wait_cycles":476320896,"thread_start_us":806717,"threads_started":1,"wal-append.queue_time_us":968142,"wal-append.run_cpu_time_us":1182,"wal-append.run_wall_time_us":1070268}
I20260709 12:10:15.869319 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:15.869879 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:15.870934 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:15.871016 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:15.872691 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:15.874084 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:15.875787 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:15.876055 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:15.876528 17949 raft_consensus.cc:2393] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 3: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:15.876915 17946 raft_consensus.cc:2393] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 4: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:15.877111 18636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60430 (request call id 358) took 2619 ms. Trace:
I20260709 12:10:15.877269 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:15.877657 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:15.877836 17949 raft_consensus.cc:2468] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 2.
I20260709 12:10:15.874231 17942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 1824) took 1229 ms. Trace:
I20260709 12:10:15.879120 17940 raft_consensus.cc:1240] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:15.879568 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:15.878729 17942 rpcz_store.cc:276] 0709 12:10:14.644866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.615029 (+970163us) service_pool.cc:224] Handling call
0709 12:10:15.667814 (+ 52785us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.668347 (+   533us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.874023 (+205676us) spinlock_profiling.cc:243] Waited 52.5 ms on lock 0x7b54000a1250. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b18ad 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:15.874171 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120784640}
I20260709 12:10:15.880447 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:15.881422 17940 raft_consensus.cc:2468] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 2.
I20260709 12:10:15.881872 17944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50334 (request call id 1764) took 2863 ms. Trace:
I20260709 12:10:15.882145 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:15.882378 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:15.882244 17944 rpcz_store.cc:276] 0709 12:10:13.018841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.018971 (+   130us) service_pool.cc:224] Handling call
0709 12:10:15.881231 (+2862260us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b5800003698. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4988db71 00007f7f4988da22 00007f7f527a68d9 00007f7f51900ee0 00007f7f519ca0ab 00007f7f519ca131 00007f7f5198bfc0 00007f7f51976929 00007f7f519763d2 00007f7f4aeedbd4
0709 12:10:15.881419 (+   188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:15.881584 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.881612 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:15.881658 (+    46us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:15.881689 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.881739 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.881823 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3908480}
I20260709 12:10:15.874927 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:15.884368 17948 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:15.877555 18636 rpcz_store.cc:276] 0709 12:10:13.257509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.272329 (+ 14820us) service_pool.cc:224] Handling call
0709 12:10:13.284617 (+ 12288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:13.732733 (+448116us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:13.736542 (+  3809us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:13.781039 (+ 44497us) log.cc:844] Serialized 26 byte log entry
0709 12:10:14.027740 (+246701us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:14.028320 (+   580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:15.876690 (+1848370us) spinlock_profiling.cc:243] Waited 342 ms on lock 0x7b54006f0254. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:15.876746 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:15.876797 (+    51us) raft_consensus.cc:1685] finished
0709 12:10:15.876810 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:15.877022 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5625,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":7038,"spinlock_wait_cycles":786383744,"thread_start_us":229625,"threads_started":1,"wal-append.queue_time_us":472846,"wal-append.run_cpu_time_us":2377,"wal-append.run_wall_time_us":1209093}
I20260709 12:10:15.869465 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:15.886842 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:15.892208 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:15.893242 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:15.893890 18090 raft_consensus.cc:2393] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 4: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:15.882907 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:15.902812 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:15.903399 17947 raft_consensus.cc:2468] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:15.903515 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:15.904140 17949 raft_consensus.cc:2376] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3. Re-sending same reply.
I20260709 12:10:15.904810 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:15.905121 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:15.905934 17944 raft_consensus.cc:2393] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 4: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:15.907420 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:15.908886 17944 raft_consensus.cc:3060] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.905848 18096 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 3.
I20260709 12:10:15.904318 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:15.909933 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:15.910166 17948 raft_consensus.cc:2393] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 4: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:15.910388 17943 raft_consensus.cc:1240] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:15.910513 18097 raft_consensus.cc:2468] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 2.
I20260709 12:10:15.906860 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:15.911437 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:15.912066 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:15.926980 18097 raft_consensus.cc:3060] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.927055 18096 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.912774 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:15.915271 17913 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:15.930930 19784 raft_consensus.cc:2749] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:15.932729 17913 leader_election.cc:304] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:15.935539 19784 raft_consensus.cc:2804] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:15.935907 19784 raft_consensus.cc:493] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:15.936233 19784 raft_consensus.cc:3060] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:15.934203 18097 raft_consensus.cc:2468] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 3.
I20260709 12:10:12.766266 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:15.939337 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:15.940043 18097 raft_consensus.cc:2393] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 6: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:15.940734 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:15.941210 18097 raft_consensus.cc:2468] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:10:15.943321 17944 raft_consensus.cc:2468] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:15.943768 17913 leader_election.cc:304] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:15.942878 17842 catalog_manager.cc:5697] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 1 to 2, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 2 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:15.947257 19826 raft_consensus.cc:2804] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:15.947674 19826 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:15.948266 19826 raft_consensus.cc:3060] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:15.947634 17842 catalog_manager.cc:5697] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 2 to 3, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 3 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
W20260709 12:10:15.948680 18091 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41818 (request call id 430) took 4813 ms (client timeout 2221 ms). Trace:
W20260709 12:10:15.949071 18091 rpcz_store.cc:269] 0709 12:10:11.135108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:11.135287 (+   179us) service_pool.cc:224] Handling call
0709 12:10:11.645061 (+509774us) spinlock_profiling.cc:243] Waited 997 us on lock 0x7b58001b0998. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4988db71 00007f7f4988da22 00007f7f527a68d9 00007f7f51900ee0 00007f7f519ca0ab 00007f7f519ca131 00007f7f519780a0 00007f7f51977984 00007f7f4aef26d4 00007f7f4aef2662
0709 12:10:15.948458 (+4303397us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54000a91d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:15.948594 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3405253120}
I20260709 12:10:15.923204 18609 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:15.951220 19879 raft_consensus.cc:2749] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:15.951498 17847 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45910 (request call id 350) took 5319 ms. Trace:
I20260709 12:10:15.959034 19784 raft_consensus.cc:515] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:15.963034 18609 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:15.952003 17847 rpcz_store.cc:276] 0709 12:10:10.615248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.615408 (+   160us) service_pool.cc:224] Handling call
0709 12:10:10.677063 (+ 61655us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b5400030890. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4988db71 00007f7f4988e0b2 00007f7f52807759 00007f7f5279fa76 00007f7f52770d58 00007f7f5286f04e 00007f7f50d302a4 00007f7f50d30232 00007f7f50d30161 00007f7f50d300dc
0709 12:10:15.934609 (+5257546us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:11.521366 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:11.521936 (+   570us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:11.521975 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:10:11.522625 (+   650us) tablet.cc:662] Decoding operations
0709 12:10:11.675760 (+153135us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:11.675855 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:11.675916 (+    61us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:10:11.676758 (+   842us) tablet.cc:701] Row locks acquired
0709 12:10:11.676783 (+    25us) write_op.cc:260] PREPARE: finished
0709 12:10:11.676978 (+   195us) write_op.cc:270] Start()
0709 12:10:11.677122 (+   144us) write_op.cc:276] Timestamp: P: 1783599011676924 usec, L: 0
0709 12:10:11.677153 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 12:10:11.772048 (+ 94895us) log.cc:844] Serialized 3219 byte log entry
0709 12:10:12.619160 (+847112us) op_driver.cc:464] REPLICATION: finished
0709 12:10:12.687857 (+ 68697us) write_op.cc:301] APPLY: starting
0709 12:10:12.687951 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:12.688201 (+   250us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:12.688317 (+   116us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:12.711881 (+ 23564us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:12.712124 (+   243us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:10:12.712186 (+    62us) write_op.cc:312] APPLY: finished
0709 12:10:12.722194 (+ 10008us) log.cc:844] Serialized 65 byte log entry
0709 12:10:12.729929 (+  7735us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:12.737168 (+  7239us) write_op.cc:454] Released schema lock
0709 12:10:12.744366 (+  7198us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:12.765082 (+ 20716us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:12.765115 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":10,"spinlock_wait_cycles":36139264,"child_traces":[["op",{"apply.queue_time_us":52007,"apply.run_cpu_time_us":3510,"apply.run_wall_time_us":82388,"num_ops":8,"prepare.queue_time_us":612577,"prepare.run_cpu_time_us":29823,"prepare.run_wall_time_us":741214,"raft.queue_time_us":235103,"raft.run_cpu_time_us":20210,"raft.run_wall_time_us":32290,"replication_time_us":941822,"thread_start_us":1095093,"threads_started":4,"wal-append.queue_time_us":571896,"wal-append.run_cpu_time_us":8878,"wal-append.run_wall_time_us":1395681}]]}
I20260709 12:10:16.140277 19784 leader_election.cc:290] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:16.140514 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:15.967880 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:16.141265 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 178297us
I20260709 12:10:16.140535 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
W20260709 12:10:16.142002 18640 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60412 (request call id 634) took 1654 ms (client timeout 1683 ms). Trace:
I20260709 12:10:16.087774 19803 leader_election.cc:290] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:15.970913 18097 raft_consensus.cc:1275] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:10:15.686618 18098 raft_consensus.cc:2468] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 2.
I20260709 12:10:15.981864 18094 raft_consensus.cc:2468] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:10:15.985342 18644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60430 (request call id 363) took 1996 ms. Trace:
I20260709 12:10:15.986457 19816 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:15.990144 19779 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:15.998045 19774 consensus_queue.cc:1048] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:16.154809 19885 raft_consensus.cc:2804] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:16.155207 19885 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
W20260709 12:10:15.999624 17912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.000571 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:16.155607 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:16.155881 18015 raft_consensus.cc:2468] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:10:16.156193 18020 raft_consensus.cc:2468] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
W20260709 12:10:16.156385 17912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.156494 19816 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:16.001384 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:16.000837 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:16.002086 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:16.157068 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:16.001590 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:16.002671 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:16.003269 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:16.156404 19622 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:16.155550 19885 raft_consensus.cc:3060] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.159996 18016 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:10:16.160228 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:15.687017 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:16.010315 18089 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53954 (request call id 1669) took 1751 ms. Trace:
I20260709 12:10:16.011947 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:16.164914 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:16.166286 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:16.014046 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
W20260709 12:10:16.013656 18062 connection.cc:256] RPC call timeout handler was delayed by -1.418368972000053s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18220000000000003s for a response
W20260709 12:10:16.168202 18062 connection.cc:256] RPC call timeout handler was delayed by -1.18951350500015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19820000000000002s for a response
W20260709 12:10:16.168673 18062 connection.cc:256] RPC call timeout handler was delayed by -1.1510689720000755s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21190000000000003s for a response
W20260709 12:10:16.169049 18062 connection.cc:256] RPC call timeout handler was delayed by -1.0826689719999649s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2195s for a response
W20260709 12:10:16.169396 18062 connection.cc:256] RPC call timeout handler was delayed by -1.0823371480000787s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19610000000000002s for a response
W20260709 12:10:16.169692 18062 connection.cc:256] RPC call timeout handler was delayed by -1.0763689719999547s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2202s for a response
W20260709 12:10:16.014698 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 70996.3us
I20260709 12:10:16.171168 17913 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:16.015547 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:15.957558 19826 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:16.116686 18096 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:10:16.118180 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:16.120510 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:16.126808 17989 leader_election.cc:304] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:10:16.174823 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 48115.3us
I20260709 12:10:16.030251 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:15.965142 17941 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44668 (request call id 240) took 1344 ms (client timeout 1776 ms). Trace:
W20260709 12:10:15.969669 18093 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53964 (request call id 1484) took 2973 ms (client timeout 2019 ms). Trace:
I20260709 12:10:16.143548 18061 leader_election.cc:304] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:16.152038 18644 rpcz_store.cc:276] 0709 12:10:13.988711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.988921 (+   210us) service_pool.cc:224] Handling call
0709 12:10:15.985104 (+1996183us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b540073d554. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:15.985268 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31495936}
W20260709 12:10:16.180946 18093 rpcz_store.cc:269] 0709 12:10:12.996508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.858892 (+862384us) service_pool.cc:224] Handling call
0709 12:10:15.969503 (+2110611us) spinlock_profiling.cc:243] Waited 83.2 ms on lock 0x7b5400249fd4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:15.969606 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":191450496}
I20260709 12:10:16.151280 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:16.182072 18022 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.182484 18643 raft_consensus.cc:1240] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:16.153229 18097 pending_rounds.cc:85] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110: Aborting all ops after (but not including) 4
I20260709 12:10:16.156839 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:16.158782 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:16.184362 18018 raft_consensus.cc:2393] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 4: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:16.164431 18637 raft_consensus.cc:1240] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:16.188205 18643 raft_consensus.cc:1240] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:16.189661 18643 raft_consensus.cc:1240] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:16.191800 18644 raft_consensus.cc:1240] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:16.159222 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:16.002414 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:16.175894 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:16.121481 19879 raft_consensus.cc:493] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:16.179889 18641 raft_consensus.cc:1240] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:16.210861 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 55461.1us
W20260709 12:10:16.142423 18640 rpcz_store.cc:269] 0709 12:10:14.487433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.967597 (+1480164us) service_pool.cc:224] Handling call
0709 12:10:16.141949 (+174352us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:16.142035 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:16.158878 18020 raft_consensus.cc:2468] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:10:16.193753 18642 raft_consensus.cc:2468] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
W20260709 12:10:16.210335 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 56174.3us
I20260709 12:10:16.183023 18097 pending_rounds.cc:107] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:10:16.180220 19707 raft_consensus.cc:2804] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:16.214809 18097 raft_consensus.cc:2889] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:16.215428 18609 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:16.180445 19779 consensus_queue.cc:1048] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:10:16.180347 19736 consensus_queue.cc:1059] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:10:16.180572 19752 consensus_queue.cc:1048] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:10:16.183776 19655 consensus_queue.cc:1048] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:10:16.219852 19622 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.218794 19707 raft_consensus.cc:493] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:16.180708 17941 rpcz_store.cc:269] 0709 12:10:14.620296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.624665 (+  4369us) service_pool.cc:224] Handling call
0709 12:10:15.964974 (+1340309us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540015f4d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:15.965084 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2485105536}
I20260709 12:10:16.220573 17842 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45928 (request call id 366) took 5572 ms. Trace:
I20260709 12:10:16.214834 19652 consensus_queue.cc:1048] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:10:16.162904 18089 rpcz_store.cc:276] 0709 12:10:14.259227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.542208 (+1282981us) service_pool.cc:224] Handling call
0709 12:10:15.992197 (+449989us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:15.992616 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:15.992650 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:15.993127 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 12:10:16.007371 (+ 14244us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:16.007670 (+   299us) log.cc:844] Serialized 14 byte log entry
0709 12:10:16.008082 (+   412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.008156 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:16.008200 (+    44us) raft_consensus.cc:1685] finished
0709 12:10:16.008210 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:16.010149 (+  1939us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b5400249fd0. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b18ad 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:16.010258 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3231,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":182,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":161,"spinlock_wait_cycles":1034054912,"thread_start_us":13821,"threads_started":1,"wal-append.queue_time_us":10001}
I20260709 12:10:16.215179 19879 raft_consensus.cc:515] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:16.254047 19885 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:16.249276 19794 raft_consensus.cc:2749] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:16.274287 18022 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
W20260709 12:10:16.276096 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:16.277034 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.256908 19707 raft_consensus.cc:3060] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:16.286116 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 107553us
W20260709 12:10:16.296936 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 153437us
I20260709 12:10:16.297863 17945 raft_consensus.cc:2468] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:16.299023 18062 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:16.297891 18061 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:16.268069 19736 raft_consensus.cc:3055] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:10:16.322325 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 104247us
I20260709 12:10:16.257074 19622 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:16.338752 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:16.316115 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 136300us
I20260709 12:10:16.319324 19736 raft_consensus.cc:740] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
W20260709 12:10:16.341022 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 183416us
W20260709 12:10:16.346259 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 174509us
W20260709 12:10:16.345047 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 47226.7us
W20260709 12:10:16.341749 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 126402us
W20260709 12:10:16.351514 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 52596us
W20260709 12:10:16.353015 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.341379 19655 raft_consensus.cc:2804] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:16.352221 18609 leader_election.cc:304] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:16.338354 19905 raft_consensus.cc:2804] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:16.356349 18609 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:16.312103 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 136076us
W20260709 12:10:16.377907 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 54523.3us
I20260709 12:10:16.360152 19912 raft_consensus.cc:2804] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:16.354758 19655 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:16.362931 18609 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:16.355122 18062 leader_election.cc:304] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:16.374956 19715 raft_consensus.cc:2749] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:16.407567 18639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60430 (request call id 385) took 1046 ms. Trace:
I20260709 12:10:16.407419 19752 consensus_queue.cc:1059] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:10:16.409578 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 60710.8us
I20260709 12:10:16.376093 19905 raft_consensus.cc:697] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
W20260709 12:10:16.411051 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 63678.9us
I20260709 12:10:16.412137 17913 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:16.362591 19706 raft_consensus.cc:2804] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:16.382469 19826 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:16.380144 19903 raft_consensus.cc:2804] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:16.422835 19903 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:16.423225 19903 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.425736 17913 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:16.425675 19647 consensus_queue.cc:1059] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:16.426821 19647 raft_consensus.cc:2749] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:16.427520 19816 leader_election.cc:290] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:16.427783 19647 raft_consensus.cc:2749] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:16.428045 19816 raft_consensus.cc:3055] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:16.427963 17913 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:16.428501 19816 raft_consensus.cc:740] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:16.428972 19647 raft_consensus.cc:2749] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:16.430065 19647 consensus_queue.cc:1048] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:16.431146 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:16.431496 19779 consensus_queue.cc:1059] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:16.431159 19826 consensus_queue.cc:1059] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:10:16.433622 19826 raft_consensus.cc:3055] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:16.434046 19826 raft_consensus.cc:740] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
W20260709 12:10:16.414734 17945 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50334 (request call id 1769) took 3387 ms (client timeout 2019 ms). Trace:
I20260709 12:10:16.387297 19655 raft_consensus.cc:3060] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.410015 18608 leader_election.cc:304] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:16.436914 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:16.460314 18022 raft_consensus.cc:2393] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 4: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
W20260709 12:10:16.450784 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 87128.6us
I20260709 12:10:16.452422 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:16.456977 17913 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:16.452703 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:16.453799 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:10:16.436399 17945 rpcz_store.cc:269] 0709 12:10:13.021316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:13.021441 (+   125us) service_pool.cc:224] Handling call
0709 12:10:16.408897 (+3387456us) spinlock_profiling.cc:243] Waited 3.05 s on lock 0x7b54003c05d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:16.409008 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7008128896}
I20260709 12:10:16.429082 19622 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:16.409921 19625 raft_consensus.cc:2804] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:16.408001 18639 rpcz_store.cc:276] 0709 12:10:15.361280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:15.362720 (+  1440us) service_pool.cc:224] Handling call
0709 12:10:16.016753 (+654033us) spinlock_profiling.cc:243] Waited 4.84 ms on lock 0x7b58001c4a98. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4988db71 00007f7f4988deee 000000000036eb39 00007f7f519011e0 00007f7f519ca0c4 00007f7f519ca131 00007f7f5198bfc0 00007f7f51976929 00007f7f519763d2 00007f7f4aeedbd4
0709 12:10:16.118668 (+101915us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:16.305586 (+186918us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:16.319480 (+ 13894us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:16.325071 (+  5591us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:16.326683 (+  1612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:16.407296 (+ 80613us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b5400671454. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:16.407345 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:16.407500 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":401571456}
I20260709 12:10:16.474210 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:16.479708 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:10:16.479763 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 69569.7us
I20260709 12:10:16.481400 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:16.482401 17940 raft_consensus.cc:2393] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 4: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:16.432607 19779 raft_consensus.cc:2804] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:16.474573 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:16.435286 19904 raft_consensus.cc:3055] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:16.486486 17947 raft_consensus.cc:2410] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:16.494091 18609 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:16.382082 19736 consensus_queue.cc:260] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:16.464239 19879 leader_election.cc:290] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:16.472318 19625 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:16.484977 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:16.485622 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:16.493827 19887 raft_consensus.cc:2804] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:16.485540 19779 raft_consensus.cc:493] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
W20260709 12:10:16.519654 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 58256.6us
I20260709 12:10:16.484891 19911 raft_consensus.cc:2749] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:16.491060 19904 raft_consensus.cc:740] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:16.496045 19914 raft_consensus.cc:3055] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:10:16.521590 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 166549us
I20260709 12:10:16.429319 19816 consensus_queue.cc:260] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:16.495684 19706 raft_consensus.cc:697] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:16.495923 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:16.513784 19625 raft_consensus.cc:3060] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.519325 19736 raft_consensus.cc:3060] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:16.457990 19826 consensus_queue.cc:260] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:16.534081 18062 leader_election.cc:304] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:16.532984 19779 raft_consensus.cc:3060] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.533329 19914 raft_consensus.cc:740] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:16.534435 19910 raft_consensus.cc:2804] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:16.669318 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:10:16.598377 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 188508us
W20260709 12:10:16.585830 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 146509us
I20260709 12:10:16.552294 18062 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:16.610594 17912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.540843 17941 raft_consensus.cc:2393] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 4: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:16.542414 18015 raft_consensus.cc:2393] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 5: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:16.544895 19915 raft_consensus.cc:2804] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:16.536844 19887 raft_consensus.cc:697] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:16.685513 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:16.688546 19924 raft_consensus.cc:2749] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:16.259994 17842 rpcz_store.cc:276] 0709 12:10:10.647822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:10.647935 (+   113us) service_pool.cc:224] Handling call
0709 12:10:10.677378 (+ 29443us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b5400030890. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4988db71 00007f7f4988e0b2 00007f7f52807759 00007f7f5279fa76 00007f7f52770d58 00007f7f5286f04e 00007f7f50d302a4 00007f7f50d30232 00007f7f50d30161 00007f7f50d300dc
0709 12:10:16.218444 (+5541066us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:15.972584 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:15.973101 (+   517us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:15.973130 (+    29us) write_op.cc:435] Acquired schema lock
0709 12:10:15.973146 (+    16us) tablet.cc:662] Decoding operations
0709 12:10:15.973507 (+   361us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:15.973581 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:15.973607 (+    26us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:10:15.973932 (+   325us) tablet.cc:701] Row locks acquired
0709 12:10:15.973950 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:10:15.974088 (+   138us) write_op.cc:270] Start()
0709 12:10:15.974192 (+   104us) write_op.cc:276] Timestamp: P: 1783599015974045 usec, L: 0
0709 12:10:15.974218 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:10:15.974858 (+   640us) log.cc:844] Serialized 919 byte log entry
0709 12:10:15.994461 (+ 19603us) op_driver.cc:464] REPLICATION: finished
0709 12:10:15.995701 (+  1240us) write_op.cc:301] APPLY: starting
0709 12:10:15.995757 (+    56us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:15.995837 (+    80us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:15.995937 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:15.996223 (+   286us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:15.996330 (+   107us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:10:15.996356 (+    26us) write_op.cc:312] APPLY: finished
0709 12:10:15.996517 (+   161us) log.cc:844] Serialized 29 byte log entry
0709 12:10:15.997102 (+   585us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:15.997162 (+    60us) write_op.cc:454] Released schema lock
0709 12:10:15.997188 (+    26us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:15.998215 (+  1027us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:15.998243 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":229418,"reported_tablets":4,"spinlock_wait_cycles":29032064,"child_traces":[["op",{"apply.queue_time_us":1050,"apply.run_cpu_time_us":1349,"apply.run_wall_time_us":2464,"num_ops":2,"prepare.queue_time_us":10250,"prepare.run_cpu_time_us":8961,"prepare.run_wall_time_us":20535,"raft.queue_time_us":1568,"raft.run_cpu_time_us":1151,"raft.run_wall_time_us":1236,"replication_time_us":20119,"thread_start_us":31788,"threads_started":4,"wal-append.queue_time_us":16263}]]}
W20260709 12:10:16.624346 19917 log.cc:927] Time spent T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:10:16.686722 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:16.698076 19887 consensus_queue.cc:237] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:16.699518 19916 log.cc:927] Time spent T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.102s	user 0.000s	sys 0.002s
I20260709 12:10:16.696885 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:16.700239 19779 raft_consensus.cc:515] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:16.690425 19915 raft_consensus.cc:493] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:16.627519 19903 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:16.683104 19908 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:16.702096 19885 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:16.701825 19908 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:16.702790 19779 leader_election.cc:290] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:16.703963 19908 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:16.687027 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:16.703871 19914 consensus_queue.cc:260] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:16.705480 19914 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.536325 19912 raft_consensus.cc:697] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:16.545184 19816 raft_consensus.cc:3060] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.707365 19912 consensus_queue.cc:237] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:16.670521 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
W20260709 12:10:16.607167 19913 log.cc:927] Time spent T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 12:10:16.545780 17944 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "158a286025af4eddba6fb641c128cd25"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:10:16.688520 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:16.562463 18639 raft_consensus.cc:1240] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:16.537358 19905 consensus_queue.cc:237] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:16.584755 19873 raft_consensus.cc:493] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:16.541649 17943 raft_consensus.cc:2468] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:16.694959 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:16.667439 18638 raft_consensus.cc:2468] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:16.642097 19752 consensus_queue.cc:1059] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:10:16.735335 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:16.709918 19903 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:16.701241 19915 raft_consensus.cc:3060] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:16.689375 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 136002us
I20260709 12:10:16.683748 19910 raft_consensus.cc:697] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:16.709255 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:16.710242 18020 raft_consensus.cc:3060] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.710671 17944 raft_consensus.cc:606] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
W20260709 12:10:16.709266 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 172233us
I20260709 12:10:16.744711 17944 raft_consensus.cc:614] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:16.634512 19707 raft_consensus.cc:515] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:16.634512 19625 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:16.718676 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
W20260709 12:10:16.722250 17912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.726390 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:16.696878 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:16.544715 19706 consensus_queue.cc:237] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:16.760067 18635 raft_consensus.cc:2393] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 5: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:16.761153 18020 raft_consensus.cc:2468] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 4.
I20260709 12:10:16.761451 19707 leader_election.cc:290] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:16.716189 19655 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:16.767439 17989 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:16.768576 17989 leader_election.cc:304] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:16.769654 17989 leader_election.cc:304] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:16.772652 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:16.776515 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:16.777283 18022 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:16.780552 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:16.782927 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:16.783805 18021 raft_consensus.cc:2468] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3.
I20260709 12:10:16.782002 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:16.785395 18020 raft_consensus.cc:3060] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.788367 18024 raft_consensus.cc:2393] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 5: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:16.728744 19873 raft_consensus.cc:515] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:16.741122 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 247097us
I20260709 12:10:16.743136 18062 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:16.712385 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:16.760104 19625 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:16.746177 18608 leader_election.cc:304] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:16.562821 19904 consensus_queue.cc:260] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:16.746881 19736 consensus_queue.cc:1059] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:10:16.735074 19929 consensus_queue.cc:1059] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:10:16.747274 19752 consensus_queue.cc:1059] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
W20260709 12:10:16.757027 17970 debug-util.cc:398] Leaking SignalData structure 0x7b0800258ea0 after lost signal to thread 16782
W20260709 12:10:16.802698 17970 debug-util.cc:398] Leaking SignalData structure 0x7b0800256ea0 after lost signal to thread 17881
W20260709 12:10:16.803861 17970 debug-util.cc:398] Leaking SignalData structure 0x7b08001cd600 after lost signal to thread 17973
I20260709 12:10:16.804028 18022 raft_consensus.cc:2468] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3.
W20260709 12:10:16.797487 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 54428.6us
I20260709 12:10:16.798377 19924 raft_consensus.cc:2749] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:16.797914 19652 raft_consensus.cc:2804] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:16.804894 17970 debug-util.cc:398] Leaking SignalData structure 0x7b0800258e40 after lost signal to thread 18048
I20260709 12:10:16.809677 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:16.833676 18020 raft_consensus.cc:2468] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3.
I20260709 12:10:16.844640 18093 raft_consensus.cc:2468] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
W20260709 12:10:16.844937 17970 debug-util.cc:398] Leaking SignalData structure 0x7b080035bba0 after lost signal to thread 18122
I20260709 12:10:16.762713 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:16.814605 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
W20260709 12:10:16.846094 17970 debug-util.cc:398] Leaking SignalData structure 0x7b0800395200 after lost signal to thread 18123
I20260709 12:10:16.846361 18098 raft_consensus.cc:3060] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:16.806469 18097 raft_consensus.cc:1240] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:16.847210 17970 debug-util.cc:398] Leaking SignalData structure 0x7b0800043480 after lost signal to thread 18668
W20260709 12:10:16.847484 17970 debug-util.cc:398] Leaking SignalData structure 0x7b08002fa6c0 after lost signal to thread 18669
I20260709 12:10:16.802232 19928 raft_consensus.cc:2749] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:16.796561 19931 raft_consensus.cc:2804] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:16.794574 19926 raft_consensus.cc:2749] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:16.798084 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 52002.6us
I20260709 12:10:16.815169 18062 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:16.830509 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:16.821637 17914 leader_election.cc:336] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Timed out: RequestConsensusVote RPC to 127.16.98.195:41931 timed out after 2.238s (SENT)
W20260709 12:10:16.854223 17914 leader_election.cc:336] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Timed out: RequestConsensusVote RPC to 127.16.98.195:41931 timed out after 2.266s (SENT)
I20260709 12:10:16.855115 18062 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:16.856159 18062 leader_election.cc:304] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:16.857332 18062 leader_election.cc:304] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:16.849676 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 107985us
I20260709 12:10:16.858826 17987 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:16.838181 19904 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:16.868043 19655 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:16.868323 19922 raft_consensus.cc:2749] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:16.869469 18062 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:16.845432 19652 raft_consensus.cc:493] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:16.874851 18098 raft_consensus.cc:2468] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
I20260709 12:10:16.875980 19922 raft_consensus.cc:2804] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:16.876405 19922 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:16.876788 19922 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:16.879757 19873 leader_election.cc:290] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:16.865518 19924 raft_consensus.cc:2749] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:16.866096 17944 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:10:16.882714 17944 raft_consensus.cc:606] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:16.883051 17944 raft_consensus.cc:614] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:16.883466 18062 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:16.890887 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:16.891065 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 121487us
I20260709 12:10:16.892010 17989 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:16.893213 17989 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:16.895212 17987 leader_election.cc:304] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:16.893989 17989 leader_election.cc:304] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:16.905942 17989 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:16.906765 17989 leader_election.cc:304] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:16.908562 18062 leader_election.cc:304] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:16.861199 19912 raft_consensus.cc:2749] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:16.853435 19931 raft_consensus.cc:697] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:16.912876 18062 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:16.913566 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 128749us
I20260709 12:10:16.862509 19779 raft_consensus.cc:2804] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:16.915056 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:16.874919 19652 raft_consensus.cc:3060] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.808473 19933 consensus_queue.cc:1048] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.101s
I20260709 12:10:16.910178 19926 raft_consensus.cc:2804] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:16.881784 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:16.892774 19655 raft_consensus.cc:493] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.811615 19910 consensus_queue.cc:237] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:16.918051 18609 leader_election.cc:304] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:16.906437 19707 raft_consensus.cc:2764] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:16.912201 19803 raft_consensus.cc:2749] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:16.924089 18092 raft_consensus.cc:3060] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:16.924641 18062 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:16.953420 17942 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
mode: GRACEFUL
new_leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:10:16.955124 18062 leader_election.cc:304] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:16.921631 19942 raft_consensus.cc:2804] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:16.925256 19655 raft_consensus.cc:515] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:16.956459 18062 leader_election.cc:304] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:16.957387 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 50685.9us
I20260709 12:10:16.986749 17989 leader_election.cc:304] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:16.915102 19622 raft_consensus.cc:2804] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:16.923024 17988 leader_election.cc:304] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:16.919353 19779 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:16.922855 19930 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:16.996954 17989 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:16.923636 19924 raft_consensus.cc:2804] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:16.958541 19905 raft_consensus.cc:2804] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:16.959396 19912 raft_consensus.cc:2764] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:10:17.000623 19707 raft_consensus.cc:2804] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:17.077528 19951 raft_consensus.cc:2804] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:16.952848 19945 raft_consensus.cc:2804] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:16.923718 19926 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:17.000123 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 82130.4us
I20260709 12:10:17.084360 17942 raft_consensus.cc:606] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Received request to transfer leadership to TS c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:17.119951 17942 raft_consensus.cc:614] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:17.007057 19803 raft_consensus.cc:2804] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:17.006778 19779 raft_consensus.cc:3060] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.119360 18609 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:16.996097 19622 raft_consensus.cc:493] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:17.088760 19707 raft_consensus.cc:493] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:17.157013 19902 raft_consensus.cc:493] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:17.082371 19924 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:16.995927 19941 raft_consensus.cc:2804] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:17.086903 19905 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:17.086184 19948 raft_consensus.cc:2804] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:17.117491 19951 raft_consensus.cc:493] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:17.123095 19926 raft_consensus.cc:3060] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.164355 19870 raft_consensus.cc:2804] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:17.165025 19707 raft_consensus.cc:3060] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.163228 19622 raft_consensus.cc:3060] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:17.177821 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 180954us
I20260709 12:10:17.137072 19908 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
W20260709 12:10:17.181051 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 193765us
I20260709 12:10:17.176343 19905 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.167833 19924 raft_consensus.cc:3060] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.082612 19930 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:17.122872 19803 raft_consensus.cc:493] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:17.193463 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
W20260709 12:10:17.181913 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 225531us
I20260709 12:10:17.178555 19951 raft_consensus.cc:3060] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.139421 19909 consensus_queue.cc:1059] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:10:17.196820 19870 raft_consensus.cc:697] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:17.175118 19902 raft_consensus.cc:515] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:17.237625 19961 raft_consensus.cc:2749] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:17.238138 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 49675.7us
I20260709 12:10:17.216826 19803 raft_consensus.cc:3060] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.139824 19931 consensus_queue.cc:237] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:17.239483 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 344324us
I20260709 12:10:17.240070 19948 raft_consensus.cc:697] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:17.194904 19908 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:17.238798 19958 raft_consensus.cc:2749] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:17.251233 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:17.226266 19956 raft_consensus.cc:2804] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:17.255568 19947 log.cc:927] Time spent T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:10:17.246696 19945 raft_consensus.cc:697] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:17.256747 18090 raft_consensus.cc:3060] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.255678 19655 leader_election.cc:290] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:17.241940 19941 raft_consensus.cc:697] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:17.257827 19948 consensus_queue.cc:237] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:17.288952 18090 raft_consensus.cc:2468] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:17.290791 19870 consensus_queue.cc:237] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:17.298188 17914 leader_election.cc:336] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Timed out: RequestConsensusVote RPC to 127.16.98.195:41931 timed out after 1.529s (SENT)
I20260709 12:10:17.259212 19956 raft_consensus.cc:493] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
W20260709 12:10:17.301648 17914 leader_election.cc:336] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Timed out: RequestConsensusVote RPC to 127.16.98.195:41931 timed out after 1.581s (SENT)
I20260709 12:10:17.309583 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:17.310607 17949 raft_consensus.cc:2393] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 4: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
W20260709 12:10:17.314826 19949 log.cc:927] Time spent T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:10:17.317292 19779 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:17.299839 19944 log.cc:927] Time spent T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 12:10:17.299290 19912 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:17.343313 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 47677us
I20260709 12:10:17.332597 19951 raft_consensus.cc:515] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:17.291357 19941 consensus_queue.cc:237] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:17.347649 19924 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:17.348443 19922 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:17.349772 19924 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:17.350966 18062 leader_election.cc:400] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123) with higher term. Message: Invalid argument: T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for earlier term 3. Current term is 4.
I20260709 12:10:17.351272 18062 leader_election.cc:403] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:17.351624 18095 raft_consensus.cc:1240] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:17.352161 18062 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:17.352438 18097 raft_consensus.cc:1240] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:17.321426 19736 raft_consensus.cc:493] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:17.304980 19956 raft_consensus.cc:3060] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.304287 19920 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
W20260709 12:10:17.357864 19940 log.cc:927] Time spent T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.433s	user 0.000s	sys 0.007s
I20260709 12:10:17.397894 19933 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.398453 19933 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:17.400606 19933 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:17.351115 19912 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:17.404245 19912 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:10:17.404397 19914 consensus_meta.cc:287] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.699s	user 0.008s	sys 0.002s
W20260709 12:10:17.390417 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.360373 19736 raft_consensus.cc:515] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:17.423375 19736 leader_election.cc:290] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:17.424607 19930 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:17.391279 19920 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:17.421052 19779 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:17.391815 19924 consensus_queue.cc:1048] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:10:17.427188 19920 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:17.437772 19826 raft_consensus.cc:3060] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:17.439523 19904 consensus_meta.cc:287] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.572s	user 0.008s	sys 0.000s
W20260709 12:10:17.395915 19915 consensus_meta.cc:287] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.648s	user 0.007s	sys 0.003s
I20260709 12:10:17.433889 19926 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:10:17.410807 19922 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:17.472920 19965 log.cc:927] Time spent T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:10:17.454996 19915 raft_consensus.cc:515] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:17.391057 19962 consensus_queue.cc:1059] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.228s
W20260709 12:10:17.545413 17914 leader_election.cc:336] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Timed out: RequestConsensusVote RPC to 127.16.98.195:41931 timed out after 1.804s (SENT)
I20260709 12:10:17.617453 19926 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123)
I20260709 12:10:17.618017 17914 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:17.618458 19962 raft_consensus.cc:3055] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:17.618949 19962 raft_consensus.cc:740] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:17.619149 18089 raft_consensus.cc:1240] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:17.619901 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 74881.1us
I20260709 12:10:17.620685 19962 consensus_queue.cc:260] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:17.551678 18092 consensus_meta.cc:287] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.600s	user 0.008s	sys 0.001s
I20260709 12:10:17.551267 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:17.552649 18094 raft_consensus.cc:1240] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:17.553193 18097 raft_consensus.cc:1240] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:17.551270 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:17.561731 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 209510us
I20260709 12:10:17.589237 19655 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.626034 18092 raft_consensus.cc:2468] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 3.
I20260709 12:10:17.593595 19706 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.597378 19902 leader_election.cc:290] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:17.605724 19905 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:17.608664 19908 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:17.390452 19945 consensus_queue.cc:237] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:17.633886 18015 raft_consensus.cc:1240] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:17.613546 19932 raft_consensus.cc:3055] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:17.637655 19932 raft_consensus.cc:740] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:17.638931 19706 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:17.611974 19774 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:17.613490 19925 raft_consensus.cc:3055] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:17.659570 19925 raft_consensus.cc:740] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:17.660924 19925 consensus_queue.cc:260] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:17.662225 19925 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.617197 19915 leader_election.cc:290] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:17.548396 17989 leader_election.cc:304] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:17.623906 19911 raft_consensus.cc:2749] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:17.392586 19971 raft_consensus.cc:2749] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123) with higher term. Message: Invalid argument: T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for earlier term 3. Current term is 4.
I20260709 12:10:17.624343 19962 raft_consensus.cc:3060] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.624732 19957 raft_consensus.cc:3055] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:17.672771 19957 raft_consensus.cc:740] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:17.672456 19956 raft_consensus.cc:515] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:17.674237 19957 consensus_queue.cc:260] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:17.675621 19957 raft_consensus.cc:3060] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.676108 19956 leader_election.cc:290] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:17.387980 19964 consensus_queue.cc:1048] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.264s
I20260709 12:10:17.625311 18062 leader_election.cc:304] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:17.681138 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 56177.6us
I20260709 12:10:17.682144 18062 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:17.621729 17914 leader_election.cc:336] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Timed out: RequestConsensusVote RPC to 127.16.98.195:41931 timed out after 2.019s (SENT)
W20260709 12:10:17.612684 19652 consensus_meta.cc:287] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.685s	user 0.014s	sys 0.014s
I20260709 12:10:17.685691 19652 raft_consensus.cc:515] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:17.647495 19706 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:17.648425 19655 raft_consensus.cc:2749] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:17.649065 19774 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:17.689558 19652 leader_election.cc:290] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:17.690701 19774 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:17.653301 19622 raft_consensus.cc:515] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:17.692993 19622 leader_election.cc:290] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:10:17.693104 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 145240us
I20260709 12:10:17.693284 19652 raft_consensus.cc:2804] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:17.693905 19652 raft_consensus.cc:697] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:17.639372 19932 consensus_queue.cc:260] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:17.684980 17914 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:17.656829 19803 raft_consensus.cc:515] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:17.698028 19959 consensus_queue.cc:1059] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:17.701284 17942 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:10:17.706410 19803 leader_election.cc:290] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:17.706801 18062 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:17.707288 19774 raft_consensus.cc:2749] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:17.708513 19803 raft_consensus.cc:2749] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:17.709575 18062 leader_election.cc:304] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:17.710414 17912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.710824 19803 raft_consensus.cc:2749] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:17.684991 19964 raft_consensus.cc:2749] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:17.718400 19954 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:17.718575 19904 raft_consensus.cc:493] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:17.718783 19979 raft_consensus.cc:493] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:17.719151 19954 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:17.719383 19904 raft_consensus.cc:515] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:17.719622 19979 raft_consensus.cc:515] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:17.721514 19707 consensus_meta.cc:287] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.528s	user 0.009s	sys 0.005s
I20260709 12:10:17.721648 19954 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:17.721969 19904 leader_election.cc:290] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:17.723541 19932 raft_consensus.cc:3060] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:17.710345 19905 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:17.704381 19915 raft_consensus.cc:2749] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:17.702544 17845 catalog_manager.cc:5697] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 1 to 2, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 2 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:17.721982 19707 raft_consensus.cc:515] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:17.728818 19929 raft_consensus.cc:3055] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:17.729298 19929 raft_consensus.cc:740] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:17.716380 17942 raft_consensus.cc:606] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:17.730347 17942 raft_consensus.cc:614] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:17.730521 19707 leader_election.cc:290] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:17.707337 19951 leader_election.cc:290] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:17.741365 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:17.742458 18637 raft_consensus.cc:2393] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 2: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:17.730773 19929 consensus_queue.cc:260] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:17.745329 17845 catalog_manager.cc:5697] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 2 to 3, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 3 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:17.746264 19929 raft_consensus.cc:3060] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:17.747814 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:17.748580 18097 raft_consensus.cc:3060] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.748812 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:17.750481 18062 leader_election.cc:304] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:17.753280 17912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.725665 19979 leader_election.cc:290] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:17.756062 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:17.757514 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
W20260709 12:10:17.758139 17988 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.017s	sys 0.015s
I20260709 12:10:17.758589 18094 raft_consensus.cc:2393] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 3: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:17.758210 19826 consensus_queue.cc:1059] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:17.760731 18636 raft_consensus.cc:1240] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:17.761889 17988 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.017s	sys 0.015s
I20260709 12:10:17.763224 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:17.766786 18061 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:17.768729 18609 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:17.769796 19706 consensus_queue.cc:1059] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:17.771127 19706 raft_consensus.cc:2804] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:17.771343 19803 raft_consensus.cc:2749] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:17.771703 19706 raft_consensus.cc:697] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:17.747808 17845 catalog_manager.cc:5697] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 2 to 3, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 3 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:17.778152 17942 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
mode: GRACEFUL
new_leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:10:17.782238 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:17.783903 18091 raft_consensus.cc:1240] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:17.784935 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 163326us
I20260709 12:10:17.787493 18091 raft_consensus.cc:1240] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:17.773270 19706 consensus_queue.cc:237] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:17.787338 17845 catalog_manager.cc:5697] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 1 to 2, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 2 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:17.787412 19715 raft_consensus.cc:3055] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:17.795574 19715 raft_consensus.cc:740] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:17.796808 19715 consensus_queue.cc:260] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:17.798249 19715 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.789346 17942 raft_consensus.cc:606] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Received request to transfer leadership to TS c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:17.799535 17942 raft_consensus.cc:614] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:10:17.801247 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 878241us
I20260709 12:10:17.805086 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:17.805588 17988 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:17.807050 19826 consensus_queue.cc:1059] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:17.807941 18094 raft_consensus.cc:1275] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:17.808342 19903 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:17.808717 17914 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.98.195:41931 timed out after 2.011s (SENT) [suppressed 46 similar messages]
I20260709 12:10:17.809105 19903 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:17.809677 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:17.799831 19979 raft_consensus.cc:2749] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:17.816414 18097 raft_consensus.cc:2468] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:17.822708 17989 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:17.824373 19948 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:17.825206 19948 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:17.826894 19918 raft_consensus.cc:493] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.827621 19918 raft_consensus.cc:515] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:17.828388 19985 log.cc:927] Time spent T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
W20260709 12:10:17.831342 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 62932.8us
I20260709 12:10:17.845886 19903 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:17.847334 19918 leader_election.cc:290] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:17.848057 18089 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41818 (request call id 473) took 1048 ms. Trace:
I20260709 12:10:17.848582 18089 rpcz_store.cc:276] 0709 12:10:16.799777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.801663 (+  1886us) service_pool.cc:224] Handling call
0709 12:10:16.808263 (+  6600us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:17.619858 (+811595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:17.847747 (+227889us) spinlock_profiling.cc:243] Waited 810 ms on lock 0x7b54002ef254. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:17.847997 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1863668480}
I20260709 12:10:17.850629 19973 consensus_queue.cc:1059] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:17.851557 19958 raft_consensus.cc:2804] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:17.852057 19973 raft_consensus.cc:3055] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:17.852246 19958 raft_consensus.cc:697] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:17.852509 19973 raft_consensus.cc:740] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:17.862684 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:17.863438 18097 raft_consensus.cc:3060] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:17.863605 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:17.864060 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:17.864511 18636 raft_consensus.cc:2468] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3.
I20260709 12:10:17.866729 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:17.843236 19911 raft_consensus.cc:493] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.867564 18096 raft_consensus.cc:2468] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 3.
I20260709 12:10:17.867878 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:17.868399 19902 raft_consensus.cc:3055] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:17.868839 19902 raft_consensus.cc:740] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:17.867938 19911 raft_consensus.cc:515] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:17.875062 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 148982us
I20260709 12:10:17.802176 19652 consensus_queue.cc:237] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:17.882107 18094 raft_consensus.cc:1275] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:17.853905 19957 consensus_queue.cc:1048] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:10:17.883030 19911 leader_election.cc:290] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:17.884410 19956 raft_consensus.cc:3055] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:17.884837 19956 raft_consensus.cc:740] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:17.869956 19902 consensus_queue.cc:260] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:17.886379 19902 raft_consensus.cc:3060] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.892426 17912 leader_election.cc:304] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:17.831954 19945 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:17.853552 19958 consensus_queue.cc:237] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:10:17.899727 18636 raft_consensus.cc:1275] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:10:17.900930 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.890312 19948 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:17.863557 19904 consensus_queue.cc:1059] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:10:17.909212 17988 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:17.913322 18097 raft_consensus.cc:2468] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
I20260709 12:10:17.907065 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:17.902904 17845 catalog_manager.cc:5697] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 2 to 3, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 3 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:17.902259 19911 raft_consensus.cc:2804] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:17.853668 19973 consensus_queue.cc:260] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:17.917770 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:17.922897 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:17.925774 19973 raft_consensus.cc:3060] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:17.929386 19941 raft_consensus.cc:2749] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:17.930235 18640 raft_consensus.cc:1275] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:17.917344 19911 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:17.932408 18062 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:17.938959 19948 raft_consensus.cc:2749] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:10:17.939126 19980 log.cc:927] Time spent T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 12:10:17.942240 18609 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:17.930217 19945 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:17.934303 19911 raft_consensus.cc:3060] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:17.948132 19928 raft_consensus.cc:2804] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:17.948525 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:17.949199 19921 consensus_queue.cc:1048] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:10:17.951977 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 44497.3us
I20260709 12:10:17.952728 18609 leader_election.cc:304] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:17.930498 19910 consensus_queue.cc:1059] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:10:17.952529 19928 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:17.954272 19655 raft_consensus.cc:2749] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:17.955560 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:17.955765 19975 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:17.936337 17845 catalog_manager.cc:5697] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 4 to 5, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 5 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:10:17.944320 19942 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.009s	sys 0.012s
I20260709 12:10:17.969848 19774 raft_consensus.cc:3055] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:17.970280 19774 raft_consensus.cc:740] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:17.973234 18097 raft_consensus.cc:1275] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:10:17.976413 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 67308.7us
I20260709 12:10:17.960270 19928 raft_consensus.cc:3060] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:17.968542 19942 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.010s	sys 0.012s
I20260709 12:10:17.985489 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:17.988262 19948 consensus_queue.cc:1048] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:17.988693 18093 raft_consensus.cc:1240] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:17.989995 18089 raft_consensus.cc:1240] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:17.991720 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:17.994324 19975 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:17.994886 17949 raft_consensus.cc:2468] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 3.
I20260709 12:10:17.995760 18094 raft_consensus.cc:1240] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:17.996127 19929 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:17.996562 19975 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:17.996793 19929 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:17.998622 19986 log.cc:927] Time spent T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.176s	user 0.002s	sys 0.000s
I20260709 12:10:17.999157 19931 consensus_queue.cc:1059] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:18.000381 19952 raft_consensus.cc:3055] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:18.000213 19931 consensus_queue.cc:1059] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:18.000794 19952 raft_consensus.cc:740] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:18.001493 19931 raft_consensus.cc:3055] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:18.001982 19931 raft_consensus.cc:740] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:18.001797 19952 consensus_queue.cc:260] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:18.002991 19969 raft_consensus.cc:3055] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:18.003479 19969 raft_consensus.cc:740] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:18.003624 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:18.004690 19969 consensus_queue.cc:260] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:18.006830 19956 consensus_queue.cc:260] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:18.007586 19904 consensus_queue.cc:1059] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:18.008069 19956 raft_consensus.cc:3060] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.011665 19931 consensus_queue.cc:260] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:18.013434 19931 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.015480 19969 raft_consensus.cc:3060] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.016149 18608 leader_election.cc:304] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:18.016894 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:18.023548 19774 consensus_queue.cc:260] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:18.023932 19929 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:18.024374 17942 raft_consensus.cc:1275] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:18.024503 18062 leader_election.cc:304] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:18.027098 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:18.031919 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.025156 19921 raft_consensus.cc:2804] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:18.036765 17988 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:18.019727 19942 raft_consensus.cc:697] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
W20260709 12:10:18.054541 19981 log.cc:927] Time spent T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.199s	user 0.001s	sys 0.003s
I20260709 12:10:18.055454 19942 consensus_queue.cc:237] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:18.062954 19979 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:18.063190 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 104976us
I20260709 12:10:18.063627 19979 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:18.064067 18062 leader_election.cc:304] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:18.065225 18062 leader_election.cc:304] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:18.034896 19707 raft_consensus.cc:3055] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:18.036042 19962 raft_consensus.cc:2749] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:18.070111 19715 raft_consensus.cc:3060] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.075862 19964 raft_consensus.cc:2804] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:18.068249 19921 raft_consensus.cc:697] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:18.069356 19707 raft_consensus.cc:740] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:18.083469 19964 raft_consensus.cc:493] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:18.073849 19774 raft_consensus.cc:3060] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:18.087765 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.090211 19953 raft_consensus.cc:2749] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:18.092396 18637 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:18.093484 19921 consensus_queue.cc:237] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:18.095209 19707 consensus_queue.cc:260] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:18.079171 19952 raft_consensus.cc:3060] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.081218 19979 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:10:18.101140 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 85273.4us
I20260709 12:10:18.095988 19964 raft_consensus.cc:3060] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.081504 19652 raft_consensus.cc:2749] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:18.099291 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 74380.6us
W20260709 12:10:18.104526 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.107439 18093 raft_consensus.cc:1240] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:18.108085 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.111006 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.112293 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:18.112897 17949 raft_consensus.cc:2468] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 1.
I20260709 12:10:18.112320 18090 raft_consensus.cc:2368] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 2. Current term is 3.
I20260709 12:10:18.123700 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.128096 18061 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:18.116813 18023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45464 (request call id 1566) took 1255 ms. Trace:
W20260709 12:10:18.127350 19984 log.cc:927] Time spent T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 12:10:18.137120 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:18.126096 19707 raft_consensus.cc:3060] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:18.129895 18610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.126747 19962 consensus_queue.cc:1048] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:10:18.138782 18090 raft_consensus.cc:2368] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 2. Current term is 3.
I20260709 12:10:18.142813 19655 raft_consensus.cc:2804] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:18.143370 19655 raft_consensus.cc:697] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 4 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:18.131844 19979 consensus_queue.cc:1048] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:10:18.133695 19973 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:18.155342 19951 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.155510 19945 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:18.155977 19951 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:18.159516 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:18.150054 19975 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.163739 19975 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:18.165802 19975 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:18.144405 19655 consensus_queue.cc:237] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:18.167575 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 46318.2us
I20260709 12:10:18.168467 17988 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:18.169718 17988 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:18.172098 19973 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:18.174176 19973 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:18.174762 19948 raft_consensus.cc:2749] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:18.175529 19948 raft_consensus.cc:2764] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:10:18.176537 18637 raft_consensus.cc:1240] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:18.177568 19951 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:18.181386 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
W20260709 12:10:18.181996 17912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.187917 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:18.188545 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.188752 18094 raft_consensus.cc:2393] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 4: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:18.192178 19870 consensus_queue.cc:1059] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:18.195267 19794 raft_consensus.cc:3055] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:18.195667 19794 raft_consensus.cc:740] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:18.196589 19794 consensus_queue.cc:260] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:18.197911 19794 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:18.159132 17914 leader_election.cc:336] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Timed out: RequestConsensusVote RPC to 127.16.98.195:41931 timed out after 1.596s (SENT)
I20260709 12:10:18.200594 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.202127 17914 leader_election.cc:304] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:18.207322 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:18.216892 19826 raft_consensus.cc:2749] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:18.218084 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 58971.5us
I20260709 12:10:18.218947 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.212153 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.223129 18094 raft_consensus.cc:1813] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Handling vote request from an unknown peer 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:18.223650 18094 raft_consensus.cc:2393] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 4: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
W20260709 12:10:18.227982 19994 log.cc:927] Time spent T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:10:18.229467 18090 raft_consensus.cc:2393] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 3: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:18.231251 17988 leader_election.cc:304] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:18.232558 17988 leader_election.cc:304] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:18.232879 19956 raft_consensus.cc:2749] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 LEADER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:18.233536 19956 raft_consensus.cc:2764] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:10:18.235358 19826 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:18.235941 19826 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:18.239066 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.240782 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:18.242818 19826 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:18.244581 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:18.246202 18092 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:10:18.246417 19826 raft_consensus.cc:493] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.247193 19826 raft_consensus.cc:515] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:18.247525 18609 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:18.248901 19910 raft_consensus.cc:2804] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:18.249259 19910 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.249581 19910 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.252249 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.252446 18097 raft_consensus.cc:1275] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:18.252964 18098 raft_consensus.cc:2393] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 3: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:18.253464 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:18.254160 18637 raft_consensus.cc:2468] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3.
I20260709 12:10:18.254258 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.254298 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.254820 19870 consensus_queue.cc:1048] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:18.257647 19826 leader_election.cc:290] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:18.255946 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.260926 18090 raft_consensus.cc:2393] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 4: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:18.259891 17912 leader_election.cc:304] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:18.262398 19902 raft_consensus.cc:2804] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:18.262928 19902 raft_consensus.cc:493] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.263415 19902 raft_consensus.cc:3060] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.270991 19870 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.271581 19870 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:18.272797 19964 raft_consensus.cc:515] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:18.273682 19870 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:18.275130 18607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.275269 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.273828 18093 raft_consensus.cc:1240] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:18.278995 19652 consensus_queue.cc:1059] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:18.280233 19652 raft_consensus.cc:3055] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:18.280633 19652 raft_consensus.cc:740] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
W20260709 12:10:18.281497 17914 leader_election.cc:336] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Timed out: RequestConsensusVote RPC to 127.16.98.195:41931 timed out after 1.606s (SENT)
I20260709 12:10:18.281968 17914 leader_election.cc:304] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:18.283219 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.283982 19826 raft_consensus.cc:2749] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:18.285799 17914 leader_election.cc:336] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Timed out: RequestConsensusVote RPC to 127.16.98.195:41931 timed out after 1.646s (SENT)
I20260709 12:10:18.286346 17914 leader_election.cc:304] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:18.289669 17912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.290656 19826 raft_consensus.cc:2749] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:18.287624 19652 consensus_queue.cc:260] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:18.294706 19652 raft_consensus.cc:3060] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.256011 18098 raft_consensus.cc:1240] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 3. Current term is 5. Ops: []
I20260709 12:10:18.317875 19715 raft_consensus.cc:2749] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:18.204382 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:18.324628 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 90919.9us
I20260709 12:10:18.326275 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.327195 18093 raft_consensus.cc:2410] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:18.328372 18091 raft_consensus.cc:1240] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:18.329738 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.331048 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.331892 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:18.332144 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:18.332669 18095 raft_consensus.cc:2410] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:18.332839 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.333150 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:18.333431 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:18.333835 18098 raft_consensus.cc:2393] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 4: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:18.334117 18095 raft_consensus.cc:2393] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 4: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:18.334192 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.331204 18096 raft_consensus.cc:1240] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:18.335079 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:18.335245 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.335785 19964 leader_election.cc:290] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:18.336328 18090 raft_consensus.cc:2393] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 4: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:18.336809 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.335340 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:18.337401 18092 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 5.
I20260709 12:10:18.337774 18090 raft_consensus.cc:1240] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:10:18.338606 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.328410 18093 raft_consensus.cc:1240] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:18.339341 18092 raft_consensus.cc:2393] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 3: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:18.339177 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:18.320504 19928 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:18.341164 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.341784 19928 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:18.330543 18091 raft_consensus.cc:2468] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3.
I20260709 12:10:18.343490 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:18.344400 18635 raft_consensus.cc:2468] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:18.344470 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
W20260709 12:10:18.345346 17913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.346999 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.348758 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.348353 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.351905 18093 raft_consensus.cc:2393] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 4: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:18.353320 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:18.357338 18635 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
I20260709 12:10:18.358139 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.358713 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:18.359140 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.361132 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.361323 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.362174 18091 raft_consensus.cc:2393] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 4: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:18.362411 18092 raft_consensus.cc:2393] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 3: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:18.360324 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:18.364043 17947 raft_consensus.cc:2468] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 1.
I20260709 12:10:18.367070 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:18.366444 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.374806 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.374377 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:10:18.380838 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.382469 17988 leader_election.cc:304] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:18.382848 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.383878 18608 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:18.135931 18023 rpcz_store.cc:276] 0709 12:10:16.772215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.787452 (+ 15237us) service_pool.cc:224] Handling call
0709 12:10:17.759314 (+971862us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b5800055898. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4988db71 00007f7f4988deee 000000000036eb39 00007f7f519011e0 00007f7f519ca0c4 00007f7f519ca131 00007f7f5198bfc0 00007f7f51976929 00007f7f519763d2 00007f7f4aeedbd4
0709 12:10:17.759667 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:17.760191 (+   524us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:17.803618 (+ 43427us) log.cc:844] Serialized 14 byte log entry
0709 12:10:17.965023 (+161405us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:17.972323 (+  7300us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:17.976862 (+  4539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:17.980556 (+  3694us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:18.026434 (+ 45878us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45452,"prepare.queue_time_us":6524,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":50,"raft.queue_time_us":43011,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":5071,"spinlock_wait_cycles":4142336,"thread_start_us":66569,"threads_started":2,"wal-append.queue_time_us":188823}
I20260709 12:10:18.385139 17942 raft_consensus.cc:2468] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:10:18.380462 19942 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.394658 18098 raft_consensus.cc:2368] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 2. Current term is 3.
I20260709 12:10:18.377743 19911 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:18.383544 19652 raft_consensus.cc:2749] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:18.396706 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.380415 19902 raft_consensus.cc:515] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:18.419687 19902 leader_election.cc:290] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:18.420842 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:18.421461 18643 raft_consensus.cc:3060] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.422729 19928 raft_consensus.cc:2804] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:18.423144 19928 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.423482 19928 raft_consensus.cc:3060] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.403653 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.411315 19942 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:18.407778 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:18.426380 18093 raft_consensus.cc:2410] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:18.431430 18637 raft_consensus.cc:2468] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:18.437294 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.441995 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:18.442725 18092 raft_consensus.cc:2393] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 4: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:18.442622 18608 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:18.444264 18608 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:18.449280 18608 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:18.451175 19921 raft_consensus.cc:2804] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:18.451920 19921 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:18.444341 17987 leader_election.cc:304] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:18.452486 19921 raft_consensus.cc:3060] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:18.452519 17988 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:18.453130 19652 raft_consensus.cc:2749] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:18.453902 19652 raft_consensus.cc:2749] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:18.454185 17988 leader_election.cc:304] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:18.452541 19975 raft_consensus.cc:2804] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:18.455083 19707 raft_consensus.cc:2749] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:18.456197 17988 leader_election.cc:304] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:18.456429 17987 leader_election.cc:304] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:18.457609 18098 raft_consensus.cc:1275] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:18.455183 19975 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.462193 19975 raft_consensus.cc:3060] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.464210 19707 raft_consensus.cc:2764] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:18.459053 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.460067 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.460748 19706 raft_consensus.cc:2804] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:18.461186 19652 consensus_queue.cc:1048] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:10:18.468076 18608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.465601 17987 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:18.469600 17987 leader_election.cc:304] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:18.436718 19952 consensus_queue.cc:1048] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:10:18.497946 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.475769 17987 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:18.484176 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:18.505734 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 49601.4us
I20260709 12:10:18.510040 18093 raft_consensus.cc:2410] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:18.470546 19706 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.516970 17987 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:18.517268 18098 raft_consensus.cc:1275] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:18.472601 19707 raft_consensus.cc:2749] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:18.477977 19956 raft_consensus.cc:2804] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:18.521160 17987 leader_election.cc:304] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:18.474905 19945 raft_consensus.cc:2749] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:18.494882 19942 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:18.520119 19706 raft_consensus.cc:3060] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.519948 19931 raft_consensus.cc:2804] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:18.530257 19774 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.533030 18098 raft_consensus.cc:1275] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:18.524657 19969 raft_consensus.cc:2749] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:18.539608 19921 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:18.542943 17913 leader_election.cc:336] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 2.104s (SENT)
I20260709 12:10:18.543391 17913 leader_election.cc:304] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:18.544720 19826 raft_consensus.cc:2749] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:18.534955 19951 consensus_queue.cc:1048] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:18.537838 19928 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:18.527201 19956 raft_consensus.cc:697] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:18.530339 19948 raft_consensus.cc:2804] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:18.547580 19774 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:18.530740 19931 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:18.527470 19957 consensus_queue.cc:1048] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:10:18.554230 18098 raft_consensus.cc:1275] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:10:18.554526 18643 raft_consensus.cc:2468] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 4.
I20260709 12:10:18.555809 17912 leader_election.cc:304] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:18.556910 19911 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:18.558045 19925 consensus_queue.cc:1048] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:18.570698 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:18.571331 18637 raft_consensus.cc:3060] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.552903 19931 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:18.554327 19948 raft_consensus.cc:697] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:18.579865 19948 consensus_queue.cc:237] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:18.567138 19902 raft_consensus.cc:2804] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:18.587683 19902 raft_consensus.cc:697] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:18.588861 19902 consensus_queue.cc:237] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:18.592185 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.592909 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:18.593706 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.594084 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:18.594413 18090 raft_consensus.cc:2393] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 4: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:18.594609 18095 raft_consensus.cc:3060] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.595357 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.593012 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.596776 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.605062 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:18.553305 19910 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:18.606050 18023 raft_consensus.cc:2393] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 4: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:18.606889 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.607470 18091 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 5.
I20260709 12:10:18.607540 19910 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:18.607652 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:18.606385 18095 raft_consensus.cc:2468] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 4.
I20260709 12:10:18.582340 19975 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:18.626963 19706 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:18.477456 19870 raft_consensus.cc:2955] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
W20260709 12:10:18.669260 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 58879us
I20260709 12:10:18.700796 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:18.614904 19956 consensus_queue.cc:237] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:18.670785 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 49639.6us
I20260709 12:10:18.674018 19931 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:18.675129 18023 raft_consensus.cc:1240] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:10:18.704299 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.675803 19921 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:18.701479 18091 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:18.704988 17987 leader_election.cc:304] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:18.707105 17914 leader_election.cc:336] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Timed out: RequestConsensusVote RPC to 127.16.98.195:41931 timed out after 1.975s (SENT)
W20260709 12:10:18.714363 17912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.719036 19794 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:18.719439 18017 raft_consensus.cc:1240] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:18.719530 19794 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:18.722604 17988 leader_election.cc:304] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:18.717686 17914 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:18.711794 18636 raft_consensus.cc:1240] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:18.722390 19652 raft_consensus.cc:2749] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:18.739447 18637 raft_consensus.cc:2468] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 4.
I20260709 12:10:18.740679 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:18.741693 18017 raft_consensus.cc:2410] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:10:18.743851 17914 leader_election.cc:336] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Timed out: RequestConsensusVote RPC to 127.16.98.195:41931 timed out after 1.988s (SENT)
I20260709 12:10:18.744261 17914 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:18.736065 19918 raft_consensus.cc:2749] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:18.764410 18090 raft_consensus.cc:1275] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 12:10:18.770910 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 48389.5us
W20260709 12:10:18.779860 18607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.783406 18091 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
I20260709 12:10:18.732337 19774 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:18.745059 19942 raft_consensus.cc:2749] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:18.793666 18609 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:18.794634 19957 consensus_queue.cc:1048] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:18.796236 19957 raft_consensus.cc:2804] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:18.796751 19957 raft_consensus.cc:697] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:18.797812 19957 consensus_queue.cc:237] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:18.806932 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:18.752745 19911 raft_consensus.cc:2749] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:18.811733 17845 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40276 (request call id 252) took 4179 ms. Trace:
I20260709 12:10:18.783623 19928 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:18.813509 19794 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:18.816290 19931 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:18.768509 19706 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:18.762722 19707 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:18.826460 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:18.830533 17949 raft_consensus.cc:3060] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.846168 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:18.850011 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:18.850999 18636 raft_consensus.cc:2410] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:18.854043 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:18.854817 17943 raft_consensus.cc:2468] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:18.807924 19975 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:10:18.861295 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 70714us
W20260709 12:10:18.823643 17912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.870934 17912 leader_election.cc:304] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:18.820353 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:18.877584 17944 raft_consensus.cc:3060] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.884656 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:18.884804 17943 raft_consensus.cc:1240] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:18.888267 17988 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:18.890980 19931 raft_consensus.cc:2749] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:18.872901 19707 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:18.893644 19707 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:18.900738 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 95245.2us
W20260709 12:10:18.906955 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.921336 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:18.929669 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:18.935765 17942 raft_consensus.cc:2468] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 1.
I20260709 12:10:18.829308 17845 rpcz_store.cc:276] 0709 12:10:14.632689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:14.634494 (+  1805us) service_pool.cc:224] Handling call
0709 12:10:18.811667 (+4177173us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:18.109055 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:18.149213 (+ 40158us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:18.149279 (+    66us) write_op.cc:435] Acquired schema lock
0709 12:10:18.149324 (+    45us) tablet.cc:662] Decoding operations
0709 12:10:18.156165 (+  6841us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:18.156267 (+   102us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:18.156295 (+    28us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:10:18.199393 (+ 43098us) tablet.cc:701] Row locks acquired
0709 12:10:18.199447 (+    54us) write_op.cc:260] PREPARE: finished
0709 12:10:18.203020 (+  3573us) write_op.cc:270] Start()
0709 12:10:18.203168 (+   148us) write_op.cc:276] Timestamp: P: 1783599018202938 usec, L: 0
0709 12:10:18.203206 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 12:10:18.215009 (+ 11803us) log.cc:844] Serialized 2515 byte log entry
0709 12:10:18.452001 (+236992us) op_driver.cc:464] REPLICATION: finished
0709 12:10:18.559012 (+107011us) write_op.cc:301] APPLY: starting
0709 12:10:18.559114 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:18.559303 (+   189us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:18.568430 (+  9127us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:18.601584 (+ 33154us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:18.601900 (+   316us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:10:18.601959 (+    59us) write_op.cc:312] APPLY: finished
0709 12:10:18.602274 (+   315us) log.cc:844] Serialized 53 byte log entry
0709 12:10:18.602457 (+   183us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:18.602568 (+   111us) write_op.cc:454] Released schema lock
0709 12:10:18.602620 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:18.667450 (+ 64830us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:18.667493 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1282985,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":98412,"apply.run_cpu_time_us":3992,"apply.run_wall_time_us":114732,"num_ops":6,"prepare.queue_time_us":99524,"prepare.run_cpu_time_us":30110,"prepare.run_wall_time_us":273273,"raft.queue_time_us":49098,"raft.run_cpu_time_us":21774,"raft.run_wall_time_us":69927,"replication_time_us":248608,"spinlock_wait_cycles":7552,"thread_start_us":318583,"threads_started":4,"wal-append.queue_time_us":180977}]]}
I20260709 12:10:18.937721 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:18.900262 19911 raft_consensus.cc:2804] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:18.958854 18093 raft_consensus.cc:1275] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:18.951805 17947 raft_consensus.cc:3060] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:18.949374 19911 raft_consensus.cc:697] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:18.973519 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
W20260709 12:10:18.977591 18608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:18.946806 19948 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
W20260709 12:10:18.981679 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 237856us
I20260709 12:10:18.981598 17949 raft_consensus.cc:2468] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:18.982939 17944 raft_consensus.cc:2468] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:18.970109 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:18.987202 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:18.988011 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:18.988718 18023 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:10:18.981487 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:18.989602 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:18.989903 17943 raft_consensus.cc:1240] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:10:18.991297 19652 consensus_queue.cc:1059] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:18.991900 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:18.992132 19925 raft_consensus.cc:3055] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:18.992583 19925 raft_consensus.cc:740] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:18.992707 17941 raft_consensus.cc:2368] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for earlier term 3. Current term is 4.
I20260709 12:10:18.993547 19925 consensus_queue.cc:260] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:18.994976 19925 raft_consensus.cc:3060] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.996905 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:18.997619 18094 raft_consensus.cc:2393] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 4: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:18.998634 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:18.999300 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:19.000252 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:19.000878 18016 raft_consensus.cc:3060] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:18.990015 18015 raft_consensus.cc:2368] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for earlier term 3. Current term is 4.
I20260709 12:10:19.010974 18018 raft_consensus.cc:2393] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 3: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:19.017266 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:19.019104 18062 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:19.024582 19964 raft_consensus.cc:2749] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:19.025025 18637 raft_consensus.cc:1275] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:19.025692 18020 raft_consensus.cc:1275] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:19.026518 20027 consensus_queue.cc:1059] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:10:19.032059 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
W20260709 12:10:19.073242 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 44025.1us
W20260709 12:10:19.076435 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 63034.5us
I20260709 12:10:19.081344 18021 raft_consensus.cc:2468] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:19.080960 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:19.083523 18637 raft_consensus.cc:2468] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:19.083707 17846 catalog_manager.cc:5697] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:19.085270 17846 catalog_manager.cc:5697] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 2 to 3, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 3 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:19.086771 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:19.087030 19964 consensus_queue.cc:1048] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:19.086632 17846 catalog_manager.cc:5697] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 3 to 4, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 4 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:19.088821 20023 log.cc:927] Time spent T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:10:19.029429 20027 raft_consensus.cc:3055] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:19.092458 20027 raft_consensus.cc:740] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:19.091859 19911 consensus_queue.cc:237] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:19.093122 18062 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:19.093469 20022 consensus_queue.cc:1048] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:10:19.094699 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:19.094815 19962 consensus_queue.cc:1059] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:19.095767 19953 consensus_queue.cc:1059] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:19.096067 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:19.096599 17949 raft_consensus.cc:3060] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.018361 19948 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:19.097680 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 64917.7us
W20260709 12:10:19.082284 20008 log.cc:927] Time spent T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:10:19.101440 17946 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.102010 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:19.104550 17949 raft_consensus.cc:2468] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:19.105708 17947 raft_consensus.cc:2468] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:19.105980 18019 raft_consensus.cc:2468] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:19.105746 17914 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:19.109671 18090 raft_consensus.cc:1275] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:19.111510 18022 raft_consensus.cc:2468] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:19.115285 17846 catalog_manager.cc:5697] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 2 to 3, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 3 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:19.099287 19984 log.cc:927] Time spent T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:10:19.116369 17846 catalog_manager.cc:5697] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 2 to 3, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 3 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:19.106544 19964 raft_consensus.cc:2749] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:19.121682 20020 log.cc:927] Time spent T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 12:10:19.121860 19942 consensus_queue.cc:1048] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:19.137396 17946 raft_consensus.cc:1275] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:19.153008 17846 catalog_manager.cc:5697] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:19.139878 19774 raft_consensus.cc:2749] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:10:19.174970 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 80326.3us
I20260709 12:10:19.140157 17943 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:19.178303 18062 leader_election.cc:304] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:19.179098 17846 catalog_manager.cc:5697] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 1 to 2, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
W20260709 12:10:19.194336 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 88687.8us
I20260709 12:10:19.202553 18062 leader_election.cc:304] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:19.205425 17914 leader_election.cc:304] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:19.212270 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 85229.8us
I20260709 12:10:19.217432 17846 catalog_manager.cc:5697] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 2 to 3, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 3 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
W20260709 12:10:19.218503 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.224349 19774 raft_consensus.cc:2749] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:19.226426 20018 log.cc:927] Time spent T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.275s	user 0.000s	sys 0.001s
I20260709 12:10:19.227807 19948 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:19.200685 18023 raft_consensus.cc:2468] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:19.230219 18016 raft_consensus.cc:2468] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:19.234820 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:19.235738 18643 raft_consensus.cc:2368] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 3. Current term is 4.
I20260709 12:10:19.234844 18640 raft_consensus.cc:1275] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:10:19.245018 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 50655.4us
I20260709 12:10:19.246021 18062 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:19.248426 18062 leader_election.cc:304] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:19.254666 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 49333us
I20260709 12:10:19.256304 19652 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:19.256892 19652 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:19.257308 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:19.257920 18019 raft_consensus.cc:3060] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:19.250415 20035 raft_consensus.cc:2749] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:19.259093 18023 raft_consensus.cc:1240] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:19.259649 18016 raft_consensus.cc:1240] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:19.260385 18021 raft_consensus.cc:1240] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:19.261089 17987 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:19.263052 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:19.263689 18018 raft_consensus.cc:2468] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:10:19.262550 19969 raft_consensus.cc:2749] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:19.269793 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:19.270504 18018 raft_consensus.cc:2468] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 3.
I20260709 12:10:19.272797 20027 consensus_queue.cc:260] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:10:19.274022 20027 raft_consensus.cc:3060] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.275007 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:19.275633 18020 raft_consensus.cc:2468] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:10:19.279666 18019 raft_consensus.cc:2468] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
I20260709 12:10:19.279928 17987 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
W20260709 12:10:19.280299 18607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.261014 18024 raft_consensus.cc:1240] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:19.283057 19964 raft_consensus.cc:3055] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:19.251137 19942 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.283450 19964 raft_consensus.cc:740] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:19.283923 19942 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:19.284425 19964 consensus_queue.cc:260] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:19.285588 19964 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.251814 19655 raft_consensus.cc:2804] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:19.287559 19655 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.287909 19655 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:19.289963 20019 raft_consensus.cc:3055] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:19.290357 20019 raft_consensus.cc:740] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:19.294270 17914 leader_election.cc:304] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:19.294840 20019 consensus_queue.cc:260] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:19.296026 20019 raft_consensus.cc:3060] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.297451 17914 leader_election.cc:400] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931) with higher term. Message: Invalid argument: T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 2. Current term is 3.
I20260709 12:10:19.297747 17914 leader_election.cc:403] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:10:19.293325 20030 log.cc:927] Time spent T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:10:19.298684 17914 leader_election.cc:304] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:19.293876 19931 raft_consensus.cc:2764] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:10:19.299566 20021 raft_consensus.cc:2749] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:19.300289 20021 raft_consensus.cc:3060] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.302109 17987 leader_election.cc:400] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Vote denied by peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647) with higher term. Message: Invalid argument: T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 3. Current term is 4.
I20260709 12:10:19.302546 17987 leader_election.cc:403] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:19.303088 19826 raft_consensus.cc:2749] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:19.303540 19931 raft_consensus.cc:3060] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:10:19.307636 17912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.308420 19948 consensus_queue.cc:1048] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:19.308607 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:19.309237 18636 raft_consensus.cc:1240] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:19.312427 19652 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:19.312712 19925 consensus_queue.cc:1059] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:19.310175 17914 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:19.333348 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:19.340067 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 91726.9us
I20260709 12:10:19.333673 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:19.360412 18062 leader_election.cc:400] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 election: Vote denied by peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297) with higher term. Message: Invalid argument: T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for earlier term 3. Current term is 4.
I20260709 12:10:19.367419 18062 leader_election.cc:403] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:10:19.360142 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:19.372937 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:19.373853 18024 raft_consensus.cc:2468] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 3.
I20260709 12:10:19.375000 18021 raft_consensus.cc:1275] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:19.346020 20035 raft_consensus.cc:3060] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:19.379491 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 69494.8us
I20260709 12:10:19.343405 20034 raft_consensus.cc:2749] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:19.313789 19942 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:19.356600 19652 raft_consensus.cc:3055] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:19.369685 19826 raft_consensus.cc:2749] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:19.382121 17914 leader_election.cc:304] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:19.382721 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:19.384377 17989 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:19.388211 18021 raft_consensus.cc:2468] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:10:19.403103 18062 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:19.409822 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:19.410462 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:19.411172 18019 raft_consensus.cc:2393] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 7: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:19.411573 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:19.411198 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:19.412168 18018 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:19.412367 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:19.412942 18022 raft_consensus.cc:3060] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.411845 18021 raft_consensus.cc:1275] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:19.412801 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:19.415624 18019 raft_consensus.cc:3060] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.417421 19931 raft_consensus.cc:2749] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647) with higher term. Message: Invalid argument: T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 3. Current term is 4.
I20260709 12:10:19.419521 18018 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
I20260709 12:10:19.422904 20033 raft_consensus.cc:2749] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297) with higher term. Message: Invalid argument: T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for earlier term 3. Current term is 4.
I20260709 12:10:19.425755 18022 raft_consensus.cc:2468] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:10:19.431643 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:19.432265 18016 raft_consensus.cc:3060] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.433673 19962 raft_consensus.cc:2804] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:19.433795 18608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.434248 19962 raft_consensus.cc:697] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:19.437747 18020 raft_consensus.cc:1275] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:19.438050 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:19.380913 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:19.438619 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:19.439222 18020 raft_consensus.cc:2468] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 4.
I20260709 12:10:19.439906 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:19.440542 18022 raft_consensus.cc:2468] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:10:19.440766 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:19.440054 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:19.440794 19962 consensus_queue.cc:237] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:19.441181 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 54122us
I20260709 12:10:19.442581 17987 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:19.439216 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:19.428421 18019 raft_consensus.cc:2468] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 3.
I20260709 12:10:19.384428 20039 consensus_queue.cc:1048] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:10:19.457196 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:19.457810 18018 raft_consensus.cc:2376] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5. Re-sending same reply.
W20260709 12:10:19.458740 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 75201.7us
I20260709 12:10:19.446605 19942 raft_consensus.cc:2749] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:19.412695 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:19.468436 18062 leader_election.cc:304] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:19.469013 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:19.386062 19652 raft_consensus.cc:740] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:19.470582 18020 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 5.
I20260709 12:10:19.472240 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:19.471194 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:19.472865 18019 raft_consensus.cc:2376] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 4. Re-sending same reply.
I20260709 12:10:19.473408 18024 raft_consensus.cc:2376] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5. Re-sending same reply.
I20260709 12:10:19.478688 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:19.479501 18018 raft_consensus.cc:2410] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:19.460974 19954 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.481678 20034 raft_consensus.cc:2804] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:19.468161 19911 raft_consensus.cc:2749] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:19.462337 19948 raft_consensus.cc:2749] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:19.486923 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 104880us
I20260709 12:10:19.487610 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:19.491911 17914 leader_election.cc:304] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:19.471479 20021 raft_consensus.cc:2749] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931) with higher term. Message: Invalid argument: T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 2. Current term is 3.
I20260709 12:10:19.494550 18092 raft_consensus.cc:1275] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:19.498358 19655 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:19.498632 19951 consensus_queue.cc:1048] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:19.500494 19655 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:19.505856 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:19.506745 18023 raft_consensus.cc:2410] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:19.507946 19652 consensus_queue.cc:260] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:19.509370 19652 raft_consensus.cc:3060] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.513162 20034 raft_consensus.cc:697] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 3 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:19.514070 20034 consensus_queue.cc:237] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:19.516280 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:19.516963 18018 raft_consensus.cc:2376] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3. Re-sending same reply.
I20260709 12:10:19.516395 18017 raft_consensus.cc:1275] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:10:19.517736 18017 pending_rounds.cc:85] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb: Aborting all ops after (but not including) 5
I20260709 12:10:19.518023 18017 pending_rounds.cc:107] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:10:19.518311 18017 raft_consensus.cc:2889] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:19.508446 20035 raft_consensus.cc:2749] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:19.520195 18098 raft_consensus.cc:1240] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:19.490010 19954 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:19.522845 19954 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:19.522984 19870 consensus_queue.cc:1059] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:19.523972 19870 raft_consensus.cc:3055] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:19.524314 19870 raft_consensus.cc:740] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:19.525185 19870 consensus_queue.cc:260] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:19.526366 19870 raft_consensus.cc:3060] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:19.527169 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.528661 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:19.529850 18062 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:10:19.557412 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 76676.9us
I20260709 12:10:19.532513 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:19.534294 17914 leader_election.cc:304] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:19.534552 20021 raft_consensus.cc:2749] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:19.537034 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:19.537663 17941 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:19.538815 17945 raft_consensus.cc:1275] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:19.539167 17944 raft_consensus.cc:1240] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:19.540693 17946 raft_consensus.cc:1275] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:19.541230 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:19.541752 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:19.565215 17914 leader_election.cc:304] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:19.565675 18098 raft_consensus.cc:2468] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:10:19.541893 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:19.542148 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
W20260709 12:10:19.542577 20038 log.cc:927] Time spent T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:10:19.542716 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:19.543052 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:19.576371 18020 raft_consensus.cc:2410] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:19.543906 17948 raft_consensus.cc:1275] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:10:19.576855 17948 pending_rounds.cc:85] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1: Aborting all ops after (but not including) 1
I20260709 12:10:19.577163 17948 pending_rounds.cc:107] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:10:19.577457 17948 raft_consensus.cc:2889] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:19.538213 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:19.558979 18019 raft_consensus.cc:2393] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 5: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:19.559587 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:19.558099 18062 leader_election.cc:304] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:19.579463 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:19.582677 17949 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:19.584980 18015 raft_consensus.cc:2393] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 4: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:19.585798 17942 raft_consensus.cc:1240] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:19.578789 20027 raft_consensus.cc:2749] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:19.591029 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:19.595636 17914 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:19.596544 17914 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:19.597223 19902 raft_consensus.cc:2749] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:19.597857 19902 raft_consensus.cc:2749] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:19.597937 17914 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:19.598505 19902 raft_consensus.cc:2749] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:19.599159 19902 raft_consensus.cc:2804] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:19.599480 19902 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:19.599956 19902 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:19.600492 18016 raft_consensus.cc:2468] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 3.
I20260709 12:10:19.563755 20035 raft_consensus.cc:2804] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:19.605369 19655 raft_consensus.cc:2804] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:19.606113 19655 raft_consensus.cc:697] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
W20260709 12:10:19.606784 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.607239 19655 consensus_queue.cc:237] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:19.608696 20027 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:19.609237 19911 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.609210 20027 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:19.609830 19911 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:19.613737 18094 raft_consensus.cc:1275] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:10:19.611199 17914 leader_election.cc:304] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:19.619781 17947 raft_consensus.cc:1275] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:19.629716 18062 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:19.631377 18092 raft_consensus.cc:1275] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:10:19.637951 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 55895.8us
I20260709 12:10:19.640933 18020 raft_consensus.cc:1240] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:19.617215 20035 raft_consensus.cc:697] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:19.648962 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:19.656967 18019 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:19.661336 17913 leader_election.cc:304] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:19.643074 18609 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
W20260709 12:10:19.675346 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 64223.6us
I20260709 12:10:19.680500 17946 raft_consensus.cc:1275] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:19.680433 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:19.681092 19707 consensus_queue.cc:1048] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:19.647126 19964 raft_consensus.cc:2804] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:19.683811 18062 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:19.693753 18608 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:19.683127 19954 raft_consensus.cc:2804] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:19.703505 19954 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:19.703953 19954 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:19.704315 20035 consensus_queue.cc:237] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:19.706910 19911 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:19.712281 19954 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:19.702522 18608 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:19.699177 17988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.691368 19655 raft_consensus.cc:2804] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:19.683001 20027 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:19.672230 19925 consensus_queue.cc:1048] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:10:19.740783 18024 raft_consensus.cc:2468] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 5.
I20260709 12:10:19.743901 18608 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:19.742197 17946 raft_consensus.cc:1275] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:10:19.692363 19964 raft_consensus.cc:697] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:19.692723 19774 raft_consensus.cc:2804] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:19.772017 18019 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
W20260709 12:10:19.790514 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 44761.2us
W20260709 12:10:19.784206 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 151313us
I20260709 12:10:19.740141 19951 raft_consensus.cc:2804] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:19.793902 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 50105.5us
I20260709 12:10:19.744488 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
W20260709 12:10:19.795969 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 139818us
I20260709 12:10:19.740067 20021 raft_consensus.cc:2749] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:19.804757 17944 raft_consensus.cc:3060] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.804966 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:10:19.805460 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 144220us
I20260709 12:10:19.806257 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:19.811295 18062 leader_election.cc:304] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:19.809623 17946 raft_consensus.cc:2468] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:10:19.812404 17913 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:19.783618 17941 raft_consensus.cc:1275] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:19.792915 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:19.739910 19655 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:19.743523 20032 consensus_queue.cc:1048] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 12:10:19.795368 19921 raft_consensus.cc:2749] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:10:19.863330 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 51677us
I20260709 12:10:19.880425 18062 leader_election.cc:400] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 election: Vote denied by peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123) with higher term. Message: Invalid argument: T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for earlier term 3. Current term is 4.
I20260709 12:10:19.889351 18062 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:19.893841 17913 leader_election.cc:304] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:19.890460 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
W20260709 12:10:19.899053 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 181758us
I20260709 12:10:19.899328 17948 raft_consensus.cc:3060] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:19.855110 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:19.843457 20034 raft_consensus.cc:2764] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:10:19.804203 19951 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:19.813760 19774 raft_consensus.cc:697] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:19.913055 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:19.917577 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:19.920080 17947 raft_consensus.cc:2468] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 3.
I20260709 12:10:19.897045 20059 raft_consensus.cc:3060] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:19.887342 20027 raft_consensus.cc:493] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:19.879628 20062 raft_consensus.cc:493] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:19.921831 17913 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:19.900908 19953 raft_consensus.cc:2749] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:19.910362 17944 raft_consensus.cc:2468] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:10:19.843297 19706 consensus_queue.cc:1048] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 12:10:19.919114 19951 raft_consensus.cc:3060] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.880882 19655 raft_consensus.cc:3060] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:19.926115 20021 raft_consensus.cc:2749] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:19.927239 18636 raft_consensus.cc:1275] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:19.960275 17988 leader_election.cc:304] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:19.918905 20019 consensus_queue.cc:1048] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
W20260709 12:10:19.963358 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.940827 20033 raft_consensus.cc:493] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.947791 20037 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:19.947224 20035 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:19.975282 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:19.978919 19803 raft_consensus.cc:493] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.979547 19803 raft_consensus.cc:515] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:19.982057 19803 leader_election.cc:290] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:19.982779 19962 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:19.983423 19962 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:19.985991 19962 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:19.990049 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:19.990856 18098 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:19.930574 20027 raft_consensus.cc:515] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:19.927317 19964 consensus_queue.cc:237] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:20.034636 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 112866us
I20260709 12:10:19.976596 20071 raft_consensus.cc:493] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:19.930976 20062 raft_consensus.cc:515] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:19.963310 19902 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:20.037580 17913 leader_election.cc:304] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:20.050024 18098 raft_consensus.cc:2468] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
I20260709 12:10:20.036841 20063 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.017711 20033 raft_consensus.cc:515] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:20.027529 20022 consensus_queue.cc:1048] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:10:20.036857 19826 raft_consensus.cc:2749] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:20.019729 19774 consensus_queue.cc:237] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:20.068527 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 67248.9us
W20260709 12:10:20.059952 19870 consensus_meta.cc:287] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.502s	user 0.008s	sys 0.002s
I20260709 12:10:20.069599 17913 leader_election.cc:304] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:20.052315 20074 raft_consensus.cc:2749] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:20.080415 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:20.084874 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 124661us
I20260709 12:10:20.085978 17988 leader_election.cc:304] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:20.038000 20067 consensus_queue.cc:1048] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:10:20.015905 20035 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:20.091769 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:20.090296 18062 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:20.096436 18609 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:20.091349 20077 raft_consensus.cc:2749] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:20.097438 19902 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:20.097795 20068 log.cc:927] Time spent T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:10:20.098057 19902 raft_consensus.cc:2804] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:20.098555 19902 raft_consensus.cc:697] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:20.099440 19902 consensus_queue.cc:237] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:20.104804 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:20.107210 18016 raft_consensus.cc:1275] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:20.059523 20063 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:20.108106 20033 leader_election.cc:290] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:20.109516 20063 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:20.110744 20035 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:20.111869 20061 raft_consensus.cc:2749] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:20.089799 20054 log.cc:927] Time spent T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
W20260709 12:10:20.131134 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 326312us
I20260709 12:10:20.088660 20036 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:20.138698 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:20.139290 18021 raft_consensus.cc:2468] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:10:20.136016 18608 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:20.136061 17913 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:20.140300 17948 raft_consensus.cc:2468] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 3.
I20260709 12:10:20.140620 17913 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:20.110224 20063 consensus_queue.cc:1048] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:10:20.087663 20019 consensus_queue.cc:1059] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:10:20.105695 20039 raft_consensus.cc:2804] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:20.118901 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:20.119270 20064 log.cc:927] Time spent T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 12:10:20.143795 18608 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:20.118491 20059 raft_consensus.cc:2749] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:20.118582 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:20.040242 20071 raft_consensus.cc:515] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:20.127879 20062 leader_election.cc:290] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:20.146831 18062 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:20.146785 19826 raft_consensus.cc:2749] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:20.177556 17948 raft_consensus.cc:1275] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:20.177562 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:20.179066 18019 raft_consensus.cc:2368] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 5. Current term is 6.
I20260709 12:10:20.182845 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:20.183138 18608 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:20.183406 17942 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:20.146256 20032 consensus_queue.cc:1048] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:10:20.175643 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:20.194478 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:20.144434 20036 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:20.174276 20067 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:20.198776 17946 raft_consensus.cc:3060] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:20.172482 20082 raft_consensus.cc:2804] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:20.198177 17948 raft_consensus.cc:2468] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:20.172212 20019 consensus_queue.cc:1243] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer c5ffa786c8fb43f7864fa8fbe76534cb log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:10:20.176343 19953 raft_consensus.cc:2804] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:20.173748 20022 consensus_queue.cc:1048] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:10:20.202204 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:20.220763 17949 raft_consensus.cc:2468] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:20.193881 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:20.174675 18016 raft_consensus.cc:2376] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3. Re-sending same reply.
I20260709 12:10:20.215997 20081 raft_consensus.cc:2804] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:20.217103 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:20.180671 20062 raft_consensus.cc:493] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:20.222625 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 75963.3us
I20260709 12:10:20.200248 20027 leader_election.cc:290] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:20.176343 20077 consensus_queue.cc:1048] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:10:20.231572 17946 raft_consensus.cc:2468] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 3.
I20260709 12:10:20.228802 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:20.179939 20060 consensus_queue.cc:1048] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:10:20.219326 19953 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.179927 20061 consensus_queue.cc:1048] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:10:20.230291 20081 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.234836 20070 raft_consensus.cc:2804] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:20.232583 19957 raft_consensus.cc:2804] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:20.263540 19953 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:20.235101 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:20.265445 20072 raft_consensus.cc:2804] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:20.270359 17913 leader_election.cc:400] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 election: Vote denied by peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297) with higher term. Message: Invalid argument: T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 5. Current term is 6.
I20260709 12:10:20.277778 17913 leader_election.cc:403] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:10:20.264463 17914 leader_election.cc:304] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:20.229444 20074 consensus_queue.cc:1048] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:10:20.230832 20039 raft_consensus.cc:697] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:20.267511 20082 raft_consensus.cc:697] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:20.217708 20067 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:20.286696 17913 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:20.269232 20081 raft_consensus.cc:3060] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:20.299227 17914 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:20.236874 20062 raft_consensus.cc:515] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:20.305929 20062 leader_election.cc:290] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:20.284338 20080 raft_consensus.cc:493] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:20.307796 17943 consensus_meta.cc:287] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.684s	user 0.005s	sys 0.005s
I20260709 12:10:20.307485 20080 raft_consensus.cc:515] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:20.308209 17943 raft_consensus.cc:2468] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:20.308063 19928 raft_consensus.cc:493] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.309217 19928 raft_consensus.cc:515] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:20.310070 20080 leader_election.cc:290] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:20.311164 19928 leader_election.cc:290] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:20.298570 19957 raft_consensus.cc:697] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:20.286751 20070 raft_consensus.cc:697] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:20.325627 20070 consensus_queue.cc:237] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:20.323441 20036 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:20.323923 20083 raft_consensus.cc:493] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.327207 20071 leader_election.cc:290] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:20.324043 20039 consensus_queue.cc:237] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:20.285203 18016 raft_consensus.cc:1275] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:20.280221 19826 raft_consensus.cc:2749] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:20.327221 20083 raft_consensus.cc:515] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:20.285817 20072 raft_consensus.cc:697] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
W20260709 12:10:20.345983 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 59385.7us
I20260709 12:10:20.349807 18062 leader_election.cc:304] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:20.280491 20079 consensus_queue.cc:1048] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.155s
W20260709 12:10:20.340600 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 157519us
I20260709 12:10:20.352875 19962 raft_consensus.cc:2804] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:20.353274 19962 raft_consensus.cc:493] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.353210 18608 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:20.353700 19962 raft_consensus.cc:3060] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:20.342609 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 43494.3us
W20260709 12:10:20.357417 20085 log.cc:927] Time spent T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 12:10:20.336097 20069 log.cc:927] Time spent T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 12:10:20.359625 19957 consensus_queue.cc:237] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:20.360253 20083 leader_election.cc:290] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:20.360769 20083 raft_consensus.cc:2804] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:20.361217 20083 raft_consensus.cc:697] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:20.327113 20082 consensus_queue.cc:237] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:20.344269 20088 raft_consensus.cc:493] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.351271 18062 leader_election.cc:304] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:20.373299 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:20.354375 18608 leader_election.cc:304] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:20.375113 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:20.374070 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:20.376927 17942 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
I20260709 12:10:20.367966 20077 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:20.389377 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:20.390009 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:20.344919 20021 raft_consensus.cc:2804] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:20.393814 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:20.362111 20083 consensus_queue.cc:237] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:20.408598 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:20.409204 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:20.405869 20033 consensus_queue.cc:1048] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:10:20.405853 20077 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:20.384322 20088 raft_consensus.cc:515] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:20.394177 20092 raft_consensus.cc:2804] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:20.423698 20088 leader_election.cc:290] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:20.423792 20089 raft_consensus.cc:2749] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297) with higher term. Message: Invalid argument: T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 5. Current term is 6.
W20260709 12:10:20.437065 18023 consensus_meta.cc:287] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.819s	user 0.011s	sys 0.000s
I20260709 12:10:20.443594 19951 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:20.447240 18643 raft_consensus.cc:1240] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:20.419080 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:20.453487 20081 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:20.456246 19953 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:20.430796 20077 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:20.437619 18023 raft_consensus.cc:2468] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 4.
I20260709 12:10:20.425045 20092 raft_consensus.cc:493] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:20.446532 19951 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:20.506343 20081 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:20.496724 18020 raft_consensus.cc:2955] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:20.474340 20092 raft_consensus.cc:3060] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:20.512461 19953 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:20.514197 20037 raft_consensus.cc:2749] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:20.514994 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:20.516007 20067 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:20.517074 20095 log.cc:927] Time spent T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
W20260709 12:10:20.508095 19655 consensus_meta.cc:287] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.548s	user 0.007s	sys 0.003s
I20260709 12:10:20.525501 19655 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:20.527618 19655 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:20.530373 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:20.531251 18635 raft_consensus.cc:2468] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:20.495347 20097 raft_consensus.cc:2749] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:20.546701 19954 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:20.548002 20102 log.cc:927] Time spent T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:10:20.442577 20072 consensus_queue.cc:237] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:20.560248 18608 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:20.554577 20067 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.562098 19962 raft_consensus.cc:515] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:20.571589 19962 leader_election.cc:290] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:20.582618 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:20.584091 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:20.592705 17914 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:20.584897 20070 consensus_queue.cc:1048] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:10:20.609920 20109 raft_consensus.cc:2749] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:20.562794 20097 consensus_queue.cc:1048] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:10:20.612061 18635 raft_consensus.cc:1275] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:20.612812 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:20.613176 20059 raft_consensus.cc:2749] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:20.613364 17948 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:20.580283 20067 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:20.620469 20067 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:20.621598 20078 raft_consensus.cc:2749] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:20.621896 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:20.625324 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:20.626446 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:20.627007 17947 raft_consensus.cc:2468] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:10:20.627779 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:20.633891 18093 raft_consensus.cc:1275] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:10:20.634219 18093 pending_rounds.cc:85] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110: Aborting all ops after (but not including) 1
I20260709 12:10:20.634438 18093 pending_rounds.cc:107] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:10:20.634704 18093 raft_consensus.cc:2889] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:21.434139 17942 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.816s	user 0.019s	sys 0.043s
W20260709 12:10:21.510187 17948 consensus_meta.cc:287] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.896s	user 0.016s	sys 0.033s
I20260709 12:10:20.735056 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:20.229460 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:20.649329 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:20.720218 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:20.862596 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:20.638499 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:21.521347 18640 raft_consensus.cc:2468] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:20.722767 18643 raft_consensus.cc:1240] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 1. Current term is 2. Ops: []
W20260709 12:10:21.510130 17942 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.892s	user 0.020s	sys 0.047s
I20260709 12:10:21.485481 17846 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45912 (request call id 378) took 5437 ms. Trace:
I20260709 12:10:21.510814 17948 raft_consensus.cc:2468] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
I20260709 12:10:21.529325 17945 raft_consensus.cc:1275] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:20.652429 17912 leader_election.cc:304] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:21.524609 17846 rpcz_store.cc:276] 0709 12:10:16.007070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:16.007213 (+   143us) service_pool.cc:224] Handling call
0709 12:10:21.444431 (+5437218us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:19.481063 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:19.518441 (+ 37378us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:19.518475 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:10:19.518495 (+    20us) tablet.cc:662] Decoding operations
0709 12:10:19.519406 (+   911us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:19.519459 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:19.519486 (+    27us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:10:19.520124 (+   638us) tablet.cc:701] Row locks acquired
0709 12:10:19.520142 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:10:19.520278 (+   136us) write_op.cc:270] Start()
0709 12:10:19.520378 (+   100us) write_op.cc:276] Timestamp: P: 1783599019520230 usec, L: 0
0709 12:10:19.520400 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:10:19.545179 (+ 24779us) log.cc:844] Serialized 3238 byte log entry
0709 12:10:19.597220 (+ 52041us) spinlock_profiling.cc:243] Waited 24.1 ms on lock 0x7b5400018454. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9ade28 00007f7f503e8581 00007f7f503e7d58 00007f7f503ec9f1 00007f7f503ec9a9 00007f7f503ec939 00007f7f503ec901 00007f7f503ebb2d 0000000000388634 0000000000388479
0709 12:10:19.877477 (+280257us) op_driver.cc:464] REPLICATION: finished
0709 12:10:20.100347 (+222870us) write_op.cc:301] APPLY: starting
0709 12:10:20.118962 (+ 18615us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:20.119196 (+   234us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:20.119217 (+    21us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:20.120127 (+   910us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:20.120349 (+   222us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:10:20.120403 (+    54us) write_op.cc:312] APPLY: finished
0709 12:10:20.120683 (+   280us) log.cc:844] Serialized 65 byte log entry
0709 12:10:20.120851 (+   168us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:20.120985 (+   134us) write_op.cc:454] Released schema lock
0709 12:10:20.121030 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:20.121395 (+   365us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:20.121426 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":33695,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":195508,"apply.run_cpu_time_us":2555,"apply.run_wall_time_us":29093,"num_ops":8,"prepare.queue_time_us":194590,"prepare.run_cpu_time_us":6667,"prepare.run_wall_time_us":134471,"replication_time_us":293753,"spinlock_wait_cycles":55462656,"thread_start_us":229100,"threads_started":2}]]}
I20260709 12:10:21.530109 17945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 1876) took 1141 ms. Trace:
I20260709 12:10:21.521834 18642 raft_consensus.cc:2468] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:21.629014 18642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60424 (request call id 674) took 1020 ms. Trace:
I20260709 12:10:21.627872 17945 rpcz_store.cc:276] 0709 12:10:20.388958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.528502 (+1139544us) service_pool.cc:224] Handling call
0709 12:10:21.528887 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.529776 (+   889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.530038 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:21.630481 17946 raft_consensus.cc:1275] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:21.632791 17946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 1877) took 1242 ms. Trace:
I20260709 12:10:21.629494 18642 rpcz_store.cc:276] 0709 12:10:20.608169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.633175 (+ 25006us) service_pool.cc:224] Handling call
0709 12:10:21.628945 (+995770us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:21.633169 17946 rpcz_store.cc:276] 0709 12:10:20.391096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.629674 (+1238578us) service_pool.cc:224] Handling call
0709 12:10:21.630074 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.632496 (+  2422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.632730 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:21.635689 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 983254us
I20260709 12:10:21.506757 20027 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:21.642983 17946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50334 (request call id 1844) took 1023 ms. Trace:
I20260709 12:10:20.813501 20094 raft_consensus.cc:493] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:20.720467 20021 raft_consensus.cc:697] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:20.812637 20060 raft_consensus.cc:493] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:20.948743 17941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44668 (request call id 288) took 1033 ms. Trace:
I20260709 12:10:20.943861 20039 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:21.033613 19803 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:21.123976 19962 raft_consensus.cc:493] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.744149 20034 raft_consensus.cc:3055] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:10:20.946226 20051 log.cc:927] Time spent T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 1.151s	user 0.000s	sys 0.004s
I20260709 12:10:20.739244 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:21.670167 17946 rpcz_store.cc:276] 0709 12:10:20.619683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.642090 (+1022407us) service_pool.cc:224] Handling call
0709 12:10:21.642418 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.642665 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:21.642702 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:21.642759 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:21.642801 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.642847 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.642936 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:21.715767 17946 raft_consensus.cc:1275] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:21.716287 17946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 1878) took 1052 ms. Trace:
I20260709 12:10:21.716575 17946 rpcz_store.cc:276] 0709 12:10:20.664224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.715223 (+1050999us) service_pool.cc:224] Handling call
0709 12:10:21.715466 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.716067 (+   601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.716240 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:20.913249 20089 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:20.667567 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:21.626819 20059 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:21.729763 18022 raft_consensus.cc:1275] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:21.686342 19652 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:21.634358 20088 raft_consensus.cc:493] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.629814 20090 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:21.639995 20082 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:20.645236 20092 raft_consensus.cc:515] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:21.648310 20074 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.711505 20034 raft_consensus.cc:740] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:21.681927 20094 raft_consensus.cc:515] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:21.720896 19931 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.720500 18024 raft_consensus.cc:1275] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:10:21.721019 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 203117us
I20260709 12:10:21.721482 18021 raft_consensus.cc:1275] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:21.084692 20052 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.681670 19655 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:21.721259 20086 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:21.679745 20027 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:21.730113 20097 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.712299 19803 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:21.754995 20120 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:21.705020 20039 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:21.638808 17943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50334 (request call id 1838) took 1238 ms. Trace:
I20260709 12:10:21.731442 20089 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:10:21.711081 20060 raft_consensus.cc:515] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:21.766001 18015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45472 (request call id 1763) took 1098 ms. Trace:
I20260709 12:10:21.758910 20121 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:21.792096 20067 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.792552 20065 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.770183 20080 raft_consensus.cc:493] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:21.796082 20027 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:21.797794 20060 leader_election.cc:290] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:21.749392 20088 raft_consensus.cc:515] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:21.713502 19962 raft_consensus.cc:515] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:21.743450 20059 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:21.752190 20090 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:21.810214 20027 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:21.758371 19931 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:21.769317 18635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60424 (request call id 677) took 1043 ms. Trace:
I20260709 12:10:21.749805 19652 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:21.772676 20097 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:21.756173 20074 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:21.752024 20082 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:21.685972 17941 rpcz_store.cc:276] 0709 12:10:19.915032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.915175 (+   143us) service_pool.cc:224] Handling call
0709 12:10:19.915466 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:20.042093 (+126627us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:20.043368 (+  1275us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:20.057006 (+ 13638us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:20.059773 (+  2767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:20.948468 (+888695us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54001fd454. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:20.948537 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:20.948684 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":283035008}
I20260709 12:10:21.768406 19655 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:21.766784 20052 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:21.768648 20086 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:21.831316 17949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 1874) took 1631 ms. Trace:
I20260709 12:10:21.799873 18015 rpcz_store.cc:276] 0709 12:10:20.667170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.667305 (+   135us) service_pool.cc:224] Handling call
0709 12:10:21.758695 (+1091390us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:21.833879 17949 rpcz_store.cc:276] 0709 12:10:20.196215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.228563 (+ 32348us) service_pool.cc:224] Handling call
0709 12:10:21.825389 (+1596826us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54003e6054. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:21.827625 (+  2236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3159050496}
I20260709 12:10:21.764329 20021 consensus_queue.cc:237] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:21.775163 20120 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:21.811579 20067 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:21.836315 18061 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:21.809340 20121 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:21.810956 20080 raft_consensus.cc:515] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:21.822098 20126 raft_consensus.cc:493] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:21.812474 20065 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:21.826822 20122 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:21.833778 20077 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:21.818166 18635 rpcz_store.cc:276] 0709 12:10:20.724512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.727175 (+  2663us) service_pool.cc:224] Handling call
0709 12:10:21.767834 (+1040659us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:21.805997 20034 consensus_queue.cc:260] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:21.826664 20027 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:21.872140 19942 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.872640 19942 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:21.856164 20092 leader_election.cc:290] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:21.862399 20124 raft_consensus.cc:493] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
W20260709 12:10:21.877521 20114 log.cc:927] Time spent T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:10:21.888289 20097 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:21.889407 19962 leader_election.cc:290] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:21.866192 18017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53022 (request call id 334) took 1469 ms. Trace:
I20260709 12:10:21.872641 20027 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:21.865195 20126 raft_consensus.cc:515] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:21.892588 20094 leader_election.cc:290] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:21.877791 20077 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:21.914278 20027 raft_consensus.cc:2749] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:21.919890 20126 leader_election.cc:290] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:21.921586 20089 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:21.902498 19962 raft_consensus.cc:2749] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:21.879037 20122 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:21.922919 19942 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:21.896279 20124 raft_consensus.cc:515] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:21.973516 20080 leader_election.cc:290] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:21.973752 20065 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:21.967792 20127 log.cc:927] Time spent T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:10:21.983652 17947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50334 (request call id 1839) took 1595 ms. Trace:
I20260709 12:10:21.983817 20052 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:21.984686 20067 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:21.984059 17947 rpcz_store.cc:276] 0709 12:10:20.388357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.628689 (+240332us) service_pool.cc:224] Handling call
0709 12:10:20.628938 (+   249us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:20.662744 (+ 33806us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:20.662789 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:21.626665 (+963876us) log.cc:844] Serialized 26 byte log entry
0709 12:10:21.804976 (+178311us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:21.805025 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.805111 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:21.983419 (+178308us) raft_consensus.cc:1685] finished
0709 12:10:21.983442 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.983587 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4147,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":97,"thread_start_us":109339,"threads_started":1,"wal-append.queue_time_us":188098}
I20260709 12:10:21.976163 20089 raft_consensus.cc:493] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:21.985750 20089 raft_consensus.cc:515] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:21.978477 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 341850us
I20260709 12:10:21.988559 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:21.992866 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:21.993798 18021 raft_consensus.cc:3060] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:21.968147 20039 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:21.992940 17945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50334 (request call id 1845) took 1373 ms. Trace:
I20260709 12:10:21.987528 17912 leader_election.cc:304] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:21.999182 17945 rpcz_store.cc:276] 0709 12:10:20.619938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.648279 (+1028341us) service_pool.cc:224] Handling call
0709 12:10:21.648584 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:21.825302 (+176718us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:21.825345 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:21.825405 (+    60us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:21.825448 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.992731 (+167283us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b54000a1254. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:21.992771 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.992888 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":403347712}
I20260709 12:10:21.974356 20088 leader_election.cc:290] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:21.971439 20059 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:22.005254 20067 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.005885 20129 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:22.006577 20065 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:22.007296 20080 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:22.008066 19942 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:21.995599 20052 raft_consensus.cc:493] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:21.973538 20082 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:22.033463 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:22.034073 18093 raft_consensus.cc:2468] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:10:21.995715 19931 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:22.019243 20131 raft_consensus.cc:493] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.078552 18021 raft_consensus.cc:2468] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
I20260709 12:10:22.024628 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:22.002141 20092 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:22.023886 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:22.050758 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:22.053095 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:22.105358 17947 raft_consensus.cc:3060] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.105708 18093 raft_consensus.cc:2410] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:22.105824 18092 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 5.
I20260709 12:10:22.004040 19925 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.106832 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:22.106709 19925 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:22.107543 18015 raft_consensus.cc:2468] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3.
I20260709 12:10:22.108497 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:22.109061 18020 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 5.
I20260709 12:10:22.109479 19925 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:22.093520 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 106085us
I20260709 12:10:22.109833 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:22.110952 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:22.112462 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:22.009404 20130 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.114568 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:22.018112 19962 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:22.010432 19655 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:22.018347 20088 raft_consensus.cc:493] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:22.009827 20086 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:22.114614 20115 log.cc:927] Time spent T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:10:22.115159 17947 raft_consensus.cc:2468] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
I20260709 12:10:22.144824 20136 consensus_queue.cc:1048] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:10:22.153828 18091 raft_consensus.cc:2468] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3.
I20260709 12:10:22.035034 20129 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:21.786952 17943 rpcz_store.cc:276] 0709 12:10:20.388014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.389694 (+  1680us) service_pool.cc:224] Handling call
0709 12:10:20.418773 (+ 29079us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:20.622130 (+203357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:20.622170 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:20.622659 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 12:10:20.921412 (+298753us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:20.922136 (+   724us) log.cc:844] Serialized 14 byte log entry
0709 12:10:21.503747 (+581611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.503836 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:21.507168 (+  3332us) raft_consensus.cc:1685] finished
0709 12:10:21.519860 (+ 12692us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.626439 (+106579us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":186236,"prepare.queue_time_us":717,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":195907,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":54976,"thread_start_us":287988,"threads_started":1,"wal-append.queue_time_us":881418}
I20260709 12:10:22.161612 20142 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.163836 19962 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:22.165977 20129 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:22.027930 20039 raft_consensus.cc:493] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:22.165905 20142 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:22.166685 20039 raft_consensus.cc:515] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:22.167645 20132 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.168032 20142 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:22.168787 20039 leader_election.cc:290] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:22.168293 20132 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:22.169335 20039 consensus_queue.cc:1048] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:22.104137 20052 raft_consensus.cc:515] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:21.900602 18017 rpcz_store.cc:276] 0709 12:10:20.397141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.400458 (+  3317us) service_pool.cc:224] Handling call
0709 12:10:20.641139 (+240681us) spinlock_profiling.cc:243] Waited 4.8 ms on lock 0x7b5800055898. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4988db71 00007f7f4988da22 00007f7f527a68d9 00007f7f51900ee0 00007f7f519ca0ab 00007f7f519ca131 00007f7f5198bfc0 00007f7f51976929 00007f7f519763d2 00007f7f4aeedbd4
0709 12:10:20.641345 (+   206us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:20.658769 (+ 17424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:20.658816 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:20.659367 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 12:10:21.503527 (+844160us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:21.717830 (+214303us) log.cc:844] Serialized 14 byte log entry
0709 12:10:21.758536 (+ 40706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:21.766872 (+  8336us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:21.837391 (+ 70519us) raft_consensus.cc:1685] finished
0709 12:10:21.865962 (+ 28571us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:21.866128 (+   166us) inbound_call.cc:177] Queueing success response
0709 12:10:21.871927 (+  5799us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b18003d6c00. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f498c5522 00007f7f498c77c1 00007f7f498c7779 00007f7f498c7709 00007f7f498c76d1 00007f7f498c69cd 0000000000388634 0000000000388479 00007f7f498a883a
0709 12:10:21.886965 (+ 15038us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b18003d6c00. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f498c53f3 00007f7f498c77c1 00007f7f498c7779 00007f7f498c7709 00007f7f498c76d1 00007f7f498c69cd 0000000000388634 0000000000388479 00007f7f498a883a
Metrics: {"mutex_wait_us":40339,"prepare.queue_time_us":254663,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":48845,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":9396,"spinlock_wait_cycles":25374336,"thread_start_us":459274,"threads_started":2,"wal-append.queue_time_us":1096887}
W20260709 12:10:22.104773 20114 log.cc:927] Time spent T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:10:22.035969 20080 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:22.029570 20067 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:22.157348 20130 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:22.035351 20065 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:22.091531 20094 raft_consensus.cc:493] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:22.092722 20138 raft_consensus.cc:493] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:22.034403 20128 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:22.034991 20126 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:22.025629 20121 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:22.017401 20134 raft_consensus.cc:493] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:22.091945 19942 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:22.164479 20088 raft_consensus.cc:515] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:22.142795 20092 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:22.179988 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:22.182440 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:22.184082 18643 raft_consensus.cc:1275] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:22.175570 20137 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:22.171627 19655 consensus_queue.cc:1048] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:10:22.172235 20086 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:22.169775 20122 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:22.112277 20131 raft_consensus.cc:515] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:22.194624 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:22.194877 20089 leader_election.cc:290] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:22.195511 20089 raft_consensus.cc:2749] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:22.196065 19942 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:22.196130 20089 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:22.196790 20089 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:22.235936 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 130075us
W20260709 12:10:22.239291 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 215470us
I20260709 12:10:22.248494 19931 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:22.249210 19931 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:22.251888 19931 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:22.264457 18092 raft_consensus.cc:1240] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:22.268695 20142 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.269256 20142 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:22.272378 17914 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:22.273087 17942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50334 (request call id 1837) took 1886 ms. Trace:
I20260709 12:10:22.184437 20094 raft_consensus.cc:515] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:22.202618 20121 raft_consensus.cc:493] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
W20260709 12:10:22.284600 18063 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.008s	sys 0.006s
W20260709 12:10:22.287065 18063 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.008s	sys 0.006s
I20260709 12:10:22.189539 20126 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:22.264356 20124 leader_election.cc:290] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:22.265681 20136 raft_consensus.cc:493] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:22.273737 20021 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.273489 17942 rpcz_store.cc:276] 0709 12:10:20.386868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.387003 (+   135us) service_pool.cc:224] Handling call
0709 12:10:20.387390 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:20.617345 (+229955us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:20.617372 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:20.617818 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 12:10:21.523720 (+905902us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:21.996418 (+472698us) log.cc:844] Serialized 14 byte log entry
0709 12:10:22.272795 (+276377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.272867 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:22.272913 (+    46us) raft_consensus.cc:1685] finished
0709 12:10:22.272924 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:22.273032 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":338814,"prepare.queue_time_us":402259,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":24,"raft.queue_time_us":328911,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":9424,"thread_start_us":1505585,"threads_started":3,"wal-append.queue_time_us":1155727}
W20260709 12:10:22.300480 18608 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.006s	sys 0.025s
I20260709 12:10:22.202109 20086 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:22.191917 20134 raft_consensus.cc:515] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:22.186189 20138 raft_consensus.cc:515] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:22.306792 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:22.304013 18608 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.006s	sys 0.025s
I20260709 12:10:22.190807 20128 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:22.199579 20137 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:22.298985 20142 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:22.316267 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 555650us
I20260709 12:10:22.314545 18098 raft_consensus.cc:1240] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:22.373255 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 187556us
I20260709 12:10:22.294661 19931 consensus_queue.cc:1048] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:10:22.387187 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:22.373550 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 272927us
I20260709 12:10:22.388321 18094 raft_consensus.cc:2410] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:22.315502 18093 raft_consensus.cc:2468] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:22.409564 17914 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:22.392544 17940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44668 (request call id 282) took 2672 ms. Trace:
I20260709 12:10:22.363786 19655 raft_consensus.cc:493] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:22.303836 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:22.422612 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:22.307430 20124 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:22.424129 18097 raft_consensus.cc:1275] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:22.306967 20132 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:22.385526 19962 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:22.294613 20121 raft_consensus.cc:515] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:22.322388 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
W20260709 12:10:22.418959 20060 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.009s	sys 0.006s
I20260709 12:10:22.319474 20152 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:22.383898 20150 raft_consensus.cc:2804] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:22.418041 20142 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
W20260709 12:10:22.433992 20139 log.cc:927] Time spent T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 12:10:22.434240 20077 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:22.435262 20160 log.cc:927] Time spent T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:10:22.439917 20128 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:22.412609 17940 rpcz_store.cc:276] 0709 12:10:19.680349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:19.681029 (+   680us) service_pool.cc:224] Handling call
0709 12:10:19.681347 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:20.572655 (+891308us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b18004127e0. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f4c55a4bc 00007f7f498a848b 00007f7f527029a9 00007f7f498c469b 00007f7f498c293f 00007f7f498c2455 00007f7f4c9aa060 00007f7f4c9aabfb 00007f7f4c9b564b
0709 12:10:20.572784 (+   129us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:20.572808 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:20.573283 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 12:10:21.503009 (+929726us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:21.996582 (+493573us) log.cc:844] Serialized 14 byte log entry
0709 12:10:22.319051 (+322469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.319670 (+   619us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:22.319799 (+   129us) raft_consensus.cc:1685] finished
0709 12:10:22.351592 (+ 31793us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:22.352515 (+   923us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26272,"prepare.queue_time_us":487380,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":181921,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":24498,"spinlock_wait_cycles":6309120,"thread_start_us":965105,"threads_started":4,"wal-append.queue_time_us":1156477}
I20260709 12:10:22.319200 20144 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:22.384171 20141 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:22.411875 20067 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:22.314050 20157 raft_consensus.cc:493] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:22.306205 20021 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:22.353096 20154 consensus_queue.cc:1048] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.132s
I20260709 12:10:22.319489 20136 raft_consensus.cc:515] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:22.421821 19655 raft_consensus.cc:515] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:22.497202 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:22.442342 17944 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50334 (request call id 1846) took 1801 ms (client timeout 2116 ms). Trace:
I20260709 12:10:22.529364 18021 raft_consensus.cc:1275] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:10:22.572146 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 185990us
W20260709 12:10:22.612668 17944 rpcz_store.cc:269] 0709 12:10:20.640979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:20.649077 (+  8098us) service_pool.cc:224] Handling call
0709 12:10:22.442172 (+1793095us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b54002afb54. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:22.442287 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1655419776}
I20260709 12:10:22.617676 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:22.617847 18608 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:22.618669 18094 raft_consensus.cc:2393] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 4: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:22.610743 20094 leader_election.cc:290] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:22.502450 20092 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:22.604103 20156 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:22.552030 20060 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.013s	sys 0.010s
I20260709 12:10:22.508416 20161 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.510320 20088 leader_election.cc:290] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:22.492762 20080 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:22.532145 20089 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:22.480115 19962 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.648648 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:22.648748 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:22.508795 17842 catalog_manager.cc:5697] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 2 to 3, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 3 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:22.649313 18022 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:10:22.649864 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:22.650764 20059 raft_consensus.cc:493] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:22.650110 17842 catalog_manager.cc:5697] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 3 to 4, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 4 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:22.614630 20128 raft_consensus.cc:493] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.651266 20059 raft_consensus.cc:515] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:22.648660 19962 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:22.651890 20128 raft_consensus.cc:515] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:22.653285 20059 leader_election.cc:290] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:22.653338 19962 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:22.653891 20128 leader_election.cc:290] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:22.509927 20126 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:22.653596 17842 catalog_manager.cc:5697] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:22.504134 20137 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:22.498878 20158 raft_consensus.cc:2804] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:22.654372 20074 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:22.441190 20153 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:22.551860 20150 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:22.612004 20121 leader_election.cc:290] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:22.527487 20131 leader_election.cc:290] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:22.609328 20141 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:22.641129 20154 consensus_queue.cc:1048] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:22.636279 20156 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:22.642998 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:22.642998 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:22.617156 20142 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:22.637151 18608 leader_election.cc:304] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:22.643694 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:22.718739 18018 raft_consensus.cc:2468] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:22.520916 20134 leader_election.cc:290] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:22.645557 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:22.610430 19803 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:22.607900 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:22.645217 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:22.722632 18019 raft_consensus.cc:2468] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:10:22.650936 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:22.431330 20052 leader_election.cc:290] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:22.650410 18022 raft_consensus.cc:1275] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:22.657466 18062 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:22.527351 20130 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:22.609544 20157 raft_consensus.cc:515] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:22.650482 18015 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:10:22.669274 20174 raft_consensus.cc:493] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.669708 20059 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:22.669822 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:22.611081 20136 leader_election.cc:290] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:22.741138 20146 raft_consensus.cc:2749] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.636885 20159 raft_consensus.cc:2804] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:22.479422 20124 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:22.676465 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 62720.3us
I20260709 12:10:22.637681 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:22.617290 20152 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:22.639149 20161 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:22.731184 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:22.677933 20153 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:22.811340 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:22.762048 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 104690us
I20260709 12:10:22.670472 20158 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:22.679422 20086 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:22.772873 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:22.799093 17948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50334 (request call id 1840) took 2410 ms. Trace:
I20260709 12:10:22.795419 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:22.798209 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:22.770789 20082 raft_consensus.cc:493] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.769158 20130 raft_consensus.cc:493] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:22.774410 18091 raft_consensus.cc:2393] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 5: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:22.807405 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:22.807691 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:22.808666 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:22.803467 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 166367us
I20260709 12:10:22.798710 18020 raft_consensus.cc:2468] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:22.773242 20138 leader_election.cc:290] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:22.810396 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:22.609444 20144 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:22.768561 20052 raft_consensus.cc:2749] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:22.820679 19652 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:22.820815 18015 raft_consensus.cc:2468] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:22.821561 20142 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:22.821677 20082 raft_consensus.cc:515] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:22.822182 20176 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:22.822880 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:22.772639 20159 raft_consensus.cc:697] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:22.772751 20132 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.816073 17948 rpcz_store.cc:276] 0709 12:10:20.388662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:21.537669 (+1149007us) service_pool.cc:224] Handling call
0709 12:10:21.538080 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:21.813843 (+275763us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:21.813870 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:21.814275 (+   405us) log.cc:844] Serialized 26 byte log entry
0709 12:10:22.005535 (+191260us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:22.027974 (+ 22439us) log.cc:844] Serialized 14 byte log entry
0709 12:10:22.092027 (+ 64053us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:22.640199 (+548172us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b18001e5020. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f498c5522 00007f7f498c77c1 00007f7f498c7779 00007f7f498c7709 00007f7f498c76d1 00007f7f498c69cd 0000000000388634 0000000000388479 00007f7f498a883a
0709 12:10:22.648633 (+  8434us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b540031b354. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:22.648685 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:22.763128 (+114443us) raft_consensus.cc:1685] finished
0709 12:10:22.763148 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:22.799036 (+ 35888us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66954,"prepare.queue_time_us":28425,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":256010,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":3648,"spinlock_wait_cycles":636144128,"thread_start_us":186856,"threads_started":1,"wal-append.queue_time_us":360014}
I20260709 12:10:22.676707 20150 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:22.823977 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:22.770153 18016 raft_consensus.cc:2468] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:22.817319 18018 raft_consensus.cc:2468] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
W20260709 12:10:22.824821 17989 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.98.195:41931 timed out after 1.526s (SENT) [suppressed 22 similar messages]
I20260709 12:10:22.819005 18608 leader_election.cc:304] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:22.832685 18608 leader_election.cc:304] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:22.813179 20090 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:22.770347 18023 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:22.822748 20176 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:22.825523 20130 raft_consensus.cc:515] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:22.771953 20174 raft_consensus.cc:515] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:22.814107 20027 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.832204 20132 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:22.843262 20027 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:22.837666 19928 raft_consensus.cc:2804] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:22.845197 20027 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:22.815845 20158 raft_consensus.cc:3060] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.845513 19928 raft_consensus.cc:493] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.836946 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:22.838022 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:22.831708 20157 leader_election.cc:290] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:22.825680 20089 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:22.845957 19928 raft_consensus.cc:3060] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.811049 20059 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:22.840421 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:22.842708 19652 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.856211 19652 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:22.846165 18091 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 5.
I20260709 12:10:22.838595 18608 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:22.836236 20072 raft_consensus.cc:2749] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:22.829654 18089 raft_consensus.cc:2468] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 3.
I20260709 12:10:22.846446 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:22.827099 20181 raft_consensus.cc:493] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:22.840988 19655 leader_election.cc:290] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:22.854465 20089 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:22.859290 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:22.865037 18091 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 5.
I20260709 12:10:22.847193 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:22.840773 20138 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.864451 17989 leader_election.cc:304] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:22.867486 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:22.873610 18020 raft_consensus.cc:2468] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:10:22.874349 17949 raft_consensus.cc:1275] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:22.874395 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:22.875517 17945 raft_consensus.cc:1275] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:22.876025 17946 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "158a286025af4eddba6fb641c128cd25"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:10:22.880851 18017 raft_consensus.cc:1275] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:10:22.881667 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:22.882256 17942 raft_consensus.cc:2468] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:22.883031 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:22.883756 18089 raft_consensus.cc:2468] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:22.870522 19652 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:22.884604 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:22.883052 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:22.885716 18018 raft_consensus.cc:1275] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:22.883137 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:22.887377 17942 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 5.
I20260709 12:10:22.885767 18021 raft_consensus.cc:2468] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:10:22.888375 20134 raft_consensus.cc:2804] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:22.888793 20134 raft_consensus.cc:493] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.889012 20144 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:22.889148 20134 raft_consensus.cc:3060] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:22.889643 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:22.890203 17944 raft_consensus.cc:2468] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:22.891161 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:22.892112 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:22.892602 17944 raft_consensus.cc:2468] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:22.893311 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:22.893795 17944 raft_consensus.cc:2468] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:22.894771 20167 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:22.894550 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:22.895645 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:22.850751 20120 leader_election.cc:290] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:22.852344 20183 raft_consensus.cc:493] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:22.902225 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:22.860302 20156 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:22.898519 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:22.897724 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:22.863853 20032 raft_consensus.cc:2749] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:22.905341 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:22.907510 17989 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:22.859182 20086 consensus_queue.cc:1059] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:10:22.911856 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:22.914222 17945 raft_consensus.cc:2468] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:22.876914 20154 raft_consensus.cc:493] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
W20260709 12:10:22.913341 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 76063.4us
I20260709 12:10:22.912621 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:22.923134 17944 raft_consensus.cc:2468] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:22.921799 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:22.885334 20082 leader_election.cc:290] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:22.924358 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:22.924450 17989 leader_election.cc:304] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:22.928439 20185 consensus_queue.cc:1048] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:22.877501 20074 consensus_queue.cc:1059] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:10:22.931273 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:22.895268 20167 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:22.885110 20138 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:22.933946 20153 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:22.934937 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:22.941751 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:22.947356 18095 raft_consensus.cc:2468] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
W20260709 12:10:22.949484 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 53652us
I20260709 12:10:22.936827 20131 raft_consensus.cc:3055] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:22.950394 20131 raft_consensus.cc:740] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:22.951213 20131 consensus_queue.cc:260] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:22.952085 20131 raft_consensus.cc:3060] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:22.906860 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:22.900202 20159 consensus_queue.cc:237] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:22.961725 20034 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:22.941815 20080 raft_consensus.cc:2804] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:22.970768 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 47489us
I20260709 12:10:22.871074 20181 raft_consensus.cc:515] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:22.944032 20088 raft_consensus.cc:2804] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:22.959610 18062 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:22.972100 17944 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
I20260709 12:10:22.975441 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:22.955603 17943 raft_consensus.cc:1275] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:22.990813 20065 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:22.969393 20021 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:22.992652 17946 raft_consensus.cc:606] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:22.994743 17946 raft_consensus.cc:614] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:22.986515 18062 leader_election.cc:304] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:22.995754 18062 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:22.993626 20052 consensus_queue.cc:1048] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:10:23.002144 19803 raft_consensus.cc:2804] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:23.002532 19803 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:23.002921 19803 raft_consensus.cc:3060] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:23.003244 20180 log.cc:927] Time spent T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:10:23.003719 20136 raft_consensus.cc:2804] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:23.004120 20136 raft_consensus.cc:493] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:23.004451 20136 raft_consensus.cc:3060] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.007189 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:23.008414 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:22.977154 20088 raft_consensus.cc:493] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:22.930354 20154 raft_consensus.cc:515] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:22.988420 20144 raft_consensus.cc:2749] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:22.965067 20153 consensus_queue.cc:1059] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:10:23.012638 18609 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:22.973598 18015 raft_consensus.cc:2468] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:10:23.016060 20174 leader_election.cc:290] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:22.991842 20124 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:23.019129 18609 leader_election.cc:304] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:23.021348 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:23.023417 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:23.013044 20088 raft_consensus.cc:3060] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.035884 20077 raft_consensus.cc:3055] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:23.036284 20077 raft_consensus.cc:740] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:23.037096 20077 consensus_queue.cc:260] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:23.038203 20077 raft_consensus.cc:3060] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.037971 19928 raft_consensus.cc:515] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:23.020571 18062 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:23.031165 20176 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:22.997162 20082 consensus_queue.cc:1048] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:10:23.017056 20167 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:23.039280 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:23.054052 18091 raft_consensus.cc:2393] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 5: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:23.010197 20080 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:23.039588 20161 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:23.040818 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:23.042999 17989 leader_election.cc:304] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:22.907972 20183 raft_consensus.cc:515] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:23.021246 19655 consensus_queue.cc:1048] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
W20260709 12:10:23.070403 17988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.044708 20059 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:23.108467 18062 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:23.045035 20157 raft_consensus.cc:2749] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:23.112986 18062 leader_election.cc:304] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:23.117467 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:23.117766 18098 raft_consensus.cc:1275] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:23.121174 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:23.122023 18022 raft_consensus.cc:2468] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:10:23.119378 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:23.120045 20132 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:23.123471 17947 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:10:23.051047 20120 raft_consensus.cc:2804] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:23.024257 20159 raft_consensus.cc:2804] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:23.115599 18062 leader_election.cc:304] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:23.108094 20080 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:23.088119 20152 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:23.111241 20065 raft_consensus.cc:2804] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:23.124116 20121 raft_consensus.cc:2804] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:23.161787 18093 raft_consensus.cc:2410] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:10:23.167861 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:23.173874 20183 leader_election.cc:290] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:23.187947 19928 leader_election.cc:290] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:23.128504 20126 raft_consensus.cc:2804] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:23.091152 20089 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:23.192443 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 219277us
I20260709 12:10:23.130609 20120 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:23.143291 20159 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:23.198308 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 223650us
I20260709 12:10:23.178084 20088 raft_consensus.cc:515] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:23.262893 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 147355us
I20260709 12:10:23.261400 19925 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:23.155421 20134 raft_consensus.cc:515] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:23.266520 20065 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:23.182564 19803 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:23.266083 20034 raft_consensus.cc:2804] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:23.268656 20121 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:23.264000 20187 consensus_queue.cc:1048] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.310s
I20260709 12:10:23.278455 20126 raft_consensus.cc:493] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:23.332140 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:23.461622 17987 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.000s	sys 0.010s
I20260709 12:10:23.656014 20126 raft_consensus.cc:3060] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.725781 20134 leader_election.cc:290] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:23.287699 20120 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:23.408093 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:23.582557 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:23.582490 17913 leader_election.cc:304] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
W20260709 12:10:23.522746 20136 consensus_meta.cc:287] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.518s	user 0.006s	sys 0.005s
W20260709 12:10:23.581374 20150 consensus_meta.cc:287] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.746s	user 0.008s	sys 0.002s
I20260709 12:10:23.298305 20159 raft_consensus.cc:3060] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.724083 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:10:23.464808 20175 log.cc:927] Time spent T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:10:23.736048 18640 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 4.
W20260709 12:10:23.579361 20131 consensus_meta.cc:287] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.627s	user 0.008s	sys 0.001s
W20260709 12:10:23.736560 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 154144us
W20260709 12:10:23.724870 17987 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.008s	sys 0.012s
I20260709 12:10:23.330569 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:23.461871 20027 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.002s	sys 0.010s
I20260709 12:10:23.444618 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:23.723750 19655 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.336339 19925 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:23.753726 19925 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:23.749229 20027 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.847s	user 0.010s	sys 0.012s
I20260709 12:10:23.755368 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:23.740096 17949 raft_consensus.cc:2468] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:23.336936 20065 raft_consensus.cc:3060] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.626544 20138 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:23.330479 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:23.744675 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 910283us
I20260709 12:10:23.741806 20183 raft_consensus.cc:2804] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:23.744854 17913 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:23.780485 17913 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:23.781487 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:23.651278 20154 leader_election.cc:290] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:23.580724 20088 leader_election.cc:290] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:23.636222 20181 leader_election.cc:290] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:23.657994 20034 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:23.723429 20121 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.698851 20153 raft_consensus.cc:3055] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:10:23.356827 20158 consensus_meta.cc:287] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.511s	user 0.009s	sys 0.001s
I20260709 12:10:23.337080 20192 consensus_queue.cc:1048] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.425s
I20260709 12:10:23.785068 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:23.746464 20137 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:23.787086 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:23.801345 18020 raft_consensus.cc:2468] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:10:23.791640 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:23.798568 18024 raft_consensus.cc:1275] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:23.798914 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:23.747092 20150 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:23.784199 20167 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:23.809126 17949 raft_consensus.cc:1275] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:10:23.779301 20183 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:23.780992 20141 leader_election.cc:290] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:23.786530 20021 raft_consensus.cc:2804] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:23.783821 19925 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:23.788004 20034 raft_consensus.cc:3060] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.788735 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:23.790144 20138 raft_consensus.cc:2749] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:23.776381 19655 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:23.790493 20153 raft_consensus.cc:740] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:23.745885 20136 raft_consensus.cc:515] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:23.818490 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:23.840583 17941 raft_consensus.cc:1240] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:23.840711 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:23.843044 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:23.843818 17945 raft_consensus.cc:3060] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.818938 19925 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:23.847568 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:23.847796 19925 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:23.813984 20021 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:23.848345 17946 raft_consensus.cc:2468] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:23.848599 20021 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:23.849507 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:23.850252 17948 raft_consensus.cc:2468] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:23.852216 17943 raft_consensus.cc:1275] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:23.814019 20183 raft_consensus.cc:3060] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.854605 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:23.857156 20134 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.857465 17940 raft_consensus.cc:2468] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:10:23.857725 20134 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:23.855093 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:23.859954 20134 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:23.859499 20153 consensus_queue.cc:260] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:23.856073 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:23.863193 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:10:23.860596 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 558894us
I20260709 12:10:23.870555 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:23.871385 17949 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:23.799538 20158 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:23.838142 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:23.808418 20137 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:23.891209 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:23.891448 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:23.890447 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:23.891896 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:23.892118 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:23.905311 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:23.892303 19803 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:23.894435 17947 raft_consensus.cc:2393] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 4: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:23.806303 20060 consensus_queue.cc:1059] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
W20260709 12:10:23.894520 20077 consensus_meta.cc:287] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.851s	user 0.009s	sys 0.000s
I20260709 12:10:23.894773 20158 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:23.895635 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:23.911671 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:23.897500 20144 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:23.899305 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:23.900518 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:23.900744 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:23.904517 20067 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.009s	sys 0.018s
I20260709 12:10:23.918476 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:23.918779 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:23.919819 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:23.903834 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:23.904136 17945 raft_consensus.cc:2468] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:10:23.909113 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:23.909534 18096 raft_consensus.cc:2393] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 5: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:23.870062 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:23.915488 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:23.815945 20167 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:23.916633 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:23.905222 20156 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.790s	user 0.022s	sys 0.050s
I20260709 12:10:23.917866 17949 raft_consensus.cc:2468] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
W20260709 12:10:23.929349 20156 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.023s	sys 0.050s
I20260709 12:10:23.923714 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:23.925233 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:23.928190 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:23.932242 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:23.933442 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:23.933910 18090 raft_consensus.cc:1240] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:23.932246 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:23.936651 18017 raft_consensus.cc:1275] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:23.936589 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:23.937283 19655 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:23.937394 18635 raft_consensus.cc:2468] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:23.938468 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:23.939155 20195 log.cc:927] Time spent T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:10:23.939611 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:23.941210 20190 log.cc:927] Time spent T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.684s	user 0.001s	sys 0.013s
I20260709 12:10:23.941075 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:23.945052 20183 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:23.946943 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:23.947325 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:23.947724 18021 raft_consensus.cc:2410] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:23.947950 18019 raft_consensus.cc:2468] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 5.
I20260709 12:10:23.948212 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:23.948616 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:23.948832 18022 raft_consensus.cc:2468] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 4.
I20260709 12:10:23.949304 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:23.929028 20130 leader_election.cc:290] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:23.949684 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:23.928905 19803 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:23.950309 18020 raft_consensus.cc:2468] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3.
I20260709 12:10:23.950409 19803 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:23.952561 20136 leader_election.cc:290] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:23.952668 20034 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:23.922441 20067 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.009s	sys 0.018s
I20260709 12:10:23.914052 20153 raft_consensus.cc:3060] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:23.953351 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:23.947585 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:23.967586 18643 raft_consensus.cc:2468] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 2.
I20260709 12:10:23.953938 18018 raft_consensus.cc:2468] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 4.
I20260709 12:10:23.968899 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:23.969672 18062 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:23.970222 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:23.971251 18018 raft_consensus.cc:2410] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 5 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:10:23.943424 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:23.956643 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:23.972440 18090 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
I20260709 12:10:23.942307 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:23.959367 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:23.973979 18094 raft_consensus.cc:2393] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 5: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:23.960673 17988 leader_election.cc:304] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:23.948889 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:23.964645 17940 raft_consensus.cc:1240] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:23.975939 17988 leader_election.cc:304] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:23.978070 17988 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:23.967320 18020 raft_consensus.cc:2468] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:10:23.980669 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:23.994035 17988 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:23.982115 18062 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:23.998216 18062 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:24.000607 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:24.004012 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:24.004563 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:24.005517 18644 raft_consensus.cc:2393] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 4: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:24.006991 17912 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:24.003753 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:24.008496 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:24.009235 17948 raft_consensus.cc:2468] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:10:24.010929 18097 raft_consensus.cc:1240] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:24.011857 17912 leader_election.cc:304] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:24.018703 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:24.019516 17945 raft_consensus.cc:2468] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 5.
I20260709 12:10:24.012506 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:23.929862 17943 raft_consensus.cc:2468] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:10:23.952562 19803 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:24.020748 20141 raft_consensus.cc:2804] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:24.037710 20141 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:24.037473 20065 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:24.038177 20141 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:23.992276 20088 raft_consensus.cc:2804] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:24.039621 20088 raft_consensus.cc:493] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:24.040006 20088 raft_consensus.cc:3060] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.043996 20156 raft_consensus.cc:2749] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:24.020614 20077 raft_consensus.cc:2804] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:24.044770 20077 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.044986 17913 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:24.037096 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:24.045148 20077 raft_consensus.cc:3060] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.046180 17913 leader_election.cc:304] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:23.924463 20144 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:24.046998 17913 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:24.048008 17913 leader_election.cc:304] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:24.048197 20144 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:24.048718 20144 raft_consensus.cc:2804] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:24.049028 17913 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:24.007057 19655 raft_consensus.cc:2804] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:24.049815 19655 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:24.050185 19655 raft_consensus.cc:3060] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.036423 20183 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:23.996415 19925 raft_consensus.cc:2804] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:24.054461 20187 raft_consensus.cc:2749] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:24.054847 20158 raft_consensus.cc:2804] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:24.056324 20167 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:24.003392 20161 raft_consensus.cc:493] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.058485 20205 raft_consensus.cc:2804] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:24.051250 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:24.011373 20131 raft_consensus.cc:2804] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:24.058586 20059 raft_consensus.cc:2749] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:24.049043 20144 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:24.057521 19925 raft_consensus.cc:493] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:24.060963 20138 raft_consensus.cc:2804] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:24.061278 20158 raft_consensus.cc:493] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:24.066713 20205 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:24.061053 20032 consensus_queue.cc:1048] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:10:24.069415 20131 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.076419 19925 raft_consensus.cc:3060] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.077452 20138 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.072124 20136 raft_consensus.cc:2804] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:24.074113 20144 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.080211 20158 raft_consensus.cc:3060] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.090854 20205 raft_consensus.cc:3060] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.083371 20150 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:24.070104 20161 raft_consensus.cc:515] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:24.096170 20131 raft_consensus.cc:3060] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.094728 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:24.093390 19803 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:24.104038 20138 raft_consensus.cc:3060] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.102341 20136 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:24.133554 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:24.101403 20021 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:24.139642 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 125788us
I20260709 12:10:24.143949 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:24.144742 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:24.145442 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:24.148857 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:24.170053 18640 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 7.
I20260709 12:10:24.155508 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:24.156216 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:24.176927 18090 raft_consensus.cc:2393] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 4: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:24.179665 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:24.181481 18093 raft_consensus.cc:2393] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 6: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:24.142398 20136 raft_consensus.cc:3060] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:24.184373 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:24.141809 18637 raft_consensus.cc:3060] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:24.140117 20137 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:24.161341 20065 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:24.147137 20034 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:10:24.193702 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 195529us
I20260709 12:10:24.157516 20144 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:24.200495 20144 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:24.202198 20219 consensus_queue.cc:1048] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:24.205425 17914 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:24.208074 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:24.208633 17942 raft_consensus.cc:2468] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:10:24.181097 20158 raft_consensus.cc:515] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:24.219918 17914 leader_election.cc:304] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:24.223287 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 56006.5us
I20260709 12:10:24.224320 17988 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:24.224653 17914 leader_election.cc:304] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:24.225461 17988 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:24.227670 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:24.228056 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:10:24.221884 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 157863us
I20260709 12:10:24.174242 20121 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:24.140241 19803 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:10:24.229712 18609 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:24.229946 17914 leader_election.cc:304] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:24.232129 17988 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:24.196899 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:24.223228 20188 raft_consensus.cc:2749] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:24.229183 20150 raft_consensus.cc:2749] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:24.232717 20060 raft_consensus.cc:2804] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:24.250458 20121 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:24.251334 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:24.242327 20167 raft_consensus.cc:2804] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:24.237301 20130 raft_consensus.cc:2749] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:24.251947 20167 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.252384 20167 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:24.252628 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:24.253104 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:24.253808 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:24.257720 20126 consensus_meta.cc:287] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.532s	user 0.005s	sys 0.005s
I20260709 12:10:24.241880 20228 raft_consensus.cc:2804] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:24.247205 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:24.233696 20059 consensus_queue.cc:1059] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:10:24.258221 20126 raft_consensus.cc:515] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:24.265094 20227 raft_consensus.cc:2804] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:24.262724 20159 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:24.251206 20077 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:24.269380 20227 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.269780 20227 raft_consensus.cc:3060] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:24.271112 20077 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:24.246973 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:24.272102 20021 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:24.272351 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:24.273479 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:24.265147 20121 consensus_queue.cc:1048] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:10:24.274529 20150 raft_consensus.cc:3055] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:24.274971 20150 raft_consensus.cc:740] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:24.275331 20161 leader_election.cc:290] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:24.275713 20150 consensus_queue.cc:260] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:24.274533 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:24.261762 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:24.262141 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:24.248931 19803 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123)
I20260709 12:10:24.231259 20082 raft_consensus.cc:2749] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:24.269239 20080 consensus_meta.cc:287] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 1.003s	user 0.011s	sys 0.000s
I20260709 12:10:24.282275 20150 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:24.250473 20060 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.284324 17949 raft_consensus.cc:1240] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:24.265905 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:24.289474 18061 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:24.285277 17945 raft_consensus.cc:2393] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 5: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:24.254421 18635 raft_consensus.cc:2468] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:10:24.287967 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:24.290920 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:24.289439 18062 leader_election.cc:304] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:24.238729 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:24.249778 20088 raft_consensus.cc:515] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:24.324958 18061 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:24.325325 18643 raft_consensus.cc:2468] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:24.327900 20217 raft_consensus.cc:2749] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:24.328590 17947 raft_consensus.cc:1275] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:24.328781 19803 raft_consensus.cc:2804] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:24.329146 19803 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.329517 19803 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:24.323870 20034 consensus_queue.cc:1048] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:10:24.336645 18089 raft_consensus.cc:1240] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:24.292506 20080 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:24.338574 20126 leader_election.cc:290] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:24.339471 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:24.340195 18098 raft_consensus.cc:2393] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 4: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:24.341209 18098 raft_consensus.cc:1240] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:24.263212 20228 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:24.342777 20228 raft_consensus.cc:3060] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.340099 20080 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:24.345558 20131 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:24.346925 18644 raft_consensus.cc:2368] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for earlier term 4. Current term is 5.
I20260709 12:10:24.348263 20088 leader_election.cc:290] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:24.348451 20159 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:24.325223 18062 leader_election.cc:304] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:24.341053 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:24.357153 18062 leader_election.cc:304] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:24.354852 18098 raft_consensus.cc:1240] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:24.361737 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.362531 18062 leader_election.cc:304] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:24.268055 18637 raft_consensus.cc:2468] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:24.292860 20060 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:24.362221 20219 raft_consensus.cc:2804] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:24.370776 20219 raft_consensus.cc:493] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:24.369657 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:24.364044 18062 leader_election.cc:304] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:24.367331 20227 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:24.327531 19655 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:24.350107 20131 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:24.378551 17987 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:24.352135 20032 raft_consensus.cc:493] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.352315 20144 raft_consensus.cc:2804] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:24.369624 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 44036.5us
I20260709 12:10:24.351282 20158 leader_election.cc:290] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:24.374236 18062 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:24.383634 18062 leader_election.cc:304] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:24.375105 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:24.375448 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 143377us
I20260709 12:10:24.384296 18020 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 7.
I20260709 12:10:24.385084 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:24.385571 18020 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.376209 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:24.263607 19925 raft_consensus.cc:515] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:24.266909 20141 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:24.380345 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.355998 18639 raft_consensus.cc:2468] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:24.371193 20219 raft_consensus.cc:3060] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:24.381601 17987 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:24.364959 20126 raft_consensus.cc:2749] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:24.352007 20205 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:24.371807 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:24.374915 20217 raft_consensus.cc:2804] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:24.388407 18018 raft_consensus.cc:2393] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 4: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:24.350186 20136 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:24.390180 18098 raft_consensus.cc:3060] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.371675 20034 raft_consensus.cc:2804] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:24.400267 20034 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:24.400575 20141 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:24.400725 20034 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:24.352007 19803 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:24.402812 20220 consensus_queue.cc:1048] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:24.403887 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:24.404110 19803 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:24.405077 20136 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:24.389576 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:24.406484 20126 raft_consensus.cc:2749] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:24.382938 20148 raft_consensus.cc:2749] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:24.397061 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:24.398304 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:24.398980 20120 consensus_meta.cc:287] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.654s	user 0.005s	sys 0.005s
I20260709 12:10:24.409574 17987 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:24.413446 18092 raft_consensus.cc:1240] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:24.424042 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:24.425107 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:24.425649 18019 raft_consensus.cc:2468] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3.
I20260709 12:10:24.429800 18098 raft_consensus.cc:2468] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
I20260709 12:10:24.381309 19928 consensus_queue.cc:1059] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:10:24.397200 20217 raft_consensus.cc:493] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:24.448319 20217 raft_consensus.cc:3060] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:24.448585 19928 raft_consensus.cc:3055] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:24.448900 20206 raft_consensus.cc:2804] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:24.449023 19928 raft_consensus.cc:740] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:24.449949 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:24.397193 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:24.451246 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:24.451599 18017 raft_consensus.cc:3060] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:24.417922 18020 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:10:24.433941 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:24.433369 17941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44668 (request call id 305) took 1568 ms. Trace:
I20260709 12:10:24.434913 20205 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:24.435139 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:24.426810 20120 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:24.435806 19925 leader_election.cc:290] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:24.436676 20227 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:24.436888 18094 raft_consensus.cc:1240] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:24.437703 19655 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:24.388172 20032 raft_consensus.cc:515] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:24.438575 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:24.438822 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:24.440976 17948 raft_consensus.cc:2468] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:24.432813 20167 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:24.442940 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:24.444432 17987 leader_election.cc:304] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:24.485512 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:24.485726 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:24.486569 18642 raft_consensus.cc:2393] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 5: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:24.487015 17987 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:24.488572 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 104973us
I20260709 12:10:24.446185 20219 raft_consensus.cc:515] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:24.447619 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:24.434372 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:24.490782 18095 raft_consensus.cc:1240] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:24.458891 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:24.453333 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:24.492674 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:24.492893 17914 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:24.493482 18020 raft_consensus.cc:2393] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 4: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:24.477293 17989 leader_election.cc:304] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:24.445350 20218 raft_consensus.cc:2749] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:24.494899 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:24.483323 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:24.459894 17941 rpcz_store.cc:276] 0709 12:10:22.865405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.870502 (+  5097us) service_pool.cc:224] Handling call
0709 12:10:22.883339 (+ 12837us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:23.841016 (+957677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.433141 (+592125us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b540022ced4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:24.433311 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2198545152}
I20260709 12:10:24.461531 20144 raft_consensus.cc:697] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:24.450012 19928 consensus_queue.cc:260] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:24.496168 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:24.453125 20230 raft_consensus.cc:2749] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:24.497227 20065 raft_consensus.cc:2804] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:24.503708 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:24.498354 17989 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:24.499830 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:24.504328 18020 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
I20260709 12:10:24.505100 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:24.505146 17989 leader_election.cc:304] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
W20260709 12:10:24.497784 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 115534us
I20260709 12:10:24.505918 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:24.507596 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:24.506358 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:24.510377 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:24.496984 20153 raft_consensus.cc:2749] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:24.512217 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:24.497215 19655 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.513268 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:24.514223 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:24.501305 19925 raft_consensus.cc:2749] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:24.511076 20080 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:24.527817 20167 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:24.523553 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:24.529124 18638 raft_consensus.cc:2468] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 2.
I20260709 12:10:24.530012 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:24.530599 18638 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.530961 20228 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:24.531296 20032 leader_election.cc:290] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:24.499604 20034 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:24.519671 18089 raft_consensus.cc:1240] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:24.502465 20227 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:24.518376 20217 raft_consensus.cc:515] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:24.538340 20227 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:24.538254 20144 consensus_queue.cc:237] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:24.539660 20034 leader_election.cc:290] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:24.523746 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:24.540267 20217 leader_election.cc:290] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:24.540481 18640 raft_consensus.cc:2393] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 5: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:24.529822 20138 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:24.531230 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:24.541400 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:24.542569 18093 raft_consensus.cc:2393] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 8: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:24.524852 20161 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.533813 18608 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:24.524276 18636 raft_consensus.cc:2393] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 8: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:24.537348 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:24.541379 20120 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:24.502313 20141 consensus_queue.cc:1059] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:10:24.507236 20065 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:24.510751 20218 raft_consensus.cc:2749] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:24.501140 20150 consensus_queue.cc:1059] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
W20260709 12:10:24.546012 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 44238.6us
I20260709 12:10:24.543301 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:24.548990 17944 raft_consensus.cc:1240] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:24.522081 19928 raft_consensus.cc:3060] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:24.544103 20097 consensus_queue.cc:1048] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:10:24.532985 19655 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:24.550172 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:24.692164 18022 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:24.569458 18610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.547963 20232 consensus_queue.cc:1048] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.206s
I20260709 12:10:24.752756 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:24.753535 18024 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:24.549582 20065 raft_consensus.cc:3060] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:24.763998 18022 raft_consensus.cc:2468] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:24.786103 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:24.788614 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:24.748709 20138 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:24.797750 18018 raft_consensus.cc:1240] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:10:24.788900 18062 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:24.792907 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:24.548085 20161 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:24.825258 18640 raft_consensus.cc:1275] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:24.832012 18021 raft_consensus.cc:2468] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
W20260709 12:10:24.835315 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 46531.6us
I20260709 12:10:24.839545 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:24.843194 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:24.843475 18022 raft_consensus.cc:2393] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 5: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:24.584093 20060 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:24.582512 20235 consensus_queue.cc:1048] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.218s
I20260709 12:10:24.846720 18021 raft_consensus.cc:1240] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:24.845201 18062 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:24.851830 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:24.852615 18018 raft_consensus.cc:3060] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:24.857759 18024 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 8.
I20260709 12:10:24.859067 18022 raft_consensus.cc:1240] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:24.835218 20150 consensus_queue.cc:1243] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer 4813437da0a74e65b61eb7bd1d18f110 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:10:24.860661 18062 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:24.872125 18062 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:24.863418 18024 raft_consensus.cc:1240] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:24.842422 20121 raft_consensus.cc:2804] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:24.871289 20034 raft_consensus.cc:2804] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:24.876072 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:24.882174 18020 raft_consensus.cc:2393] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 7: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:24.895228 18024 raft_consensus.cc:1240] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:24.892903 20034 raft_consensus.cc:697] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 4 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:24.885979 20120 raft_consensus.cc:2764] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:10:24.907608 18637 raft_consensus.cc:1240] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:24.908284 20034 consensus_queue.cc:237] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:24.889243 20236 raft_consensus.cc:2804] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:10:24.914983 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 368220us
I20260709 12:10:24.916299 18024 raft_consensus.cc:1240] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:24.916721 18608 leader_election.cc:304] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:24.871963 19803 consensus_queue.cc:1059] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:10:24.896013 20121 raft_consensus.cc:697] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:24.918290 18023 raft_consensus.cc:2393] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 4: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:24.925896 18608 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:24.929863 18608 leader_election.cc:304] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:24.931353 18018 raft_consensus.cc:2468] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:24.932261 18021 raft_consensus.cc:1240] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:24.934950 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:24.938832 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 66786.1us
I20260709 12:10:24.940404 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:24.941161 18098 raft_consensus.cc:2393] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 5: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:24.942030 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:24.942711 18098 raft_consensus.cc:2393] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 4: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:24.932053 20097 consensus_queue.cc:1059] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:10:24.943437 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:24.944509 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:24.944648 20206 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:24.945060 20206 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:24.950513 20156 raft_consensus.cc:3055] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:24.950930 20156 raft_consensus.cc:740] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:24.951809 20156 consensus_queue.cc:260] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:24.952296 18062 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:24.952798 20156 raft_consensus.cc:3060] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.952911 18642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60424 (request call id 690) took 1056 ms. Trace:
I20260709 12:10:24.953357 19803 raft_consensus.cc:2804] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:24.953982 19803 raft_consensus.cc:697] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:24.954916 19803 consensus_queue.cc:237] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:24.953500 18642 rpcz_store.cc:276] 0709 12:10:23.896112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.545237 (+649125us) service_pool.cc:224] Handling call
0709 12:10:24.576623 (+ 31386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:24.576983 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:24.577013 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:24.772767 (+195754us) log.cc:844] Serialized 26 byte log entry
0709 12:10:24.914193 (+141426us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:24.914226 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:24.914287 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:24.952670 (+ 38383us) raft_consensus.cc:1685] finished
0709 12:10:24.952699 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:24.952836 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21937,"raft.queue_time_us":14004,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":127,"thread_start_us":71420,"threads_started":1,"wal-append.queue_time_us":152687}
I20260709 12:10:24.959789 20080 raft_consensus.cc:2749] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:24.960700 19655 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:24.939783 20032 raft_consensus.cc:2804] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:24.962200 20121 consensus_queue.cc:237] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:24.963150 18636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60424 (request call id 683) took 1169 ms. Trace:
I20260709 12:10:24.963536 18636 rpcz_store.cc:276] 0709 12:10:23.794225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.252871 (+458646us) service_pool.cc:224] Handling call
0709 12:10:24.962939 (+710068us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b54006630d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:24.963090 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":569170304}
I20260709 12:10:24.934706 20242 consensus_queue.cc:1048] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
W20260709 12:10:24.966768 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:24.961647 20032 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:24.967443 20032 raft_consensus.cc:3060] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:24.967667 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:24.968415 18023 raft_consensus.cc:2393] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 6: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:24.969326 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:24.928892 20137 raft_consensus.cc:2749] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:24.971199 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:24.933071 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:24.927759 20146 raft_consensus.cc:2749] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:24.974766 18024 raft_consensus.cc:1240] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
W20260709 12:10:24.980463 20239 log.cc:927] Time spent T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:10:24.983379 18091 raft_consensus.cc:1240] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:10:24.980917 20072 consensus_queue.cc:1048] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:24.932893 20236 raft_consensus.cc:697] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:24.983815 20233 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:24.987903 20138 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:25.007352 18018 raft_consensus.cc:1240] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:25.001464 18023 raft_consensus.cc:1240] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:25.017693 20208 consensus_queue.cc:1059] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:10:25.018324 18017 consensus_meta.cc:287] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.566s	user 0.007s	sys 0.003s
I20260709 12:10:25.018746 18017 raft_consensus.cc:2468] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
I20260709 12:10:25.018944 20137 raft_consensus.cc:3055] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:25.019280 20088 raft_consensus.cc:2749] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:25.019352 20137 raft_consensus.cc:740] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:25.020228 20142 consensus_queue.cc:1048] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:25.020310 20137 consensus_queue.cc:260] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:25.025616 20134 raft_consensus.cc:3055] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:10:25.024696 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 65145.6us
I20260709 12:10:25.016021 20161 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:25.038542 18097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53964 (request call id 1569) took 1143 ms. Trace:
I20260709 12:10:25.025862 20137 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.015295 18638 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 5.
I20260709 12:10:25.042102 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:25.038971 18097 rpcz_store.cc:276] 0709 12:10:23.888110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.888228 (+   118us) service_pool.cc:224] Handling call
0709 12:10:23.892547 (+  4319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:24.016056 (+123509us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.031227 (+1015171us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54001b4c54. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:25.031416 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":260614016}
I20260709 12:10:25.040373 18609 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:25.026602 20060 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:25.057369 18640 raft_consensus.cc:1240] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:25.007925 20233 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:25.025981 20134 raft_consensus.cc:740] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:25.059394 18608 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:25.014945 20138 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:25.067333 18608 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:25.068835 18608 leader_election.cc:304] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:25.064648 20250 raft_consensus.cc:2804] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:25.073460 20250 raft_consensus.cc:697] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:25.060981 20167 raft_consensus.cc:2764] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:25.074707 20250 consensus_queue.cc:237] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:25.090060 20065 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:25.090680 20240 log.cc:927] Time spent T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 12:10:25.092283 20065 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:25.035503 20236 consensus_queue.cc:237] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:25.093490 20247 log.cc:927] Time spent T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:10:25.100999 20249 raft_consensus.cc:2804] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:25.101521 20249 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:25.101874 20249 raft_consensus.cc:3060] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.102097 18095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41818 (request call id 585) took 2276 ms. Trace:
I20260709 12:10:25.102495 18095 rpcz_store.cc:276] 0709 12:10:22.826012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.041914 (+215902us) service_pool.cc:224] Handling call
0709 12:10:23.055359 (+ 13445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.491271 (+1435912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.101845 (+610574us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b5400338454. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:25.102041 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3300468480}
I20260709 12:10:25.075789 20153 consensus_queue.cc:1059] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
W20260709 12:10:25.106580 18607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.106899 18016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 1796) took 1317 ms. Trace:
I20260709 12:10:25.107321 18016 rpcz_store.cc:276] 0709 12:10:23.789647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.792093 (+  2446us) service_pool.cc:224] Handling call
0709 12:10:24.544230 (+752137us) spinlock_profiling.cc:243] Waited 8.48 ms on lock 0x7b5800055898. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4988db71 00007f7f4988da22 00007f7f527a68d9 00007f7f51900ee0 00007f7f519ca0ab 00007f7f519ca131 00007f7f5198bfc0 00007f7f51976929 00007f7f519763d2 00007f7f4aeedbd4
0709 12:10:24.550754 (+  6524us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:24.680841 (+130087us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:24.693981 (+ 13140us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:24.824858 (+130877us) log.cc:844] Serialized 26 byte log entry
0709 12:10:24.999464 (+174606us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:25.003887 (+  4423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.012108 (+  8221us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:25.103697 (+ 91589us) raft_consensus.cc:1685] finished
0709 12:10:25.103716 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.106839 (+  3123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":118,"spinlock_wait_cycles":19513728,"thread_start_us":96088,"threads_started":1,"wal-append.queue_time_us":155196}
I20260709 12:10:25.099371 20138 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:25.116281 18608 leader_election.cc:304] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:25.120769 18608 leader_election.cc:304] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:25.122561 18608 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:25.127525 18640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60412 (request call id 695) took 1072 ms. Trace:
I20260709 12:10:25.105319 20159 raft_consensus.cc:2749] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.123752 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:25.123688 20161 raft_consensus.cc:2749] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.128010 18640 rpcz_store.cc:276] 0709 12:10:24.054758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.848944 (+794186us) service_pool.cc:224] Handling call
0709 12:10:25.057138 (+208194us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.058884 (+  1746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.127275 (+ 68391us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b540072bd50. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b18ad 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:25.127452 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":477914880}
I20260709 12:10:25.105664 20253 raft_consensus.cc:2804] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:25.139681 18095 raft_consensus.cc:1240] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:25.145228 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:25.146478 20255 raft_consensus.cc:2749] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:25.126037 20241 raft_consensus.cc:2749] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:25.152311 17912 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:25.152716 18061 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:25.153891 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:25.154145 18061 leader_election.cc:304] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:25.154510 18016 raft_consensus.cc:3060] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.154945 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:25.143384 20253 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:25.163574 20253 raft_consensus.cc:3060] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:25.161294 20206 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:25.165910 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:25.169634 20260 consensus_queue.cc:1059] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:25.165819 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:25.172183 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:25.172770 18022 raft_consensus.cc:2468] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 3.
I20260709 12:10:25.144196 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:25.175496 18061 leader_election.cc:304] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:25.185353 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:25.188038 18018 raft_consensus.cc:2393] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 8: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:25.117218 20134 consensus_queue.cc:260] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:25.190889 20260 raft_consensus.cc:3055] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:25.199805 20260 raft_consensus.cc:740] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:25.199913 20134 raft_consensus.cc:3060] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:25.200664 20260 consensus_queue.cc:260] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:25.201902 20260 raft_consensus.cc:3060] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:25.188755 19655 raft_consensus.cc:2749] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.190893 18637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60430 (request call id 468) took 1094 ms. Trace:
I20260709 12:10:25.197326 18019 raft_consensus.cc:1240] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:10:25.199040 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:25.199293 18023 raft_consensus.cc:1240] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:25.198293 18016 raft_consensus.cc:2468] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
I20260709 12:10:25.162313 20236 raft_consensus.cc:2804] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:25.211570 20034 consensus_queue.cc:1048] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:25.170691 20153 raft_consensus.cc:2804] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:25.217708 20153 raft_consensus.cc:697] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:25.177057 20245 raft_consensus.cc:2804] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:25.161528 20159 consensus_queue.cc:1059] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:10:25.227133 17912 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:25.161737 20218 consensus_queue.cc:1059] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:10:25.231266 20121 consensus_queue.cc:1059] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:25.206349 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:25.226106 18638 raft_consensus.cc:2393] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 2: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
W20260709 12:10:25.227979 19928 consensus_meta.cc:287] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.525s	user 0.010s	sys 0.000s
I20260709 12:10:25.215454 20236 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:25.226461 20245 raft_consensus.cc:493] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
W20260709 12:10:25.283543 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 226838us
I20260709 12:10:25.257231 20138 raft_consensus.cc:2749] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:25.284762 20236 raft_consensus.cc:3060] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:25.280174 20233 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:25.286798 20245 raft_consensus.cc:3060] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.283841 17943 raft_consensus.cc:2468] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:10:25.218672 20153 consensus_queue.cc:237] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:25.298374 18062 leader_election.cc:304] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:25.308104 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:25.290014 18639 raft_consensus.cc:2468] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
I20260709 12:10:25.310434 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:25.317869 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:25.318711 17947 raft_consensus.cc:2393] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 4: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:25.311013 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:25.311486 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:25.299286 20206 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:25.319393 17942 raft_consensus.cc:2468] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:25.321290 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:25.319969 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:25.321986 18643 raft_consensus.cc:2468] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:25.322793 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:25.323130 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:25.323451 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:25.323917 18636 raft_consensus.cc:2393] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 8: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:25.323843 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:25.324579 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:25.324703 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:25.325204 17943 raft_consensus.cc:2468] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:25.325829 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:25.326119 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:25.326443 17948 raft_consensus.cc:2468] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:25.326808 17943 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:25.327394 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:25.327732 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:25.328531 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:25.328860 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:25.329957 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:25.329385 17948 raft_consensus.cc:2410] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:10:25.331712 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:25.324784 20228 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:25.334236 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:25.329567 20227 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:25.324806 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
W20260709 12:10:25.337303 17914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.338318 20207 raft_consensus.cc:3055] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:25.338727 20207 raft_consensus.cc:740] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:25.339109 20150 raft_consensus.cc:3055] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:25.339532 20150 raft_consensus.cc:740] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:25.340463 20150 consensus_queue.cc:260] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:25.341228 19803 raft_consensus.cc:3055] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:25.341632 19803 raft_consensus.cc:740] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:25.206406 18637 rpcz_store.cc:276] 0709 12:10:24.096734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.928191 (+831457us) service_pool.cc:224] Handling call
0709 12:10:24.978753 (+ 50562us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:25.017387 (+ 38634us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:25.017428 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:25.017948 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 12:10:25.097655 (+ 79707us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:25.143683 (+ 46028us) log.cc:844] Serialized 14 byte log entry
0709 12:10:25.177487 (+ 33804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.188427 (+ 10940us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:25.189378 (+   951us) raft_consensus.cc:1685] finished
0709 12:10:25.189407 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.190835 (+  1428us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64685,"prepare.queue_time_us":55988,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":42650,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":12046,"thread_start_us":105768,"threads_started":2,"wal-append.queue_time_us":78863}
I20260709 12:10:25.342392 19803 consensus_queue.cc:260] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:25.343560 19803 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.350226 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:25.350857 17947 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:25.351811 18061 leader_election.cc:304] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:25.303282 20034 consensus_queue.cc:1059] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:10:25.354727 18643 raft_consensus.cc:2410] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:25.361195 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:25.303545 20249 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:25.346060 20144 raft_consensus.cc:2749] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.330878 20256 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
W20260709 12:10:25.420410 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 51038.6us
I20260709 12:10:25.353983 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:25.422667 18061 leader_election.cc:304] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:25.424234 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 71423.2us
I20260709 12:10:25.424379 17947 raft_consensus.cc:2468] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
I20260709 12:10:25.428782 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:25.429486 17948 raft_consensus.cc:3060] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.429709 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:25.420053 20233 raft_consensus.cc:2804] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:25.431118 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:25.358996 20032 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:25.435491 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:25.441847 18093 raft_consensus.cc:1240] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:10:25.435680 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 118143us
I20260709 12:10:25.454967 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:25.461269 17948 raft_consensus.cc:2410] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:25.462705 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:25.467424 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:25.469069 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:25.470504 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:25.471493 17947 raft_consensus.cc:2393] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 6: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:25.472401 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:25.473366 17947 raft_consensus.cc:2410] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:25.474233 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:25.475092 17947 raft_consensus.cc:2468] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:25.440174 18089 raft_consensus.cc:1240] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 4 LEADER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:25.477234 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:25.477756 17947 raft_consensus.cc:3060] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.459705 20032 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:25.442600 20121 raft_consensus.cc:2749] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:25.469683 18644 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:10:25.483191 18608 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:25.481107 17913 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:25.452705 20233 raft_consensus.cc:493] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:25.485777 18608 leader_election.cc:304] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:25.486274 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:25.487324 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:25.488626 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:25.489876 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:25.425976 20256 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:25.484810 17913 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:25.491717 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:25.494824 20249 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:25.495896 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:25.498003 20241 raft_consensus.cc:2804] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:25.498425 20241 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:25.498795 20241 raft_consensus.cc:3060] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:25.502233 20264 log.cc:927] Time spent T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:10:25.503672 20266 log.cc:927] Time spent T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 12:10:25.504762 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.504642 20159 consensus_queue.cc:1059] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:25.505611 20159 consensus_queue.cc:1059] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:25.506135 18089 raft_consensus.cc:1240] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:25.506837 20259 raft_consensus.cc:3055] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:25.507210 20259 raft_consensus.cc:740] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:25.508194 20259 consensus_queue.cc:260] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:25.509346 20259 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:25.509471 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:25.510512 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:25.512042 18639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60412 (request call id 693) took 1461 ms. Trace:
I20260709 12:10:25.513738 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:25.514882 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:25.515861 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:25.516161 20156 consensus_meta.cc:287] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.563s	user 0.011s	sys 0.000s
I20260709 12:10:25.507279 20159 raft_consensus.cc:3055] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:10:25.510705 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.526677 18061 leader_election.cc:304] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:25.512420 18639 rpcz_store.cc:276] 0709 12:10:24.050436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.438340 (+387904us) service_pool.cc:224] Handling call
0709 12:10:25.511837 (+1073497us) spinlock_profiling.cc:243] Waited 801 ms on lock 0x7b54003bea54. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:25.511956 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1842837760}
I20260709 12:10:25.527993 18024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45464 (request call id 1636) took 1101 ms. Trace:
I20260709 12:10:25.528041 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:25.528319 18061 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:25.528488 18024 rpcz_store.cc:276] 0709 12:10:24.426271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.920499 (+494228us) service_pool.cc:224] Handling call
0709 12:10:24.939079 (+ 18580us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:24.975374 (+ 36295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.527767 (+552393us) spinlock_profiling.cc:243] Waited 35.4 ms on lock 0x7b540005f5d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:25.527935 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81309056}
I20260709 12:10:25.529331 18639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:52812
I20260709 12:10:25.529114 20253 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:25.529886 20137 raft_consensus.cc:3055] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:25.530714 20265 raft_consensus.cc:2749] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.531435 19655 raft_consensus.cc:2749] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.531769 18640 raft_consensus.cc:1240] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:25.532073 19655 raft_consensus.cc:2749] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:25.532173 20219 leader_election.cc:290] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:25.526693 20159 raft_consensus.cc:740] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:25.533593 20159 consensus_queue.cc:260] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:25.534093 20256 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:25.486385 20262 raft_consensus.cc:2764] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:25.534744 20159 raft_consensus.cc:3060] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:25.530321 18061 leader_election.cc:304] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:25.540833 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:25.541505 20126 raft_consensus.cc:2749] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:25.542264 20242 raft_consensus.cc:3055] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:25.492435 20233 raft_consensus.cc:3060] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.542585 18061 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:25.543459 20126 raft_consensus.cc:2749] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:25.544543 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:25.546007 18636 raft_consensus.cc:1240] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:10:25.546973 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:25.547266 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:25.548243 18098 raft_consensus.cc:1240] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:25.549098 18642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60430 (request call id 469) took 1449 ms. Trace:
I20260709 12:10:25.549579 17940 raft_consensus.cc:1275] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:25.549469 18642 rpcz_store.cc:276] 0709 12:10:24.099568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.959134 (+859566us) service_pool.cc:224] Handling call
0709 12:10:25.328366 (+369232us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b58001c4a98. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4988db71 00007f7f4988da22 00007f7f527a68d9 00007f7f51900ee0 00007f7f519ca0ab 00007f7f519ca131 00007f7f5198bfc0 00007f7f51976929 00007f7f519763d2 00007f7f4aeedbd4
0709 12:10:25.328534 (+   168us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.537842 (+209308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:25.537871 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:25.537923 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:25.537977 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.538559 (+   582us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b5400075654. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:25.538598 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:25.549045 (+ 10447us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":512710272}
I20260709 12:10:25.530269 20137 raft_consensus.cc:740] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:25.551270 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:25.551450 20137 consensus_queue.cc:260] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:25.552573 20137 raft_consensus.cc:3060] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.553140 17944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44668 (request call id 316) took 1292 ms. Trace:
I20260709 12:10:25.553490 17944 rpcz_store.cc:276] 0709 12:10:24.261013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:24.261152 (+   139us) service_pool.cc:224] Handling call
0709 12:10:24.261444 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:24.787687 (+526243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:25.552943 (+765256us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b5400253fd4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:25.553087 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":660878208}
I20260709 12:10:25.483994 20206 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:25.554891 20228 consensus_queue.cc:1059] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:25.554932 20206 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:25.516940 17943 raft_consensus.cc:2410] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:25.542742 18015 raft_consensus.cc:1240] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:25.534406 18640 raft_consensus.cc:1275] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:25.559346 20157 consensus_queue.cc:1059] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:10:25.496475 18644 raft_consensus.cc:2376] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4. Re-sending same reply.
I20260709 12:10:25.565670 17988 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:25.587893 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:25.594005 17944 raft_consensus.cc:1240] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:25.588548 18022 raft_consensus.cc:2468] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:10:25.584218 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
W20260709 12:10:25.598336 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 113596us
I20260709 12:10:25.599298 17913 leader_election.cc:304] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:25.600363 17913 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:25.612308 17913 leader_election.cc:304] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:25.516908 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:25.618328 18020 raft_consensus.cc:2468] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 5.
I20260709 12:10:25.623262 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:25.566521 20249 raft_consensus.cc:3055] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:25.565158 20205 raft_consensus.cc:3055] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:25.529898 18639 raft_consensus.cc:606] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:25.597335 20206 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:25.651736 18642 raft_consensus.cc:1240] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:25.542681 20242 raft_consensus.cc:740] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:25.496264 20261 consensus_queue.cc:1059] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:10:25.563418 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:25.609583 20228 raft_consensus.cc:2804] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:25.611454 20059 raft_consensus.cc:2804] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:25.719988 20059 raft_consensus.cc:493] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:25.720463 20059 raft_consensus.cc:3060] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:25.633137 17948 raft_consensus.cc:1240] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:25.631976 20249 raft_consensus.cc:740] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:25.565378 20134 consensus_queue.cc:1059] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 12:10:25.723932 20134 raft_consensus.cc:3055] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:25.723539 20249 consensus_queue.cc:260] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:25.724294 20134 raft_consensus.cc:740] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:25.651281 20205 raft_consensus.cc:740] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:25.725392 20205 consensus_queue.cc:260] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:25.611821 20027 raft_consensus.cc:2749] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:25.661772 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.665022 17947 raft_consensus.cc:2468] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:25.727617 17940 raft_consensus.cc:1240] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:25.728143 20027 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:25.728648 20027 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:25.731031 18635 raft_consensus.cc:2393] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 3: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:25.562620 20207 consensus_queue.cc:260] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:25.731698 20207 raft_consensus.cc:3060] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.609797 20156 raft_consensus.cc:2749] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.629040 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:25.653290 18639 raft_consensus.cc:614] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:25.726414 20205 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:25.732507 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 75199.9us
I20260709 12:10:25.732120 20261 raft_consensus.cc:3055] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:25.758913 17946 raft_consensus.cc:1240] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 LEADER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:25.741466 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 173952us
I20260709 12:10:25.743016 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:25.726118 20233 raft_consensus.cc:515] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:25.651384 20141 raft_consensus.cc:2749] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:25.749161 18641 raft_consensus.cc:1240] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:25.720026 18636 raft_consensus.cc:1275] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:25.699859 20228 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:25.762588 17987 leader_election.cc:304] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
W20260709 12:10:25.762387 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 150148us
I20260709 12:10:25.739512 20027 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:25.776289 20268 log.cc:927] Time spent T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:10:25.756600 20261 raft_consensus.cc:740] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:25.740315 20138 consensus_queue.cc:1059] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:10:25.783943 18095 raft_consensus.cc:1240] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:25.775271 20228 raft_consensus.cc:3060] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.769325 17913 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:25.722416 20245 raft_consensus.cc:515] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:25.763772 20253 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:25.788177 17913 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:25.780277 18024 raft_consensus.cc:2468] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 4.
I20260709 12:10:25.780527 18098 raft_consensus.cc:1240] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:25.765594 17988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.790131 17913 leader_election.cc:304] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:25.761633 20241 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:25.795298 18093 raft_consensus.cc:1240] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:25.795626 20272 raft_consensus.cc:2749] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.788048 20088 raft_consensus.cc:2804] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:25.799554 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 191412us
I20260709 12:10:25.799844 17987 leader_election.cc:304] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:25.794979 17913 leader_election.cc:304] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:25.793397 20027 raft_consensus.cc:2804] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:25.801614 17987 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:25.795428 20156 raft_consensus.cc:2749] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:25.807747 20060 raft_consensus.cc:2749] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:25.816732 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:25.817485 18019 raft_consensus.cc:2393] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 4: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:25.819814 20249 raft_consensus.cc:3060] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:25.804217 20227 raft_consensus.cc:2804] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:25.820449 20227 raft_consensus.cc:697] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:25.821358 20227 consensus_queue.cc:237] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:25.823432 20242 consensus_queue.cc:260] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:25.824577 20242 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:25.825857 20141 raft_consensus.cc:3055] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:25.826237 20141 raft_consensus.cc:740] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:25.801960 20088 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:25.828857 17913 leader_election.cc:304] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:25.805228 20027 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:25.804327 20253 consensus_queue.cc:1059] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:10:25.843868 20253 raft_consensus.cc:3055] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:25.844201 20253 raft_consensus.cc:740] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:25.844517 20150 raft_consensus.cc:3060] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.844981 20253 consensus_queue.cc:260] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:25.846134 20253 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:25.810449 20261 consensus_queue.cc:260] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:25.847743 20261 raft_consensus.cc:3060] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:25.851248 20245 leader_election.cc:290] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:25.851281 20067 raft_consensus.cc:3055] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:25.851825 20067 raft_consensus.cc:740] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:25.852154 20233 leader_election.cc:290] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:25.852591 20067 consensus_queue.cc:260] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:25.853770 20067 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:25.854099 18610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.855584 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:25.796164 20236 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:25.856703 20141 consensus_queue.cc:260] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:25.857748 20141 raft_consensus.cc:3060] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:25.857968 20236 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:25.858860 20027 raft_consensus.cc:3060] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.842504 20156 raft_consensus.cc:2749] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.838526 20088 raft_consensus.cc:3060] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.844206 20241 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:25.871037 20218 consensus_queue.cc:1059] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:25.871943 20218 raft_consensus.cc:3055] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:25.872234 20218 raft_consensus.cc:740] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:25.872982 20218 consensus_queue.cc:260] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:25.874104 20218 raft_consensus.cc:3060] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.876853 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:25.879843 17943 raft_consensus.cc:1240] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:25.880962 20228 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:25.886750 18610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:25.887348 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 58592.1us
I20260709 12:10:25.888056 17913 leader_election.cc:304] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:25.889109 17913 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:25.890111 17913 leader_election.cc:304] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:25.891533 18095 raft_consensus.cc:1240] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:25.893754 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:25.894094 18608 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:25.894810 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:25.893085 20059 raft_consensus.cc:515] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:25.896059 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:25.897522 20259 raft_consensus.cc:2749] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:25.902320 20234 raft_consensus.cc:3055] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:25.902751 20234 raft_consensus.cc:740] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:25.902823 20156 raft_consensus.cc:2749] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.903436 20156 raft_consensus.cc:2749] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.903998 20156 raft_consensus.cc:2749] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.892421 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:25.904203 20233 consensus_queue.cc:1059] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:25.904886 18098 raft_consensus.cc:2468] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
I20260709 12:10:25.905026 18062 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:25.905731 20059 leader_election.cc:290] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:25.906381 17913 leader_election.cc:304] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:25.906630 20034 raft_consensus.cc:2804] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:25.906965 20206 consensus_queue.cc:1059] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:25.908097 20059 raft_consensus.cc:2749] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.908231 20206 raft_consensus.cc:3055] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:25.908633 20206 raft_consensus.cc:740] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:25.908926 20228 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:25.909166 17913 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:25.909395 20206 consensus_queue.cc:260] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:25.909549 20234 consensus_queue.cc:260] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:25.907192 20034 raft_consensus.cc:697] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:25.910010 20152 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:25.886224 20088 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:25.901692 20027 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:25.911386 20034 consensus_queue.cc:237] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:25.911966 17945 raft_consensus.cc:1240] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:25.912823 20088 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:25.905269 20233 raft_consensus.cc:3055] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:10:25.914172 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 83247.9us
I20260709 12:10:25.916347 17913 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:25.843140 17987 leader_election.cc:304] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:25.918632 20027 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:25.919241 20027 consensus_queue.cc:1059] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:25.920140 18608 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:25.920310 20279 raft_consensus.cc:2804] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:10:25.920750 20279 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:25.921129 20279 raft_consensus.cc:3060] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:25.922937 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:25.923903 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:25.924834 20259 raft_consensus.cc:2749] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.925190 17913 leader_election.cc:304] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:25.897559 20242 consensus_queue.cc:1059] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:10:25.925374 20270 consensus_queue.cc:1059] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:25.925880 20233 raft_consensus.cc:740] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:25.926373 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:25.926734 20270 raft_consensus.cc:3055] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:25.927141 20270 raft_consensus.cc:740] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:25.926862 20233 consensus_queue.cc:260] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:25.926928 17913 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:25.928129 20233 raft_consensus.cc:3060] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.928102 20270 consensus_queue.cc:260] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:25.929324 20027 raft_consensus.cc:2804] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:25.929396 20270 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:25.930104 20027 raft_consensus.cc:697] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:25.928791 17913 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:25.932339 18640 raft_consensus.cc:1275] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:10:25.934235 18608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.927172 20059 raft_consensus.cc:2804] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:25.936117 18643 raft_consensus.cc:1275] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:25.937644 17945 raft_consensus.cc:1240] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:25.938074 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
W20260709 12:10:25.938246 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 95158.9us
I20260709 12:10:25.938988 17987 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:25.940009 17987 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:25.932698 18062 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:25.941978 18608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.942261 17988 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:25.939988 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:25.943002 17946 raft_consensus.cc:3060] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:25.944269 17942 raft_consensus.cc:2410] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:10:25.944700 17914 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:25.944732 18608 leader_election.cc:304] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:25.945441 17987 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:25.947747 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.950093 17945 raft_consensus.cc:1240] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:25.951138 17947 raft_consensus.cc:1240] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:25.910568 20206 raft_consensus.cc:3060] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.957464 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:25.963419 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:25.959734 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:25.965039 18019 raft_consensus.cc:3060] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:25.953982 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:25.967163 17947 raft_consensus.cc:1240] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:25.953640 18062 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:25.969763 18062 leader_election.cc:304] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:25.965147 17945 raft_consensus.cc:2393] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 3: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:25.971612 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:25.954792 18608 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:25.934728 20234 raft_consensus.cc:3060] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.973191 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:25.941193 20278 raft_consensus.cc:2749] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:25.974231 18062 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:25.984624 18062 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:25.985730 18062 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:25.951196 20060 raft_consensus.cc:2749] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.985968 17946 raft_consensus.cc:2468] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
I20260709 12:10:25.964352 20250 raft_consensus.cc:2749] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.949345 20228 raft_consensus.cc:2749] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:25.971354 20262 raft_consensus.cc:2804] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:25.977192 20144 raft_consensus.cc:2749] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:25.992663 18608 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:25.987820 18062 leader_election.cc:304] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:25.977392 20236 raft_consensus.cc:3060] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.951810 20059 raft_consensus.cc:697] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
W20260709 12:10:25.996769 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:25.993121 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 50931.9us
I20260709 12:10:25.963809 20281 raft_consensus.cc:2749] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:25.943601 20088 consensus_queue.cc:1059] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:10:25.978605 20167 raft_consensus.cc:2749] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:25.977365 20207 raft_consensus.cc:2804] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:26.010285 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:25.988590 20120 raft_consensus.cc:2804] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:26.018227 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:26.014078 19655 consensus_queue.cc:1059] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:10:26.019106 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 73705.8us
I20260709 12:10:25.976219 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:26.019536 19655 consensus_queue.cc:1048] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:26.012697 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:26.019827 17987 leader_election.cc:304] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:26.020457 18642 raft_consensus.cc:3060] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:25.988920 19803 raft_consensus.cc:2804] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:26.016234 18062 leader_election.cc:304] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:25.988767 20126 raft_consensus.cc:2804] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:26.022780 18062 leader_election.cc:304] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:26.023018 18019 raft_consensus.cc:2468] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
I20260709 12:10:26.021770 20120 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:26.007746 20227 raft_consensus.cc:2749] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:26.014752 20219 raft_consensus.cc:2749] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:25.982997 20157 consensus_queue.cc:1059] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:10:26.029937 20152 raft_consensus.cc:2749] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:26.015511 20207 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:26.005146 20138 consensus_queue.cc:1059] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:10:25.986845 20161 consensus_queue.cc:1059] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:10:26.025549 19803 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:26.025384 20126 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:25.988387 20255 consensus_queue.cc:1059] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:10:26.005493 20262 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:26.013140 20137 raft_consensus.cc:2804] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:26.042232 17987 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:26.023895 20060 raft_consensus.cc:2749] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:26.047446 17940 raft_consensus.cc:2468] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 3.
I20260709 12:10:26.124666 18608 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:26.051751 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:26.052702 17988 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:26.055305 18023 raft_consensus.cc:1275] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:26.055815 20245 raft_consensus.cc:2749] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:10:26.129403 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 76770.4us
I20260709 12:10:26.130262 17988 leader_election.cc:304] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:26.059628 20227 raft_consensus.cc:2749] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:26.064416 18642 raft_consensus.cc:2468] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:26.032615 20144 raft_consensus.cc:2749] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:26.041260 20120 raft_consensus.cc:3060] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:26.065688 18062 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:26.040880 18636 raft_consensus.cc:2468] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:26.042555 20228 raft_consensus.cc:3055] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:10:26.116266 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.116456 18098 raft_consensus.cc:1240] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:26.117525 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
W20260709 12:10:26.120496 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.055372 20157 raft_consensus.cc:3055] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:10:26.122366 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 80178.6us
I20260709 12:10:26.126976 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:26.114804 19803 raft_consensus.cc:3060] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:26.019261 20027 consensus_queue.cc:237] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:26.067898 17943 raft_consensus.cc:1275] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:10:26.127604 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.066708 18639 raft_consensus.cc:2468] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:26.115082 20126 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:26.136226 17988 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:26.180713 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 44557.8us
I20260709 12:10:26.181685 17988 leader_election.cc:304] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:26.121593 20262 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:26.126817 20218 raft_consensus.cc:3060] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:26.063069 20207 raft_consensus.cc:3060] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:26.166414 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 100800us
I20260709 12:10:26.202042 18062 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:26.134950 20146 raft_consensus.cc:493] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:26.135118 20137 raft_consensus.cc:697] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:26.124805 20059 consensus_queue.cc:237] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:26.152102 20157 raft_consensus.cc:740] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:26.138108 20281 raft_consensus.cc:2749] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:26.138967 20060 raft_consensus.cc:2749] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:26.149684 20228 raft_consensus.cc:740] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:26.172700 20287 raft_consensus.cc:2749] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:26.168056 20227 consensus_queue.cc:1059] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:10:26.173977 17987 leader_election.cc:304] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:26.172715 17842 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45910 (request call id 351) took 7560 ms. Trace:
I20260709 12:10:26.142135 20161 raft_consensus.cc:2804] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:10:26.177376 17989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:26.177590 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 163457us
I20260709 12:10:26.185909 17988 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:26.188006 20088 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:26.205873 20285 raft_consensus.cc:2749] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:26.176787 18016 raft_consensus.cc:2468] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
I20260709 12:10:26.189491 20034 raft_consensus.cc:3055] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:26.218169 18062 leader_election.cc:304] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:26.226971 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 53063.5us
W20260709 12:10:26.231459 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 45628.4us
I20260709 12:10:26.237275 17988 leader_election.cc:304] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:26.238762 17988 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:26.244485 18022 raft_consensus.cc:1275] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:26.258919 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:26.222047 20289 raft_consensus.cc:2804] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:26.250285 18098 raft_consensus.cc:1275] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 12:10:26.260982 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 136400us
I20260709 12:10:26.268422 17946 raft_consensus.cc:1240] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:26.267896 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:26.269265 18019 raft_consensus.cc:2468] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:26.224505 17842 rpcz_store.cc:276] 0709 12:10:18.667107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:18.668688 (+  1581us) service_pool.cc:224] Handling call
0709 12:10:26.172650 (+7503962us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:23.308079 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:23.308656 (+   577us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:23.308686 (+    30us) write_op.cc:435] Acquired schema lock
0709 12:10:23.308703 (+    17us) tablet.cc:662] Decoding operations
0709 12:10:23.445286 (+136583us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:23.445360 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:23.445406 (+    46us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:10:23.445721 (+   315us) tablet.cc:701] Row locks acquired
0709 12:10:23.445742 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:10:23.445881 (+   139us) write_op.cc:270] Start()
0709 12:10:23.446000 (+   119us) write_op.cc:276] Timestamp: P: 1783599023445834 usec, L: 0
0709 12:10:23.446023 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:10:23.492315 (+ 46292us) log.cc:844] Serialized 1303 byte log entry
0709 12:10:24.133652 (+641337us) op_driver.cc:464] REPLICATION: finished
0709 12:10:24.263522 (+129870us) write_op.cc:301] APPLY: starting
0709 12:10:24.275948 (+ 12426us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:24.276094 (+   146us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:24.276217 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:24.282426 (+  6209us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:24.282612 (+   186us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:10:24.282678 (+    66us) write_op.cc:312] APPLY: finished
0709 12:10:24.282925 (+   247us) log.cc:844] Serialized 35 byte log entry
0709 12:10:24.283097 (+   172us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:24.283187 (+    90us) write_op.cc:454] Released schema lock
0709 12:10:24.283229 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:24.283644 (+   415us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:24.283680 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":59025,"reported_tablets":22,"spinlock_wait_cycles":1531648,"child_traces":[["op",{"apply.queue_time_us":100488,"apply.run_cpu_time_us":2492,"apply.run_wall_time_us":44287,"num_ops":3,"prepare.queue_time_us":253670,"prepare.run_cpu_time_us":23487,"prepare.run_wall_time_us":479580,"raft.queue_time_us":205153,"raft.run_cpu_time_us":12946,"raft.run_wall_time_us":45542,"replication_time_us":687466,"thread_start_us":592938,"threads_started":4,"wal-append.queue_time_us":346134,"wal-append.run_cpu_time_us":19144,"wal-append.run_wall_time_us":1444538}]]}
I20260709 12:10:26.276786 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:26.276881 20142 consensus_queue.cc:1059] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:26.278160 18642 raft_consensus.cc:1240] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:26.278338 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:26.278733 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:26.231904 20245 consensus_queue.cc:1048] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
W20260709 12:10:26.284049 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 45419.6us
I20260709 12:10:26.284552 20227 raft_consensus.cc:2749] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:26.234046 20034 raft_consensus.cc:740] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:26.233294 20161 raft_consensus.cc:697] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:26.289988 18018 raft_consensus.cc:1275] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:10:26.292732 20141 raft_consensus.cc:3055] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:26.227666 20219 consensus_queue.cc:1048] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:10:26.257397 20060 raft_consensus.cc:2749] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:26.294181 17988 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:26.265187 18636 raft_consensus.cc:1275] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 12:10:26.286617 20291 log.cc:927] Time spent T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:10:26.316306 17988 leader_election.cc:304] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:26.239804 20288 raft_consensus.cc:2749] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:26.319804 18021 raft_consensus.cc:1275] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:26.215482 20146 raft_consensus.cc:515] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:26.236152 20287 consensus_queue.cc:1048] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 12:10:26.238148 20281 raft_consensus.cc:2804] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:26.327805 18020 raft_consensus.cc:1240] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:26.330931 20300 raft_consensus.cc:2804] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:26.334033 18017 raft_consensus.cc:1275] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:26.314993 20141 raft_consensus.cc:740] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:26.326155 20060 raft_consensus.cc:2749] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:26.293882 20121 raft_consensus.cc:2749] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:26.267843 20027 consensus_queue.cc:1048] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 12:10:26.328214 20281 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
W20260709 12:10:26.363456 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 135197us
I20260709 12:10:26.373407 18061 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:26.374830 18061 leader_election.cc:304] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:26.376996 18022 raft_consensus.cc:2468] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:26.385951 18022 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:44098
I20260709 12:10:26.386662 18022 raft_consensus.cc:606] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:26.387040 17987 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:26.387640 20297 raft_consensus.cc:2749] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:26.387056 18022 raft_consensus.cc:614] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:26.389400 20285 raft_consensus.cc:2749] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:26.390992 20307 raft_consensus.cc:2804] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:26.392959 20308 consensus_queue.cc:1048] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:10:26.395026 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 70968us
I20260709 12:10:26.268100 20228 consensus_queue.cc:260] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:26.398608 17988 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:26.401459 17988 leader_election.cc:304] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:26.376737 20281 raft_consensus.cc:3060] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:26.326973 20137 consensus_queue.cc:237] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:26.413288 17913 leader_election.cc:304] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:26.356415 20279 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:26.411948 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:26.415625 17946 raft_consensus.cc:2410] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:26.351672 20288 consensus_queue.cc:1059] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:10:26.416664 17913 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:26.398285 20300 raft_consensus.cc:697] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:26.420979 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:26.424733 17946 raft_consensus.cc:2393] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 4: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:26.356981 20034 consensus_queue.cc:260] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:26.409981 20289 raft_consensus.cc:697] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:26.425838 20034 raft_consensus.cc:3060] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:26.426753 20289 consensus_queue.cc:237] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:26.429872 18643 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
mode: GRACEFUL
new_leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:52812
I20260709 12:10:26.430630 18643 raft_consensus.cc:606] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Received request to transfer leadership to TS 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:26.410368 20227 raft_consensus.cc:2749] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:26.432286 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
W20260709 12:10:26.432757 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.412658 20060 raft_consensus.cc:2749] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:26.401295 20219 consensus_queue.cc:1048] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:10:26.442058 18022 raft_consensus.cc:1240] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:26.421481 20228 raft_consensus.cc:3060] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:26.436951 20292 consensus_queue.cc:1048] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.145s
I20260709 12:10:26.415956 20152 raft_consensus.cc:2749] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:26.429057 20154 raft_consensus.cc:2749] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:26.430250 18637 raft_consensus.cc:1240] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:26.398511 20141 consensus_queue.cc:260] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:26.394876 20161 consensus_queue.cc:237] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:26.458688 18643 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:52812
I20260709 12:10:26.460393 18643 raft_consensus.cc:606] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:26.460731 18643 raft_consensus.cc:614] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:26.479336 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:26.481089 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:26.481874 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:26.474072 20152 raft_consensus.cc:493] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.466975 20307 raft_consensus.cc:697] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 4 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:26.488826 20146 leader_election.cc:290] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:26.493362 20126 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:26.459185 20245 consensus_queue.cc:1048] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:10:26.457674 20255 consensus_queue.cc:1059] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
W20260709 12:10:26.484220 20270 consensus_meta.cc:287] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.554s	user 0.013s	sys 0.000s
W20260709 12:10:26.505661 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 130919us
I20260709 12:10:26.506460 18061 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:26.440572 20310 consensus_queue.cc:1048] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 12:10:26.507654 20060 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.516353 18093 raft_consensus.cc:1240] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:26.523514 20207 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:26.525630 20207 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:26.528575 20088 raft_consensus.cc:2749] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:26.529016 20218 raft_consensus.cc:2749] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:26.532032 20120 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:10:26.481025 20300 consensus_queue.cc:237] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:26.466707 20293 consensus_queue.cc:1048] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.111s
I20260709 12:10:26.534341 20279 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:26.537981 18061 leader_election.cc:304] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:26.501515 20152 raft_consensus.cc:515] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:26.556016 20236 consensus_meta.cc:287] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.542s	user 0.006s	sys 0.005s
I20260709 12:10:26.558339 17941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 1925) took 1243 ms. Trace:
I20260709 12:10:26.559526 20270 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.521409 20310 consensus_queue.cc:1243] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer c5ffa786c8fb43f7864fa8fbe76534cb log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:10:26.554023 20067 consensus_meta.cc:287] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.693s	user 0.005s	sys 0.005s
I20260709 12:10:26.573685 20120 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123)
I20260709 12:10:26.575053 20126 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:26.521446 20060 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:26.556689 20292 raft_consensus.cc:2804] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:26.560560 20156 raft_consensus.cc:2749] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:26.580816 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 134682us
I20260709 12:10:26.541008 19803 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:26.569715 20236 raft_consensus.cc:2749] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:26.567106 20034 raft_consensus.cc:2804] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:26.571475 17941 rpcz_store.cc:276] 0709 12:10:25.314468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:25.511419 (+196951us) service_pool.cc:224] Handling call
0709 12:10:25.511698 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:25.511878 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:25.742475 (+230597us) log.cc:844] Serialized 14 byte log entry
0709 12:10:26.518331 (+775856us) spinlock_profiling.cc:243] Waited 2.53 ms on lock 0x7b1800386e60. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f498a7e07 00007f7f527029a9 00007f7f498c469b 00007f7f498c293f 00007f7f498c2455 00007f7f4c9aa060 00007f7f4c9bc716 00007f7f4c9cd287 00007f7f4c9cd208
0709 12:10:26.556474 (+ 38143us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:26.556533 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:26.556579 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:26.558124 (+  1545us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:26.558284 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":207643,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":6529,"raft.run_wall_time_us":6429,"spinlock_wait_cycles":19319680,"thread_start_us":354691,"threads_started":3,"wal-append.queue_time_us":272772}
I20260709 12:10:26.593626 18643 raft_consensus.cc:1240] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:10:26.577268 20060 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:26.582862 20292 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:26.600756 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:26.601504 18640 raft_consensus.cc:2393] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 2: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:26.571169 20270 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:26.583272 20307 consensus_queue.cc:237] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:26.610718 18638 raft_consensus.cc:1275] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:26.612486 18638 raft_consensus.cc:1275] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:26.612929 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:26.615270 19803 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:26.597352 20034 raft_consensus.cc:697] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:26.599773 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:26.603046 20292 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:26.625039 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:26.669139 20060 consensus_queue.cc:1048] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:26.670053 20152 leader_election.cc:290] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:26.623651 20206 consensus_meta.cc:287] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.642s	user 0.011s	sys 0.000s
I20260709 12:10:26.670893 19803 consensus_queue.cc:1048] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:10:26.618263 20233 consensus_meta.cc:287] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.690s	user 0.012s	sys 0.000s
W20260709 12:10:26.671128 20282 log.cc:927] Time spent T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.644s	user 0.001s	sys 0.002s
W20260709 12:10:26.675688 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 46660us
W20260709 12:10:26.720220 17988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.724253 20220 raft_consensus.cc:3055] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:26.724720 20220 raft_consensus.cc:740] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:26.725585 20220 consensus_queue.cc:260] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:26.737805 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:26.738621 18092 raft_consensus.cc:2393] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 4: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:26.739316 20253 raft_consensus.cc:3055] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:26.739712 20253 raft_consensus.cc:740] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:26.740552 20253 consensus_queue.cc:260] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:26.741866 20253 raft_consensus.cc:3060] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:26.742532 18094 raft_consensus.cc:1240] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:26.744747 18093 raft_consensus.cc:1275] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:26.752574 18022 raft_consensus.cc:1240] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:26.756022 20234 consensus_meta.cc:287] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.772s	user 0.016s	sys 0.000s
I20260709 12:10:26.766884 20205 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.767417 20205 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:26.769594 20205 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:26.768963 20157 consensus_queue.cc:260] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:26.771106 20270 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:26.772051 20208 raft_consensus.cc:3055] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:26.772524 20208 raft_consensus.cc:740] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:26.773401 20208 consensus_queue.cc:260] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:26.801740 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:26.802464 18642 raft_consensus.cc:2468] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3.
I20260709 12:10:26.802951 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:26.803608 18637 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:10:26.819664 18061 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:26.829912 17912 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:26.790187 20034 consensus_queue.cc:237] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:26.811026 20234 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.826730 19803 raft_consensus.cc:2804] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:26.836230 19803 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:26.843379 19803 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:26.824930 20205 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
W20260709 12:10:26.868227 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.836701 20027 raft_consensus.cc:2804] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:26.805932 20250 consensus_queue.cc:1059] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:10:26.848711 20146 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.848773 20234 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:26.828998 20319 consensus_queue.cc:1048] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 12:10:26.884584 20027 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:26.878860 19928 consensus_queue.cc:1059] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:10:26.915935 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:26.917395 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:26.917717 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:26.909255 20027 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:26.961867 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:26.918013 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:26.918493 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:26.878008 20205 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:26.905304 20262 consensus_meta.cc:287] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.701s	user 0.000s	sys 0.012s
W20260709 12:10:26.910466 20322 log.cc:927] Time spent T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
W20260709 12:10:26.910560 20318 log.cc:927] Time spent T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:10:26.880369 20232 consensus_queue.cc:1048] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:10:26.957552 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:26.917923 18020 raft_consensus.cc:1275] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:26.985996 18020 pending_rounds.cc:85] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb: Aborting all ops after (but not including) 6
I20260709 12:10:26.986378 18020 pending_rounds.cc:107] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:26.958235 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:26.958829 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:26.987409 18094 raft_consensus.cc:2468] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 5.
I20260709 12:10:26.890959 20146 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:26.948915 20320 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.969817 19655 consensus_queue.cc:1059] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:26.973408 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:26.993697 18021 raft_consensus.cc:3060] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:26.975703 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:26.988097 18020 raft_consensus.cc:2889] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:26.963950 20250 raft_consensus.cc:493] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.967032 20307 raft_consensus.cc:493] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:26.904428 20281 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:27.004135 18610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.006850 20316 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.007478 19928 raft_consensus.cc:3055] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:26.971026 20262 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:27.010444 17914 leader_election.cc:304] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:26.971650 18089 raft_consensus.cc:1240] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:27.014384 19928 raft_consensus.cc:740] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
W20260709 12:10:27.021546 20324 log.cc:927] Time spent T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
W20260709 12:10:27.021930 20315 log.cc:927] Time spent T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
I20260709 12:10:27.011332 20233 raft_consensus.cc:3055] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:27.003958 20219 consensus_queue.cc:1048] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:10:27.028064 18024 raft_consensus.cc:1240] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:27.012691 20320 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:27.031637 20233 raft_consensus.cc:740] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:27.038218 20233 consensus_queue.cc:260] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:27.039418 20233 raft_consensus.cc:3060] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:27.042783 20325 log.cc:927] Time spent T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.115s	user 0.003s	sys 0.000s
I20260709 12:10:27.043267 20320 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:27.031950 20316 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:27.044142 20323 log.cc:927] Time spent T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:10:27.047541 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:27.048391 17942 raft_consensus.cc:2468] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
I20260709 12:10:27.045221 20316 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:27.050891 18608 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:27.028709 20138 raft_consensus.cc:2804] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:27.033643 20326 log.cc:927] Time spent T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:10:27.011191 20250 raft_consensus.cc:515] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:27.055109 20321 log.cc:927] Time spent T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:10:27.055938 20281 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:27.056691 20316 raft_consensus.cc:493] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:27.057703 20311 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:27.066218 18095 raft_consensus.cc:1240] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:27.072162 18021 raft_consensus.cc:2468] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:10:27.012741 20307 raft_consensus.cc:515] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:27.073210 20218 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:27.098989 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:27.060142 20138 raft_consensus.cc:493] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.135251 20138 raft_consensus.cc:3060] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.139142 20161 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.139756 20161 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:27.140200 20234 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:27.074126 20137 raft_consensus.cc:2804] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:27.141287 20137 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.141793 20137 raft_consensus.cc:3060] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:27.141889 20161 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:27.142668 20138 raft_consensus.cc:515] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:27.144164 18023 raft_consensus.cc:1240] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:10:27.144912 20138 leader_election.cc:290] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:27.056671 20262 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:27.042408 20292 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:27.151674 18095 raft_consensus.cc:1275] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:27.157420 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:27.159175 20120 raft_consensus.cc:493] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.159721 20250 leader_election.cc:290] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:27.159670 20120 raft_consensus.cc:515] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:27.161689 20120 leader_election.cc:290] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:27.162866 20205 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:27.115192 20281 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.079309 20316 raft_consensus.cc:515] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:27.098439 20311 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:27.165356 20316 leader_election.cc:290] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:27.165752 20311 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:27.166018 20220 raft_consensus.cc:3060] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:27.098029 19928 consensus_queue.cc:260] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:27.162982 20292 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:27.169999 18098 raft_consensus.cc:1275] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:27.150274 20262 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:27.187359 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 193277us
I20260709 12:10:27.151253 20218 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:27.182086 20205 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.163761 20281 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:27.196305 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:27.197062 17988 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:27.198604 17942 raft_consensus.cc:1240] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:27.200366 17988 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:27.206995 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:27.207551 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:27.207688 17942 raft_consensus.cc:2468] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:10:27.190738 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:27.186717 20262 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:27.215164 17945 raft_consensus.cc:1275] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:27.195313 20205 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:27.205288 20027 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:27.219163 20205 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:27.223407 20281 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:27.223773 20228 consensus_meta.cc:287] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.774s	user 0.003s	sys 0.008s
I20260709 12:10:27.224020 20281 raft_consensus.cc:2749] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:27.224427 20307 leader_election.cc:290] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:27.227090 17988 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:27.228598 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:27.229462 18098 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 6.
I20260709 12:10:27.230847 18609 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:27.225095 19803 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:27.233915 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:27.234681 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:27.235673 20281 raft_consensus.cc:2749] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:27.213421 18089 raft_consensus.cc:2468] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 3.
I20260709 12:10:27.236829 20134 consensus_queue.cc:260] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:27.237475 20218 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:27.238224 20027 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:27.225903 20146 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:27.246953 18093 raft_consensus.cc:1240] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
W20260709 12:10:27.247131 20280 log.cc:927] Time spent T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 1.209s	user 0.011s	sys 0.002s
I20260709 12:10:27.224354 20228 raft_consensus.cc:2749] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:27.246510 19803 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:27.248960 20344 raft_consensus.cc:2804] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:27.249439 20344 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.249826 20344 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:27.252580 20262 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:27.253219 20281 consensus_queue.cc:1059] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:27.233309 18015 raft_consensus.cc:2468] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:10:27.256433 18609 leader_election.cc:304] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:27.259022 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:27.266294 18638 raft_consensus.cc:1275] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:27.268218 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:27.285476 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:27.286425 18019 raft_consensus.cc:2468] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 5.
W20260709 12:10:27.287115 18608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.288749 18019 raft_consensus.cc:1240] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:27.290989 18019 raft_consensus.cc:1275] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:27.291383 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:27.292104 18020 raft_consensus.cc:2468] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 4.
I20260709 12:10:27.293990 17989 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:27.298789 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:27.299561 18020 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:27.260202 19803 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.262521 20146 raft_consensus.cc:2804] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:27.295846 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:27.316988 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:27.317461 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.317579 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:27.319934 18018 raft_consensus.cc:2468] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 5.
I20260709 12:10:27.321149 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:27.321877 18018 raft_consensus.cc:2468] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 6.
I20260709 12:10:27.298215 20233 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.294090 20307 consensus_queue.cc:1048] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:10:27.308146 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:27.310953 20262 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:27.261250 20137 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:27.333941 20233 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:27.338867 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:27.339819 20233 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:27.335515 20027 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.318938 19803 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:27.340902 20027 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:27.343199 19803 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:27.343652 18023 raft_consensus.cc:2393] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 6: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:27.335409 20262 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:27.346554 20262 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:27.311782 20218 consensus_queue.cc:1059] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:10:27.352955 20027 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:27.354605 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:27.358701 18642 raft_consensus.cc:2393] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 3: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:27.359792 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:27.318655 20146 raft_consensus.cc:493] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.367652 20141 raft_consensus.cc:3060] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:27.372537 20245 raft_consensus.cc:493] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.303090 20228 consensus_queue.cc:1059] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:10:27.376502 17913 leader_election.cc:304] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:27.335150 18019 raft_consensus.cc:3060] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.380472 18022 raft_consensus.cc:2468] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:10:27.391212 17913 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:27.383333 18018 raft_consensus.cc:1275] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:27.383728 18641 raft_consensus.cc:2468] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
W20260709 12:10:27.395180 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.395563 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:27.396155 18641 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:27.389189 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.382931 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:27.391634 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:27.396926 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:27.397485 18022 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
I20260709 12:10:27.398963 18018 raft_consensus.cc:1275] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:27.400004 20205 raft_consensus.cc:2804] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:27.400435 20205 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.400578 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:27.400678 20341 raft_consensus.cc:3055] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:27.401310 20341 raft_consensus.cc:740] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:27.401398 18016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45472 (request call id 1831) took 1142 ms. Trace:
I20260709 12:10:27.400813 20205 raft_consensus.cc:3060] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:27.401947 18016 rpcz_store.cc:276] 0709 12:10:26.258759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.265921 (+  7162us) service_pool.cc:224] Handling call
0709 12:10:27.400409 (+1134488us) spinlock_profiling.cc:243] Waited 2.23 ms on lock 0x7b5800055898. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4988db71 00007f7f4988da22 00007f7f527a68d9 00007f7f51900ee0 00007f7f519ca0ab 00007f7f519ca131 00007f7f519780a0 00007f7f51977984 00007f7f4aef26d4 00007f7f4aef2662
0709 12:10:27.401316 (+   907us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5137664}
I20260709 12:10:27.402431 20341 consensus_queue.cc:260] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:10:27.403867 20341 raft_consensus.cc:3060] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:27.427069 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.385248 20146 raft_consensus.cc:3060] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:27.415292 18641 raft_consensus.cc:2468] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 4.
I20260709 12:10:27.413592 18020 raft_consensus.cc:2468] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 7.
W20260709 12:10:27.449098 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 57994.4us
I20260709 12:10:27.451256 17913 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:27.382362 20272 raft_consensus.cc:3055] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:27.454116 17912 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:27.422138 18635 raft_consensus.cc:2368] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 6. Current term is 7.
I20260709 12:10:27.459450 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:27.455418 20278 raft_consensus.cc:2804] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:27.463244 20278 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.463627 20278 raft_consensus.cc:3060] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.429343 20137 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:27.467922 20312 raft_consensus.cc:2804] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:27.461122 20319 raft_consensus.cc:2804] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:10:27.455603 20294 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.468608 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:27.388005 20262 consensus_queue.cc:1059] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 12:10:27.475482 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:27.484568 17945 raft_consensus.cc:1275] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:27.397162 20027 consensus_queue.cc:1048] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 12:10:27.457775 20272 raft_consensus.cc:740] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:27.545873 17942 raft_consensus.cc:2393] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 4: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:27.405057 20245 raft_consensus.cc:515] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:27.562318 18019 raft_consensus.cc:2468] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
I20260709 12:10:27.488421 20311 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:27.551753 20138 raft_consensus.cc:493] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
W20260709 12:10:27.585953 20337 log.cc:927] Time spent T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 12:10:27.588359 18024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 1824) took 1352 ms. Trace:
I20260709 12:10:27.588763 18024 rpcz_store.cc:276] 0709 12:10:26.235854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.235964 (+   110us) service_pool.cc:224] Handling call
0709 12:10:26.264539 (+ 28575us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:27.034938 (+770399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:27.588162 (+553224us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b540008ded4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:27.588310 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1755530624}
I20260709 12:10:27.602123 18015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53022 (request call id 387) took 1017 ms. Trace:
I20260709 12:10:27.602622 18015 rpcz_store.cc:276] 0709 12:10:26.584334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.585479 (+  1145us) service_pool.cc:224] Handling call
0709 12:10:27.601916 (+1016437us) spinlock_profiling.cc:243] Waited 600 ms on lock 0x7b54000b2f54. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:27.602052 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1380076288}
I20260709 12:10:27.609776 20088 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:27.611810 20088 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:27.616124 20208 raft_consensus.cc:3060] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:27.547092 20294 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:27.579275 20311 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:27.641932 18639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60424 (request call id 714) took 1365 ms. Trace:
I20260709 12:10:27.648375 20297 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.588903 20138 raft_consensus.cc:515] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:27.624172 20088 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:27.636809 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:27.656608 18023 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 6.
I20260709 12:10:27.643323 20245 leader_election.cc:290] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:27.671473 18062 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:27.650292 20297 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:27.689992 20297 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:27.647058 20034 raft_consensus.cc:493] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:27.698078 18062 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:27.724996 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:27.748745 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 50756.7us
I20260709 12:10:27.749769 18062 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:27.645244 18639 rpcz_store.cc:276] 0709 12:10:26.276723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.276841 (+   118us) service_pool.cc:224] Handling call
0709 12:10:26.277131 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:26.364826 (+ 87695us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:26.411503 (+ 46677us) log.cc:844] Serialized 14 byte log entry
0709 12:10:26.596752 (+185249us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:26.597534 (+   782us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:26.601023 (+  3489us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:27.641643 (+1040620us) spinlock_profiling.cc:243] Waited 77.5 ms on lock 0x7b54004164d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:27.641696 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:27.641849 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":32149,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":35,"raft.queue_time_us":82,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":1843,"spinlock_wait_cycles":178357120,"thread_start_us":168680,"threads_started":1,"wal-append.queue_time_us":209272}
I20260709 12:10:27.752382 20138 leader_election.cc:290] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:27.752954 20138 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.753401 20138 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:27.756350 20311 leader_election.cc:290] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:27.756845 20311 raft_consensus.cc:493] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:27.757272 20311 raft_consensus.cc:515] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:27.696780 20207 consensus_queue.cc:1048] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 12:10:27.762197 20207 consensus_queue.cc:1243] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer 63f5bddeebd84e5788d671a176cfa8e1 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:10:27.623276 20344 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:27.763309 20207 raft_consensus.cc:2749] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:27.763913 20207 raft_consensus.cc:2749] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:27.764529 20207 raft_consensus.cc:493] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:27.765333 20346 log.cc:927] Time spent T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:10:27.765893 20034 raft_consensus.cc:515] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:27.764782 20344 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:27.772235 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:27.773401 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:27.773923 18096 raft_consensus.cc:3060] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:27.772847 18098 raft_consensus.cc:2468] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 4.
I20260709 12:10:27.775384 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:27.775522 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:27.775801 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:27.775995 18091 raft_consensus.cc:2468] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 5.
I20260709 12:10:27.668701 20161 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.776824 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:27.777840 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:27.778349 18095 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:27.779021 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:27.783658 18098 raft_consensus.cc:1240] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:27.784893 18062 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:27.787360 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:27.788321 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.789088 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:27.616945 20272 consensus_queue.cc:260] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:27.789637 18091 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:27.790097 20272 raft_consensus.cc:3060] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:27.791947 20072 raft_consensus.cc:493] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.791613 20278 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:27.793809 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:27.793884 20072 raft_consensus.cc:515] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:27.741532 20292 raft_consensus.cc:2749] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:27.796167 20072 leader_election.cc:290] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:27.798082 18090 raft_consensus.cc:2393] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 4: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:27.794479 18089 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:27.745870 20245 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.799659 18096 raft_consensus.cc:2468] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
I20260709 12:10:27.801647 20141 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.802105 20141 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:27.802496 18091 raft_consensus.cc:2468] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 4.
I20260709 12:10:27.802609 20285 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
W20260709 12:10:27.803699 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.802399 18095 raft_consensus.cc:2468] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 7.
I20260709 12:10:27.769918 20241 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:27.803309 20285 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:27.801129 18062 leader_election.cc:304] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:27.873664 20034 leader_election.cc:290] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:27.793185 20289 raft_consensus.cc:2804] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:27.774792 20207 raft_consensus.cc:515] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:27.894201 20345 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.004s	sys 0.018s
W20260709 12:10:27.894621 20345 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.004s	sys 0.018s
I20260709 12:10:27.903565 18608 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:27.905725 20167 raft_consensus.cc:2804] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:27.906208 20167 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:27.906599 20167 raft_consensus.cc:3060] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:27.907693 20340 consensus_queue.cc:1048] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:27.792807 20161 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:27.801179 20205 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:27.927516 18608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.807509 20245 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:27.910472 20307 raft_consensus.cc:2749] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:27.891961 20289 raft_consensus.cc:697] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 5 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:27.820272 20241 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:27.934337 18638 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.022s	sys 0.090s
W20260709 12:10:27.939857 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:27.910218 20310 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.008s	sys 0.015s
I20260709 12:10:27.918223 20311 leader_election.cc:290] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:27.956624 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:27.954345 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 366448us
W20260709 12:10:27.944943 20341 consensus_meta.cc:287] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.538s	user 0.007s	sys 0.005s
I20260709 12:10:27.937034 20141 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:27.960619 18094 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.077s	sys 0.167s
W20260709 12:10:27.976773 18094 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.078s	sys 0.167s
W20260709 12:10:27.945998 18638 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.022s	sys 0.090s
I20260709 12:10:27.916128 20134 raft_consensus.cc:3060] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:27.970741 18022 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.007s	sys 0.013s
I20260709 12:10:27.971271 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:27.985745 18022 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.007s	sys 0.013s
I20260709 12:10:27.929375 20270 consensus_queue.cc:1059] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:10:27.986444 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:27.970577 20310 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.008s	sys 0.019s
W20260709 12:10:28.003932 17989 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.006s	sys 0.017s
W20260709 12:10:28.005216 17989 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.006s	sys 0.017s
I20260709 12:10:27.985873 17943 raft_consensus.cc:2368] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 4. Current term is 5.
W20260709 12:10:28.006882 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 709382us
W20260709 12:10:28.010480 18607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:27.975159 20294 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:28.014622 17989 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:27.985239 20234 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:27.985102 20311 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.020062 20262 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
W20260709 12:10:27.996163 20316 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.022s	sys 0.006s
I20260709 12:10:27.992659 20312 raft_consensus.cc:697] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:28.024281 18637 raft_consensus.cc:2393] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 5: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
W20260709 12:10:28.034482 20206 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.045s	sys 0.110s
I20260709 12:10:28.036947 20278 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:28.035436 20316 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.022s	sys 0.006s
I20260709 12:10:28.015345 20344 consensus_queue.cc:1048] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:10:28.028358 20088 consensus_queue.cc:1048] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:10:28.044883 20319 raft_consensus.cc:697] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:28.055478 20141 raft_consensus.cc:493] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:28.052479 20236 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.011s	sys 0.018s
I20260709 12:10:28.030833 20234 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:28.035591 20311 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:28.013890 20289 consensus_queue.cc:237] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:28.052762 20228 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.004s	sys 0.023s
I20260709 12:10:28.060598 20205 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:28.051887 20206 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.046s	sys 0.110s
I20260709 12:10:28.051216 20207 leader_election.cc:290] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:28.046665 20159 consensus_queue.cc:1048] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:10:28.071596 20319 consensus_queue.cc:237] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:28.066340 20236 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.011s	sys 0.018s
I20260709 12:10:28.086825 20312 consensus_queue.cc:237] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:28.076718 20228 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.005s	sys 0.023s
I20260709 12:10:28.037336 20262 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:28.052945 20370 raft_consensus.cc:2749] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:28.081312 20088 consensus_queue.cc:1048] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:28.059614 20278 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.070350 20161 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:28.070587 20245 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:28.072458 20285 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:28.072834 20369 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:28.090291 20228 raft_consensus.cc:493] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:28.078055 20241 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:28.069439 20141 raft_consensus.cc:515] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:28.086098 20167 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:28.097600 20311 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:28.039526 18061 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
W20260709 12:10:28.270232 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.111831 20228 raft_consensus.cc:515] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:28.289029 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.273061 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:28.291317 20284 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.292022 18638 raft_consensus.cc:2393] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 5: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:28.292364 20284 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:28.293599 18608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.293960 20300 raft_consensus.cc:2749] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:28.250626 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.213872 18017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 1837) took 1297 ms. Trace:
I20260709 12:10:28.297256 20285 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:28.298271 20285 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:28.299291 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:28.301067 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:28.301939 18095 raft_consensus.cc:2468] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:28.101500 20278 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:28.303442 20375 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.303725 18091 raft_consensus.cc:1240] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:28.304203 20375 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:28.305079 20365 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.305155 20278 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:28.305882 20365 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:28.306270 20358 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.306910 20375 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:28.307186 20358 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:28.308391 20365 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:28.110556 20369 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:28.310214 20377 raft_consensus.cc:493] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
W20260709 12:10:28.156426 20360 log.cc:927] Time spent T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:10:28.311112 20377 raft_consensus.cc:515] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:28.311964 20369 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:28.312244 20374 raft_consensus.cc:2764] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:10:28.313346 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:28.313699 20377 leader_election.cc:290] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:28.314131 18096 raft_consensus.cc:2468] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 5.
I20260709 12:10:28.271410 20262 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:28.297988 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 258418us
I20260709 12:10:28.277400 20141 leader_election.cc:290] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:28.314190 20285 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:28.191744 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:28.241326 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 428247us
I20260709 12:10:28.263149 18094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41818 (request call id 637) took 1216 ms. Trace:
I20260709 12:10:28.310295 20358 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:28.296464 18017 rpcz_store.cc:276] 0709 12:10:26.916169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:26.919997 (+  3828us) service_pool.cc:224] Handling call
0709 12:10:26.962840 (+ 42843us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:27.006527 (+ 43687us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:27.006571 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:27.007099 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 12:10:27.608097 (+600998us) spinlock_profiling.cc:243] Waited 2.75 ms on lock 0x7b18003c91c0. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f498c5522 00007f7f498c77c1 00007f7f498c7779 00007f7f498c7709 00007f7f498c76d1 00007f7f498c69cd 0000000000388634 0000000000388479 00007f7f498a883a
0709 12:10:27.994620 (+386523us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b18003c91c0. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f498a7e07 00007f7f527029a9 00007f7f498c469b 00007f7f498c293f 00007f7f498c4c02 00007f7f4c54c20b 00007f7f4c551d23 00007f7f4c5520d1 00007f7f4c96da0f
0709 12:10:28.212857 (+218237us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:28.212980 (+   123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.213181 (+   201us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:28.213271 (+    90us) raft_consensus.cc:1685] finished
0709 12:10:28.213316 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.213599 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5043,"raft.queue_time_us":13154,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":2250,"spinlock_wait_cycles":13971584,"thread_start_us":217646,"threads_started":1,"wal-append.queue_time_us":1144635}
I20260709 12:10:28.373268 17989 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:28.278573 20241 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.375504 20241 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:28.376009 20358 raft_consensus.cc:2749] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:28.376178 17989 leader_election.cc:304] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:28.377526 20358 raft_consensus.cc:2804] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:28.377996 20358 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:28.378412 20358 raft_consensus.cc:3060] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:28.280205 20142 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.279541 20208 raft_consensus.cc:493] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.379313 20142 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:28.380087 20208 raft_consensus.cc:515] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:28.270489 20088 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:28.278033 20234 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:28.382021 20088 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:28.272754 20218 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.396054 20167 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:28.384609 20241 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:28.365006 18094 rpcz_store.cc:276] 0709 12:10:27.046884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.047182 (+   298us) service_pool.cc:224] Handling call
0709 12:10:27.073250 (+ 26068us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:27.156584 (+ 83334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:27.156613 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:27.158361 (+  1748us) log.cc:844] Serialized 26 byte log entry
0709 12:10:27.977425 (+819064us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:27.977495 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:27.977602 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:28.262376 (+284774us) raft_consensus.cc:1685] finished
0709 12:10:28.262422 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.262811 (+   389us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82896,"raft.queue_time_us":83466,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"thread_start_us":818676,"threads_started":1,"wal-append.queue_time_us":920901}
I20260709 12:10:28.407738 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:28.411060 20370 raft_consensus.cc:493] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.411882 20370 raft_consensus.cc:515] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:28.414106 18095 raft_consensus.cc:2410] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:10:28.423046 20228 leader_election.cc:290] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:28.423324 17989 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:28.424424 20228 raft_consensus.cc:2804] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:28.424863 20228 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:28.424979 20060 raft_consensus.cc:3055] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:28.425325 20228 raft_consensus.cc:3060] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:28.425482 20060 raft_consensus.cc:740] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:28.397323 20218 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:28.422394 20272 consensus_meta.cc:287] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.632s	user 0.015s	sys 0.000s
I20260709 12:10:28.435241 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:28.439831 20146 consensus_meta.cc:287] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.980s	user 0.007s	sys 0.007s
I20260709 12:10:28.440505 20146 raft_consensus.cc:515] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:28.441321 20027 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.442322 18640 raft_consensus.cc:2368] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 3. Current term is 4.
I20260709 12:10:28.442148 20027 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:28.410356 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:28.492982 20312 raft_consensus.cc:493] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:28.494000 20312 raft_consensus.cc:515] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:28.494573 20146 leader_election.cc:290] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:28.495913 18638 raft_consensus.cc:2410] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:28.497030 20312 leader_election.cc:290] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:28.497531 20138 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:28.501829 20027 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:28.502818 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:28.502807 20285 raft_consensus.cc:493] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:28.502861 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:28.505786 18095 raft_consensus.cc:1240] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:28.506148 20218 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:28.506794 20284 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:28.509148 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:28.509344 18092 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53954 (request call id 1810) took 1441 ms. Trace:
I20260709 12:10:28.514266 20365 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.517134 20367 raft_consensus.cc:493] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.517161 20088 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:28.520303 19928 raft_consensus.cc:3060] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:28.536787 20285 raft_consensus.cc:515] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:28.537793 20365 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:28.539259 20285 leader_election.cc:290] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:28.539775 20157 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:28.540122 20365 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:28.528793 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 99446.2us
W20260709 12:10:28.541474 18608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.540550 20367 raft_consensus.cc:515] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:28.530686 18092 rpcz_store.cc:276] 0709 12:10:27.067613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.067751 (+   138us) service_pool.cc:224] Handling call
0709 12:10:28.412023 (+1344272us) spinlock_profiling.cc:243] Waited 6.45 ms on lock 0x7b58001b0998. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4988db71 00007f7f4988da22 00007f7f527a68d9 00007f7f51900ee0 00007f7f519ca0ab 00007f7f519ca131 00007f7f5198bfc0 00007f7f51976929 00007f7f519763d2 00007f7f4aeedbd4
0709 12:10:28.412450 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:28.508878 (+ 96428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:28.508914 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:28.508980 (+    66us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:10:28.509019 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:28.509070 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:28.509187 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14828288}
W20260709 12:10:28.543797 18608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.550726 20138 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.551494 20138 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:28.558728 18607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.559922 20297 raft_consensus.cc:3055] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:28.560319 20297 raft_consensus.cc:740] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
W20260709 12:10:28.562270 20134 consensus_meta.cc:287] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.569s	user 0.002s	sys 0.012s
I20260709 12:10:28.550742 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:28.561448 20297 consensus_queue.cc:260] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:28.565939 20285 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:28.549115 20088 raft_consensus.cc:493] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:28.574528 18089 consensus_meta.cc:287] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.635s	user 0.011s	sys 0.011s
I20260709 12:10:28.581063 18095 raft_consensus.cc:2468] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:28.581650 20293 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.578315 18642 raft_consensus.cc:2468] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 4.
I20260709 12:10:28.569135 20284 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:28.568711 20365 consensus_queue.cc:1059] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:10:28.580611 20027 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:28.623844 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:28.660808 20027 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:28.661804 20284 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:28.576839 18608 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 1.758s (SENT) [suppressed 40 similar messages]
I20260709 12:10:28.662809 20138 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:28.672369 17989 leader_election.cc:304] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:28.657204 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:28.608558 20088 raft_consensus.cc:515] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:28.624022 20381 log.cc:927] Time spent T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:10:28.656459 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:28.659312 20270 raft_consensus.cc:493] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:28.653479 20387 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.666213 19928 raft_consensus.cc:493] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.688741 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:28.690325 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:28.690826 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:28.691150 18019 raft_consensus.cc:2468] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:28.691608 18024 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 7.
I20260709 12:10:28.691902 20241 raft_consensus.cc:493] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:28.692572 20241 raft_consensus.cc:515] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:28.693302 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:28.693979 18016 raft_consensus.cc:2468] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:28.695250 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:28.682950 18635 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60430 (request call id 494) took 1406 ms (client timeout 1539 ms). Trace:
I20260709 12:10:28.694970 19928 raft_consensus.cc:515] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:28.696102 18635 rpcz_store.cc:269] 0709 12:10:27.276709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.323252 (+ 46543us) service_pool.cc:224] Handling call
0709 12:10:28.682486 (+1359234us) spinlock_profiling.cc:243] Waited 66.5 ms on lock 0x7b540069e954. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:28.682763 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":152867200}
I20260709 12:10:28.699040 20297 raft_consensus.cc:3060] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:28.699214 17988 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.254s	user 0.002s	sys 0.014s
W20260709 12:10:28.699627 17988 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.255s	user 0.002s	sys 0.014s
I20260709 12:10:28.652724 20358 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:28.612967 20285 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:28.702332 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:28.679682 20365 raft_consensus.cc:2804] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:28.717324 17941 raft_consensus.cc:1275] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:28.712687 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:28.683372 20284 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:28.723853 17942 raft_consensus.cc:1275] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:28.712795 18023 raft_consensus.cc:2410] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:28.723461 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:28.719697 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:28.699251 19928 leader_election.cc:290] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:28.764586 20370 leader_election.cc:290] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:28.738063 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:28.764521 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:28.742369 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:28.743901 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:28.744647 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:28.744786 20228 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:28.746029 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:28.738046 18018 raft_consensus.cc:2468] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:28.746824 20138 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.749226 20060 consensus_queue.cc:260] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:28.686151 20205 raft_consensus.cc:493] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:28.750871 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:28.751204 20270 raft_consensus.cc:515] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:28.701282 20367 leader_election.cc:290] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:28.719521 20277 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:28.752532 18094 raft_consensus.cc:2410] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:28.752772 20272 raft_consensus.cc:493] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:28.754276 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:28.756431 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:28.757212 20256 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.781369 20060 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:28.760706 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:28.782163 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:28.781739 20256 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:28.758968 20358 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:28.782764 17946 raft_consensus.cc:3060] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:28.762066 20300 raft_consensus.cc:493] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:28.783195 17949 raft_consensus.cc:3060] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:28.784091 18096 raft_consensus.cc:3060] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:28.774309 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:28.782858 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:28.786587 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:28.787237 17944 raft_consensus.cc:2468] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:10:28.788610 20228 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:28.788924 18641 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
I20260709 12:10:28.788030 17941 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 7.
I20260709 12:10:28.679510 18089 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
I20260709 12:10:28.764904 19928 raft_consensus.cc:493] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:28.802125 18096 raft_consensus.cc:2468] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:10:28.769966 20241 leader_election.cc:290] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:28.774636 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:28.781030 17947 raft_consensus.cc:2468] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:10:28.781461 17948 raft_consensus.cc:3060] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:28.783656 20300 raft_consensus.cc:515] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:28.788127 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:28.704015 20027 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:28.792483 17945 raft_consensus.cc:2393] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 6: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:28.736279 20365 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.797516 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:28.810359 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:28.817013 18092 raft_consensus.cc:2468] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:28.819070 17989 leader_election.cc:304] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:28.822156 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:28.824098 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:28.820719 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:10:28.829366 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 256630us
I20260709 12:10:28.830708 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:28.811447 20365 raft_consensus.cc:3060] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:28.769068 20293 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:28.797617 20138 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:28.839608 17944 raft_consensus.cc:2468] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 6.
I20260709 12:10:28.805231 20228 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:28.840237 17947 raft_consensus.cc:2468] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:28.829315 20358 raft_consensus.cc:2804] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:28.793476 20387 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:28.849745 17941 raft_consensus.cc:2468] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:28.847596 18022 raft_consensus.cc:2468] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:10:28.851233 17946 raft_consensus.cc:2468] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:10:28.847172 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:28.851070 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:28.853654 19655 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:28.853893 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:28.854423 17912 leader_election.cc:400] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Vote denied by peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647) with higher term. Message: Invalid argument: T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 6. Current term is 7.
I20260709 12:10:28.854326 19655 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:28.854817 17912 leader_election.cc:403] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:10:28.854019 20383 log.cc:927] Time spent T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
I20260709 12:10:28.835369 18089 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41818 (request call id 643) took 1058 ms. Trace:
I20260709 12:10:28.852346 17942 raft_consensus.cc:2468] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 3.
I20260709 12:10:28.860100 17942 raft_consensus.cc:3060] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:28.861702 20259 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:28.854614 18021 raft_consensus.cc:2468] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:10:28.855232 18095 raft_consensus.cc:2468] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:28.828178 20277 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:10:28.808530 20205 raft_consensus.cc:515] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:28.823745 20272 raft_consensus.cc:515] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:28.845502 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:28.849269 20157 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:28.838462 19928 raft_consensus.cc:515] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:28.872529 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:28.874558 17989 leader_election.cc:304] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:28.873747 17948 raft_consensus.cc:2468] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
W20260709 12:10:28.873807 18021 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53022 (request call id 394) took 1530 ms (client timeout 1525 ms). Trace:
I20260709 12:10:28.851989 20358 raft_consensus.cc:697] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:28.857124 20367 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:28.875008 17945 raft_consensus.cc:2468] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
I20260709 12:10:28.874416 20157 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:28.882588 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 80350.3us
W20260709 12:10:28.878960 18021 rpcz_store.cc:269] 0709 12:10:27.332692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.332822 (+   130us) service_pool.cc:224] Handling call
0709 12:10:28.845612 (+1512790us) spinlock_profiling.cc:243] Waited 3.51 ms on lock 0x7b5800055898. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4988db71 00007f7f4988da22 00007f7f527a68d9 00007f7f51900ee0 00007f7f519ca0ab 00007f7f519ca131 00007f7f519780a0 00007f7f51977984 00007f7f4aef26d4 00007f7f4aef2662
0709 12:10:28.863119 (+ 17507us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8061824}
W20260709 12:10:28.882830 20392 log.cc:927] Time spent T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:10:28.874081 18636 raft_consensus.cc:2468] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 5.
I20260709 12:10:28.884171 17943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50334 (request call id 1905) took 1422 ms. Trace:
I20260709 12:10:28.884928 20277 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:28.887624 20270 leader_election.cc:290] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:28.912110 17943 rpcz_store.cc:276] 0709 12:10:27.462143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.468325 (+  6182us) service_pool.cc:224] Handling call
0709 12:10:28.883735 (+1415410us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b54003c1254. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:28.883962 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":917601024}
I20260709 12:10:28.890206 20242 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:28.915272 20386 raft_consensus.cc:493] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:28.915041 20242 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:28.915848 20386 raft_consensus.cc:515] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:28.862314 20259 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:28.917309 18090 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53964 (request call id 1611) took 1144 ms. Trace:
I20260709 12:10:28.917747 18093 raft_consensus.cc:2468] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 5.
I20260709 12:10:28.917721 18090 rpcz_store.cc:276] 0709 12:10:27.773222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.773350 (+   128us) service_pool.cc:224] Handling call
0709 12:10:28.916972 (+1143622us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b54001455d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:28.917137 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50159360}
I20260709 12:10:28.917877 20386 leader_election.cc:290] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:28.918933 20259 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:28.919531 20259 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:28.919581 20340 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:28.890739 20228 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:28.921577 18609 leader_election.cc:304] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:28.922428 20228 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:28.922552 20249 raft_consensus.cc:2804] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:28.923112 20228 raft_consensus.cc:2804] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:28.923172 20249 raft_consensus.cc:697] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 4 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:28.923646 20228 raft_consensus.cc:493] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:28.924371 20249 consensus_queue.cc:237] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:28.899535 20027 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:28.927204 20341 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:28.927299 20270 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.891105 20300 leader_election.cc:290] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:28.897401 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:28.906433 19655 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:28.859266 18089 rpcz_store.cc:276] 0709 12:10:27.767251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.769800 (+  2549us) service_pool.cc:224] Handling call
0709 12:10:28.811771 (+1041971us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:28.906929 20138 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:28.907194 17947 pending_rounds.cc:85] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1: Aborting all ops after (but not including) 1
I20260709 12:10:28.907431 20379 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:28.907467 18643 raft_consensus.cc:1275] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:10:28.908382 20281 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:28.908957 20344 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:28.852090 20370 raft_consensus.cc:493] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:28.920104 20285 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:28.937713 17942 raft_consensus.cc:1275] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:28.944305 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:28.946487 18093 raft_consensus.cc:2368] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 3. Current term is 4.
I20260709 12:10:28.926216 20027 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:28.924081 20228 raft_consensus.cc:3060] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:28.894037 20218 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.931219 17947 pending_rounds.cc:107] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:10:28.878876 20284 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.953872 17949 raft_consensus.cc:2468] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
I20260709 12:10:28.953989 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:28.950857 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:28.966137 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:28.959527 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:28.963660 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:28.964095 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:28.968439 17941 raft_consensus.cc:2468] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:28.907226 20157 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:28.922571 20293 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:28.917343 20242 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:28.958076 17912 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:28.920181 20259 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:28.927958 20270 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:28.927927 20341 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:28.920253 20340 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:28.968931 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:29.212216 18093 raft_consensus.cc:3060] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.023859 18090 raft_consensus.cc:2393] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 6: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
W20260709 12:10:29.022607 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.149925 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:29.024940 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:29.219184 18098 raft_consensus.cc:3060] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.095819 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:29.222221 18089 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 7.
I20260709 12:10:28.967733 18094 raft_consensus.cc:2468] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 4.
I20260709 12:10:29.209743 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:29.223788 18019 raft_consensus.cc:3060] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:29.217706 20341 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:29.217933 20386 raft_consensus.cc:2804] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:29.228279 20386 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:29.228710 20386 raft_consensus.cc:3060] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:29.079572 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 178410us
I20260709 12:10:29.231546 17989 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:10:29.218410 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 260401us
I20260709 12:10:29.149549 18644 raft_consensus.cc:1275] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:29.233253 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:29.234982 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:29.235704 18644 raft_consensus.cc:2468] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 5.
I20260709 12:10:29.235913 20277 consensus_queue.cc:1048] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:29.237010 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:29.237761 18644 raft_consensus.cc:2468] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:29.217078 20157 consensus_queue.cc:1048] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:29.239710 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:29.239842 18640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60430 (request call id 501) took 1269 ms. Trace:
I20260709 12:10:29.240442 18640 rpcz_store.cc:276] 0709 12:10:27.970370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.971842 (+  1472us) service_pool.cc:224] Handling call
0709 12:10:29.239587 (+1267745us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b540041f854. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:29.239775 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1033165056}
I20260709 12:10:29.241875 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:29.245968 20088 leader_election.cc:290] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:29.249905 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:29.254943 18641 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60430 (request call id 499) took 1836 ms (client timeout 2093 ms). Trace:
W20260709 12:10:29.255519 18641 rpcz_store.cc:269] 0709 12:10:27.419289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.458749 (+ 39460us) service_pool.cc:224] Handling call
0709 12:10:29.254718 (+1795969us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b5400760f54. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:29.254868 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3054816512}
I20260709 12:10:29.029115 20370 raft_consensus.cc:515] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:29.259851 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.026813 20218 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:29.022857 18609 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:29.263345 20241 raft_consensus.cc:2804] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:29.263887 20241 raft_consensus.cc:697] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:29.264977 20241 consensus_queue.cc:237] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:29.267385 18635 raft_consensus.cc:1813] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Handling vote request from an unknown peer 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:29.267973 18635 raft_consensus.cc:2368] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 4. Current term is 5.
I20260709 12:10:28.963394 17947 raft_consensus.cc:2889] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:29.279297 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:29.280658 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:29.280722 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:29.281420 18096 raft_consensus.cc:2393] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 5: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:29.283486 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:29.285024 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:29.238363 20277 raft_consensus.cc:493] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:29.286597 20256 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:29.286839 20277 raft_consensus.cc:515] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:29.289186 20277 leader_election.cc:290] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:29.290597 20088 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.291189 20088 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:10:29.293314 20088 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123)
W20260709 12:10:29.294039 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 62579.3us
W20260709 12:10:29.295020 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 288094us
I20260709 12:10:29.297626 18098 raft_consensus.cc:2468] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 5.
I20260709 12:10:29.298707 20370 leader_election.cc:290] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:29.282333 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:29.298980 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:29.299389 20370 raft_consensus.cc:2804] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:29.300124 18098 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
I20260709 12:10:29.300128 18096 raft_consensus.cc:2468] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:10:29.304579 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:29.303632 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:29.305915 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:29.301223 20218 leader_election.cc:290] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:29.302109 20208 leader_election.cc:290] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:29.306607 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:29.026844 20206 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.324775 20206 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:29.325953 18095 raft_consensus.cc:2393] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 3: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:29.329769 20206 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:29.317667 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:29.029014 20205 leader_election.cc:290] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:29.336333 18643 raft_consensus.cc:2468] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:10:29.320052 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:29.152932 20385 log.cc:927] Time spent T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.635s	user 0.000s	sys 0.003s
W20260709 12:10:29.349597 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.024641 20156 raft_consensus.cc:3055] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:29.350131 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:29.037417 20387 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:29.030975 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:29.150107 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:29.213450 20270 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:10:29.348335 18642 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60430 (request call id 496) took 1967 ms (client timeout 2055 ms). Trace:
I20260709 12:10:29.029217 20367 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:29.016390 20312 raft_consensus.cc:2749] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647) with higher term. Message: Invalid argument: T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 6. Current term is 7.
I20260709 12:10:29.015625 20379 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:29.319964 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:29.315920 18062 leader_election.cc:304] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:29.307765 18094 raft_consensus.cc:2468] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 4.
I20260709 12:10:29.281308 18092 raft_consensus.cc:2468] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 5.
I20260709 12:10:29.411054 18022 raft_consensus.cc:2468] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:10:29.013648 20284 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:29.384778 17941 raft_consensus.cc:2410] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:10:29.309580 20256 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:28.966420 20365 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:29.393330 18093 raft_consensus.cc:2468] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
W20260709 12:10:29.385821 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 176933us
I20260709 12:10:29.406268 19655 raft_consensus.cc:493] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:29.358194 19928 leader_election.cc:290] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:29.317816 20218 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:29.397701 18642 rpcz_store.cc:269] 0709 12:10:27.381196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:27.382616 (+  1420us) service_pool.cc:224] Handling call
0709 12:10:29.333610 (+1950994us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54005f0ad4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:29.348259 (+ 14649us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2707145984}
I20260709 12:10:29.366729 18019 raft_consensus.cc:2468] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
I20260709 12:10:29.407076 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:29.319090 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:29.412153 17989 leader_election.cc:304] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:29.029403 20344 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:29.314805 20370 raft_consensus.cc:697] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:28.965742 20281 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:29.344357 20386 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:29.035264 20358 consensus_queue.cc:237] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:29.401054 20060 consensus_meta.cc:287] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.613s	user 0.006s	sys 0.006s
W20260709 12:10:29.418664 20394 log.cc:927] Time spent T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:10:29.419200 20067 raft_consensus.cc:2804] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:29.419080 20218 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:29.418709 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:29.384223 20156 raft_consensus.cc:740] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:29.422963 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:29.423794 18093 raft_consensus.cc:1275] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:29.424353 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:29.424997 18096 raft_consensus.cc:1275] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:29.417408 17912 leader_election.cc:304] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:29.430274 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:29.397101 18636 raft_consensus.cc:2468] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 4.
I20260709 12:10:29.430723 19655 raft_consensus.cc:515] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:29.443087 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:29.453435 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:29.456053 18098 raft_consensus.cc:2468] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 5.
W20260709 12:10:29.454025 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 138205us
I20260709 12:10:29.457280 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:29.310433 18089 raft_consensus.cc:2468] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 4.
I20260709 12:10:29.459123 18095 raft_consensus.cc:2468] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 2.
I20260709 12:10:29.462225 17912 leader_election.cc:400] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Vote denied by peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647) with higher term. Message: Invalid argument: T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 3. Current term is 4.
I20260709 12:10:29.421058 20270 raft_consensus.cc:2749] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:29.462720 17912 leader_election.cc:403] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:29.433151 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:29.444240 20256 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:29.464421 18090 raft_consensus.cc:2468] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
I20260709 12:10:29.475852 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:29.476966 18023 raft_consensus.cc:2468] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
I20260709 12:10:29.477931 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:29.479131 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:29.466179 20336 consensus_queue.cc:1048] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:10:29.479868 19655 leader_election.cc:290] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:29.452566 20205 raft_consensus.cc:2804] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:29.480721 20205 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.481096 20205 raft_consensus.cc:3060] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.481434 18023 raft_consensus.cc:2468] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
I20260709 12:10:29.482368 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:29.468654 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:29.482914 18023 raft_consensus.cc:3060] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.483332 18020 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:29.488508 20256 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:29.468540 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 385573us
I20260709 12:10:29.492302 18023 raft_consensus.cc:2468] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
I20260709 12:10:29.492516 17914 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:29.493465 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:29.494202 18023 raft_consensus.cc:2468] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:10:29.494805 20277 consensus_queue.cc:1059] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:29.495119 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:29.495646 20138 raft_consensus.cc:2749] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:29.495745 20277 raft_consensus.cc:3055] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:29.495816 18023 raft_consensus.cc:2468] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 3.
I20260709 12:10:29.496245 20277 raft_consensus.cc:740] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:29.496848 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:29.497208 20277 consensus_queue.cc:260] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:29.497938 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:29.498590 18023 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
I20260709 12:10:29.499511 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:29.500063 18023 raft_consensus.cc:2468] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:10:29.500222 20365 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:29.500886 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 74479.3us
I20260709 12:10:29.501561 18608 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:29.502262 20379 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:29.471288 20400 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.442580 20206 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.503423 20293 raft_consensus.cc:2804] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:29.503911 20293 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.504355 20293 raft_consensus.cc:3060] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.503957 20206 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:29.506315 20206 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:29.471901 20397 log.cc:927] Time spent T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:10:29.420852 20272 leader_election.cc:290] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:29.507828 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:29.508436 18089 raft_consensus.cc:3060] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.508553 18091 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53954 (request call id 1821) took 1137 ms. Trace:
I20260709 12:10:29.508922 18091 rpcz_store.cc:276] 0709 12:10:28.371726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:28.387827 (+ 16101us) service_pool.cc:224] Handling call
0709 12:10:28.789887 (+402060us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b58001b0998. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4988db71 00007f7f4988da22 00007f7f527a68d9 00007f7f51900ee0 00007f7f519ca0ab 00007f7f519ca131 00007f7f5198bfc0 00007f7f51976929 00007f7f519763d2 00007f7f4aeedbd4
0709 12:10:28.790189 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:28.804177 (+ 13988us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:28.804224 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:28.826260 (+ 22036us) log.cc:844] Serialized 26 byte log entry
0709 12:10:28.952073 (+125813us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:29.224593 (+272520us) log.cc:844] Serialized 14 byte log entry
0709 12:10:29.225365 (+   772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:29.225435 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:29.508273 (+282838us) raft_consensus.cc:1685] finished
0709 12:10:29.508361 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:29.508494 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9248,"prepare.queue_time_us":271547,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":13732,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":15973,"spinlock_wait_cycles":6947712,"thread_start_us":103281,"threads_started":1,"wal-append.queue_time_us":364583}
I20260709 12:10:29.443711 20067 raft_consensus.cc:493] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:29.502262 20401 log.cc:927] Time spent T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:10:29.464063 18024 raft_consensus.cc:2468] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:10:29.502472 18608 leader_election.cc:304] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:29.494547 17914 leader_election.cc:304] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:29.451032 20027 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:29.515782 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 53898.6us
I20260709 12:10:29.517911 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:29.518561 17941 raft_consensus.cc:2468] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:29.519083 20344 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:29.518767 20370 consensus_queue.cc:237] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:29.522616 20156 consensus_queue.cc:260] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:29.523295 20297 consensus_meta.cc:287] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.824s	user 0.011s	sys 0.000s
I20260709 12:10:29.514909 20142 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:29.524174 20156 raft_consensus.cc:3060] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.524982 20259 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:29.525406 20340 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:29.503376 20400 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:29.526978 20367 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:29.517088 18062 leader_election.cc:304] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:29.498468 20277 raft_consensus.cc:3060] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.528512 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:29.527875 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:29.568719 20027 raft_consensus.cc:2749] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:29.647698 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:29.528673 18019 raft_consensus.cc:1275] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:29.560941 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:10:29.645650 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 151141us
I20260709 12:10:29.556583 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:29.648818 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:29.676455 17941 raft_consensus.cc:2468] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
W20260709 12:10:29.555776 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 98311.1us
W20260709 12:10:29.622723 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 120351us
I20260709 12:10:29.553896 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:29.678390 17949 raft_consensus.cc:2393] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 3: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:29.470430 20218 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:29.676810 18094 raft_consensus.cc:2468] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:29.571244 17912 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:29.553959 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:29.683681 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:29.686285 18062 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:29.686965 17940 raft_consensus.cc:2393] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 4: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:29.555855 20270 raft_consensus.cc:2764] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:29.513852 20067 raft_consensus.cc:3060] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.528046 20272 raft_consensus.cc:2749] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647) with higher term. Message: Invalid argument: T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 3. Current term is 4.
I20260709 12:10:29.655526 20060 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:29.564865 20228 consensus_meta.cc:287] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.595s	user 0.009s	sys 0.000s
I20260709 12:10:29.694005 17987 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:29.555493 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:29.649103 20367 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.554107 20284 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:29.672274 20386 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:29.646535 20400 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:29.699188 18020 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
W20260709 12:10:29.702086 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 170239us
I20260709 12:10:29.702821 17913 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:29.703472 20387 raft_consensus.cc:2804] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:29.703868 20330 raft_consensus.cc:2804] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:29.704648 20206 raft_consensus.cc:2804] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:29.705616 18608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.707916 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:29.713092 17989 leader_election.cc:304] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:10:29.761956 18608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.686048 20297 raft_consensus.cc:493] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.725540 20205 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:29.726079 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.738456 18089 raft_consensus.cc:2468] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:29.731549 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:29.748798 17845 catalog_manager.cc:5697] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 3 to 4, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 4 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } }
I20260709 12:10:29.733345 20293 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:29.774473 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:29.761868 20330 raft_consensus.cc:493] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.775367 20205 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:29.775590 20330 raft_consensus.cc:3060] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.755707 20218 raft_consensus.cc:2804] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:29.776173 20293 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:29.776510 20218 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:29.776970 20218 raft_consensus.cc:3060] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.777654 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:29.778342 18638 raft_consensus.cc:2468] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:29.778888 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:29.779511 18098 raft_consensus.cc:2468] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:10:29.780431 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:29.780819 18091 raft_consensus.cc:1275] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:29.760475 20387 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.781559 20387 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:29.700692 20060 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:29.742383 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:29.742883 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:29.776228 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:29.784724 18019 raft_consensus.cc:3060] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.743875 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:29.755479 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 58728.8us
I20260709 12:10:29.755844 18062 leader_election.cc:304] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:29.759080 17912 leader_election.cc:400] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Vote denied by peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647) with higher term. Message: Invalid argument: T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 4. Current term is 5.
I20260709 12:10:29.759425 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:29.760452 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:29.719450 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:29.729437 20281 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:29.770816 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 57809.5us
I20260709 12:10:29.754822 20402 consensus_queue.cc:1048] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:29.772881 18024 raft_consensus.cc:3060] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.760159 20236 consensus_queue.cc:1048] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:10:29.761694 20206 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.789141 17989 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:29.773213 20297 raft_consensus.cc:515] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:29.773502 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:29.773521 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:29.793344 18095 raft_consensus.cc:2368] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 3. Current term is 4.
I20260709 12:10:29.785629 18609 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:29.775308 18640 raft_consensus.cc:2468] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:10:29.786561 17912 leader_election.cc:403] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:10:29.788894 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 89572.1us
W20260709 12:10:29.788894 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 261130us
W20260709 12:10:29.793645 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 96414.3us
I20260709 12:10:29.795003 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:29.795820 18023 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 5.
I20260709 12:10:29.751308 20228 raft_consensus.cc:515] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:29.791692 18061 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
W20260709 12:10:29.810029 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:29.813473 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:29.814785 18062 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:29.786691 20400 raft_consensus.cc:2804] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:29.817035 20400 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.817430 20400 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:29.817519 20157 raft_consensus.cc:2804] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:29.817997 20157 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.818428 20157 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.818576 19655 raft_consensus.cc:2804] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:29.825327 19655 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.797039 20386 raft_consensus.cc:2804] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:29.792711 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:29.819365 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:29.828693 17914 leader_election.cc:304] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:29.831553 18018 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 7.
I20260709 12:10:29.830627 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:29.820243 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 65663.5us
I20260709 12:10:29.821424 17913 leader_election.cc:304] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:29.823189 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:29.818991 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:29.815797 17912 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:29.825682 19655 raft_consensus.cc:3060] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.793325 20206 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:29.840826 18640 raft_consensus.cc:2393] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 5: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:29.806510 20205 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.832481 18023 raft_consensus.cc:2468] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 4.
I20260709 12:10:29.833671 17943 raft_consensus.cc:2410] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:29.834118 18015 raft_consensus.cc:2368] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 4. Current term is 5.
I20260709 12:10:29.835029 20297 leader_election.cc:290] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:29.835971 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:29.838778 20232 consensus_queue.cc:1048] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:10:29.839075 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:29.839491 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:29.806706 20270 raft_consensus.cc:2804] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:29.807469 20402 raft_consensus.cc:2804] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:29.843526 17989 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:29.818111 20228 leader_election.cc:290] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:29.844429 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 49572.3us
I20260709 12:10:29.828153 18017 raft_consensus.cc:2393] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 5: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:29.789319 20367 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:29.855130 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 57574.2us
I20260709 12:10:29.851639 20234 raft_consensus.cc:2764] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:10:29.843276 17845 catalog_manager.cc:5697] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: config changed from index 4 to 5, term changed from 2 to 4, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196), VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New cstate: current_term: 4 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:29.867928 17989 leader_election.cc:304] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:29.845855 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:29.885495 18019 raft_consensus.cc:2468] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 5.
I20260709 12:10:29.843704 20060 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:29.879980 17912 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:29.859517 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:29.889675 18018 raft_consensus.cc:1813] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Handling vote request from an unknown peer 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:29.854831 20156 raft_consensus.cc:2804] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:29.847774 20386 raft_consensus.cc:697] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:29.847110 18636 raft_consensus.cc:2468] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
W20260709 12:10:29.892091 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 54107.9us
I20260709 12:10:29.880254 20358 raft_consensus.cc:2804] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:29.886196 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:29.898023 18062 leader_election.cc:304] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:29.893849 18018 raft_consensus.cc:2368] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 4. Current term is 5.
I20260709 12:10:29.866910 20402 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.879561 20027 raft_consensus.cc:2804] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:29.865113 20270 raft_consensus.cc:493] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.899047 17845 catalog_manager.cc:5697] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 1 to 3, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 3 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:29.897996 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
W20260709 12:10:29.906739 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 82192.4us
I20260709 12:10:29.906997 20205 raft_consensus.cc:2749] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647) with higher term. Message: Invalid argument: T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 4. Current term is 5.
I20260709 12:10:29.912436 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:29.912961 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:29.914438 20234 raft_consensus.cc:2804] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:29.914338 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:29.947297 18609 leader_election.cc:400] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Vote denied by peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931) with higher term. Message: Invalid argument: T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 3. Current term is 4.
I20260709 12:10:29.947614 18609 leader_election.cc:403] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:29.917974 20206 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:29.883759 20277 raft_consensus.cc:2749] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:29.898463 20358 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.894801 18635 raft_consensus.cc:2468] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 2.
I20260709 12:10:29.932847 19655 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:29.933872 20027 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:29.935000 18024 raft_consensus.cc:2468] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
I20260709 12:10:29.981166 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:29.981413 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:29.945977 20234 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:29.897413 20312 raft_consensus.cc:2804] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:29.963743 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:29.973511 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 88518.8us
I20260709 12:10:29.934230 20402 raft_consensus.cc:3060] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.934653 20228 raft_consensus.cc:2804] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:10:29.975468 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 77512.1us
I20260709 12:10:29.972736 17845 catalog_manager.cc:5697] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 3 to 4, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 4 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:29.875233 18023 raft_consensus.cc:1240] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:29.933786 20156 raft_consensus.cc:697] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:29.940987 20270 raft_consensus.cc:3060] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.982161 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:29.995168 18644 raft_consensus.cc:3060] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:29.945545 20404 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:29.983067 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:29.995728 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:29.935528 17989 leader_election.cc:304] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:29.984812 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:29.996917 18642 raft_consensus.cc:2368] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 5. Current term is 6.
I20260709 12:10:29.986388 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:29.926472 20387 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:29.999056 18062 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:29.992026 19655 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:29.979287 20358 raft_consensus.cc:3060] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.976908 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:30.001981 17845 catalog_manager.cc:5697] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 3 to 4, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 4 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:29.954357 20400 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:29.980598 20293 raft_consensus.cc:3060] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:29.988880 20228 raft_consensus.cc:493] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
W20260709 12:10:29.998790 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 63388.8us
I20260709 12:10:29.975075 18639 raft_consensus.cc:2468] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:29.958576 20218 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:29.990401 18019 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 6.
I20260709 12:10:29.997430 18022 raft_consensus.cc:2376] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5. Re-sending same reply.
I20260709 12:10:29.984503 20234 raft_consensus.cc:3060] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:29.988059 20312 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:30.002542 20134 raft_consensus.cc:2804] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:30.011824 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:30.012719 17988 leader_election.cc:304] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:29.985764 20027 raft_consensus.cc:3060] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:30.014350 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:30.010260 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:30.020810 17913 leader_election.cc:304] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:30.022259 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:30.026412 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:30.030958 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:30.033156 18022 raft_consensus.cc:3060] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.033216 18093 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 5.
I20260709 12:10:30.033775 17912 leader_election.cc:400] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 election: Vote denied by peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647) with higher term. Message: Invalid argument: T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 5. Current term is 6.
I20260709 12:10:30.034061 17912 leader_election.cc:403] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:10:30.003151 20297 raft_consensus.cc:2804] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:30.034238 17845 catalog_manager.cc:5697] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 3 to 4, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 4 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:30.036723 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:30.036883 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:30.040128 17948 raft_consensus.cc:2468] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:30.021296 20228 raft_consensus.cc:3060] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:30.043512 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:30.039052 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:30.042837 19655 consensus_queue.cc:1048] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:30.024170 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:30.025497 20312 raft_consensus.cc:3060] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.046993 18018 raft_consensus.cc:2393] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 5: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
W20260709 12:10:30.047873 17912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.048282 17989 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:30.045784 18608 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:30.050344 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:30.000463 20404 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:30.053510 18024 raft_consensus.cc:2393] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 5: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:30.054706 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:30.063676 17988 leader_election.cc:400] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 election: Vote denied by peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123) with higher term. Message: Invalid argument: T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 4. Current term is 5.
I20260709 12:10:30.064275 17988 leader_election.cc:403] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:10:30.064822 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:30.040877 20297 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:30.043385 20205 raft_consensus.cc:3060] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.065598 18021 raft_consensus.cc:2468] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 6.
I20260709 12:10:30.074234 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:30.047125 20060 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:30.040820 20134 raft_consensus.cc:697] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:30.063403 17845 catalog_manager.cc:5697] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 3 to 5, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 5 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } }
I20260709 12:10:30.067282 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:30.075158 18021 raft_consensus.cc:2468] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 4.
I20260709 12:10:30.079784 20294 raft_consensus.cc:2749] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:30.018298 20386 consensus_queue.cc:237] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:30.030155 20067 raft_consensus.cc:515] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:30.062269 20156 consensus_queue.cc:237] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:30.059986 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:30.041306 20330 raft_consensus.cc:515] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:30.075400 20272 raft_consensus.cc:2804] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:30.101747 18644 raft_consensus.cc:2468] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
I20260709 12:10:30.137547 20205 raft_consensus.cc:2749] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647) with higher term. Message: Invalid argument: T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 5. Current term is 6.
I20260709 12:10:30.139863 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:30.140048 20367 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:30.140501 18637 raft_consensus.cc:2468] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
W20260709 12:10:30.142979 20421 log.cc:927] Time spent T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 12:10:30.097607 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 46671.7us
I20260709 12:10:30.146080 17988 leader_election.cc:304] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:30.098421 20404 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:30.147657 18019 raft_consensus.cc:1240] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:30.087551 18608 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:30.148602 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:30.148888 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 61406.2us
W20260709 12:10:30.149364 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.149628 18608 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:30.075836 18061 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
W20260709 12:10:30.150985 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 75221.6us
I20260709 12:10:30.151594 18061 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:30.153333 18021 raft_consensus.cc:1240] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:30.153789 20236 raft_consensus.cc:2804] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:30.154199 20236 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:30.154520 20236 raft_consensus.cc:3060] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.155465 20330 leader_election.cc:290] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:30.156064 20330 raft_consensus.cc:2749] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:30.156697 20330 raft_consensus.cc:2804] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:30.157153 20330 raft_consensus.cc:697] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:30.158885 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:30.159363 20161 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:30.159538 18639 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:30.159906 20161 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:30.161290 20134 consensus_queue.cc:237] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:30.161973 20161 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:30.163969 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:30.098954 20060 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:30.165290 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:30.166014 18091 raft_consensus.cc:2393] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 6: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:30.166615 20060 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:30.167508 20400 leader_election.cc:290] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:30.168239 20218 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:30.168844 20218 raft_consensus.cc:2804] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:30.169206 20218 raft_consensus.cc:493] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:30.169282 17988 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:30.169693 20218 raft_consensus.cc:3060] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.171346 20367 raft_consensus.cc:2749] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:30.150509 18608 leader_election.cc:304] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:30.079784 20281 raft_consensus.cc:2804] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:30.173696 20281 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:30.173924 19655 raft_consensus.cc:2804] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:30.174086 20281 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.174356 19655 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:30.174791 19655 raft_consensus.cc:3060] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:30.170455 17988 leader_election.cc:304] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:30.177595 18019 raft_consensus.cc:1275] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:10:30.177616 17912 leader_election.cc:304] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:30.081331 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:30.075138 20297 raft_consensus.cc:3060] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.082199 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:30.080566 18636 raft_consensus.cc:2468] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:30.177616 17988 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:30.191383 17912 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:30.127341 20370 raft_consensus.cc:2749] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123) with higher term. Message: Invalid argument: T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 4. Current term is 5.
I20260709 12:10:30.157997 20330 consensus_queue.cc:237] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:30.133181 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 84968.9us
W20260709 12:10:30.198372 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 177620us
I20260709 12:10:30.098611 20387 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:30.139274 20272 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:30.225560 17913 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:30.233527 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:30.234701 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 57146.9us
I20260709 12:10:30.235447 17988 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:30.182261 18022 raft_consensus.cc:2468] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
I20260709 12:10:30.244472 17988 leader_election.cc:304] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:30.251217 17845 catalog_manager.cc:5697] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 2 to 3, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 3 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:30.247575 19655 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:30.222626 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 46271.2us
I20260709 12:10:30.184136 20206 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:30.255661 17988 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:30.134207 20277 consensus_queue.cc:1059] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.094s
I20260709 12:10:30.205610 20060 raft_consensus.cc:2749] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:30.271376 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:30.267606 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:30.272140 18019 raft_consensus.cc:2468] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:30.191396 20404 raft_consensus.cc:2804] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:30.273615 19655 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:30.262250 17988 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:30.224421 20294 raft_consensus.cc:2804] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:30.280268 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 129820us
I20260709 12:10:30.168867 20157 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:30.280300 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
W20260709 12:10:30.274159 20421 log.cc:927] Time spent T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:10:30.285969 18092 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:30.270766 17845 catalog_manager.cc:5697] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 3 to 5, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 5 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:30.290588 20284 raft_consensus.cc:2749] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:30.291846 20293 raft_consensus.cc:2749] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931) with higher term. Message: Invalid argument: T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 3. Current term is 4.
I20260709 12:10:30.291550 17845 catalog_manager.cc:5697] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 4 to 5, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 5 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:30.292943 20358 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:30.293037 17845 catalog_manager.cc:5697] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 1 to 3, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 3 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:30.296212 18018 raft_consensus.cc:2393] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 5: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:30.281069 18608 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:30.297351 18608 leader_election.cc:304] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:30.297653 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:30.298368 18608 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:30.244446 20272 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.243455 20400 raft_consensus.cc:2749] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:30.243184 20365 raft_consensus.cc:2749] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:30.283496 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:30.284543 18091 raft_consensus.cc:1240] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:30.244947 20428 raft_consensus.cc:2804] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:30.193322 20270 raft_consensus.cc:515] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:30.270852 20427 raft_consensus.cc:2749] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:30.301824 18608 leader_election.cc:304] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:30.302460 17845 catalog_manager.cc:5697] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 1 to 2, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 2 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:30.304471 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:30.322208 18096 raft_consensus.cc:2468] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 5.
I20260709 12:10:30.270762 18017 raft_consensus.cc:1240] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:10:30.305923 18092 raft_consensus.cc:2468] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 7.
I20260709 12:10:30.258610 20429 raft_consensus.cc:2804] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:30.327149 18608 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:30.274369 20367 raft_consensus.cc:2749] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:30.280510 20294 raft_consensus.cc:493] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
W20260709 12:10:30.299523 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 107225us
I20260709 12:10:30.324146 18093 raft_consensus.cc:2468] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 7.
I20260709 12:10:30.300740 20161 raft_consensus.cc:2749] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:30.334434 18095 raft_consensus.cc:2393] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 5: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:30.307171 20293 raft_consensus.cc:2804] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:30.314905 20232 raft_consensus.cc:2804] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:30.315372 20428 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:30.306515 20277 raft_consensus.cc:2749] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:30.363379 17989 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:10:30.344496 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 119048us
I20260709 12:10:30.364480 17913 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:30.357239 20232 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:30.366613 20232 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.333648 20294 raft_consensus.cc:3060] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:30.329946 20340 raft_consensus.cc:2804] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:30.369573 17845 catalog_manager.cc:5697] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 5 to 6, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 6 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:30.345594 20293 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:30.374722 20436 consensus_queue.cc:1048] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:30.327534 20429 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:30.346460 18638 raft_consensus.cc:1240] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:30.345016 20134 consensus_queue.cc:1059] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:10:30.388895 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:30.389392 20134 raft_consensus.cc:3055] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:30.389546 18092 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.389799 20134 raft_consensus.cc:740] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:30.390776 20134 consensus_queue.cc:260] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:30.362869 20428 raft_consensus.cc:3060] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:30.397285 18092 raft_consensus.cc:2468] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
I20260709 12:10:30.378670 17913 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:30.323493 20027 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:30.364307 20156 raft_consensus.cc:3055] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:30.381531 17845 catalog_manager.cc:5697] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 2 to 3, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 3 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
W20260709 12:10:30.382959 20426 log.cc:927] Time spent T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:10:30.383086 20159 raft_consensus.cc:2804] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:30.383893 20441 raft_consensus.cc:2749] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:30.385005 20427 raft_consensus.cc:2804] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:30.386778 20358 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:30.387873 20157 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:30.398584 18609 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:30.374881 18062 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:30.376588 20340 raft_consensus.cc:493] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:30.424546 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 61269.1us
W20260709 12:10:30.425072 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 47566.9us
I20260709 12:10:30.380213 20404 raft_consensus.cc:697] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:30.428979 17989 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:30.398025 20429 raft_consensus.cc:3060] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:30.407095 20293 raft_consensus.cc:3060] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.416841 20156 raft_consensus.cc:740] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:30.437701 17989 leader_election.cc:304] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:30.439342 17845 catalog_manager.cc:5697] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 2 to 4, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 4 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } }
I20260709 12:10:30.437752 17913 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:30.423396 20427 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:30.419826 20159 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:30.424249 20067 leader_election.cc:290] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:30.474225 17913 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:30.477838 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:30.478442 18096 raft_consensus.cc:3060] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.430655 20340 raft_consensus.cc:3060] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.496563 17913 leader_election.cc:304] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:10:30.490134 17912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.481755 17845 catalog_manager.cc:5697] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 3 to 4, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 4 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:30.500000 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
W20260709 12:10:30.500831 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 126063us
I20260709 12:10:30.499898 17845 catalog_manager.cc:5697] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:30.504841 17947 raft_consensus.cc:1240] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:30.506460 18095 raft_consensus.cc:3060] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.458292 20284 raft_consensus.cc:2804] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:30.509384 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 49928.7us
I20260709 12:10:30.513039 18608 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:30.452718 20206 raft_consensus.cc:2749] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:30.482407 20159 raft_consensus.cc:3060] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:30.482335 20386 raft_consensus.cc:2804] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:30.461021 20157 raft_consensus.cc:2804] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:30.545425 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 146948us
W20260709 12:10:30.547840 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:30.517566 17845 catalog_manager.cc:5697] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 3 to 4, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 4 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:30.519801 20265 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:30.520640 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:30.429700 20228 raft_consensus.cc:515] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:30.485091 20427 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:30.475883 20400 raft_consensus.cc:2804] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:10:30.564642 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 68157.2us
I20260709 12:10:30.482836 20440 raft_consensus.cc:2804] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:30.554528 20218 raft_consensus.cc:515] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:30.542910 20386 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:30.520645 20431 log.cc:927] Time spent T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:10:30.513150 20387 raft_consensus.cc:2804] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:30.513365 20284 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:30.472626 20234 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:30.566751 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:30.554894 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:30.459893 20439 consensus_queue.cc:1059] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.127s
I20260709 12:10:30.569463 18608 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:30.563830 17845 catalog_manager.cc:5697] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 3 to 4, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 4 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:30.571278 17913 leader_election.cc:400] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Vote denied by peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297) with higher term. Message: Invalid argument: T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 4. Current term is 5.
I20260709 12:10:31.562345 17913 leader_election.cc:403] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:30.586835 17914 leader_election.cc:400] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931) with higher term. Message: Invalid argument: T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 3. Current term is 4.
W20260709 12:10:31.775897 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 1.18909e+06us
I20260709 12:10:30.589684 17946 raft_consensus.cc:1275] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:30.581403 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:30.586905 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:30.586171 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:32.084719 17942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44668 (request call id 387) took 1499 ms. Trace:
I20260709 12:10:32.085114 17942 rpcz_store.cc:276] 0709 12:10:30.585572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.585894 (+   322us) service_pool.cc:224] Handling call
0709 12:10:32.084649 (+1498755us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:30.596004 18022 raft_consensus.cc:1240] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:30.613482 18062 leader_election.cc:304] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:32.120867 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 1.50734e+06us
I20260709 12:10:30.689391 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
W20260709 12:10:32.125537 18090 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53954 (request call id 1861) took 1456 ms (client timeout 1696 ms). Trace:
W20260709 12:10:32.125964 18090 rpcz_store.cc:269] 0709 12:10:30.669566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.689059 (+ 19493us) service_pool.cc:224] Handling call
0709 12:10:32.125469 (+1436410us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.127038 20206 consensus_queue.cc:1048] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:30.613333 18092 raft_consensus.cc:1240] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:30.701826 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:32.132272 18093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53954 (request call id 1862) took 1430 ms. Trace:
I20260709 12:10:32.132632 18093 rpcz_store.cc:276] 0709 12:10:30.701470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.701591 (+   121us) service_pool.cc:224] Handling call
0709 12:10:32.132211 (+1430620us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:30.653870 18095 raft_consensus.cc:2468] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
I20260709 12:10:30.577131 18096 raft_consensus.cc:2468] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 5.
W20260709 12:10:32.136369 18096 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53954 (request call id 1855) took 1659 ms (client timeout 1785 ms). Trace:
I20260709 12:10:32.136459 20423 raft_consensus.cc:2749] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:32.136742 18096 rpcz_store.cc:269] 0709 12:10:30.476867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.477623 (+   756us) service_pool.cc:224] Handling call
0709 12:10:32.136315 (+1658692us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:30.665346 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:30.602767 18639 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 7.
W20260709 12:10:30.576701 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 98526.3us
I20260709 12:10:32.143165 18092 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53954 (request call id 1860) took 1581 ms. Trace:
I20260709 12:10:32.143548 18092 rpcz_store.cc:276] 0709 12:10:30.561730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.561923 (+   193us) service_pool.cc:224] Handling call
0709 12:10:30.562205 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.142187 (+1579982us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.142939 (+   752us) spinlock_profiling.cc:243] Waited 48.5 ms on lock 0x7b54000a96d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:32.143110 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111522048}
W20260709 12:10:32.144388 17987 connection.cc:256] RPC call timeout handler was delayed by -1.7404752080001344s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1902s for a response
I20260709 12:10:30.625442 20134 raft_consensus.cc:3060] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.541277 20156 consensus_queue.cc:260] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:30.559178 20157 raft_consensus.cc:697] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:32.155290 20157 consensus_queue.cc:237] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:30.748624 20159 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:30.634882 20027 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:30.700388 20218 leader_election.cc:290] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:30.656524 20232 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:30.604722 20236 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.169318 20236 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:30.668473 20228 leader_election.cc:290] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:30.679848 20234 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:30.565339 20265 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:30.699366 20272 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:30.628474 20281 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:32.174122 20265 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:30.591439 20284 raft_consensus.cc:3060] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:30.756542 20293 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.184986 20293 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:30.542557 20297 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.187718 20297 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:30.706954 20312 consensus_meta.cc:287] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.643s	user 0.010s	sys 0.000s
I20260709 12:10:32.189858 20312 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.190830 18089 raft_consensus.cc:1240] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:32.193297 18089 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41818 (request call id 676) took 2177 ms. Trace:
I20260709 12:10:32.193599 18089 rpcz_store.cc:276] 0709 12:10:30.015531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.017843 (+  2312us) service_pool.cc:224] Handling call
0709 12:10:30.152208 (+134365us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b58001b0998. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4988db71 00007f7f4988da22 00007f7f527a68d9 00007f7f51900ee0 00007f7f519ca0ab 00007f7f519ca131 00007f7f5198bfc0 00007f7f51976929 00007f7f519763d2 00007f7f4aeedbd4
0709 12:10:30.152390 (+   182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.191228 (+2038838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.193058 (+  1830us) spinlock_profiling.cc:243] Waited 2.04 s on lock 0x7b540024a754. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:32.193216 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4693705856}
I20260709 12:10:30.572285 20270 leader_election.cc:290] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:30.756436 20340 raft_consensus.cc:515] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.197120 20340 leader_election.cc:290] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:30.753523 20294 raft_consensus.cc:515] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:30.560184 20404 consensus_queue.cc:237] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:30.582901 20387 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.203467 20387 raft_consensus.cc:3060] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:30.576141 20386 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:30.585304 20400 raft_consensus.cc:697] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:32.215660 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:32.216321 18096 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:32.215924 20400 consensus_queue.cc:237] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:30.583494 20402 consensus_meta.cc:287] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.585s	user 0.009s	sys 0.000s
I20260709 12:10:32.219218 20402 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:10:32.220214 20294 leader_election.cc:290] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:32.220247 18023 raft_consensus.cc:2368] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 5. Current term is 6.
I20260709 12:10:32.221088 20402 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123)
I20260709 12:10:30.621393 20453 raft_consensus.cc:2749] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:30.603652 20432 log.cc:927] Time spent T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 12:10:30.708376 20427 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:32.228900 20312 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:30.590485 20438 log.cc:927] Time spent T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:10:30.755620 20429 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.232044 20429 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:30.739461 20456 log.cc:927] Time spent T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.083s	user 0.002s	sys 0.000s
W20260709 12:10:30.630748 20447 log.cc:927] Time spent T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:10:30.607116 20441 raft_consensus.cc:3055] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:30.556634 20442 raft_consensus.cc:2804] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:32.236454 20442 raft_consensus.cc:697] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:32.237406 20442 consensus_queue.cc:237] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:30.568658 20440 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:31.535392 20465 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.239833 20440 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.239871 20465 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.242151 20465 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:31.561163 17845 catalog_manager.cc:5697] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:32.246629 18096 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
I20260709 12:10:32.249476 20284 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:31.563534 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 992442us
I20260709 12:10:32.250991 20270 raft_consensus.cc:493] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:32.251127 17913 leader_election.cc:400] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Vote denied by peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297) with higher term. Message: Invalid argument: T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 4. Current term is 5.
I20260709 12:10:32.251577 20270 raft_consensus.cc:515] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.252290 17913 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:32.252739 20440 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:32.253625 17913 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:31.619357 20205 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:32.254385 20205 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:32.254952 20297 raft_consensus.cc:493] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:32.255466 20297 raft_consensus.cc:515] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.256882 20205 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:32.257951 20205 raft_consensus.cc:2804] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:31.750231 17912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:32.258942 17912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:31.751045 19655 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.759223 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:31.779891 20434 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:31.778249 17914 leader_election.cc:304] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:31.796593 20436 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.798355 20448 raft_consensus.cc:493] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.801694 20444 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.803583 20455 raft_consensus.cc:3060] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:31.809578 20367 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:31.817801 20060 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:31.838951 17948 raft_consensus.cc:2393] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 7: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:31.839653 17946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44668 (request call id 390) took 1253 ms. Trace:
W20260709 12:10:31.848944 17878 debug-util.cc:398] Leaking SignalData structure 0x7b0800039380 after lost signal to thread 16782
I20260709 12:10:31.849758 20330 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.904776 20439 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:31.988298 20370 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.997432 20161 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.265059 20297 leader_election.cc:290] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:30.613327 18608 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:32.047087 20445 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:32.065598 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 100976us
W20260709 12:10:32.349551 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 1.73613e+06us
I20260709 12:10:32.316082 20277 raft_consensus.cc:2749] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:32.101070 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:32.271726 20436 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.109802 18022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 1867) took 1859 ms. Trace:
I20260709 12:10:32.131263 20469 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
W20260709 12:10:32.134668 18095 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53954 (request call id 1858) took 1635 ms (client timeout 1581 ms). Trace:
W20260709 12:10:32.140292 18639 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60430 (request call id 524) took 2037 ms (client timeout 1681 ms). Trace:
I20260709 12:10:32.140861 20449 raft_consensus.cc:2764] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:10:32.141741 20365 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:32.159828 20159 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:10:32.160562 20437 consensus_queue.cc:1175] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" responder_term: 5 status { last_received { term: 5 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 5 index: 8 } }
I20260709 12:10:32.163236 18638 raft_consensus.cc:1240] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:32.320370 20370 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:32.167371 20027 raft_consensus.cc:493] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:32.167446 17987 connection.cc:256] RPC call timeout handler was delayed by -1.4785752080001657s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21930000000000002s for a response
I20260709 12:10:32.353907 20293 raft_consensus.cc:2804] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:32.174897 20272 leader_election.cc:290] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:32.176849 17989 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:32.365235 20429 raft_consensus.cc:493] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:32.225673 18023 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45464 (request call id 1681) took 2254 ms (client timeout 1672 ms). Trace:
W20260709 12:10:32.382383 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 110032us
I20260709 12:10:32.228679 17940 raft_consensus.cc:2393] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 5: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:30.701900 20428 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.234193 20427 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:32.235390 20441 raft_consensus.cc:740] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:32.238659 20453 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:32.253801 20270 leader_election.cc:290] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:32.257979 20234 raft_consensus.cc:493] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:32.427727 20441 consensus_queue.cc:260] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.428243 20234 raft_consensus.cc:515] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.429301 20441 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.430285 20234 leader_election.cc:290] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:31.627810 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.433622 20156 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:32.435426 17940 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44668 (request call id 384) took 1878 ms (client timeout 1924 ms). Trace:
I20260709 12:10:32.260963 19655 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:32.435876 17940 rpcz_store.cc:269] 0709 12:10:30.556633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.556747 (+   114us) service_pool.cc:224] Handling call
0709 12:10:32.435230 (+1878483us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b540031cc54. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:32.435369 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3763116928}
I20260709 12:10:32.437286 19655 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:32.439139 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:32.439824 18096 raft_consensus.cc:2393] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 4: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:32.444085 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
W20260709 12:10:32.262430 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 140612us
I20260709 12:10:32.446669 18062 leader_election.cc:304] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:32.269822 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 491612us
I20260709 12:10:32.265268 20386 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:32.446463 18020 raft_consensus.cc:1240] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:32.438192 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:32.448619 17914 leader_election.cc:304] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:32.449261 20386 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:32.449740 17914 leader_election.cc:304] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:32.449846 20386 raft_consensus.cc:2804] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:32.449837 20428 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:32.450522 20386 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:32.450977 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:32.451699 18019 raft_consensus.cc:3060] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:32.264590 20465 raft_consensus.cc:2749] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:32.455106 18638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60430 (request call id 527) took 2056 ms. Trace:
I20260709 12:10:32.455204 20449 consensus_queue.cc:1059] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:32.455793 18638 rpcz_store.cc:276] 0709 12:10:30.398421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.405949 (+  7528us) service_pool.cc:224] Handling call
0709 12:10:30.475492 (+ 69543us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.375587 (+1900095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.454776 (+ 79189us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b54005429d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:32.455004 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3863888128}
I20260709 12:10:32.456739 19655 consensus_queue.cc:1048] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:10:32.318348 17878 debug-util.cc:398] Leaking SignalData structure 0x7b08000916e0 after lost signal to thread 17881
I20260709 12:10:32.457969 19655 raft_consensus.cc:2749] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:32.456421 20449 raft_consensus.cc:3055] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:32.458927 20449 raft_consensus.cc:740] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
W20260709 12:10:32.459275 17878 debug-util.cc:398] Leaking SignalData structure 0x7b080035c740 after lost signal to thread 17973
W20260709 12:10:32.459686 17878 debug-util.cc:398] Leaking SignalData structure 0x7b08002c6a20 after lost signal to thread 17974
W20260709 12:10:32.460991 17878 debug-util.cc:398] Leaking SignalData structure 0x7b08003641a0 after lost signal to thread 18048
I20260709 12:10:32.461028 17914 leader_election.cc:304] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:32.461551 17878 debug-util.cc:398] Leaking SignalData structure 0x7b08001cde60 after lost signal to thread 18049
I20260709 12:10:32.258002 20440 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:32.265637 20312 raft_consensus.cc:493] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.002274 20443 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:32.319051 17946 rpcz_store.cc:276] 0709 12:10:30.586433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.589111 (+  2678us) service_pool.cc:224] Handling call
0709 12:10:30.589364 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:31.839369 (+1250005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:31.839572 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.462595 20443 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:32.462534 20312 raft_consensus.cc:515] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.464906 20443 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:32.465467 20312 leader_election.cc:290] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:32.330098 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:32.465597 20453 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.466512 18644 raft_consensus.cc:2468] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 7.
W20260709 12:10:32.331449 17948 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44668 (request call id 385) took 1750 ms (client timeout 1549 ms). Trace:
I20260709 12:10:32.092871 17941 raft_consensus.cc:2468] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 6.
W20260709 12:10:32.467976 17941 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44668 (request call id 389) took 1881 ms (client timeout 2041 ms). Trace:
I20260709 12:10:32.468078 20453 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:32.450980 20386 raft_consensus.cc:3060] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:32.467799 17948 rpcz_store.cc:269] 0709 12:10:30.570167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.570315 (+   148us) service_pool.cc:224] Handling call
0709 12:10:32.319983 (+1749668us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:32.468508 17941 rpcz_store.cc:269] 0709 12:10:30.586161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.586630 (+   469us) service_pool.cc:224] Handling call
0709 12:10:32.467920 (+1881290us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:32.101914 18098 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.334s	user 0.023s	sys 0.034s
W20260709 12:10:32.469388 18098 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.702s	user 0.023s	sys 0.034s
I20260709 12:10:32.469059 20449 consensus_queue.cc:260] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:32.355624 18095 rpcz_store.cc:269] 0709 12:10:30.499532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.499781 (+   249us) service_pool.cc:224] Handling call
0709 12:10:32.134582 (+1634801us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.355337 18022 rpcz_store.cc:276] 0709 12:10:30.251686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.251910 (+   224us) service_pool.cc:224] Handling call
0709 12:10:30.252188 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:32.087336 (+1835148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.109512 (+ 22176us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b5400363b54. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:32.109735 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":790294400}
W20260709 12:10:32.470274 17878 debug-util.cc:398] Leaking SignalData structure 0x7b0800386360 after lost signal to thread 18122
W20260709 12:10:32.470584 17878 debug-util.cc:398] Leaking SignalData structure 0x7b080038c600 after lost signal to thread 18123
I20260709 12:10:32.353773 18091 raft_consensus.cc:2376] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6. Re-sending same reply.
I20260709 12:10:32.335283 20470 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.471349 20449 raft_consensus.cc:3060] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:32.471120 20470 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:32.471670 17878 debug-util.cc:398] Leaking SignalData structure 0x7b08003e0880 after lost signal to thread 18668
I20260709 12:10:32.473268 20470 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:32.316566 20367 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.344476 20340 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:32.474023 20340 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.475155 20367 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:32.475682 20470 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.476071 20340 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:32.350697 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:32.476186 20470 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:32.477442 18637 raft_consensus.cc:2393] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 5: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:32.163736 20446 raft_consensus.cc:493] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.353263 20157 raft_consensus.cc:493] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:32.478511 20446 raft_consensus.cc:515] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:32.478746 20157 raft_consensus.cc:515] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.479200 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:32.479753 18024 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:32.480619 20446 leader_election.cc:290] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:32.480791 20157 leader_election.cc:290] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:32.289695 20434 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.478505 20470 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:32.482728 20434 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:32.375797 17987 connection.cc:256] RPC call timeout handler was delayed by -1.2305211780001173s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1774s for a response
W20260709 12:10:32.483258 17987 connection.cc:256] RPC call timeout handler was delayed by -1.1052116930000011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17010000000000003s for a response
I20260709 12:10:32.483902 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:32.484452 18021 raft_consensus.cc:3060] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.175513 20281 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:32.328809 20060 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.331118 20330 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.504699 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:10:32.506244 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 45277.4us
I20260709 12:10:32.507674 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:32.508960 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:32.509747 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:32.510344 17945 raft_consensus.cc:2468] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:32.167398 20232 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:32.297904 20444 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.511232 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:32.511770 17945 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 5.
W20260709 12:10:32.379352 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 202563us
I20260709 12:10:32.380884 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:32.383526 18061 leader_election.cc:304] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:32.512693 18018 raft_consensus.cc:2376] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7. Re-sending same reply.
W20260709 12:10:32.512897 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 129438us
I20260709 12:10:32.363453 20205 raft_consensus.cc:697] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:32.515398 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:32.385262 20284 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:32.518113 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:32.385710 18016 raft_consensus.cc:1240] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:32.388356 20370 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:32.366076 20387 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:32.384075 20400 raft_consensus.cc:2804] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:32.377645 20293 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:32.392535 20436 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:32.344792 20161 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.525719 20455 raft_consensus.cc:2749] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297) with higher term. Message: Invalid argument: T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 4. Current term is 5.
I20260709 12:10:32.365111 20469 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:32.357143 18639 rpcz_store.cc:269] 0709 12:10:30.103301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.104779 (+  1478us) service_pool.cc:224] Handling call
0709 12:10:32.140213 (+2035434us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:32.370728 20365 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.403151 18015 raft_consensus.cc:1275] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:32.335044 20439 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:32.320734 20448 raft_consensus.cc:515] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:32.529420 17944 raft_consensus.cc:2393] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 5: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:32.357213 20445 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.408538 20429 raft_consensus.cc:515] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.379055 20027 raft_consensus.cc:515] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.520220 20367 consensus_queue.cc:1059] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:10:32.532469 20448 leader_election.cc:290] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:32.419174 20437 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:32.533010 20367 raft_consensus.cc:3055] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:32.533062 20439 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:32.431934 20442 consensus_queue.cc:1059] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:10:32.447569 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.539685 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:32.540282 17944 raft_consensus.cc:3060] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:32.541548 20429 leader_election.cc:290] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:32.543418 20445 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:32.543758 20387 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:32.544456 20205 consensus_queue.cc:237] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:32.486963 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:32.486410 18019 raft_consensus.cc:2468] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 3.
I20260709 12:10:32.545569 18020 raft_consensus.cc:3060] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.533816 20444 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:32.548049 20437 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.550052 20437 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:32.334425 20294 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.550259 17945 raft_consensus.cc:2468] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 5.
W20260709 12:10:32.472065 17878 debug-util.cc:398] Leaking SignalData structure 0x7b08003e08e0 after lost signal to thread 18669
I20260709 12:10:32.562062 18018 raft_consensus.cc:2468] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
W20260709 12:10:32.562474 17878 debug-util.cc:398] Leaking SignalData structure 0x7b08003d87c0 after lost signal to thread 20416
W20260709 12:10:32.563162 17878 debug-util.cc:398] Leaking SignalData structure 0x7b08003d90a0 after lost signal to thread 20435
I20260709 12:10:32.495884 18024 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 6.
I20260709 12:10:32.497253 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:32.497437 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:32.486842 20277 raft_consensus.cc:2804] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:32.502990 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:32.503115 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:32.503799 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:32.503854 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:32.504447 20060 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:32.506306 20330 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:32.382663 18023 rpcz_store.cc:269] 0709 12:10:29.971340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:29.992053 (+ 20713us) service_pool.cc:224] Handling call
0709 12:10:32.222586 (+2230533us) spinlock_profiling.cc:243] Waited 2.22 s on lock 0x7b540005e1d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:32.225577 (+  2991us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5114098048}
I20260709 12:10:32.568128 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:32.568745 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:32.569101 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:32.569659 17948 raft_consensus.cc:2376] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7. Re-sending same reply.
I20260709 12:10:32.450939 20428 raft_consensus.cc:2749] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:32.516829 18021 raft_consensus.cc:2410] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 12:10:32.517212 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 256821us
I20260709 12:10:32.504468 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:32.518072 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:32.519013 18098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41818 (request call id 689) took 1766 ms. Trace:
I20260709 12:10:32.519425 17989 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:10:32.520937 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 73296.3us
W20260709 12:10:32.523902 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 116823us
I20260709 12:10:32.518220 20281 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.495802 20446 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:32.518860 20434 raft_consensus.cc:2804] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:32.526393 20400 raft_consensus.cc:697] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:32.587461 20434 raft_consensus.cc:493] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.587895 20434 raft_consensus.cc:3060] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.588080 20400 consensus_queue.cc:237] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:32.523725 20440 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.520056 20236 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:32.523157 20272 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:31.565346 20466 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.431514 17947 raft_consensus.cc:2368] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 3. Current term is 4.
I20260709 12:10:32.525403 20293 raft_consensus.cc:3060] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:32.544937 20442 raft_consensus.cc:3055] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:32.487195 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:32.490077 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:32.555750 20312 consensus_queue.cc:1048] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:32.556334 20294 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.602567 20442 raft_consensus.cc:740] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:32.602926 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:32.603168 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:32.603586 18091 raft_consensus.cc:2468] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:10:32.603711 18637 raft_consensus.cc:2468] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3.
I20260709 12:10:32.560532 17944 raft_consensus.cc:2468] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:10:32.604481 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:32.605024 18016 raft_consensus.cc:3060] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:32.605366 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:32.560879 18020 raft_consensus.cc:2468] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
I20260709 12:10:32.565774 17949 raft_consensus.cc:2468] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
I20260709 12:10:32.606907 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:32.606961 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:32.607627 17949 raft_consensus.cc:2368] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 4. Current term is 5.
I20260709 12:10:32.607430 20294 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:32.608477 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:32.608991 17949 raft_consensus.cc:3060] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.596767 20236 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.596616 20060 raft_consensus.cc:2804] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:32.610556 20060 raft_consensus.cc:697] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
W20260709 12:10:32.578945 18608 connection.cc:256] RPC call timeout handler was delayed by -2.3029721230000177s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2222s for a response
W20260709 12:10:32.611713 18608 connection.cc:256] RPC call timeout handler was delayed by -2.1455770210000082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1884s for a response
I20260709 12:10:32.611338 20060 consensus_queue.cc:237] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:32.612089 18608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.595793 20161 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:32.579697 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:32.579805 18097 raft_consensus.cc:2393] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 5: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:32.571141 17940 raft_consensus.cc:2468] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:32.533077 20027 leader_election.cc:290] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:32.571745 18098 rpcz_store.cc:276] 0709 12:10:30.752218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.752443 (+   225us) service_pool.cc:224] Handling call
0709 12:10:30.767159 (+ 14716us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:30.767348 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:32.469756 (+1702408us) log.cc:844] Serialized 14 byte log entry
0709 12:10:32.518597 (+ 48841us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:32.518738 (+   141us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:32.518794 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:32.518867 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:32.518962 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":865,"prepare.queue_time_us":85283,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":56,"raft.queue_time_us":797,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":3955,"spinlock_wait_cycles":7291648,"thread_start_us":1749941,"threads_started":2,"wal-append.queue_time_us":49786}
I20260709 12:10:32.582789 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:32.629998 18023 raft_consensus.cc:2393] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 5: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:32.583830 20448 consensus_queue.cc:1059] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:32.579452 18636 raft_consensus.cc:2468] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 4.
I20260709 12:10:32.584971 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:32.585767 20205 consensus_queue.cc:1059] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:32.586548 17912 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:32.533492 20367 raft_consensus.cc:740] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:32.591598 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
W20260709 12:10:32.591719 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 72369us
I20260709 12:10:32.642360 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:32.594622 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:32.651183 17989 leader_election.cc:304] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:10:32.596947 18062 connection.cc:256] RPC call timeout handler was delayed by -2.2903820980000091s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2066s for a response
I20260709 12:10:32.650480 17945 raft_consensus.cc:2393] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 5: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
W20260709 12:10:32.652021 18062 connection.cc:256] RPC call timeout handler was delayed by -2.0113820980000128s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2376s for a response
I20260709 12:10:32.598033 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:32.599802 20466 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:32.595471 20440 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.596896 20272 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.609012 18022 raft_consensus.cc:2393] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 5: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:32.614509 18024 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:32.579893 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:32.653993 17946 raft_consensus.cc:2393] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 5: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:32.620162 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:32.628543 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:32.654534 18095 raft_consensus.cc:2393] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 6: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
W20260709 12:10:32.635224 18608 connection.cc:256] RPC call timeout handler was delayed by -1.7002981990001445s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19940000000000002s for a response
W20260709 12:10:32.654968 18608 connection.cc:256] RPC call timeout handler was delayed by -1.4669887909999488s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19240000000000002s for a response
W20260709 12:10:32.655416 18608 connection.cc:256] RPC call timeout handler was delayed by -1.4264887910001107s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19690000000000002s for a response
W20260709 12:10:32.655810 18608 connection.cc:256] RPC call timeout handler was delayed by -1.2655526200001077s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1549s for a response
W20260709 12:10:32.656189 18608 connection.cc:256] RPC call timeout handler was delayed by -1.1737919820000116s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3093s for a response
I20260709 12:10:32.657353 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:32.658188 18644 raft_consensus.cc:2368] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 4. Current term is 5.
I20260709 12:10:32.659255 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:32.659763 18644 raft_consensus.cc:2468] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:32.637228 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:32.640439 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:32.640826 20448 raft_consensus.cc:3055] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:32.642573 20469 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:32.607532 18639 raft_consensus.cc:3060] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:10:32.643052 17944 raft_consensus.cc:2410] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:32.593253 20281 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.566234 20277 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.654465 18020 raft_consensus.cc:2468] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:10:32.617985 18609 leader_election.cc:304] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:32.663080 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:32.663615 18637 raft_consensus.cc:2393] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 4: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:32.602926 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:32.675305 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:32.675755 18638 raft_consensus.cc:2376] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 7. Re-sending same reply.
I20260709 12:10:32.675500 20367 consensus_queue.cc:260] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:32.675973 18642 raft_consensus.cc:2468] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
I20260709 12:10:32.676373 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:32.665304 19655 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.676733 20367 raft_consensus.cc:3060] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.676909 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:32.677085 19655 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:10:32.677415 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:32.677718 18642 raft_consensus.cc:2393] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 3: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:32.677979 18637 raft_consensus.cc:2468] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
W20260709 12:10:32.664870 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 78392.8us
I20260709 12:10:32.678789 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:32.678898 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:32.679549 17912 leader_election.cc:304] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:32.675977 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:32.680361 20365 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:32.680784 18640 raft_consensus.cc:2393] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 5: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:32.681392 20440 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:32.666388 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 48516.7us
I20260709 12:10:32.682542 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:32.683593 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:32.683929 20272 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:32.676738 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:32.675177 20428 raft_consensus.cc:2804] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:32.672945 17949 raft_consensus.cc:2468] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 5.
I20260709 12:10:32.637012 20157 raft_consensus.cc:493] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
W20260709 12:10:32.687690 18062 connection.cc:256] RPC call timeout handler was delayed by -1.1085199480000938s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1573s for a response
I20260709 12:10:32.678443 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:32.688151 18062 connection.cc:256] RPC call timeout handler was delayed by -1.0500199479999992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1638s for a response
I20260709 12:10:32.688800 18642 raft_consensus.cc:2393] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 6: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:32.689380 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:32.690076 18098 raft_consensus.cc:2393] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 5: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:32.690574 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:32.691000 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:32.691696 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:32.692155 17941 raft_consensus.cc:2468] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
I20260709 12:10:32.692577 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:32.693534 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:32.685664 20428 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.694828 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:32.695051 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:32.695202 17948 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 6.
I20260709 12:10:32.695374 18096 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:10:32.695641 18640 raft_consensus.cc:2468] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 4.
I20260709 12:10:32.695048 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:32.682410 20440 raft_consensus.cc:2804] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:32.694257 18092 raft_consensus.cc:2393] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 4: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:32.687463 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:32.694546 20428 raft_consensus.cc:3060] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:32.703214 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:32.703617 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:32.703681 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:32.704183 18094 raft_consensus.cc:1240] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:32.704538 20157 raft_consensus.cc:515] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.705104 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:32.696359 20234 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.706138 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:32.685627 18638 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:10:32.697947 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:32.698674 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:32.699450 18024 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 8.
I20260709 12:10:32.697367 19655 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123)
I20260709 12:10:32.635196 20027 raft_consensus.cc:493] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:32.703330 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:32.711952 18018 raft_consensus.cc:2468] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
I20260709 12:10:32.595549 20446 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.703141 18095 raft_consensus.cc:3060] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:32.707542 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:32.716410 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:32.707770 18641 raft_consensus.cc:2468] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:32.704320 17945 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:32.680899 20277 raft_consensus.cc:3060] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.717039 18091 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:32.718868 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 203932us
I20260709 12:10:32.719173 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:32.719882 18098 raft_consensus.cc:2368] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 4. Current term is 5.
I20260709 12:10:32.706609 20157 leader_election.cc:290] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:32.706512 20234 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:32.727453 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:32.728072 17949 raft_consensus.cc:2468] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
I20260709 12:10:32.728478 20234 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:32.728904 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:32.729233 18016 raft_consensus.cc:2468] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
I20260709 12:10:32.729839 18093 raft_consensus.cc:2468] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 5.
I20260709 12:10:32.663894 20448 raft_consensus.cc:740] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:32.721434 17912 leader_election.cc:304] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:32.603736 20442 consensus_queue.cc:260] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:32.801288 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:32.775645 18097 raft_consensus.cc:1275] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:32.797291 18095 raft_consensus.cc:2468] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
W20260709 12:10:32.730937 17947 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44668 (request call id 383) took 2190 ms (client timeout 1969 ms). Trace:
I20260709 12:10:32.761483 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:32.820098 17944 raft_consensus.cc:3060] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:32.761255 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:32.800621 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:32.821337 18089 raft_consensus.cc:2393] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 8: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:32.759272 18090 raft_consensus.cc:2368] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 6. Current term is 7.
I20260709 12:10:32.821666 18637 raft_consensus.cc:2410] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:32.800293 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:32.797887 17945 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
I20260709 12:10:32.822180 18644 raft_consensus.cc:2468] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:32.778357 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:32.822995 17946 raft_consensus.cc:3060] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:32.778882 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:32.828105 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:32.828917 17940 raft_consensus.cc:2468] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:32.830039 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:32.831018 17940 raft_consensus.cc:2393] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 5: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:32.832412 20469 raft_consensus.cc:2804] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:32.832923 20469 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.833340 20469 raft_consensus.cc:3060] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:32.835356 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 113987us
I20260709 12:10:32.708523 20440 raft_consensus.cc:493] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.843168 20440 raft_consensus.cc:3060] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:32.847200 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:32.848196 18016 raft_consensus.cc:2468] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:32.850658 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:32.851516 18016 raft_consensus.cc:2468] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
I20260709 12:10:32.691658 20443 raft_consensus.cc:2804] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:32.853251 20443 raft_consensus.cc:697] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:32.854579 20443 consensus_queue.cc:237] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:32.675364 20330 raft_consensus.cc:2804] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:32.858825 18635 raft_consensus.cc:1275] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:32.859614 20330 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:32.860248 20330 raft_consensus.cc:3060] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:32.870975 18016 raft_consensus.cc:1240] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:32.876474 18018 raft_consensus.cc:1240] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:32.878289 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:32.879292 18018 raft_consensus.cc:2393] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 6: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:32.881146 18018 raft_consensus.cc:1240] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:32.882516 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:32.883718 18016 raft_consensus.cc:2393] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 6: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:32.818375 18640 raft_consensus.cc:2468] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:32.807582 20234 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:32.886214 20481 log.cc:927] Time spent T 00000000000000000000000000000000 P b852ae4791e4401b8356c71ae33bbc7d: Append to log took a long time: real 0.178s	user 0.002s	sys 0.000s
I20260709 12:10:32.799760 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:32.730403 20027 raft_consensus.cc:515] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.886557 18092 raft_consensus.cc:1275] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:10:32.888108 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 67755.2us
W20260709 12:10:32.819923 17947 rpcz_store.cc:269] 0709 12:10:30.525042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.525233 (+   191us) service_pool.cc:224] Handling call
0709 12:10:32.715176 (+2189943us) spinlock_profiling.cc:243] Waited 1.84 s on lock 0x7b54001fc554. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:32.715331 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4229412736}
I20260709 12:10:32.890261 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:32.890372 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:32.890982 17945 raft_consensus.cc:3060] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:32.891573 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:32.892306 18095 raft_consensus.cc:2393] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 4: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:32.893051 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:32.894003 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:32.729897 17943 raft_consensus.cc:2410] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:32.894665 18090 raft_consensus.cc:2368] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 5. Current term is 6.
I20260709 12:10:32.900604 20440 raft_consensus.cc:515] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.903044 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:32.907527 18096 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 7.
I20260709 12:10:32.910778 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:32.911468 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:32.922936 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:32.923684 18089 raft_consensus.cc:2368] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 5. Current term is 6.
I20260709 12:10:32.804028 20281 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:32.806113 20466 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:32.925477 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:32.889880 20365 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:32.932968 17945 raft_consensus.cc:2468] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
W20260709 12:10:32.947686 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.951404 20277 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:32.955117 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:32.956632 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:32.957338 17945 raft_consensus.cc:2468] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 1.
I20260709 12:10:32.958262 18639 raft_consensus.cc:2468] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 4.
I20260709 12:10:32.959286 17942 raft_consensus.cc:2368] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 4. Current term is 5.
I20260709 12:10:32.923530 20442 raft_consensus.cc:3060] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:32.964587 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
W20260709 12:10:32.959604 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:32.804718 20293 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.974056 17944 raft_consensus.cc:2468] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
I20260709 12:10:32.975847 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:32.886539 20234 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.978140 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:32.979915 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:32.983104 18636 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60430 (request call id 529) took 2341 ms (client timeout 1573 ms). Trace:
I20260709 12:10:32.985139 17946 raft_consensus.cc:2468] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:32.989339 18095 raft_consensus.cc:2393] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 4: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:32.992218 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:32.993021 17948 raft_consensus.cc:2376] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6. Re-sending same reply.
I20260709 12:10:32.959241 20365 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:32.990096 18636 rpcz_store.cc:269] 0709 12:10:30.641422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.642975 (+  1553us) service_pool.cc:224] Handling call
0709 12:10:32.982908 (+2339933us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b54005f0ad4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:32.983018 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":841629568}
I20260709 12:10:32.995606 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:32.996163 17946 raft_consensus.cc:2376] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6. Re-sending same reply.
I20260709 12:10:32.996935 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:32.948931 20434 raft_consensus.cc:515] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:32.998039 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:32.998539 17946 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:33.003752 20440 leader_election.cc:290] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:33.020793 17946 raft_consensus.cc:2468] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 7.
I20260709 12:10:33.025043 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:33.027040 18090 raft_consensus.cc:2393] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 5: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:33.029156 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:33.029834 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:33.030265 18096 raft_consensus.cc:2468] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
I20260709 12:10:33.030543 17942 raft_consensus.cc:2393] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 8: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:33.028517 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:10:33.031309 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 103097us
I20260709 12:10:33.005779 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:33.005308 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:33.031742 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:33.033211 18062 leader_election.cc:304] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:33.034065 18093 raft_consensus.cc:2393] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 8: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:33.034763 18095 raft_consensus.cc:2393] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 5: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:33.035508 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:33.040691 19655 raft_consensus.cc:2804] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:33.041232 19655 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.041674 19655 raft_consensus.cc:3060] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:33.042783 16784 debug-util.cc:398] Leaking SignalData structure 0x7b08003e7120 after lost signal to thread 18608
I20260709 12:10:33.044103 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:33.044227 18062 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:33.002002 20428 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:33.047490 17948 raft_consensus.cc:1275] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:33.029024 20441 raft_consensus.cc:3055] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:33.045674 18062 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:33.054280 18089 raft_consensus.cc:1275] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:33.057641 17944 raft_consensus.cc:1240] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:33.060472 18062 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:33.024583 20386 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:33.059144 20489 log.cc:927] Time spent T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:10:33.026818 20330 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:33.064260 18097 raft_consensus.cc:1275] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:33.051795 20436 raft_consensus.cc:2804] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:33.072634 20491 raft_consensus.cc:2804] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:33.073150 20491 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.072718 19655 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:33.073542 20491 raft_consensus.cc:3060] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:33.055498 20441 raft_consensus.cc:740] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:33.075677 19655 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:33.076478 19655 raft_consensus.cc:2804] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:33.077018 19655 raft_consensus.cc:697] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:33.078261 19655 consensus_queue.cc:237] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:33.089382 17989 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:33.095585 20448 consensus_queue.cc:260] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:33.096987 20448 raft_consensus.cc:3060] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.099259 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:33.100282 17947 raft_consensus.cc:2393] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 8: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:33.104148 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:33.104853 20386 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:33.106392 17912 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:33.106626 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:33.107192 20386 raft_consensus.cc:2804] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:33.107671 20386 raft_consensus.cc:697] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:33.108174 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:33.108534 20386 consensus_queue.cc:237] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:33.108958 18639 raft_consensus.cc:3060] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:33.109850 18636 raft_consensus.cc:1240] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:33.107664 17948 raft_consensus.cc:2393] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 5: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:33.116667 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:33.117609 17948 raft_consensus.cc:2368] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 4. Current term is 5.
I20260709 12:10:33.118453 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:33.125691 17948 raft_consensus.cc:2468] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 5.
I20260709 12:10:33.128165 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:33.090145 17914 leader_election.cc:304] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:33.130913 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:33.132243 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:10:33.133700 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 43640.2us
I20260709 12:10:33.134589 20294 consensus_queue.cc:1048] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:33.159720 17914 leader_election.cc:400] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Vote denied by peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931) with higher term. Message: Invalid argument: T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 4. Current term is 5.
I20260709 12:10:33.160041 17914 leader_election.cc:403] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:10:33.131719 17948 raft_consensus.cc:2376] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 5. Re-sending same reply.
I20260709 12:10:33.135481 20365 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:33.135756 20330 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:33.136356 20281 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.136946 20434 leader_election.cc:290] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:33.136842 20312 consensus_queue.cc:1059] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:33.137679 20446 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:33.138047 20400 raft_consensus.cc:2804] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:33.139544 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.134176 20440 raft_consensus.cc:2749] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:33.139572 20234 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:33.142055 20428 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:33.142751 20027 leader_election.cc:290] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:33.143435 20293 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:33.143528 20236 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:33.144078 20486 log.cc:927] Time spent T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:10:33.146466 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:33.111869 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:33.195870 17944 raft_consensus.cc:2376] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 5. Re-sending same reply.
I20260709 12:10:33.196171 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
W20260709 12:10:33.148609 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.150895 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:33.199080 18096 raft_consensus.cc:3060] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.199568 18091 raft_consensus.cc:2468] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:10:33.200763 18094 raft_consensus.cc:1240] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:33.201103 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:33.151775 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:33.153272 17943 raft_consensus.cc:1275] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:33.215000 20446 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.215370 18016 raft_consensus.cc:1275] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:33.215656 20446 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:33.216480 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:33.216363 20469 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:33.217275 18016 raft_consensus.cc:2393] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 4: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:33.218063 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:33.218176 20446 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:33.156100 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:33.161758 20281 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:33.219964 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:33.220644 20281 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:33.163342 20444 consensus_queue.cc:1048] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:10:33.221272 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:33.222209 18641 raft_consensus.cc:2393] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 5: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:33.168658 20400 raft_consensus.cc:697] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:33.156764 18639 raft_consensus.cc:2468] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 4.
I20260709 12:10:33.223563 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:33.225003 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:33.225641 18639 raft_consensus.cc:3060] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.154413 20491 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:33.166936 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:33.175818 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:33.176822 18642 raft_consensus.cc:1240] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:33.179787 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:33.186434 18023 raft_consensus.cc:1240] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:33.161211 20272 raft_consensus.cc:3060] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:33.182778 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 51654.3us
I20260709 12:10:33.175877 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:33.188836 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:33.190194 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:33.191380 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:33.192620 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:33.193076 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:33.133016 17940 raft_consensus.cc:2376] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6. Re-sending same reply.
I20260709 12:10:33.196883 18021 raft_consensus.cc:2393] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 8: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:33.201686 17942 raft_consensus.cc:2468] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 5.
I20260709 12:10:33.176409 20277 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:33.177364 18638 raft_consensus.cc:1240] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:10:33.178771 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:33.223337 20400 consensus_queue.cc:237] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:10:33.161645 17914 leader_election.cc:400] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 election: Vote denied by peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931) with higher term. Message: Invalid argument: T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 6. Current term is 7.
I20260709 12:10:33.210440 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:33.226995 18643 raft_consensus.cc:3060] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:33.249279 18016 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 7.
I20260709 12:10:33.391386 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:33.391669 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:33.392633 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:33.392923 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:33.393945 18638 raft_consensus.cc:1240] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:33.394050 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:33.394780 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.395293 18637 raft_consensus.cc:3060] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:33.396025 18020 raft_consensus.cc:2468] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 7.
W20260709 12:10:33.338941 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 278890us
I20260709 12:10:33.394743 17914 leader_election.cc:403] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 12:10:33.398753 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 237831us
I20260709 12:10:33.400947 17914 leader_election.cc:400] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 election: Vote denied by peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931) with higher term. Message: Invalid argument: T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 5. Current term is 6.
I20260709 12:10:33.401990 17949 raft_consensus.cc:2410] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:33.402088 17914 leader_election.cc:403] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:10:33.403258 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:33.403860 18021 raft_consensus.cc:2468] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 5.
I20260709 12:10:33.404662 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:33.399346 18062 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:33.408345 18643 raft_consensus.cc:2468] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
I20260709 12:10:33.408619 18062 leader_election.cc:304] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:33.411049 17988 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:33.412534 17988 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:33.413945 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:33.439298 18018 raft_consensus.cc:2410] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:33.414819 18640 raft_consensus.cc:2393] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 4: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:33.415383 18024 raft_consensus.cc:2393] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 5: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:33.229321 18096 raft_consensus.cc:2468] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
I20260709 12:10:33.417143 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:33.163209 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:33.365554 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:33.283767 20491 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:33.283193 20365 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.430250 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:33.423131 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:33.445312 18020 raft_consensus.cc:2468] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 5.
I20260709 12:10:33.401760 20277 raft_consensus.cc:2749] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931) with higher term. Message: Invalid argument: T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 6. Current term is 7.
I20260709 12:10:33.437979 18644 raft_consensus.cc:1240] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:33.438172 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:33.433167 17989 leader_election.cc:304] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:33.486668 18643 raft_consensus.cc:3060] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:33.486877 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 57783.9us
I20260709 12:10:33.428467 18021 raft_consensus.cc:1275] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:33.435350 18062 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:10:33.487874 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 52574.7us
I20260709 12:10:33.488142 17988 leader_election.cc:304] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:33.441574 18609 leader_election.cc:304] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:33.401584 18639 raft_consensus.cc:2468] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:10:33.418774 20446 raft_consensus.cc:2749] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:33.405586 20466 raft_consensus.cc:2749] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931) with higher term. Message: Invalid argument: T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 5. Current term is 6.
I20260709 12:10:33.283456 20444 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.492347 17914 leader_election.cc:304] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:33.493906 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:33.524751 18021 raft_consensus.cc:3060] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.431887 20236 raft_consensus.cc:2804] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:33.517195 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 75702.2us
W20260709 12:10:33.521958 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.405499 20156 consensus_queue.cc:1048] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.079s
I20260709 12:10:33.432991 20436 raft_consensus.cc:697] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:33.515256 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:33.527134 18640 raft_consensus.cc:2410] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:10:33.441431 20434 raft_consensus.cc:2804] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:33.419508 18015 raft_consensus.cc:2468] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:10:33.534042 18643 raft_consensus.cc:2468] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:10:33.536182 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:33.483728 20281 raft_consensus.cc:2804] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:33.546211 17946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50334 (request call id 1934) took 1045 ms. Trace:
I20260709 12:10:33.484692 20312 raft_consensus.cc:493] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:33.549804 18021 raft_consensus.cc:2468] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:10:33.446123 20234 consensus_queue.cc:1059] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 12:10:33.549111 17946 rpcz_store.cc:276] 0709 12:10:32.501003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.021646 (+520643us) service_pool.cc:224] Handling call
0709 12:10:33.021958 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:33.022284 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:33.022311 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:33.022743 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 12:10:33.065919 (+ 43176us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:33.537561 (+471642us) log.cc:844] Serialized 14 byte log entry
0709 12:10:33.545934 (+  8373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:33.546000 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:33.546035 (+    35us) raft_consensus.cc:1685] finished
0709 12:10:33.546045 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:33.546163 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8129,"raft.queue_time_us":4874,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":8285,"thread_start_us":504126,"threads_started":2,"wal-append.queue_time_us":93243}
I20260709 12:10:33.446003 20270 consensus_queue.cc:1059] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 12:10:33.516355 20060 raft_consensus.cc:2804] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:33.463114 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:33.554272 18608 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:33.534965 20161 raft_consensus.cc:2804] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:33.566998 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:33.545642 20277 raft_consensus.cc:493] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.536324 20434 raft_consensus.cc:493] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.526293 20236 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:33.548501 20466 raft_consensus.cc:2749] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:33.548930 20281 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:33.574288 20367 raft_consensus.cc:2804] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:10:33.595320 20493 log.cc:927] Time spent T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:10:33.595664 20367 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:33.596091 20367 raft_consensus.cc:3060] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:33.596664 20441 consensus_queue.cc:260] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:33.598263 20441 raft_consensus.cc:3060] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:33.569216 20312 raft_consensus.cc:515] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:33.600641 20312 leader_election.cc:290] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:33.603679 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:33.604482 18635 raft_consensus.cc:2393] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 4: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:33.606271 18637 raft_consensus.cc:2468] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
I20260709 12:10:33.579921 18608 leader_election.cc:304] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:33.569041 20060 raft_consensus.cc:493] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.536509 20444 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:33.618940 18019 raft_consensus.cc:1240] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 LEADER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:10:33.525295 20365 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:33.552912 20494 raft_consensus.cc:2804] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:33.608777 20492 log.cc:927] Time spent T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:10:33.579344 20293 raft_consensus.cc:2804] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:33.605590 18016 raft_consensus.cc:3060] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:33.594473 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:33.550767 20436 consensus_queue.cc:237] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:33.611979 20236 raft_consensus.cc:3060] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:33.608549 20281 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.606402 20161 raft_consensus.cc:697] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:33.607877 20434 raft_consensus.cc:3060] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:33.618973 20294 raft_consensus.cc:2764] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:10:33.619588 20060 raft_consensus.cc:3060] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:33.639745 17913 connection.cc:256] RPC call timeout handler was delayed by -1.7456016969999837s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16720000000000002s for a response
I20260709 12:10:33.645314 18608 leader_election.cc:304] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:33.605863 20277 raft_consensus.cc:515] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:33.652436 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 164363us
W20260709 12:10:33.653199 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 160924us
I20260709 12:10:33.625696 20494 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:33.626708 20293 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:33.653770 17988 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:33.655020 17988 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:33.655272 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:33.656044 17914 leader_election.cc:400] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931) with higher term. Message: Invalid argument: T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 5. Current term is 6.
I20260709 12:10:33.656127 17941 raft_consensus.cc:1240] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:33.658116 17946 raft_consensus.cc:2393] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 3: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:33.658363 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:33.659080 17941 raft_consensus.cc:2393] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 5: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:33.639717 18015 raft_consensus.cc:3060] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:33.658855 17914 leader_election.cc:403] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:33.660950 17940 raft_consensus.cc:1275] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:10:33.663158 17940 pending_rounds.cc:85] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1: Aborting all ops after (but not including) 2
I20260709 12:10:33.663412 17940 pending_rounds.cc:107] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:10:33.663637 17940 raft_consensus.cc:2889] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:33.661319 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:33.645304 18017 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:33.661813 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.644886 20466 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.662678 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:33.665612 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:33.656662 20443 raft_consensus.cc:2804] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:33.665608 20157 raft_consensus.cc:2749] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:33.675599 18608 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:33.659969 20293 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:33.677557 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:33.679250 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:33.681105 17940 raft_consensus.cc:2393] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 8: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:33.681134 17944 raft_consensus.cc:2393] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 5: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
W20260709 12:10:33.679915 17987 leader_election.cc:336] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Timed out: RequestConsensusVote RPC to 127.16.98.196:43647 timed out after 1.535s (SENT)
I20260709 12:10:33.681697 17987 leader_election.cc:304] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:33.656198 20494 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:33.684921 20157 raft_consensus.cc:2804] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:33.686012 17940 raft_consensus.cc:1240] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:10:33.683184 20232 consensus_queue.cc:1048] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:10:33.682113 18608 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:33.688598 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:33.656718 17943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "137ed415b9d242989f28f349c1618c74"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:10:33.689637 17943 raft_consensus.cc:606] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:33.690102 17943 raft_consensus.cc:614] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:33.690735 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:33.691468 17940 raft_consensus.cc:2468] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:33.692499 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:33.693123 17944 raft_consensus.cc:2468] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:33.664048 17914 leader_election.cc:304] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:33.694636 20505 raft_consensus.cc:2749] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:33.695526 20161 consensus_queue.cc:237] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:33.696184 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:33.696777 17944 raft_consensus.cc:2468] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:10:33.697886 17914 leader_election.cc:304] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:33.699100 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:33.699599 20277 leader_election.cc:290] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:33.700461 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:33.701205 17944 raft_consensus.cc:2410] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:33.702335 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:33.703754 20505 raft_consensus.cc:2749] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:33.705435 20469 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:33.705643 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:33.707130 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:33.707767 20365 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:33.708695 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:33.709347 17940 raft_consensus.cc:2393] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 6: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:33.711079 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:33.712117 20469 consensus_queue.cc:1059] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:33.713068 20505 raft_consensus.cc:3055] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:33.713392 20505 raft_consensus.cc:740] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:33.718005 18641 raft_consensus.cc:2468] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
I20260709 12:10:33.740793 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:33.669937 20027 raft_consensus.cc:2749] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931) with higher term. Message: Invalid argument: T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 5. Current term is 6.
W20260709 12:10:33.739210 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 235112us
I20260709 12:10:33.746663 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:33.747704 17942 raft_consensus.cc:2393] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 5: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
W20260709 12:10:33.748420 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 66353.9us
I20260709 12:10:33.749359 18608 leader_election.cc:304] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:33.758410 18608 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:33.717196 20443 raft_consensus.cc:697] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:33.742102 20157 raft_consensus.cc:697] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:33.766834 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:33.675683 20466 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:33.737314 20503 raft_consensus.cc:2804] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:33.745541 20365 raft_consensus.cc:2749] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:33.768262 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:33.767592 17948 raft_consensus.cc:2393] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 3: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:33.769227 17942 raft_consensus.cc:2393] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 5: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:33.770112 17944 raft_consensus.cc:2393] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 6: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:33.770409 17989 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:33.766870 20236 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:33.771998 20443 consensus_queue.cc:237] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:33.773716 20236 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:33.758697 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:33.760463 20330 raft_consensus.cc:2764] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 12:10:33.775324 20157 consensus_queue.cc:237] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:33.776111 17943 raft_consensus.cc:2410] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:10:33.764876 20232 raft_consensus.cc:2804] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:33.777125 20232 raft_consensus.cc:697] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:33.777974 20232 consensus_queue.cc:237] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:33.779563 20444 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:33.779791 18016 raft_consensus.cc:2468] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
I20260709 12:10:33.714148 20505 consensus_queue.cc:260] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:33.767951 20498 log.cc:927] Time spent T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:10:33.787811 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:33.788014 20503 raft_consensus.cc:697] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:33.788925 18091 raft_consensus.cc:1240] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:33.787173 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:33.790299 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:33.791188 18094 raft_consensus.cc:2393] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 7: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:33.774115 20367 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:33.795157 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:33.796794 18093 raft_consensus.cc:2468] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
I20260709 12:10:33.774248 20281 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:33.798967 17989 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:33.799400 18608 leader_election.cc:400] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Vote denied by peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123) with higher term. Message: Invalid argument: T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 3. Current term is 4.
I20260709 12:10:33.799783 18608 leader_election.cc:403] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:33.783070 20236 raft_consensus.cc:493] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.800320 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:33.798285 20400 consensus_queue.cc:1059] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:10:33.801133 20514 raft_consensus.cc:2804] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:33.801556 20514 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:33.801672 20400 raft_consensus.cc:3055] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:33.801999 20514 raft_consensus.cc:3060] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:33.802034 20400 raft_consensus.cc:740] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:33.803041 20400 consensus_queue.cc:260] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:33.804162 20400 raft_consensus.cc:3060] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:33.792649 20365 consensus_queue.cc:1048] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:10:33.810149 20365 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:33.811029 18018 raft_consensus.cc:1240] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:33.812966 20281 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:33.817329 18015 raft_consensus.cc:2468] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 7.
I20260709 12:10:33.233208 17912 leader_election.cc:304] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:33.821225 20027 raft_consensus.cc:2804] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:33.821805 20027 raft_consensus.cc:697] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:33.822712 20027 consensus_queue.cc:237] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:33.826040 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 592862us
I20260709 12:10:33.827697 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
W20260709 12:10:33.830221 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 150347us
W20260709 12:10:33.834007 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.783375 20508 raft_consensus.cc:2804] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:33.793476 20444 raft_consensus.cc:2804] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:33.805975 20293 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:33.832412 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:33.832140 20236 raft_consensus.cc:515] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:33.835223 20365 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:33.837499 17912 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:33.838322 20444 raft_consensus.cc:697] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
W20260709 12:10:33.843416 17987 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.98.196:43647 timed out after 1.696s (SENT) [suppressed 55 similar messages]
I20260709 12:10:33.828826 20505 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:33.843969 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:10:33.848246 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 188131us
I20260709 12:10:33.849210 17988 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:33.843938 18608 leader_election.cc:304] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:33.851243 17988 leader_election.cc:400] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 election: Vote denied by peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123) with higher term. Message: Invalid argument: T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 4. Current term is 5.
I20260709 12:10:33.851539 17988 leader_election.cc:403] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:10:33.851650 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:33.836589 20330 raft_consensus.cc:2749] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123) with higher term. Message: Invalid argument: T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 3. Current term is 4.
I20260709 12:10:33.856067 17913 leader_election.cc:400] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Vote denied by peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297) with higher term. Message: Invalid argument: T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 5. Current term is 6.
I20260709 12:10:33.857560 17913 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:33.859282 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:33.860291 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:33.861423 17988 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:33.837108 20508 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:33.862486 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:33.863471 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:33.866820 17913 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:33.867123 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:33.868014 17945 raft_consensus.cc:2376] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5. Re-sending same reply.
I20260709 12:10:33.868033 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:33.868604 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:33.847726 20469 raft_consensus.cc:2804] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:33.865768 18061 leader_election.cc:304] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:33.868196 17913 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:33.788944 20503 consensus_queue.cc:237] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:33.881829 17948 raft_consensus.cc:1275] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:10:33.892887 17948 pending_rounds.cc:85] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1: Aborting all ops after (but not including) 5
I20260709 12:10:33.849578 20272 raft_consensus.cc:2749] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931) with higher term. Message: Invalid argument: T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 4. Current term is 5.
I20260709 12:10:33.893226 17948 pending_rounds.cc:107] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:10:33.893535 20312 raft_consensus.cc:2749] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:33.865272 20400 raft_consensus.cc:2749] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123) with higher term. Message: Invalid argument: T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 4. Current term is 5.
I20260709 12:10:33.845904 20161 consensus_queue.cc:1048] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:10:33.869256 20504 raft_consensus.cc:2804] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:33.869663 20502 raft_consensus.cc:2749] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:33.864248 20516 raft_consensus.cc:2749] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:33.941177 20517 log.cc:927] Time spent T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:10:33.943162 20365 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:33.943461 20270 consensus_queue.cc:1059] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:10:33.991344 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 125802us
I20260709 12:10:33.944447 20507 raft_consensus.cc:2749] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:33.946091 20236 leader_election.cc:290] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:33.947983 20443 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:33.864173 20515 raft_consensus.cc:2804] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:33.869554 20386 raft_consensus.cc:2749] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:33.907413 20469 raft_consensus.cc:697] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:33.953274 18017 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 7.
I20260709 12:10:33.956808 20060 raft_consensus.cc:515] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:33.959692 20514 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:33.961254 20367 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:33.963297 20466 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:33.964118 20436 consensus_queue.cc:1059] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:10:33.966583 18061 leader_election.cc:304] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:33.896325 20234 consensus_queue.cc:1059] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 12:10:33.968648 20434 raft_consensus.cc:515] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:33.896150 20330 consensus_queue.cc:1059] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 12:10:33.897111 17948 raft_consensus.cc:2889] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:34.086810 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:34.087632 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:33.868093 20277 consensus_queue.cc:1048] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:10:33.975081 18641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:52812
I20260709 12:10:33.864895 20508 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.091284 18641 raft_consensus.cc:606] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:34.091723 18641 raft_consensus.cc:614] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:33.907963 17946 raft_consensus.cc:2468] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
W20260709 12:10:33.989802 17914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.087656 18093 raft_consensus.cc:2468] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 5.
W20260709 12:10:34.093616 17914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:33.944123 20513 log.cc:927] Time spent T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:10:33.996937 18608 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:34.095149 17948 raft_consensus.cc:2393] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 6: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:34.010205 17942 raft_consensus.cc:1240] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:34.012195 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.990123 20504 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
W20260709 12:10:34.026803 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 183796us
I20260709 12:10:33.920411 20470 consensus_queue.cc:1059] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 12:10:34.009613 20515 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:34.067481 20469 consensus_queue.cc:237] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:33.897246 20293 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:34.071506 18637 raft_consensus.cc:1275] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:34.071661 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:34.018383 20494 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:34.072742 20448 raft_consensus.cc:3055] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:34.014118 20443 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:34.075924 18094 raft_consensus.cc:1275] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:34.076653 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
W20260709 12:10:34.083158 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 116641us
W20260709 12:10:33.999287 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 129438us
I20260709 12:10:34.011682 20509 consensus_queue.cc:1059] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:10:34.098171 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:34.101213 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:34.018379 20157 consensus_queue.cc:1048] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 12:10:34.094846 20270 raft_consensus.cc:2804] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:34.103507 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:33.991235 20444 consensus_queue.cc:237] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:34.112337 18641 raft_consensus.cc:1275] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:34.101569 20504 raft_consensus.cc:3060] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.115203 17988 leader_election.cc:304] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:34.124084 17988 leader_election.cc:304] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:34.116429 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:34.098505 17987 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
W20260709 12:10:34.118556 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 121725us
I20260709 12:10:34.119092 17948 raft_consensus.cc:2376] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6. Re-sending same reply.
I20260709 12:10:34.119987 18061 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:34.106266 20515 raft_consensus.cc:3060] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.108101 20277 raft_consensus.cc:493] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.129639 20509 raft_consensus.cc:3055] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:34.130155 20509 raft_consensus.cc:740] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:34.130096 20277 raft_consensus.cc:515] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:34.131110 20509 consensus_queue.cc:260] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:34.132366 20277 leader_election.cc:290] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:34.132725 20270 raft_consensus.cc:697] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 5 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:34.133724 20270 consensus_queue.cc:237] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:34.113981 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:34.126991 18061 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:34.144410 17988 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:34.128976 20520 raft_consensus.cc:2804] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:34.148191 20520 raft_consensus.cc:697] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:34.136782 20466 consensus_queue.cc:1048] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:10:34.149119 20520 consensus_queue.cc:237] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:34.126737 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:34.132407 20509 raft_consensus.cc:3060] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.150447 20516 consensus_queue.cc:1048] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:34.152119 20516 raft_consensus.cc:2764] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:10:34.152650 20060 leader_election.cc:290] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:34.152726 20507 raft_consensus.cc:2749] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:34.129442 20519 raft_consensus.cc:2804] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:34.153760 20519 raft_consensus.cc:697] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:34.153849 20514 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:34.156389 18637 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7201987495494cf8a78424cb721d1c88"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
mode: GRACEFUL
new_leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
 from {username='slave'} at 127.0.0.1:52812
I20260709 12:10:34.157058 18637 raft_consensus.cc:606] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 LEADER]: Received request to transfer leadership to TS c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:34.121089 20441 consensus_meta.cc:287] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.002s
I20260709 12:10:34.111239 20448 raft_consensus.cc:740] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:34.126324 18608 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
W20260709 12:10:34.142954 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 44537.8us
I20260709 12:10:34.162523 17913 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:34.162905 17987 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:34.163525 20440 raft_consensus.cc:2749] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:34.164278 17913 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:34.138023 20470 raft_consensus.cc:2804] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:34.129562 20367 raft_consensus.cc:2804] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:34.164309 17987 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:34.166244 18608 leader_election.cc:304] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:34.146905 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.131126 20434 leader_election.cc:290] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:34.171332 17987 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:34.166263 17913 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:34.173935 20448 consensus_queue.cc:260] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:34.174810 20400 raft_consensus.cc:2804] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:34.175235 20400 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:34.175351 20448 raft_consensus.cc:3060] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.175652 20400 raft_consensus.cc:3060] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.171053 20441 raft_consensus.cc:2804] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:34.177301 20441 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.177641 20441 raft_consensus.cc:3060] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.177892 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:34.179018 19655 raft_consensus.cc:3055] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:34.179373 19655 raft_consensus.cc:740] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:34.118168 20027 consensus_queue.cc:1048] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:10:34.180171 17940 raft_consensus.cc:2393] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 6: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:34.182351 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:34.182535 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:34.183272 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:34.183768 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:34.184038 18020 raft_consensus.cc:2410] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:34.184412 18022 raft_consensus.cc:2368] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 6. Current term is 7.
I20260709 12:10:34.192541 18608 leader_election.cc:304] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:34.184959 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:34.192911 17913 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:34.193562 18023 raft_consensus.cc:2410] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:34.196102 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:34.198174 18095 raft_consensus.cc:1240] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:34.161875 20060 raft_consensus.cc:2804] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:34.198601 17913 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:34.200201 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:34.200224 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:34.202203 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:34.202322 18608 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:34.169950 20514 raft_consensus.cc:2749] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:34.210920 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:34.171279 20528 raft_consensus.cc:2804] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:34.206123 17913 leader_election.cc:304] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:34.212177 18608 leader_election.cc:304] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:34.212183 18021 raft_consensus.cc:3060] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:34.198925 20526 log.cc:927] Time spent T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:10:34.218987 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:34.195731 20439 raft_consensus.cc:2749] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.199703 20330 raft_consensus.cc:2749] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.194957 20470 raft_consensus.cc:697] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:34.195479 20367 raft_consensus.cc:697] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:34.220402 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:34.225571 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:34.200105 20440 raft_consensus.cc:2749] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:34.226378 17940 raft_consensus.cc:2393] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 7: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:34.219163 17988 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:34.224078 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:34.227453 17949 raft_consensus.cc:2468] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 5.
I20260709 12:10:34.203274 20469 raft_consensus.cc:2749] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.200941 20060 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.217800 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:34.231769 20060 raft_consensus.cc:3060] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.235342 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:34.235275 20367 consensus_queue.cc:237] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:34.213667 20466 raft_consensus.cc:2749] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:10:34.236614 20386 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.237151 20386 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:34.237663 20449 raft_consensus.cc:2749] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.156518 20519 consensus_queue.cc:237] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:34.238132 20470 consensus_queue.cc:237] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:34.239295 20386 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:34.215210 20161 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.242121 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:34.213732 20533 raft_consensus.cc:2764] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:10:34.245404 18021 raft_consensus.cc:2468] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
I20260709 12:10:34.228413 20536 raft_consensus.cc:2804] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:34.216254 20281 raft_consensus.cc:2749] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:34.250109 18018 raft_consensus.cc:3060] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:34.222534 20277 consensus_queue.cc:1048] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:10:34.268465 20536 raft_consensus.cc:697] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:34.276932 20536 consensus_queue.cc:237] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:34.278111 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:34.278849 18015 raft_consensus.cc:2468] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 2.
I20260709 12:10:34.280020 18015 raft_consensus.cc:1240] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 LEADER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:34.281380 18015 raft_consensus.cc:1275] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:34.282480 18015 raft_consensus.cc:1240] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:34.283716 18015 raft_consensus.cc:1240] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 12:10:34.287245 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:34.287472 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:34.288733 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:34.289379 18096 raft_consensus.cc:1240] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:34.290323 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:34.290894 18098 raft_consensus.cc:2468] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 5.
I20260709 12:10:34.291203 18092 raft_consensus.cc:1275] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:34.291973 18089 raft_consensus.cc:1240] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 12:10:34.293107 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:34.251149 20522 raft_consensus.cc:2749] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.248824 20386 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:34.296069 18062 leader_election.cc:304] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:34.297412 18093 raft_consensus.cc:2393] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 5: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:34.297217 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:34.300631 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:34.300756 17948 raft_consensus.cc:2410] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:10:34.301134 20491 consensus_queue.cc:1048] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:10:34.302423 18091 raft_consensus.cc:1240] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:34.302462 18019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45464 (request call id 1703) took 1104 ms. Trace:
I20260709 12:10:34.304324 18018 raft_consensus.cc:2468] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
I20260709 12:10:34.308748 18019 rpcz_store.cc:276] 0709 12:10:33.198335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.395372 (+197037us) service_pool.cc:224] Handling call
0709 12:10:33.395656 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:33.619874 (+224218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:34.302217 (+682343us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b540030cad4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:34.302405 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":512907648}
I20260709 12:10:34.300295 18062 leader_election.cc:304] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:34.264166 20161 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:34.340513 17989 leader_election.cc:304] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:34.341925 20522 raft_consensus.cc:2804] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:34.342335 20522 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.342695 20522 raft_consensus.cc:3060] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.346088 18097 raft_consensus.cc:1275] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:34.346939 20514 consensus_queue.cc:1048] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:34.352401 20522 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:34.355028 20522 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:34.357326 18637 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
mode: GRACEFUL
new_leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:52812
I20260709 12:10:34.357476 17943 raft_consensus.cc:1275] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:34.360153 17943 raft_consensus.cc:1275] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:34.364449 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:34.365178 18097 raft_consensus.cc:2393] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 7: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:34.365541 18095 raft_consensus.cc:1275] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:34.365988 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:34.366566 18090 raft_consensus.cc:3060] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.367136 18093 raft_consensus.cc:1275] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:10:34.367982 20236 raft_consensus.cc:3055] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:34.368376 20236 raft_consensus.cc:740] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:34.369309 20236 consensus_queue.cc:260] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:34.370410 20236 raft_consensus.cc:3060] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.373632 18090 raft_consensus.cc:2468] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 7.
I20260709 12:10:34.376297 20293 raft_consensus.cc:3055] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:34.376680 20293 raft_consensus.cc:740] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:34.377492 20293 consensus_queue.cc:260] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:34.378448 20293 raft_consensus.cc:3060] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:34.384719 18607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:34.387523 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 216235us
I20260709 12:10:34.388474 17987 leader_election.cc:304] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:34.389355 20367 raft_consensus.cc:2749] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.390753 17987 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:34.392040 20514 raft_consensus.cc:2749] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:34.391984 20281 consensus_queue.cc:1048] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:34.392966 20514 consensus_queue.cc:1048] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:34.395831 17987 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:34.397169 17987 leader_election.cc:304] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:34.398768 17987 leader_election.cc:304] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:34.394440 17989 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:34.302579 20270 raft_consensus.cc:2749] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.304891 20443 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:34.465802 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 165564us
I20260709 12:10:34.303674 20234 consensus_queue.cc:1059] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.169s
I20260709 12:10:34.394088 20436 raft_consensus.cc:3055] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:34.300808 20386 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:34.514191 18062 leader_election.cc:304] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:34.465648 20503 raft_consensus.cc:2764] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:34.531654 18062 leader_election.cc:304] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:34.465720 17987 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:34.451495 20281 raft_consensus.cc:2804] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:10:34.534760 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 69119.7us
I20260709 12:10:34.535737 17987 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:34.536175 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:34.537417 18090 raft_consensus.cc:3060] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.305289 20400 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:34.319425 20060 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:34.302424 20508 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:34.443679 20544 raft_consensus.cc:2804] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:34.544987 18062 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:34.509470 20434 raft_consensus.cc:2804] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:34.471653 20523 raft_consensus.cc:2804] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:34.513509 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:34.455065 20367 consensus_queue.cc:1048] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
W20260709 12:10:34.547236 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.549674 18090 raft_consensus.cc:2468] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
I20260709 12:10:34.519449 20469 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.443837 20504 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:34.541260 20514 raft_consensus.cc:2749] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:34.519539 20436 raft_consensus.cc:740] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:34.534181 20281 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
W20260709 12:10:34.591928 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 46992.9us
I20260709 12:10:34.547462 20470 raft_consensus.cc:493] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:34.612409 18062 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:34.533859 20440 raft_consensus.cc:493] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:34.544027 20443 raft_consensus.cc:2749] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:34.548080 20236 raft_consensus.cc:2804] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:34.610952 20530 log.cc:927] Time spent T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.391s	user 0.001s	sys 0.000s
I20260709 12:10:34.614377 18062 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:34.590010 20507 raft_consensus.cc:2804] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:34.655225 20507 raft_consensus.cc:493] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
W20260709 12:10:34.655529 20540 log.cc:927] Time spent T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 12:10:34.547844 20544 raft_consensus.cc:493] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:34.656785 20507 raft_consensus.cc:3060] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.656986 20544 raft_consensus.cc:3060] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:34.657783 20494 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:34.659657 20400 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:34.660292 19655 consensus_queue.cc:260] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:34.661608 19655 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.519711 20441 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:34.663621 20060 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:34.664184 20441 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:34.664927 20386 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:34.621089 20270 raft_consensus.cc:3060] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.666934 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:34.635421 20470 raft_consensus.cc:515] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:34.666599 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:34.669420 20470 leader_election.cc:290] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:34.604799 20234 raft_consensus.cc:2749] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:34.670666 20234 raft_consensus.cc:2749] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:34.655387 20277 raft_consensus.cc:493] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:34.587248 20434 raft_consensus.cc:493] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:34.680526 20434 raft_consensus.cc:3060] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:34.683001 20507 raft_consensus.cc:515] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:34.685350 20507 leader_election.cc:290] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:34.666584 20515 consensus_meta.cc:287] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.520s	user 0.005s	sys 0.000s
I20260709 12:10:34.691608 20515 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:34.692731 18639 raft_consensus.cc:3060] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.693439 20508 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:34.695209 20161 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:34.608366 20469 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:34.698978 20469 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:34.637113 20236 raft_consensus.cc:493] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:34.699824 20236 raft_consensus.cc:3060] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:34.608809 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 400027us
I20260709 12:10:34.666970 20504 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:34.691805 18017 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45464 (request call id 1691) took 1513 ms (client timeout 1681 ms). Trace:
I20260709 12:10:34.679203 20277 raft_consensus.cc:515] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:34.703866 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:34.608791 20523 raft_consensus.cc:697] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:34.620898 20281 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:34.705607 17913 leader_election.cc:304] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:34.712229 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:34.715052 18024 raft_consensus.cc:1240] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 6. Current term is 7. Ops: [4.4-6.5]
I20260709 12:10:34.715744 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:34.737337 17945 raft_consensus.cc:2468] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:34.716679 17948 raft_consensus.cc:3060] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:34.719128 17988 leader_election.cc:304] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:34.721077 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:34.739408 17989 leader_election.cc:304] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:34.739943 18020 raft_consensus.cc:2393] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 6: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:34.740059 17988 leader_election.cc:304] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
W20260709 12:10:34.741706 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 127421us
I20260709 12:10:34.721665 18016 raft_consensus.cc:1275] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:34.745234 17947 raft_consensus.cc:1275] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:34.722975 18637 raft_consensus.cc:606] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Received request to transfer leadership to TS 63f5bddeebd84e5788d671a176cfa8e1
W20260709 12:10:34.716370 20551 log.cc:927] Time spent T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:10:34.742411 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:34.735723 18641 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
I20260709 12:10:34.741838 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:34.744928 17988 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:34.752702 18093 raft_consensus.cc:2393] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 6: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:34.722007 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:34.753764 18021 raft_consensus.cc:2468] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3.
I20260709 12:10:34.706043 20528 raft_consensus.cc:697] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:34.779948 17941 raft_consensus.cc:1275] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:34.743839 20442 raft_consensus.cc:2804] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:34.751770 18095 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
W20260709 12:10:34.728163 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.700423 18639 raft_consensus.cc:2468] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
I20260709 12:10:34.686303 20544 raft_consensus.cc:515] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:34.742414 18062 leader_election.cc:304] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:34.756260 17912 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:34.633968 20440 raft_consensus.cc:515] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:34.757400 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:34.794548 17942 raft_consensus.cc:2393] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 6: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:34.783133 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:34.744431 20519 raft_consensus.cc:2749] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:10:34.788945 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:34.758013 20365 raft_consensus.cc:2749] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:34.796653 19655 raft_consensus.cc:2749] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:10:34.796922 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 54590us
I20260709 12:10:34.805358 18062 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:34.806289 19655 raft_consensus.cc:2749] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:34.806411 18062 leader_election.cc:304] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:34.793201 17948 raft_consensus.cc:2468] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
I20260709 12:10:34.746956 20060 raft_consensus.cc:2749] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:34.746999 20504 raft_consensus.cc:2804] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:34.785719 17988 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:34.819996 18062 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:34.782029 20495 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.001s	sys 0.007s
W20260709 12:10:34.815837 18607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:34.747576 20027 consensus_queue.cc:1059] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 12:10:34.743853 20232 consensus_queue.cc:1059] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:10:34.824038 19655 raft_consensus.cc:2749] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:34.824478 18062 leader_election.cc:304] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:34.834434 18062 leader_election.cc:304] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:34.790587 20446 consensus_queue.cc:1048] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:10:34.746850 20439 consensus_queue.cc:1048] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:10:34.744611 20436 consensus_queue.cc:260] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:34.790779 20514 consensus_queue.cc:1048] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
W20260709 12:10:34.711190 18017 rpcz_store.cc:269] 0709 12:10:33.178332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:33.178480 (+   148us) service_pool.cc:224] Handling call
0709 12:10:34.691591 (+1513111us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b54001c89d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:34.691729 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":559731072}
I20260709 12:10:34.750602 20469 consensus_queue.cc:1059] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 12:10:34.846256 19655 raft_consensus.cc:2749] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:34.829008 20495 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.001s	sys 0.007s
I20260709 12:10:34.822093 20494 raft_consensus.cc:3060] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:34.830199 20519 raft_consensus.cc:2804] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:34.852659 18062 leader_election.cc:304] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:34.816880 18608 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.017s	sys 0.060s
I20260709 12:10:34.862840 20519 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:34.863464 20519 raft_consensus.cc:3060] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.863791 20440 leader_election.cc:290] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:34.871402 18608 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.017s	sys 0.060s
W20260709 12:10:34.872083 20556 log.cc:927] Time spent T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:10:34.878840 20528 consensus_queue.cc:237] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:34.881350 20469 raft_consensus.cc:2804] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:34.881788 20469 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:34.882241 20469 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:34.882592 20567 log.cc:927] Time spent T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:10:34.833096 20443 consensus_queue.cc:1048] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:10:34.841399 20504 raft_consensus.cc:697] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:34.885946 20504 consensus_queue.cc:237] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:34.886812 20440 raft_consensus.cc:3055] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:34.887239 20440 raft_consensus.cc:740] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:34.888002 20440 consensus_queue.cc:260] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:34.889106 20293 consensus_meta.cc:287] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.510s	user 0.005s	sys 0.004s
I20260709 12:10:34.888001 18098 raft_consensus.cc:1275] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:34.891340 20544 leader_election.cc:290] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:34.828428 20523 consensus_queue.cc:237] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:34.903645 20533 raft_consensus.cc:3055] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:34.904031 20533 raft_consensus.cc:740] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:34.907624 20277 leader_election.cc:290] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:34.908854 20515 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:34.909996 20436 raft_consensus.cc:3060] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:34.889175 20440 raft_consensus.cc:3060] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:34.938123 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 725960us
I20260709 12:10:34.941152 18095 raft_consensus.cc:1275] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:34.942337 18608 leader_election.cc:400] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Vote denied by peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297) with higher term. Message: Invalid argument: T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 6. Current term is 7.
I20260709 12:10:34.942772 18608 leader_election.cc:403] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:34.944937 18092 raft_consensus.cc:1275] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:34.836719 20507 raft_consensus.cc:2749] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:34.955497 18608 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:34.949946 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 97370.2us
I20260709 12:10:34.961264 18062 leader_election.cc:304] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:34.902984 17846 catalog_manager.cc:5697] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:10:34.965761 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 209599us
I20260709 12:10:34.969201 18062 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:34.973145 18608 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:34.964877 20448 raft_consensus.cc:2749] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:34.968153 20293 raft_consensus.cc:3060] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:34.985600 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:34.986608 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:34.987663 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:34.988368 18021 raft_consensus.cc:2393] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 7: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:34.989482 18021 raft_consensus.cc:1240] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:34.979614 18637 raft_consensus.cc:1275] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:34.991745 18021 raft_consensus.cc:1240] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:34.995132 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:34.999428 18023 raft_consensus.cc:1275] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:35.003492 18020 raft_consensus.cc:1275] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:34.914950 20515 consensus_queue.cc:1048] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:10:34.977829 18608 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:35.018635 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:35.005048 20442 raft_consensus.cc:697] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:35.020448 20563 raft_consensus.cc:2804] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:35.021840 18641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:52812
I20260709 12:10:35.022368 18641 raft_consensus.cc:606] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:35.022723 18641 raft_consensus.cc:614] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:35.023167 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:35.020946 20563 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:34.855796 20434 raft_consensus.cc:515] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:34.980213 20491 raft_consensus.cc:2749] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:34.979848 20232 raft_consensus.cc:2749] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:34.979557 18635 raft_consensus.cc:1275] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:35.036144 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:35.036904 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:35.037081 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:34.976059 20541 raft_consensus.cc:2749] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:35.051641 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:35.052636 18643 raft_consensus.cc:2393] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 6: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:35.051827 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:35.055837 18642 raft_consensus.cc:2393] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 7: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:35.024374 18062 leader_election.cc:304] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:34.967913 20550 consensus_queue.cc:1048] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:10:35.039753 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:35.027630 20563 raft_consensus.cc:3060] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:34.980123 20544 consensus_queue.cc:1048] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:10:35.050407 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:35.065531 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:35.067013 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:35.067570 17942 raft_consensus.cc:3060] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:35.068460 17941 raft_consensus.cc:1275] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:35.069005 17948 raft_consensus.cc:1275] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:10:35.069923 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:35.071198 17948 raft_consensus.cc:1275] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:10:35.071498 17948 pending_rounds.cc:85] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1: Aborting all ops after (but not including) 4
I20260709 12:10:35.071702 17948 pending_rounds.cc:107] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 12:10:35.058614 18024 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:35.074503 18637 raft_consensus.cc:2393] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 7: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:35.057591 18021 raft_consensus.cc:3060] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:35.077157 17914 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:35.071911 17948 raft_consensus.cc:2889] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:35.077880 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 54848.7us
I20260709 12:10:35.078055 17948 pending_rounds.cc:107] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:10:35.078456 17948 raft_consensus.cc:2889] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:35.078665 18062 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:35.078801 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:35.080219 18091 raft_consensus.cc:1275] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:35.036514 20564 raft_consensus.cc:2749] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:35.082216 17987 leader_election.cc:304] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:35.083817 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:35.061658 20277 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.085099 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:35.085609 20277 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:35.091926 20569 consensus_queue.cc:1059] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:35.092794 20569 raft_consensus.cc:3055] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:35.093099 20569 raft_consensus.cc:740] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:35.093827 20569 consensus_queue.cc:260] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:35.097106 17845 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45928 (request call id 367) took 12088 ms (client timeout 15000 ms). Trace:
I20260709 12:10:35.100430 17987 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:35.100852 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 84069.4us
I20260709 12:10:35.100469 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:35.101184 17913 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:35.020962 20442 consensus_queue.cc:237] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:35.109792 20569 raft_consensus.cc:3060] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.113371 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:35.114025 18635 raft_consensus.cc:3060] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:35.114284 18092 raft_consensus.cc:1240] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:35.115103 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:35.116040 18639 raft_consensus.cc:2368] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 3. Current term is 4.
I20260709 12:10:35.116959 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:35.123210 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
W20260709 12:10:35.148813 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 48477.9us
I20260709 12:10:35.072374 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:35.077504 20491 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.084134 20448 raft_consensus.cc:2804] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:35.154688 17948 pending_rounds.cc:85] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1: Aborting all ops after (but not including) 3
I20260709 12:10:35.182303 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:35.182503 17948 pending_rounds.cc:107] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:10:35.183020 17948 raft_consensus.cc:2889] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:35.183346 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.154767 17913 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:35.184265 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 56898.3us
W20260709 12:10:35.155030 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 77943.2us
W20260709 12:10:35.155282 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 70732.5us
I20260709 12:10:35.154798 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:35.160027 18018 raft_consensus.cc:1240] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:35.182238 18022 raft_consensus.cc:3060] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:35.186470 17914 leader_election.cc:304] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:35.153357 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:10:35.167668 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 65905.5us
I20260709 12:10:35.169194 17987 leader_election.cc:304] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:35.191464 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:35.186954 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
W20260709 12:10:35.097517 17845 rpcz_store.cc:269] 0709 12:10:23.008519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:23.008730 (+   211us) service_pool.cc:224] Handling call
0709 12:10:35.097003 (+12088273us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:32.403690 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:32.404364 (+   674us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:32.404411 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:10:32.404444 (+    33us) tablet.cc:662] Decoding operations
0709 12:10:32.424830 (+ 20386us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:32.424919 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:32.424953 (+    34us) tablet.cc:685] Acquiring locks for 20 operations
0709 12:10:32.426597 (+  1644us) tablet.cc:701] Row locks acquired
0709 12:10:32.487153 (+ 60556us) write_op.cc:260] PREPARE: finished
0709 12:10:32.511137 (+ 23984us) write_op.cc:270] Start()
0709 12:10:32.511278 (+   141us) write_op.cc:276] Timestamp: P: 1783599032511068 usec, L: 0
0709 12:10:32.511296 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:10:32.511984 (+   688us) log.cc:844] Serialized 7846 byte log entry
0709 12:10:33.065600 (+553616us) op_driver.cc:464] REPLICATION: finished
0709 12:10:33.526006 (+460406us) write_op.cc:301] APPLY: starting
0709 12:10:33.534543 (+  8537us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:33.543105 (+  8562us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:33.607958 (+ 64853us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:33.692778 (+ 84820us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:33.693978 (+  1200us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=20
0709 12:10:33.694033 (+    55us) write_op.cc:312] APPLY: finished
0709 12:10:33.694465 (+   432us) log.cc:844] Serialized 139 byte log entry
0709 12:10:33.699559 (+  5094us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:33.699742 (+   183us) write_op.cc:454] Released schema lock
0709 12:10:33.699822 (+    80us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:33.703231 (+  3409us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:33.703265 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":460071,"apply.run_cpu_time_us":9268,"apply.run_wall_time_us":177185,"num_ops":20,"prepare.queue_time_us":150099,"prepare.run_cpu_time_us":61258,"prepare.run_wall_time_us":229357,"raft.queue_time_us":177791,"raft.run_cpu_time_us":128454,"raft.run_wall_time_us":324183,"replication_time_us":554087,"thread_start_us":632756,"threads_started":4,"wal-append.queue_time_us":121308,"wal-append.run_cpu_time_us":69618,"wal-append.run_wall_time_us":2068258}]]}
I20260709 12:10:35.195303 19655 consensus_queue.cc:1048] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:35.188760 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:10:35.182600 20270 consensus_meta.cc:287] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.513s	user 0.009s	sys 0.009s
I20260709 12:10:35.158411 18021 raft_consensus.cc:1275] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:35.176388 17942 raft_consensus.cc:2468] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
I20260709 12:10:35.102210 17947 raft_consensus.cc:2468] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:10:35.179944 18608 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:35.061400 20443 consensus_queue.cc:1048] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 12:10:35.199468 18640 raft_consensus.cc:1275] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:35.170423 18024 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 8.
I20260709 12:10:35.201083 18641 raft_consensus.cc:1275] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:35.207562 17914 leader_election.cc:304] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:35.208199 18641 raft_consensus.cc:1240] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 LEADER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:10:35.208237 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:35.175987 20570 raft_consensus.cc:2749] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:35.204797 17941 raft_consensus.cc:1275] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:35.204515 18608 leader_election.cc:304] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:35.210346 18023 raft_consensus.cc:1240] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:10:35.211963 18640 raft_consensus.cc:1240] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:35.249713 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 45279.3us
I20260709 12:10:35.213735 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:35.252882 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 45374.4us
I20260709 12:10:35.211459 18062 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:35.253012 18608 leader_election.cc:304] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:35.256135 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 44909.8us
I20260709 12:10:35.257507 19655 raft_consensus.cc:2804] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:35.258229 19655 raft_consensus.cc:697] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:35.259620 18024 raft_consensus.cc:1275] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:35.260005 17914 leader_election.cc:304] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:35.194471 20550 raft_consensus.cc:2749] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:35.178238 20506 consensus_queue.cc:1048] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 12:10:35.201671 20448 raft_consensus.cc:697] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:35.178251 20234 consensus_queue.cc:1059] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:10:35.272243 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:35.277367 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 92225us
I20260709 12:10:35.277815 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:35.278721 18092 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
I20260709 12:10:35.197176 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:35.263162 17914 leader_election.cc:304] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:35.254539 20236 consensus_meta.cc:287] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.551s	user 0.008s	sys 0.004s
I20260709 12:10:35.284379 20236 raft_consensus.cc:515] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:35.176152 20541 consensus_queue.cc:1059] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 12:10:35.287556 18015 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
I20260709 12:10:35.289579 20236 leader_election.cc:290] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:35.184878 20491 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:35.247387 20441 raft_consensus.cc:2749] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:35.200894 20507 consensus_queue.cc:1059] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 12:10:35.275102 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:35.215555 20270 raft_consensus.cc:2749] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:35.294051 19655 consensus_queue.cc:237] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:35.321950 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 53415.1us
I20260709 12:10:35.207393 20470 consensus_queue.cc:1048] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 12:10:35.334435 18018 raft_consensus.cc:2368] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 5. Current term is 6.
I20260709 12:10:35.269623 20559 raft_consensus.cc:2749] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:35.213068 20509 raft_consensus.cc:2749] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:35.289569 18022 raft_consensus.cc:1275] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:10:35.316473 18607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:35.327845 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 64808.1us
I20260709 12:10:35.267020 20528 raft_consensus.cc:2749] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:35.265988 20027 raft_consensus.cc:2749] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:35.385293 17914 leader_election.cc:304] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:35.313820 20277 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:35.412529 17914 leader_election.cc:304] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:35.415258 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:35.410714 20575 raft_consensus.cc:2804] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:35.410156 20542 raft_consensus.cc:2804] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:35.415668 18097 raft_consensus.cc:1275] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:35.251571 20439 consensus_queue.cc:1048] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 12:10:35.308730 20367 raft_consensus.cc:2749] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:35.366788 20503 raft_consensus.cc:2749] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:35.322454 20570 raft_consensus.cc:2749] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:35.460130 20441 consensus_queue.cc:1048] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
W20260709 12:10:35.470943 20436 consensus_meta.cc:287] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.555s	user 0.008s	sys 0.003s
I20260709 12:10:35.471992 18090 raft_consensus.cc:1275] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:10:35.472394 18090 pending_rounds.cc:85] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110: Aborting all ops after (but not including) 5
I20260709 12:10:35.472631 18090 pending_rounds.cc:107] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:10:35.472901 18090 raft_consensus.cc:2889] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:35.479235 20281 consensus_meta.cc:287] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.728s	user 0.007s	sys 0.006s
I20260709 12:10:35.479843 20281 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:35.291025 20554 consensus_queue.cc:1048] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.179s
I20260709 12:10:35.448750 20575 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:35.446560 17914 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:35.453022 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 186984us
I20260709 12:10:35.330350 20386 consensus_queue.cc:1048] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.127s
W20260709 12:10:35.488377 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 189066us
W20260709 12:10:35.450491 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 262892us
W20260709 12:10:35.486380 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 207897us
I20260709 12:10:35.421617 20576 consensus_queue.cc:1048] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.145s
W20260709 12:10:35.502161 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 55711.2us
I20260709 12:10:35.503008 17914 leader_election.cc:304] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:35.504130 17914 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:35.504350 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:35.463749 20542 raft_consensus.cc:697] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:35.506067 18608 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:35.482594 20281 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:35.512785 18022 raft_consensus.cc:1275] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:35.488816 20466 raft_consensus.cc:2764] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:35.490819 18639 raft_consensus.cc:1275] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:35.483500 20596 raft_consensus.cc:2749] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:35.519407 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
W20260709 12:10:35.520215 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.519992 18022 raft_consensus.cc:2376] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 7. Re-sending same reply.
I20260709 12:10:35.521245 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:35.521978 18022 raft_consensus.cc:2468] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3.
I20260709 12:10:35.523557 18022 raft_consensus.cc:1240] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:35.491664 20575 raft_consensus.cc:3060] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:35.508489 20519 consensus_meta.cc:287] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.644s	user 0.012s	sys 0.000s
I20260709 12:10:35.507793 20586 raft_consensus.cc:2749] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:35.515512 20570 raft_consensus.cc:2749] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:35.515242 20515 raft_consensus.cc:2804] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:35.509452 20522 consensus_queue.cc:1048] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:10:35.527329 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:35.513242 20550 consensus_queue.cc:1048] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:10:35.510156 20528 consensus_queue.cc:1059] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:10:35.516664 20559 consensus_queue.cc:1048] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:10:35.576736 18015 raft_consensus.cc:1275] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:10:35.576862 20593 consensus_queue.cc:1059] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 12:10:35.577540 20592 consensus_queue.cc:1048] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.042s
W20260709 12:10:35.578907 20584 log.cc:927] Time spent T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 12:10:35.579766 20579 log.cc:927] Time spent T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:10:35.590073 20570 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.590804 20595 raft_consensus.cc:2749] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:35.507975 20448 consensus_queue.cc:237] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:35.593765 18635 raft_consensus.cc:2468] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:35.593257 20542 consensus_queue.cc:237] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:35.595178 20293 consensus_meta.cc:287] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.616s	user 0.007s	sys 0.002s
I20260709 12:10:35.512552 20507 consensus_queue.cc:1048] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:10:35.599113 20528 raft_consensus.cc:3055] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:35.599690 20491 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:35.609031 18015 pending_rounds.cc:85] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb: Aborting all ops after (but not including) 5
I20260709 12:10:35.613224 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:35.623363 18091 raft_consensus.cc:1240] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:35.624572 18095 raft_consensus.cc:1240] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:35.625499 18098 raft_consensus.cc:1240] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:35.632611 18017 raft_consensus.cc:1240] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 8. Current term is 9. Ops: []
W20260709 12:10:35.633348 17987 leader_election.cc:336] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Timed out: RequestConsensusVote RPC to 127.16.98.196:43647 timed out after 2.141s (SENT)
W20260709 12:10:35.641844 20569 consensus_meta.cc:287] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.532s	user 0.007s	sys 0.004s
W20260709 12:10:35.657658 20494 consensus_meta.cc:287] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.798s	user 0.009s	sys 0.000s
I20260709 12:10:35.697593 20494 raft_consensus.cc:2749] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:35.536624 20588 raft_consensus.cc:2749] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:35.564853 20515 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:35.698675 20515 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:35.606951 20533 consensus_queue.cc:260] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:35.703007 20533 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:35.703536 20232 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.704233 20232 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:35.570128 20596 raft_consensus.cc:2749] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:35.660563 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 160730us
W20260709 12:10:35.667449 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 163396us
I20260709 12:10:35.707696 17914 leader_election.cc:304] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:35.626389 20505 raft_consensus.cc:3055] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:35.710610 20505 raft_consensus.cc:740] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:35.711119 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:35.711414 20505 consensus_queue.cc:260] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:35.673612 18097 raft_consensus.cc:1240] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:35.536414 20470 consensus_queue.cc:1059] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 12:10:35.715538 20470 raft_consensus.cc:493] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:35.716192 20470 raft_consensus.cc:515] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:35.719009 20505 raft_consensus.cc:3060] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:35.679772 18641 raft_consensus.cc:1240] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:35.676957 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 157361us
I20260709 12:10:35.569528 20161 consensus_queue.cc:1048] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.101s
I20260709 12:10:35.535267 20519 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:35.670858 20469 consensus_meta.cc:287] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.774s	user 0.015s	sys 0.000s
W20260709 12:10:35.686801 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 53500.2us
W20260709 12:10:35.680004 20440 consensus_meta.cc:287] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.767s	user 0.012s	sys 0.002s
I20260709 12:10:35.686506 20293 raft_consensus.cc:2749] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297) with higher term. Message: Invalid argument: T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 6. Current term is 7.
I20260709 12:10:35.749431 18024 raft_consensus.cc:1275] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:35.750098 17940 raft_consensus.cc:2410] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:10:35.691169 18098 raft_consensus.cc:1275] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:35.750607 20519 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:35.687287 18015 pending_rounds.cc:107] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:10:35.751317 18015 raft_consensus.cc:2889] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:35.115046 20428 consensus_queue.cc:1175] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" responder_term: 7 status { last_received { term: 3 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 6. Current term is 7. Ops: [4.4-6.5]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:10:35.673523 20570 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:35.772707 20570 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:35.772893 20569 raft_consensus.cc:2749] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:35.695286 20495 raft_consensus.cc:3055] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:35.774020 20495 raft_consensus.cc:740] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:35.774847 20495 consensus_queue.cc:260] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:35.776058 20495 raft_consensus.cc:3060] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:35.744891 17987 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:35.777312 17987 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:35.746145 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:35.778909 20436 raft_consensus.cc:3055] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:35.779348 20436 raft_consensus.cc:740] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:35.779512 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:35.751999 18021 raft_consensus.cc:1240] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:35.685016 20528 raft_consensus.cc:740] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
W20260709 12:10:35.759637 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 52011.9us
I20260709 12:10:35.775861 20592 consensus_queue.cc:1059] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:35.778453 17987 leader_election.cc:400] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Vote denied by peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647) with higher term. Message: Invalid argument: T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 3. Current term is 4.
I20260709 12:10:35.789909 17987 leader_election.cc:403] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:10:35.748817 20469 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:35.783449 18061 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:35.791311 19655 raft_consensus.cc:2749] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:35.793183 17946 raft_consensus.cc:1240] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:35.786342 18642 raft_consensus.cc:2468] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:35.787423 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:35.787539 20161 consensus_queue.cc:1048] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:35.787853 20519 raft_consensus.cc:2749] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:35.788160 20440 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.795430 17987 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:35.797374 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:35.804147 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:35.814738 18608 leader_election.cc:400] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Vote denied by peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297) with higher term. Message: Invalid argument: T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 5. Current term is 6.
I20260709 12:10:35.815769 17949 raft_consensus.cc:1240] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 5. Current term is 6. Ops: [3.5-5.6]
I20260709 12:10:35.812296 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:35.822161 18644 raft_consensus.cc:2468] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 7.
I20260709 12:10:35.751384 20491 consensus_queue.cc:1048] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:10:35.819450 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:35.823670 17941 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:35.820154 17913 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:35.824993 17942 raft_consensus.cc:3060] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:35.825452 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:35.826395 17946 raft_consensus.cc:2368] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 6. Current term is 7.
I20260709 12:10:35.821007 17948 raft_consensus.cc:1240] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:35.829288 18608 leader_election.cc:403] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:10:35.832442 17987 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:35.780140 20436 consensus_queue.cc:260] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:35.903291 18610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:35.840754 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:35.848733 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:35.870168 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 50133.4us
I20260709 12:10:35.822548 20232 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:35.829336 20281 raft_consensus.cc:2749] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:35.850210 20563 consensus_meta.cc:287] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.754s	user 0.010s	sys 0.005s
I20260709 12:10:35.905830 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:35.859122 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:35.884492 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:35.811401 20446 raft_consensus.cc:2749] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647) with higher term. Message: Invalid argument: T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 3. Current term is 4.
I20260709 12:10:35.923918 17942 raft_consensus.cc:2468] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:10:36.061448 17913 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:35.862588 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:36.049973 18020 raft_consensus.cc:2468] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 8.
I20260709 12:10:35.834208 20509 raft_consensus.cc:2749] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297) with higher term. Message: Invalid argument: T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 5. Current term is 6.
I20260709 12:10:35.914364 20606 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.813047 20550 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.862757 20519 raft_consensus.cc:2804] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:35.858979 20400 consensus_queue.cc:1048] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.211s
I20260709 12:10:35.871783 17933 tablet_service.cc:1558] Processing DeleteTablet for tablet 3cdd445b25e5404da2f578c388210925 with delete_type TABLET_DATA_TOMBSTONED (TS 63f5bddeebd84e5788d671a176cfa8e1 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:50326
W20260709 12:10:36.074219 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 241846us
I20260709 12:10:36.028250 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:35.832468 20514 consensus_queue.cc:1048] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.237s
I20260709 12:10:35.855177 20367 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.910796 20027 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:35.894284 19655 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.081470 20522 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.099756 17987 leader_election.cc:304] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:36.069500 20596 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.072956 20234 raft_consensus.cc:493] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:35.830997 20440 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:35.869531 20592 consensus_queue.cc:1059] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.224s
I20260709 12:10:36.108310 20607 raft_consensus.cc:2804] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:36.076191 20470 leader_election.cc:290] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:36.080739 17943 raft_consensus.cc:3060] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:36.076390 20588 raft_consensus.cc:2804] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:10:36.111639 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 249627us
W20260709 12:10:36.114277 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.118742 19655 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:36.073293 17941 raft_consensus.cc:2468] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
W20260709 12:10:36.130908 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 59824us
I20260709 12:10:36.073486 20563 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:36.156454 20563 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:36.156658 18641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60412 (request call id 806) took 1087 ms. Trace:
I20260709 12:10:36.105471 20519 raft_consensus.cc:697] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:36.157112 18641 rpcz_store.cc:276] 0709 12:10:35.069458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.209723 (+140265us) service_pool.cc:224] Handling call
0709 12:10:35.679603 (+469880us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:35.719990 (+ 40387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.156454 (+436464us) spinlock_profiling.cc:243] Waited 470 ms on lock 0x7b54005447d0. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b18ad 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:36.156594 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1080034688}
I20260709 12:10:36.158154 20519 consensus_queue.cc:237] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:36.159278 20612 log.cc:927] Time spent T 00000000000000000000000000000000 P b852ae4791e4401b8356c71ae33bbc7d: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:10:35.875089 20528 consensus_queue.cc:260] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:36.146952 19655 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:36.096247 20550 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:36.095964 20606 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:36.121165 20367 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:36.144646 20588 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:36.162091 17914 leader_election.cc:304] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:36.166767 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:36.104476 20509 consensus_queue.cc:1059] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:10:36.167140 19655 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:36.134531 20281 raft_consensus.cc:2804] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:36.117574 18639 raft_consensus.cc:2468] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 4.
I20260709 12:10:36.172133 19655 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:36.175333 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:36.172324 18608 leader_election.cc:400] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 election: Vote denied by peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123) with higher term. Message: Invalid argument: T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 6. Current term is 7.
I20260709 12:10:36.176086 18608 leader_election.cc:403] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:10:36.194633 17987 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:36.196475 19655 leader_election.cc:290] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:36.126693 20027 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:36.133941 20522 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:36.143433 20234 raft_consensus.cc:515] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:36.175326 18636 raft_consensus.cc:1240] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:36.168882 20507 raft_consensus.cc:493] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.170713 20588 raft_consensus.cc:3060] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:36.234289 18092 raft_consensus.cc:1240] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:36.242851 17943 raft_consensus.cc:2468] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:10:36.244287 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:36.192790 20281 raft_consensus.cc:697] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:36.199234 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:36.251995 20606 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:36.229409 20528 raft_consensus.cc:3060] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.136682 20596 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:10:36.198091 20563 consensus_queue.cc:1059] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 12:10:36.289487 20161 raft_consensus.cc:3055] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:36.229949 20444 raft_consensus.cc:2749] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:36.288102 20504 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.216s	user 0.019s	sys 0.029s
W20260709 12:10:36.238947 20533 consensus_meta.cc:287] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.535s	user 0.010s	sys 0.000s
I20260709 12:10:36.229305 20619 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:36.200294 20559 consensus_queue.cc:1059] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 12:10:36.258180 20509 raft_consensus.cc:493] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.258680 20507 raft_consensus.cc:515] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:36.352255 18016 raft_consensus.cc:2468] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
W20260709 12:10:36.329578 20504 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.268s	user 0.023s	sys 0.032s
I20260709 12:10:36.322929 18015 raft_consensus.cc:1240] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:36.322522 20161 raft_consensus.cc:740] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:36.359627 20509 raft_consensus.cc:515] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:36.330142 20515 consensus_meta.cc:287] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.631s	user 0.011s	sys 0.007s
I20260709 12:10:36.360733 20161 consensus_queue.cc:260] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:36.361466 20515 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:36.367554 20620 log.cc:927] Time spent T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:10:36.368019 18640 raft_consensus.cc:1240] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:36.368881 20281 consensus_queue.cc:237] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:36.372640 20434 leader_election.cc:290] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:36.375756 20234 leader_election.cc:290] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:36.376451 20608 consensus_queue.cc:1048] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.130s
W20260709 12:10:36.357228 20575 consensus_meta.cc:287] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.795s	user 0.006s	sys 0.005s
W20260709 12:10:36.333387 17894 auto_rebalancer.cc:629] Failed to schedule move for tablet 374a5fb3dfcf4ad4adf6e172cc1759a4: Illegal state: Replica 4813437da0a74e65b61eb7bd1d18f110 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } }
I20260709 12:10:36.382033 20575 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:36.383347 17945 raft_consensus.cc:1240] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:36.377883 20622 consensus_queue.cc:1059] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.131s
I20260709 12:10:36.411521 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:36.412369 20367 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:36.418095 20614 log.cc:927] Time spent T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
W20260709 12:10:36.461338 20611 log.cc:927] Time spent T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.335s	user 0.001s	sys 0.000s
W20260709 12:10:36.462472 20623 log.cc:927] Time spent T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:10:36.463203 20575 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:36.411552 20627 tablet_replica.cc:333] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
W20260709 12:10:36.466521 20495 consensus_meta.cc:287] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.690s	user 0.008s	sys 0.003s
I20260709 12:10:36.481547 20550 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:36.488224 20515 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:36.488370 20509 leader_election.cc:290] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:36.489333 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 321343us
I20260709 12:10:36.489066 20508 raft_consensus.cc:3055] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:36.504746 20508 raft_consensus.cc:740] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:36.505611 20508 consensus_queue.cc:260] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:36.506084 20522 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:36.504550 20564 consensus_queue.cc:1059] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:10:36.488454 20624 log.cc:927] Time spent T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 12:10:36.508543 18608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.504360 18062 leader_election.cc:304] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:36.529884 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:36.526126 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 46887.4us
I20260709 12:10:36.534340 17944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50334 (request call id 2002) took 1465 ms. Trace:
I20260709 12:10:36.534704 17944 rpcz_store.cc:276] 0709 12:10:35.069195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.075053 (+  5858us) service_pool.cc:224] Handling call
0709 12:10:35.075325 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:35.156446 (+ 81121us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:35.156473 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:35.178485 (+ 22012us) log.cc:844] Serialized 26 byte log entry
0709 12:10:35.315238 (+136753us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:35.369356 (+ 54118us) log.cc:844] Serialized 14 byte log entry
0709 12:10:35.369648 (+   292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:35.369736 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:35.787538 (+417802us) spinlock_profiling.cc:243] Waited 5.85 ms on lock 0x7b1800186100. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f498c5522 00007f7f498c77c1 00007f7f498c7779 00007f7f498c7709 00007f7f498c76d1 00007f7f498c69cd 0000000000388634 0000000000388479 00007f7f498a883a
0709 12:10:36.408015 (+620477us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b1800186100. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f498932a6 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f498c53f3 00007f7f498c77c1
0709 12:10:36.409523 (+  1508us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b1800186100. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f498c53f3 00007f7f498c77c1 00007f7f498c7779 00007f7f498c7709 00007f7f498c76d1 00007f7f498c69cd 0000000000388634 0000000000388479 00007f7f498a883a
0709 12:10:36.534128 (+124605us) raft_consensus.cc:1685] finished
0709 12:10:36.534148 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:36.534287 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":128156,"prepare.queue_time_us":53369,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":1914,"raft.queue_time_us":180195,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":27019,"spinlock_wait_cycles":62369536,"thread_start_us":49879,"threads_started":1,"wal-append.queue_time_us":251167}
I20260709 12:10:36.537643 20434 raft_consensus.cc:2749] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:36.541613 18643 raft_consensus.cc:2468] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 7.
W20260709 12:10:36.542125 18643 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60424 (request call id 775) took 1476 ms (client timeout 1960 ms). Trace:
I20260709 12:10:36.547030 17944 raft_consensus.cc:1275] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:10:36.542502 18643 rpcz_store.cc:269] 0709 12:10:35.065276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.066324 (+  1048us) service_pool.cc:224] Handling call
0709 12:10:36.411358 (+1345034us) spinlock_profiling.cc:243] Waited 6.33 ms on lock 0x7b58001c4a98. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4988db71 00007f7f4988da22 00007f7f527a68d9 00007f7f51900ee0 00007f7f519ca0ab 00007f7f519ca131 00007f7f519780a0 00007f7f51977984 00007f7f4aef26d4 00007f7f4aef2662
0709 12:10:36.542073 (+130715us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14557952}
I20260709 12:10:36.551015 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:36.525477 20027 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:36.566421 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:36.569936 18092 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:36.570905 18062 leader_election.cc:304] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:36.574103 18062 leader_election.cc:304] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:36.578169 20626 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.578822 20626 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:36.583037 18641 raft_consensus.cc:1275] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:36.534065 20509 consensus_queue.cc:1059] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:10:36.552076 20161 raft_consensus.cc:3060] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:36.593369 20630 raft_consensus.cc:2804] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:36.593933 20630 raft_consensus.cc:697] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:36.571173 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:36.549220 20608 consensus_queue.cc:1048] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:10:36.594841 20630 consensus_queue.cc:237] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:36.581802 20270 consensus_queue.cc:1048] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:10:36.605829 20544 raft_consensus.cc:2749] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:36.587234 20434 raft_consensus.cc:2804] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:36.607085 20434 raft_consensus.cc:493] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:36.608161 20367 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:36.600871 20615 log.cc:927] Time spent T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.343s	user 0.000s	sys 0.001s
I20260709 12:10:36.630699 20434 raft_consensus.cc:3060] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:36.628824 20596 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:36.588654 20507 leader_election.cc:290] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:36.642879 20367 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:36.646723 20367 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:36.642076 20444 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.647944 20444 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:36.654093 18636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60430 (request call id 569) took 1674 ms. Trace:
I20260709 12:10:36.661513 18092 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 8.
I20260709 12:10:36.668632 20444 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:36.670383 18096 raft_consensus.cc:1240] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:36.607844 20519 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.675442 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:36.659616 20626 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:36.669992 20440 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:36.669425 20367 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:36.694569 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:36.687443 20557 raft_consensus.cc:493] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:36.717049 20557 raft_consensus.cc:515] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:36.698274 20588 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:36.686583 20234 raft_consensus.cc:493] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.721144 20234 raft_consensus.cc:515] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:36.721697 20588 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:36.723172 20234 leader_election.cc:290] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:36.723649 20234 raft_consensus.cc:493] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:36.724686 20619 raft_consensus.cc:2749] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123) with higher term. Message: Invalid argument: T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 6. Current term is 7.
I20260709 12:10:36.725149 20234 raft_consensus.cc:515] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:36.689719 20519 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:36.724143 20470 raft_consensus.cc:3055] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:36.698127 20444 consensus_queue.cc:1048] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:10:36.687310 20270 raft_consensus.cc:493] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
W20260709 12:10:36.687579 20232 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.024s	sys 0.027s
I20260709 12:10:36.688124 20509 consensus_queue.cc:1059] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:10:36.654603 18636 rpcz_store.cc:276] 0709 12:10:34.980145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.997228 (+ 17083us) service_pool.cc:224] Handling call
0709 12:10:35.031152 (+ 33924us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.247395 (+1216243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.653742 (+406347us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400075654. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:36.654020 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2598819712}
W20260709 12:10:36.771217 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.737144 18092 raft_consensus.cc:1275] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 12:10:36.788426 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 213047us
I20260709 12:10:36.848057 18062 leader_election.cc:304] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:36.849342 18062 leader_election.cc:304] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:36.797254 18024 raft_consensus.cc:1275] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:10:36.790500 20232 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.024s	sys 0.033s
W20260709 12:10:36.842978 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:36.874325 20554 raft_consensus.cc:3055] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:36.698549 20367 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:36.890523 17989 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:36.890926 20519 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:36.769315 20434 raft_consensus.cc:515] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:36.895365 20234 leader_election.cc:290] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:36.731587 20470 raft_consensus.cc:740] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:36.848582 20621 raft_consensus.cc:493] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:36.897043 20507 raft_consensus.cc:2804] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:10:36.897159 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 47903.9us
I20260709 12:10:36.911113 18062 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:36.798537 20400 raft_consensus.cc:493] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.760807 20550 consensus_queue.cc:1048] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.126s
I20260709 12:10:36.898839 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:36.898840 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:36.788542 20557 leader_election.cc:290] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:36.909190 18021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53022 (request call id 450) took 1747 ms. Trace:
I20260709 12:10:36.918438 18021 rpcz_store.cc:276] 0709 12:10:35.161809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.202900 (+ 41091us) service_pool.cc:224] Handling call
0709 12:10:35.203203 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:35.781278 (+578075us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.909015 (+1127737us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b54002792d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:36.909142 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1261674880}
I20260709 12:10:36.900481 20630 raft_consensus.cc:2804] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:36.842795 20270 raft_consensus.cc:515] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:36.916687 18024 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:36.916587 18093 raft_consensus.cc:1240] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:10:36.900040 20554 raft_consensus.cc:740] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:36.919726 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:36.909518 20519 raft_consensus.cc:2749] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:36.915529 20608 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:36.910159 20523 consensus_queue.cc:1048] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:10:36.962122 18024 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 8.
I20260709 12:10:36.964287 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:36.965571 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:36.912268 20621 raft_consensus.cc:515] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:36.970801 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:36.917964 20400 raft_consensus.cc:515] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:36.977437 20642 log.cc:927] Time spent T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:10:36.963805 20581 log.cc:927] Time spent T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 1.446s	user 0.004s	sys 0.000s
I20260709 12:10:36.950310 20630 raft_consensus.cc:697] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 5 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:36.985488 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:36.986304 18024 raft_consensus.cc:2468] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:10:36.996850 18021 raft_consensus.cc:2410] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:37.001400 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:36.960348 20608 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:36.989096 20434 leader_election.cc:290] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:37.009421 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:36.959059 20470 consensus_queue.cc:260] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:37.020085 20469 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:37.021644 20608 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:37.013208 20400 leader_election.cc:290] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:37.013693 20630 consensus_queue.cc:237] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:36.989180 20554 consensus_queue.cc:260] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:37.024359 18062 leader_election.cc:304] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:37.014420 20533 raft_consensus.cc:3055] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:37.015067 20236 raft_consensus.cc:3055] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:37.015501 20621 leader_election.cc:290] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:37.017525 20436 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:37.023293 20554 raft_consensus.cc:3060] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.026993 20236 raft_consensus.cc:740] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:37.026572 20533 raft_consensus.cc:740] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:37.031956 20533 consensus_queue.cc:260] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:37.033080 20533 raft_consensus.cc:3060] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:37.027257 20434 raft_consensus.cc:2804] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:37.034951 20434 raft_consensus.cc:493] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.035317 20434 raft_consensus.cc:3060] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.039036 20367 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:37.039774 20367 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:37.040093 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:37.041432 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:37.042891 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:37.043931 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:37.044843 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:37.045408 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:37.046804 18094 raft_consensus.cc:1275] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:37.046967 18017 raft_consensus.cc:1240] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 1. Current term is 2. Ops: []
I20260709 12:10:37.048540 20236 consensus_queue.cc:260] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:37.052448 20236 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.055850 20559 raft_consensus.cc:3055] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:37.056283 20559 raft_consensus.cc:740] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:37.057165 20559 consensus_queue.cc:260] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:37.058177 20559 raft_consensus.cc:3060] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.064517 18017 raft_consensus.cc:1275] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 2. (index mismatch)
I20260709 12:10:37.029124 20507 raft_consensus.cc:697] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
W20260709 12:10:37.074822 18637 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60424 (request call id 768) took 2048 ms (client timeout 2070 ms). Trace:
W20260709 12:10:37.075730 18637 rpcz_store.cc:269] 0709 12:10:35.026170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.036673 (+ 10503us) service_pool.cc:224] Handling call
0709 12:10:37.074611 (+2037938us) spinlock_profiling.cc:243] Waited 36.9 ms on lock 0x7b54003bea54. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:37.074765 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":84781824}
I20260709 12:10:37.074590 20448 consensus_queue.cc:1059] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:10:37.068051 20523 consensus_queue.cc:1059] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:10:37.040334 20367 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:37.077230 20523 raft_consensus.cc:3055] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:37.077585 20523 raft_consensus.cc:740] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:37.078773 20564 consensus_queue.cc:1048] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:37.079022 20367 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:37.068892 20400 consensus_queue.cc:1048] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 12:10:37.081607 18090 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41818 (request call id 729) took 2347 ms. Trace:
I20260709 12:10:37.082001 18090 rpcz_store.cc:276] 0709 12:10:34.734364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:34.734741 (+   377us) service_pool.cc:224] Handling call
0709 12:10:34.735095 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:35.473407 (+738312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.081392 (+1607985us) spinlock_profiling.cc:243] Waited 736 ms on lock 0x7b5400145fd4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:37.081542 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1693797760}
I20260709 12:10:37.083292 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:37.084457 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:37.086180 20507 consensus_queue.cc:237] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:37.095769 20270 leader_election.cc:290] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:10:37.097641 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:37.100582 20632 log.cc:927] Time spent T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.531s	user 0.000s	sys 0.003s
I20260709 12:10:37.103518 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:37.088563 18089 raft_consensus.cc:1275] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:37.114311 20448 raft_consensus.cc:3055] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:10:37.114934 20448 raft_consensus.cc:740] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:37.116068 20448 consensus_queue.cc:260] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:37.117658 20448 raft_consensus.cc:3060] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:10:37.119730 18015 raft_consensus.cc:1275] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:10:37.127082 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.130914 18095 raft_consensus.cc:1240] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 2. Current term is 3. Ops: []
W20260709 12:10:37.129446 20516 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.256s	user 0.020s	sys 0.021s
I20260709 12:10:37.136864 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:37.128928 20554 consensus_queue.cc:1048] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
W20260709 12:10:37.138778 20641 log.cc:927] Time spent T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.352s	user 0.000s	sys 0.003s
I20260709 12:10:37.078387 20523 consensus_queue.cc:260] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:37.137475 18089 raft_consensus.cc:2468] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
W20260709 12:10:37.137351 20516 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.264s	user 0.020s	sys 0.021s
I20260709 12:10:37.146416 18018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45464 (request call id 1735) took 1328 ms. Trace:
I20260709 12:10:37.151851 18018 rpcz_store.cc:276] 0709 12:10:35.817806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.818033 (+   227us) service_pool.cc:224] Handling call
0709 12:10:35.858110 (+ 40077us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:36.095659 (+237549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:36.095703 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:36.107321 (+ 11618us) log.cc:844] Serialized 26 byte log entry
0709 12:10:36.453349 (+346028us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b180012f220. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f498a7e07 00007f7f527029a9 00007f7f498c469b 00007f7f498c293f 00007f7f498c4c02 00007f7f4c54c20b 00007f7f4c551d23 00007f7f4c5520d1 00007f7f4c96da0f
0709 12:10:36.516761 (+ 63412us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:36.516817 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.138234 (+621417us) spinlock_profiling.cc:243] Waited 57.1 ms on lock 0x7b4400022b4c. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f497ebc85 00007f7f497ec6a2 00007f7f4c55e1db 00007f7f4c559aaf 00007f7f4c54d86e 00007f7f4c54cbb6 00007f7f4c54c7d8 00007f7f4c556221 00007f7f4c5561d9 00007f7f4c556169
0709 12:10:37.146066 (+  7832us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b5400364a54. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:37.146124 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:37.146181 (+    57us) raft_consensus.cc:1685] finished
0709 12:10:37.146197 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:37.146350 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1886,"raft.queue_time_us":2630,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":5985,"spinlock_wait_cycles":697696000,"thread_start_us":63159,"threads_started":1,"wal-append.queue_time_us":668367}
I20260709 12:10:37.160298 20508 raft_consensus.cc:3060] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.131421 20644 consensus_queue.cc:1048] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:10:37.168708 20523 raft_consensus.cc:3060] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:37.170894 20616 log.cc:927] Time spent T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 1.017s	user 0.001s	sys 0.003s
I20260709 12:10:37.175900 18016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45472 (request call id 1916) took 1008 ms. Trace:
I20260709 12:10:37.176293 18016 rpcz_store.cc:276] 0709 12:10:36.167001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.168342 (+  1341us) service_pool.cc:224] Handling call
0709 12:10:37.175736 (+1007394us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b5400279cd4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:37.175841 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":232860416}
I20260709 12:10:37.177763 18062 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:10:37.179329 18610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.180089 18609 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:37.182349 20622 raft_consensus.cc:2804] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:37.182761 20622 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.183094 20622 raft_consensus.cc:3060] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:37.179318 20495 raft_consensus.cc:2804] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:37.188292 20495 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.188689 20495 raft_consensus.cc:3060] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:37.194206 18092 raft_consensus.cc:3060] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:37.166039 20434 raft_consensus.cc:515] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:37.234517 18092 raft_consensus.cc:1275] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:37.215418 20644 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.239913 20644 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:37.243530 18093 raft_consensus.cc:2393] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 6: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:37.242923 20559 raft_consensus.cc:493] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.261055 20541 raft_consensus.cc:3055] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:37.261547 20541 raft_consensus.cc:740] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:37.265110 18097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53964 (request call id 1675) took 1097 ms. Trace:
I20260709 12:10:37.265472 18097 rpcz_store.cc:276] 0709 12:10:36.167668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.167819 (+   151us) service_pool.cc:224] Handling call
0709 12:10:36.176683 (+  8864us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:36.361959 (+185276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:36.361993 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:37.184923 (+822930us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b2c000bf908. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4b2aba11 00007f7f4b2bb372 00007f7f4c9eda01 00007f7f4c9b243a 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2
0709 12:10:37.185389 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 12:10:37.247713 (+ 62324us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:37.255785 (+  8072us) log.cc:844] Serialized 14 byte log entry
0709 12:10:37.256024 (+   239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.256128 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:37.264855 (+  8727us) raft_consensus.cc:1685] finished
0709 12:10:37.264940 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:37.265048 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":9185,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":146697,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":6488,"spinlock_wait_cycles":241969920,"thread_start_us":245113,"threads_started":2,"wal-append.queue_time_us":77575}
I20260709 12:10:37.255527 18023 consensus_queue.cc:237] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:10:37.281091 18092 raft_consensus.cc:1240] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 LEADER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:37.283341 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:37.284140 18021 raft_consensus.cc:3060] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:37.285490 17988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.290132 17940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 1999) took 2225 ms. Trace:
I20260709 12:10:37.290513 17940 rpcz_store.cc:276] 0709 12:10:35.064944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.066600 (+  1656us) service_pool.cc:224] Handling call
0709 12:10:37.278103 (+2211503us) spinlock_profiling.cc:243] Waited 664 ms on lock 0x7b540031c254. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:37.290070 (+ 11967us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1527192320}
I20260709 12:10:37.294075 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:37.296657 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:37.298441 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:37.299261 18643 raft_consensus.cc:2468] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
W20260709 12:10:37.326700 20670 log.cc:927] Time spent T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:10:37.328539 17940 raft_consensus.cc:1275] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:37.329162 17940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2009) took 1166 ms. Trace:
I20260709 12:10:37.329484 17940 rpcz_store.cc:276] 0709 12:10:36.162601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.306969 (+1144368us) service_pool.cc:224] Handling call
0709 12:10:37.328214 (+ 21245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:37.328917 (+   703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.329107 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:37.262548 20541 consensus_queue.cc:260] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:37.332850 18610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.335956 18021 raft_consensus.cc:2468] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
I20260709 12:10:37.338124 18062 leader_election.cc:304] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:37.307338 20644 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:37.343601 20644 raft_consensus.cc:2804] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:37.344161 20644 raft_consensus.cc:697] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:37.344985 20644 consensus_queue.cc:237] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:37.348680 20365 consensus_queue.cc:1048] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:37.352089 20434 leader_election.cc:290] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:37.352787 18021 raft_consensus.cc:1240] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:37.353600 20495 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:37.355674 20495 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:37.322269 20673 log.cc:927] Time spent T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:10:37.356685 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:37.357635 18021 raft_consensus.cc:3060] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:10:37.320087 20161 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:37.362243 20161 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:37.364301 20161 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:37.322672 20236 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.365132 20236 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:37.304165 20520 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:37.366858 20522 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.367244 20520 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:37.367409 20522 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:37.369366 20520 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:37.304026 20621 raft_consensus.cc:493] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:37.370028 20621 raft_consensus.cc:515] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:37.371944 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.302475 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:37.280644 20559 raft_consensus.cc:515] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:37.388365 18021 raft_consensus.cc:2468] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 8.
I20260709 12:10:37.093029 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:10:37.379076 18610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:37.456375 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:37.451538 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 77526.8us
I20260709 12:10:37.449249 17942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50334 (request call id 2009) took 1650 ms. Trace:
I20260709 12:10:37.473760 17941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50334 (request call id 2011) took 1674 ms. Trace:
I20260709 12:10:37.474275 17941 rpcz_store.cc:276] 0709 12:10:35.798889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.144498 (+345609us) service_pool.cc:224] Handling call
0709 12:10:36.144825 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.145084 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:36.147588 (+  2504us) log.cc:844] Serialized 14 byte log entry
0709 12:10:37.473319 (+1325731us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:37.473389 (+    70us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:37.473454 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.473544 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:37.473692 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1325480,"prepare.queue_time_us":2519,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34}
I20260709 12:10:37.472883 17942 rpcz_store.cc:276] 0709 12:10:35.798440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.071264 (+272824us) service_pool.cc:224] Handling call
0709 12:10:36.071611 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.071863 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:36.095603 (+ 23740us) log.cc:844] Serialized 14 byte log entry
0709 12:10:37.448647 (+1353044us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b1800482560. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f4983fc0a 00007f7f52f7f219 00007f7f498c7a40 00007f7f498c24e4 00007f7f498c2455 00007f7f4c9aa060 00007f7f4c9bc716 00007f7f4c9cd287 00007f7f4c9cd208
0709 12:10:37.448830 (+   183us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:37.448891 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:37.448960 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.449046 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:37.449179 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1589,"prepare.queue_time_us":23334,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":5690,"raft.queue_time_us":1371025,"spinlock_wait_cycles":4233984}
I20260709 12:10:37.466136 18019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45472 (request call id 1915) took 1299 ms. Trace:
I20260709 12:10:37.479063 18019 rpcz_store.cc:276] 0709 12:10:36.166361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.166470 (+   109us) service_pool.cc:224] Handling call
0709 12:10:37.449529 (+1283059us) spinlock_profiling.cc:243] Waited 741 ms on lock 0x7b540005e6d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:37.466065 (+ 16536us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1703326976}
I20260709 12:10:37.482592 17987 leader_election.cc:304] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:37.459453 17945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44668 (request call id 414) took 1667 ms. Trace:
I20260709 12:10:37.486564 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:37.435596 20638 log.cc:927] Time spent T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.590s	user 0.001s	sys 0.003s
I20260709 12:10:37.488258 20508 raft_consensus.cc:493] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.488454 20607 raft_consensus.cc:697] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:37.488744 20161 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:37.491029 20367 consensus_queue.cc:1048] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:37.491998 20520 raft_consensus.cc:493] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.493696 20470 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:37.494271 20554 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.449754 20557 raft_consensus.cc:2749] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:37.494920 20236 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:37.495942 18062 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:37.486891 17945 rpcz_store.cc:276] 0709 12:10:35.792341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.793863 (+  1522us) service_pool.cc:224] Handling call
0709 12:10:35.810802 (+ 16939us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.383712 (+572910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.459143 (+1075431us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b54002544d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:37.459374 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1316318976}
W20260709 12:10:37.497623 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 1.33551e+06us
I20260709 12:10:37.503260 20505 raft_consensus.cc:2749] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:37.507423 20575 raft_consensus.cc:493] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.511003 17943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50334 (request call id 2012) took 1711 ms. Trace:
I20260709 12:10:37.511055 20575 raft_consensus.cc:515] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:37.511507 17943 rpcz_store.cc:276] 0709 12:10:35.799116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.259008 (+459892us) service_pool.cc:224] Handling call
0709 12:10:36.259353 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:36.259962 (+   609us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:36.333108 (+ 73146us) log.cc:844] Serialized 14 byte log entry
0709 12:10:37.510704 (+1177596us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:37.510755 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:37.510795 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.510853 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:37.510953 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":961244,"prepare.queue_time_us":14570,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":2246,"raft.queue_time_us":961662,"raft.run_cpu_time_us":58,"raft.run_wall_time_us":59,"thread_start_us":215973,"threads_started":1,"wal-append.queue_time_us":252858}
I20260709 12:10:37.513705 20575 leader_election.cc:290] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:37.514231 20575 raft_consensus.cc:493] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.514808 20440 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:37.515707 20559 leader_election.cc:290] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:37.515499 20440 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:37.518054 20440 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:37.520349 20601 raft_consensus.cc:493] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:37.520934 20588 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.521662 20570 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.521837 20506 raft_consensus.cc:493] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.522171 20570 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:37.522976 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:37.522629 20506 raft_consensus.cc:515] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:37.524248 20570 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:37.524871 20522 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:37.525218 20506 leader_election.cc:290] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:37.526309 17949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50334 (request call id 2007) took 1728 ms. Trace:
I20260709 12:10:37.448638 20509 raft_consensus.cc:493] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:37.526717 17949 rpcz_store.cc:276] 0709 12:10:35.798022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.832323 (+ 34301us) service_pool.cc:224] Handling call
0709 12:10:35.860515 (+ 28192us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:35.908298 (+ 47783us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:35.908341 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:35.908875 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 12:10:36.378187 (+469312us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b1800282d00. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f498a7e07 00007f7f527029a9 00007f7f498c469b 00007f7f498c293f 00007f7f498c4c02 00007f7f4c54c20b 00007f7f4c551d23 00007f7f4c5520d1 00007f7f4c96da0f
0709 12:10:36.549457 (+171270us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:36.549496 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:36.549557 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:37.434921 (+885364us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b4400022b4c. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f497ebc85 00007f7f497ec6a2 00007f7f4c55e1db 00007f7f4c559aaf 00007f7f4c54d86e 00007f7f4c54cbb6 00007f7f4c54c7d8 00007f7f4c556221 00007f7f4c5561d9 00007f7f4c556169
0709 12:10:37.526117 (+ 91196us) raft_consensus.cc:1685] finished
0709 12:10:37.526137 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:37.526251 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47315,"raft.queue_time_us":47448,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":16134,"spinlock_wait_cycles":55070976,"thread_start_us":170956,"threads_started":1,"wal-append.queue_time_us":853172}
I20260709 12:10:37.527516 20509 raft_consensus.cc:515] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:37.449082 20541 raft_consensus.cc:3060] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:37.532135 20509 leader_election.cc:290] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:37.520824 20601 raft_consensus.cc:515] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:37.535363 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:37.536580 18641 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 7.
I20260709 12:10:37.372117 20621 leader_election.cc:290] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:37.544497 18062 leader_election.cc:304] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:37.549679 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 71390us
I20260709 12:10:37.436084 20622 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:37.552870 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:37.553225 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:37.554421 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:37.556622 18090 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:37.537258 20440 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.538932 20630 raft_consensus.cc:2804] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:37.539525 20595 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:37.539748 20027 raft_consensus.cc:493] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:37.560873 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:37.606792 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:37.541980 20593 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.558096 17912 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
W20260709 12:10:37.608875 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 50882.6us
I20260709 12:10:37.565116 17943 raft_consensus.cc:1275] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:37.609815 17941 raft_consensus.cc:1240] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:10:37.610477 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:37.508114 20161 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:37.567458 17945 raft_consensus.cc:1240] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:37.557065 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:37.538385 20520 raft_consensus.cc:515] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:37.584895 20607 consensus_queue.cc:237] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:37.504949 20508 raft_consensus.cc:515] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:37.539366 20575 raft_consensus.cc:515] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:37.570132 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 87658.7us
I20260709 12:10:37.604228 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:37.611204 17943 raft_consensus.cc:2468] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:10:37.587051 20439 raft_consensus.cc:493] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:37.663015 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:37.663205 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:37.664017 17942 raft_consensus.cc:3060] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:37.666610 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:37.630689 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.667682 18017 raft_consensus.cc:2468] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 7.
I20260709 12:10:37.550652 20491 raft_consensus.cc:2749] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:37.613492 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:37.607640 17949 raft_consensus.cc:2468] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 7.
I20260709 12:10:37.670038 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:10:37.561679 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.614795 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:37.672284 18019 raft_consensus.cc:2410] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:37.538761 20554 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:37.675061 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.521672 20588 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:37.575330 20605 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:37.557577 20505 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.623721 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:37.621806 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 57048.3us
I20260709 12:10:37.568570 20441 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.568812 20442 raft_consensus.cc:493] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:37.650928 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:37.699960 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:37.651506 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:37.575649 20400 raft_consensus.cc:2749] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:37.709707 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:37.652817 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.656765 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:37.711958 18021 raft_consensus.cc:2393] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 6: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:37.576172 20569 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:37.659147 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:37.621513 20440 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:37.713775 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:37.715062 20440 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:37.715241 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:37.567063 20559 raft_consensus.cc:493] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:37.716261 20559 raft_consensus.cc:515] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:37.716884 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:37.558670 20495 consensus_queue.cc:1048] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 12:10:37.674893 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:37.675380 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 52451.7us
I20260709 12:10:37.724139 17912 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:37.620239 17940 raft_consensus.cc:1240] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:37.726168 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:37.670799 17949 raft_consensus.cc:2468] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 5.
I20260709 12:10:37.727737 18017 raft_consensus.cc:1240] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:37.610951 20277 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:37.622532 20386 raft_consensus.cc:2804] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:37.696630 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:37.697232 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:37.697566 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:37.608997 20630 raft_consensus.cc:697] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:37.706379 17941 raft_consensus.cc:2468] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:37.620932 20027 raft_consensus.cc:515] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:37.708890 18024 raft_consensus.cc:2393] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 4: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:37.750366 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:37.721359 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 137098us
I20260709 12:10:37.729802 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:37.730688 18090 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 7.
I20260709 12:10:37.611876 20595 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:37.727738 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:37.736745 18091 raft_consensus.cc:2468] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 7.
I20260709 12:10:37.740089 17942 raft_consensus.cc:2468] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
I20260709 12:10:37.755393 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:37.755435 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:37.622259 20593 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:37.747390 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:37.762656 18019 raft_consensus.cc:2393] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 8: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
W20260709 12:10:37.747869 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 181615us
I20260709 12:10:37.748522 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:37.764254 18608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:37.765048 18608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.765167 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:37.755539 18062 leader_election.cc:304] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:37.756259 18016 raft_consensus.cc:2393] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 9: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:37.753340 17914 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:37.735680 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:37.758961 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:37.768910 17941 raft_consensus.cc:2468] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:37.760798 17913 leader_election.cc:304] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:37.760872 20595 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:37.761461 17945 raft_consensus.cc:2468] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 1.
I20260709 12:10:37.769454 18062 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:37.771777 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:37.772557 18640 raft_consensus.cc:1275] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:37.695454 20439 raft_consensus.cc:515] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:37.720309 20441 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:37.702669 20505 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:37.694540 20596 consensus_queue.cc:1059] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:10:37.786242 17913 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:37.736418 20386 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:37.720288 20442 raft_consensus.cc:515] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:37.789947 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:37.798084 17941 raft_consensus.cc:2410] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:10:37.769462 20506 raft_consensus.cc:2804] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:37.724756 20655 consensus_queue.cc:1048] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:10:37.789695 17940 raft_consensus.cc:2468] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
W20260709 12:10:37.781991 20678 log.cc:927] Time spent T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:10:37.698215 20605 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:37.726293 20569 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:37.782339 20234 raft_consensus.cc:2804] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:37.800872 17942 raft_consensus.cc:2468] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:37.787376 18642 raft_consensus.cc:2468] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:37.795958 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:37.815325 18062 leader_election.cc:304] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:37.795357 20595 raft_consensus.cc:2804] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:37.812341 18644 raft_consensus.cc:2468] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 7.
I20260709 12:10:37.806175 20506 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:37.783213 20559 leader_election.cc:290] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:37.793866 20466 raft_consensus.cc:2804] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:37.764263 20576 consensus_queue.cc:1048] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:10:37.821221 18062 leader_election.cc:304] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:37.830308 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:37.979987 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:37.795490 20386 raft_consensus.cc:3060] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:37.799415 20637 raft_consensus.cc:2804] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:37.799407 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:37.885370 18610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:38.010967 18610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:37.819335 20234 raft_consensus.cc:493] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:37.750478 20277 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:37.976411 17943 raft_consensus.cc:2468] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:37.853525 20506 raft_consensus.cc:3060] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.000227 17941 raft_consensus.cc:1275] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:10:38.000947 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 338788us
I20260709 12:10:37.857445 20434 raft_consensus.cc:2804] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:37.893762 20466 raft_consensus.cc:493] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:37.857163 20601 leader_election.cc:290] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:38.019069 17941 raft_consensus.cc:1240] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:37.999918 20622 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:37.975572 20570 raft_consensus.cc:493] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:37.974063 20448 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:38.010270 20637 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:38.054350 17949 raft_consensus.cc:2468] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 5.
I20260709 12:10:38.009233 20595 raft_consensus.cc:697] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:38.036357 20428 raft_consensus.cc:2749] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:38.015595 20234 raft_consensus.cc:3060] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.042902 20466 raft_consensus.cc:3060] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:38.017096 20434 raft_consensus.cc:493] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:38.070015 18608 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
W20260709 12:10:38.059046 20541 consensus_meta.cc:287] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.001s
I20260709 12:10:38.051499 20161 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:38.053553 20533 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.086421 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:38.087191 18641 raft_consensus.cc:3060] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:38.090137 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:38.162429 18642 raft_consensus.cc:2468] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:38.163590 18642 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
mode: GRACEFUL
new_leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
 from {username='slave'} at 127.0.0.1:52812
I20260709 12:10:38.164659 18642 raft_consensus.cc:606] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Received request to transfer leadership to TS c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:38.100191 17942 raft_consensus.cc:1275] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 2. (term mismatch)
I20260709 12:10:38.165719 17942 pending_rounds.cc:85] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1: Aborting all ops after (but not including) 1
I20260709 12:10:38.166031 17942 pending_rounds.cc:107] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:10:38.166301 17942 raft_consensus.cc:2889] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:38.167034 17942 pending_rounds.cc:107] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:10:38.167297 17942 raft_consensus.cc:2889] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:38.133620 18640 raft_consensus.cc:1275] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:10:38.140233 17949 raft_consensus.cc:1275] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:10:38.142889 20683 raft_consensus.cc:3055] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:10:38.171363 20683 raft_consensus.cc:740] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:38.173224 17949 raft_consensus.cc:1275] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:38.178579 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:38.180677 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:38.155702 20680 log.cc:927] Time spent T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.539s	user 0.003s	sys 0.000s
I20260709 12:10:38.091431 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:38.183104 18644 raft_consensus.cc:2410] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 12:10:38.191764 17846 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40276 (request call id 253) took 15260 ms (client timeout 15000 ms). Trace:
W20260709 12:10:38.193291 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.165467 18642 raft_consensus.cc:614] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:38.202783 20592 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:38.203426 20592 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:38.205879 20592 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:10:38.212845 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.217912 20520 leader_election.cc:290] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:38.222149 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:37.893345 20630 consensus_queue.cc:237] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:38.065716 20637 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:38.239456 17942 raft_consensus.cc:1240] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:10:38.278756 17942 raft_consensus.cc:1275] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:10:38.246558 18642 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3cdd445b25e5404da2f578c388210925"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
mode: GRACEFUL
new_leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
 from {username='slave'} at 127.0.0.1:52812
I20260709 12:10:38.059016 20508 leader_election.cc:290] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:38.071740 20655 raft_consensus.cc:2804] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:38.281504 18608 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
W20260709 12:10:38.283080 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 496868us
I20260709 12:10:38.079078 20434 raft_consensus.cc:3060] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:38.371765 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 550573us
W20260709 12:10:38.374477 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.310504 17945 raft_consensus.cc:1275] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:10:38.325548 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.359099 17913 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:38.358399 18642 raft_consensus.cc:606] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 LEADER]: Received request to transfer leadership to TS c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:38.279628 20684 log.cc:927] Time spent T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.538s	user 0.001s	sys 0.001s
I20260709 12:10:38.081724 20554 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:10:38.375561 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.273494 20601 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:38.379849 20441 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:38.254945 20588 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:38.254824 20622 raft_consensus.cc:2804] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:38.071122 20448 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:38.391624 17913 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:38.416939 17913 leader_election.cc:304] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:38.387076 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 105715us
I20260709 12:10:38.418727 18608 leader_election.cc:304] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:38.379410 18641 raft_consensus.cc:2468] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
W20260709 12:10:38.228735 17846 rpcz_store.cc:269] 0709 12:10:22.930686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:22.930816 (+   130us) service_pool.cc:224] Handling call
0709 12:10:38.191393 (+15260577us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:35.776719 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:35.777294 (+   575us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:35.777331 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:10:35.777348 (+    17us) tablet.cc:662] Decoding operations
0709 12:10:35.777669 (+   321us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:35.777722 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:35.777746 (+    24us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:10:35.777923 (+   177us) tablet.cc:701] Row locks acquired
0709 12:10:35.777936 (+    13us) write_op.cc:260] PREPARE: finished
0709 12:10:35.778083 (+   147us) write_op.cc:270] Start()
0709 12:10:35.778182 (+    99us) write_op.cc:276] Timestamp: P: 1783599035778032 usec, L: 0
0709 12:10:35.778203 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:10:35.778849 (+   646us) log.cc:844] Serialized 536 byte log entry
0709 12:10:36.608658 (+829809us) op_driver.cc:464] REPLICATION: finished
0709 12:10:36.999367 (+390709us) write_op.cc:301] APPLY: starting
0709 12:10:37.003803 (+  4436us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:37.009313 (+  5510us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:37.013324 (+  4011us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:37.013542 (+   218us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:37.013758 (+   216us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:10:37.013822 (+    64us) write_op.cc:312] APPLY: finished
0709 12:10:37.014005 (+   183us) log.cc:844] Serialized 23 byte log entry
0709 12:10:37.014163 (+   158us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:37.014246 (+    83us) write_op.cc:454] Released schema lock
0709 12:10:37.014283 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:37.024692 (+ 10409us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:37.028282 (+  3590us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":263,"mutex_wait_us":251956,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":337383,"apply.run_cpu_time_us":2061,"apply.run_wall_time_us":25993,"num_ops":1,"prepare.queue_time_us":551227,"prepare.run_cpu_time_us":9402,"prepare.run_wall_time_us":151023,"raft.queue_time_us":412326,"raft.run_cpu_time_us":33070,"raft.run_wall_time_us":323639,"replication_time_us":813384,"thread_start_us":918399,"threads_started":4,"wal-append.queue_time_us":250256,"wal-append.run_cpu_time_us":45671,"wal-append.run_wall_time_us":2003849}]]}
I20260709 12:10:38.279688 20575 leader_election.cc:290] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:38.066082 20570 raft_consensus.cc:515] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:38.273691 20533 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:38.397620 20569 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:38.397771 20691 log.cc:927] Time spent T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.391s	user 0.001s	sys 0.000s
I20260709 12:10:38.406821 20627 raft_consensus.cc:2243] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Raft consensus shutting down.
W20260709 12:10:38.407763 20686 log.cc:927] Time spent T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.497s	user 0.000s	sys 0.001s
I20260709 12:10:38.408151 20428 raft_consensus.cc:2749] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:38.411497 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:38.297451 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:38.420387 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:38.445050 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:38.445362 18641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
mode: GRACEFUL
new_leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
 from {username='slave'} at 127.0.0.1:52812
I20260709 12:10:38.421258 20593 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:38.460270 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:38.458033 20650 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.387739 20505 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:38.297366 20541 consensus_queue.cc:1059] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.120s
I20260709 12:10:38.412336 20508 raft_consensus.cc:2804] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:38.512775 18641 raft_consensus.cc:606] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Received request to transfer leadership to TS c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:38.534718 18641 raft_consensus.cc:614] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:38.381731 20027 leader_election.cc:290] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:38.415464 20622 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
W20260709 12:10:38.460902 20682 log.cc:927] Time spent T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.639s	user 0.001s	sys 0.000s
I20260709 12:10:38.449566 20588 raft_consensus.cc:2749] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:38.460650 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 43768.6us
I20260709 12:10:38.558116 17913 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:38.459288 20592 raft_consensus.cc:2749] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:38.517122 17944 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.052s	sys 0.059s
I20260709 12:10:38.532308 18638 raft_consensus.cc:2393] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 3: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:38.479287 20440 raft_consensus.cc:2749] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:38.415616 20601 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:38.561918 20601 leader_election.cc:290] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:38.566660 17987 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.019s	sys 0.062s
I20260709 12:10:38.568976 18062 leader_election.cc:304] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:38.567909 17987 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.019s	sys 0.062s
W20260709 12:10:38.559871 17944 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.052s	sys 0.059s
I20260709 12:10:38.574214 17944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44668 (request call id 421) took 2721 ms. Trace:
W20260709 12:10:38.594769 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:38.578548 17944 rpcz_store.cc:276] 0709 12:10:35.852888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.551917 (+699029us) service_pool.cc:224] Handling call
0709 12:10:36.564990 (+ 13073us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:37.510828 (+945838us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:37.510854 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:37.511249 (+   395us) log.cc:844] Serialized 26 byte log entry
0709 12:10:37.612722 (+101473us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:37.841684 (+228962us) log.cc:844] Serialized 14 byte log entry
0709 12:10:38.573813 (+732129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.573918 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:38.573975 (+    57us) raft_consensus.cc:1685] finished
0709 12:10:38.573991 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:38.574148 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1079210,"prepare.queue_time_us":430823,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":4511,"raft.queue_time_us":1079807,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":9511,"thread_start_us":884038,"threads_started":3,"wal-append.queue_time_us":183629}
I20260709 12:10:38.512355 20507 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.506799 20655 raft_consensus.cc:697] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:38.515583 20605 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:38.566089 20522 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.004s	sys 0.037s
I20260709 12:10:38.395257 20595 consensus_queue.cc:237] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:38.628067 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 59181.6us
I20260709 12:10:38.557354 20622 raft_consensus.cc:3060] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:38.639959 18020 raft_consensus.cc:1275] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:38.640882 18643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60430 (request call id 579) took 1121 ms. Trace:
I20260709 12:10:38.641422 18643 rpcz_store.cc:276] 0709 12:10:37.519936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.521330 (+  1394us) service_pool.cc:224] Handling call
0709 12:10:37.521643 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:37.521992 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:37.522026 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:37.522443 (+   417us) log.cc:844] Serialized 26 byte log entry
0709 12:10:37.738539 (+216096us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:37.738573 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.738632 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:38.111449 (+372817us) spinlock_profiling.cc:243] Waited 7.82 ms on lock 0x7b1800351be0. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f498c53f3 00007f7f498c77c1 00007f7f498c7779 00007f7f498c7709 00007f7f498c76d1 00007f7f498c69cd 0000000000388634 0000000000388479 00007f7f498a883a
0709 12:10:38.623569 (+512120us) raft_consensus.cc:1685] finished
0709 12:10:38.623597 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:38.640797 (+ 17200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4149,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"spinlock_wait_cycles":17984896,"thread_start_us":204806,"threads_started":1,"wal-append.queue_time_us":332585}
I20260709 12:10:38.619607 20627 raft_consensus.cc:2272] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:10:38.613689 20440 raft_consensus.cc:2749] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:38.683444 18017 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.002s	sys 0.016s
I20260709 12:10:38.657164 18636 raft_consensus.cc:2393] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 8: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:38.683648 17947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50334 (request call id 2013) took 2853 ms. Trace:
I20260709 12:10:38.618052 20503 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:38.626052 20563 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:38.651464 20519 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.005s	sys 0.026s
W20260709 12:10:38.698510 18017 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.002s	sys 0.016s
I20260709 12:10:38.685936 17947 rpcz_store.cc:276] 0709 12:10:35.799346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.454273 (+654927us) service_pool.cc:224] Handling call
0709 12:10:36.476201 (+ 21928us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:37.532661 (+1056460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:37.532695 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:37.533150 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 12:10:37.656632 (+123482us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:37.656666 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.656725 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:38.653024 (+996299us) raft_consensus.cc:1685] finished
0709 12:10:38.653043 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:38.653167 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1030901,"raft.queue_time_us":1034336,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":69,"thread_start_us":123144,"threads_started":1,"wal-append.queue_time_us":256025}
I20260709 12:10:38.747720 18089 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41818 (request call id 757) took 1600 ms. Trace:
I20260709 12:10:38.816184 18089 rpcz_store.cc:276] 0709 12:10:37.147112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.332301 (+185189us) service_pool.cc:224] Handling call
0709 12:10:37.332621 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:37.468016 (+135395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:37.468061 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:37.468609 (+   548us) log.cc:844] Serialized 26 byte log entry
0709 12:10:37.591102 (+122493us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:37.591158 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.591256 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:38.747380 (+1156124us) raft_consensus.cc:1685] finished
0709 12:10:38.747413 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:38.747629 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22017,"raft.queue_time_us":22909,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":13963,"thread_start_us":96185,"threads_started":1,"wal-append.queue_time_us":281433}
I20260709 12:10:38.638749 20491 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.639791 20644 raft_consensus.cc:2749] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:38.679669 20694 log.cc:927] Time spent T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.223s	user 0.000s	sys 0.004s
I20260709 12:10:38.556413 20650 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:38.683017 20704 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:38.624541 20507 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:38.821981 20519 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.005s	sys 0.026s
I20260709 12:10:38.833235 20491 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:38.908372 18640 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.012s	sys 0.032s
W20260709 12:10:38.910246 18640 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.012s	sys 0.033s
I20260709 12:10:38.820243 20270 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:38.894415 20703 raft_consensus.cc:493] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:38.896185 20698 raft_consensus.cc:493] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:38.822161 20563 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:38.933732 20698 raft_consensus.cc:515] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:38.928236 20696 log.cc:927] Time spent T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.480s	user 0.000s	sys 0.001s
I20260709 12:10:38.895073 20655 consensus_queue.cc:237] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:38.902900 20704 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
W20260709 12:10:38.973922 20710 log.cc:927] Time spent T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:10:38.972280 20708 log.cc:927] Time spent T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.285s	user 0.001s	sys 0.000s
W20260709 12:10:38.978040 20700 log.cc:927] Time spent T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.325s	user 0.000s	sys 0.001s
I20260709 12:10:38.936194 20703 raft_consensus.cc:515] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:38.981855 20721 raft_consensus.cc:3055] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:38.982434 20721 raft_consensus.cc:740] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:38.983588 20721 consensus_queue.cc:260] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:38.985323 20721 raft_consensus.cc:3060] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:39.023277 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:39.024081 17989 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.014s	user 0.011s	sys 0.112s
W20260709 12:10:39.024503 17989 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.015s	user 0.011s	sys 0.112s
W20260709 12:10:38.874442 17987 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.98.196:43647 timed out after 1.910s (SENT) [suppressed 7 similar messages]
I20260709 12:10:39.027813 18022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45464 (request call id 1743) took 1369 ms. Trace:
I20260709 12:10:39.028326 18022 rpcz_store.cc:276] 0709 12:10:37.658377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.658518 (+   141us) service_pool.cc:224] Handling call
0709 12:10:37.658842 (+   324us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:37.659232 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:37.659267 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:37.701811 (+ 42544us) log.cc:844] Serialized 52 byte log entry
0709 12:10:38.044764 (+342953us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:38.044816 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.045458 (+   642us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:39.027124 (+981666us) raft_consensus.cc:1685] finished
0709 12:10:39.027186 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:39.027540 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1571,"raft.queue_time_us":552,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":30254,"thread_start_us":294230,"threads_started":1,"wal-append.queue_time_us":645330}
I20260709 12:10:39.036862 18015 raft_consensus.cc:1275] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:39.040287 18090 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53954 (request call id 1952) took 1277 ms. Trace:
I20260709 12:10:39.040818 18090 rpcz_store.cc:276] 0709 12:10:37.762606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.763666 (+  1060us) service_pool.cc:224] Handling call
0709 12:10:37.763934 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:37.768437 (+  4503us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:37.768463 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:37.774344 (+  5881us) log.cc:844] Serialized 26 byte log entry
0709 12:10:38.104289 (+329945us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:38.104643 (+   354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.105583 (+   940us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:39.039589 (+934006us) raft_consensus.cc:1685] finished
0709 12:10:39.039631 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:39.039987 (+   356us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4147,"raft.queue_time_us":4382,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":23539,"thread_start_us":290761,"threads_started":1,"wal-append.queue_time_us":756039}
I20260709 12:10:39.046802 18091 raft_consensus.cc:2468] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 2.
I20260709 12:10:39.049257 18094 raft_consensus.cc:1275] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:10:39.051549 18607 thread.cc:641] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.925s	user 0.034s	sys 0.066s
W20260709 12:10:39.069406 18607 thread.cc:608] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.944s	user 0.035s	sys 0.067s
W20260709 12:10:39.073565 18607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:39.053095 18609 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.008s	sys 0.033s
W20260709 12:10:39.074178 18609 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.009s	sys 0.033s
I20260709 12:10:38.923434 20270 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:39.063200 20161 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.009s	sys 0.014s
W20260709 12:10:39.076299 20161 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.009s	sys 0.014s
W20260709 12:10:39.052189 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 632265us
I20260709 12:10:39.078323 20270 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:10:39.089965 17831 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.947s	user 0.016s	sys 0.008s
W20260709 12:10:39.090509 17831 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.948s	user 0.016s	sys 0.008s
W20260709 12:10:39.107995 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 48847.5us
I20260709 12:10:39.111326 20723 raft_consensus.cc:493] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.112612 20723 raft_consensus.cc:515] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:39.116330 20650 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:39.121734 20621 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:39.122790 20621 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:39.123845 20703 leader_election.cc:290] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:39.124742 20563 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:39.126979 20697 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:39.131099 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.133287 20522 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.134378 20522 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:39.137882 20522 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:39.139334 20533 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:39.141966 20507 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:39.142220 20448 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:39.143599 20704 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123)
I20260709 12:10:39.144379 20491 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:38.814956 20503 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:39.133513 20443 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.317s	user 0.079s	sys 0.088s
W20260709 12:10:39.153226 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 232230us
I20260709 12:10:38.956274 20570 leader_election.cc:290] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:39.128049 20697 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:39.155229 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 75845.5us
I20260709 12:10:39.149509 20621 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:39.157322 20443 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.375s	user 0.079s	sys 0.089s
W20260709 12:10:39.157135 18016 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.000s	sys 0.018s
W20260709 12:10:39.158665 20508 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.012s	sys 0.006s
I20260709 12:10:39.179673 20698 leader_election.cc:290] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:39.186528 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:39.187510 18643 raft_consensus.cc:2376] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 7. Re-sending same reply.
I20260709 12:10:39.187704 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:39.188494 18638 raft_consensus.cc:2376] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 7. Re-sending same reply.
I20260709 12:10:39.188791 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:39.189571 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:39.189855 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:39.190111 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:39.183046 18062 leader_election.cc:304] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
W20260709 12:10:39.191712 18639 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60412 (request call id 819) took 1423 ms (client timeout 1768 ms). Trace:
I20260709 12:10:39.188689 18644 raft_consensus.cc:1275] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:39.194613 18641 raft_consensus.cc:1275] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:10:39.190351 18638 raft_consensus.cc:2468] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 5.
I20260709 12:10:39.184401 20627 ts_tablet_manager.cc:1916] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:10:39.212872 20277 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:39.224037 20491 raft_consensus.cc:2804] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:39.224670 20491 raft_consensus.cc:493] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:39.225183 20491 raft_consensus.cc:3060] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.226511 20704 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.227429 20704 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:39.231032 20621 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:39.231880 20621 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:39.232760 20592 raft_consensus.cc:993] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db: : Instructing follower c5ffa786c8fb43f7864fa8fbe76534cb to start an election
I20260709 12:10:39.233603 20592 raft_consensus.cc:1081] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 LEADER]: Signalling peer c5ffa786c8fb43f7864fa8fbe76534cb to start an election
W20260709 12:10:39.192919 18639 rpcz_store.cc:269] 0709 12:10:37.767402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.768543 (+  1141us) service_pool.cc:224] Handling call
0709 12:10:39.189509 (+1420966us) spinlock_profiling.cc:243] Waited 6.82 ms on lock 0x7b58001c4a98. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4988db71 00007f7f4988da22 00007f7f527a68d9 00007f7f51900ee0 00007f7f519ca0ab 00007f7f519ca131 00007f7f519780a0 00007f7f51977984 00007f7f4aef26d4 00007f7f4aef2662
0709 12:10:39.190823 (+  1314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15686400}
I20260709 12:10:39.215890 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:39.217741 20439 leader_election.cc:290] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:39.199215 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:39.218853 18636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60412 (request call id 828) took 1143 ms. Trace:
I20260709 12:10:39.219290 20698 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:39.219936 18061 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.007s	sys 0.015s
I20260709 12:10:39.220338 20442 leader_election.cc:290] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:39.220739 20723 leader_election.cc:290] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:39.236582 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:39.234737 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:39.238315 18643 raft_consensus.cc:2393] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 3: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
W20260709 12:10:39.246723 18061 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.008s	sys 0.016s
I20260709 12:10:39.195421 20508 raft_consensus.cc:697] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 8 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:39.235373 20621 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:39.250991 18641 raft_consensus.cc:2393] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 6: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:39.248118 20448 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:39.254824 18644 raft_consensus.cc:2468] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
W20260709 12:10:39.244693 20470 consensus_meta.cc:287] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 1.624s	user 0.019s	sys 0.000s
I20260709 12:10:39.241868 18636 rpcz_store.cc:276] 0709 12:10:38.052057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.078698 (+ 26641us) service_pool.cc:224] Handling call
0709 12:10:39.194620 (+1115922us) spinlock_profiling.cc:243] Waited 35.8 ms on lock 0x7b54003bea54. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:39.194847 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82373888}
I20260709 12:10:39.260668 18092 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 9.
I20260709 12:10:39.259889 20508 consensus_queue.cc:237] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:39.245321 20704 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:39.260527 20448 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:39.264457 20707 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.264456 20469 raft_consensus.cc:493] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:39.266129 20466 consensus_meta.cc:287] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 1.185s	user 0.011s	sys 0.003s
I20260709 12:10:39.270654 20448 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:39.271195 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:39.271751 20469 raft_consensus.cc:515] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:39.259915 20698 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:39.275025 20698 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:39.274371 20469 leader_election.cc:290] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:39.276178 18642 raft_consensus.cc:1275] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:10:39.269838 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:39.270932 20466 raft_consensus.cc:515] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:39.266570 18638 raft_consensus.cc:2468] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
W20260709 12:10:39.280308 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 727101us
I20260709 12:10:39.279335 20698 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:39.299175 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:39.300324 18093 raft_consensus.cc:2468] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3.
W20260709 12:10:39.306610 20637 consensus_meta.cc:287] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.917s	user 0.014s	sys 0.000s
I20260709 12:10:39.311980 20637 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:39.311242 17987 leader_election.cc:336] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Timed out: RequestConsensusVote RPC to 127.16.98.196:43647 timed out after 1.593s (SENT)
I20260709 12:10:39.316452 20466 leader_election.cc:290] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:39.313975 20386 consensus_meta.cc:287] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 1.282s	user 0.004s	sys 0.013s
I20260709 12:10:39.316409 20637 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:39.335466 18640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60412 (request call id 830) took 1223 ms. Trace:
I20260709 12:10:39.335978 18640 rpcz_store.cc:276] 0709 12:10:38.069441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.169883 (+100442us) service_pool.cc:224] Handling call
0709 12:10:38.170172 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:38.170386 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:38.912363 (+741977us) log.cc:844] Serialized 14 byte log entry
0709 12:10:39.203861 (+291498us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:39.235839 (+ 31978us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:39.257609 (+ 21770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:39.263158 (+  5549us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:39.292270 (+ 29112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":806062,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":4393,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":38825,"thread_start_us":999574,"threads_started":2,"wal-append.queue_time_us":372169}
I20260709 12:10:39.271202 20707 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:39.348604 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:39.340839 20698 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:39.347236 17987 leader_election.cc:336] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Timed out: RequestConsensusVote RPC to 127.16.98.196:43647 timed out after 1.960s (SENT)
I20260709 12:10:39.354276 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:39.355129 20698 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:39.358283 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.358820 20704 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:39.359591 20637 consensus_queue.cc:1048] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:10:39.360841 20681 log.cc:927] Time spent T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 1.743s	user 0.006s	sys 0.010s
W20260709 12:10:39.360978 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.362725 18098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53954 (request call id 1949) took 1877 ms. Trace:
W20260709 12:10:39.362943 20688 log.cc:927] Time spent T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 1.350s	user 0.000s	sys 0.004s
W20260709 12:10:39.364111 20685 log.cc:927] Time spent T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 1.746s	user 0.010s	sys 0.027s
I20260709 12:10:39.363169 18098 rpcz_store.cc:276] 0709 12:10:37.485077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.486771 (+  1694us) service_pool.cc:224] Handling call
0709 12:10:37.487042 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:37.487345 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:37.487380 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:37.487829 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 12:10:37.616966 (+129137us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:37.617006 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.617068 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:39.359792 (+1742724us) spinlock_profiling.cc:243] Waited 33.1 ms on lock 0x7b4400022b4c. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f497ebc85 00007f7f497ec6a2 00007f7f4c55e1db 00007f7f4c559aaf 00007f7f4c54d86e 00007f7f4c54cbb6 00007f7f4c54c7d8 00007f7f4c556221 00007f7f4c5561d9 00007f7f4c556169
0709 12:10:39.362115 (+  2323us) raft_consensus.cc:1685] finished
0709 12:10:39.362143 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:39.362481 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":802,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":5776,"spinlock_wait_cycles":76096384,"thread_start_us":128853,"threads_started":1,"wal-append.queue_time_us":129090}
W20260709 12:10:39.365823 20689 log.cc:927] Time spent T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 1.356s	user 0.002s	sys 0.000s
I20260709 12:10:39.365943 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:39.354460 20234 consensus_meta.cc:287] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 1.273s	user 0.009s	sys 0.013s
I20260709 12:10:39.359546 20704 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:39.331156 20386 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:39.369382 20466 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
W20260709 12:10:39.368394 20622 consensus_meta.cc:287] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.694s	user 0.010s	sys 0.010s
I20260709 12:10:39.368378 18637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60430 (request call id 578) took 1848 ms. Trace:
I20260709 12:10:39.370113 20466 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:39.349946 20697 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:39.375236 17948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50334 (request call id 2010) took 3576 ms. Trace:
I20260709 12:10:39.373639 20234 raft_consensus.cc:515] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:39.383229 17948 rpcz_store.cc:276] 0709 12:10:35.798676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.082066 (+283390us) service_pool.cc:224] Handling call
0709 12:10:36.082393 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:37.503553 (+1421160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:37.503583 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:37.503995 (+   412us) log.cc:844] Serialized 26 byte log entry
0709 12:10:37.686972 (+182977us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:37.687032 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.084156 (+397124us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54003e6054. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:38.084219 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:39.362007 (+1277788us) spinlock_profiling.cc:243] Waited 28.9 ms on lock 0x7b4400022b4c. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f497ebc85 00007f7f497ec6a2 00007f7f4c55e1db 00007f7f4c559aaf 00007f7f4c54d86e 00007f7f4c54cbb6 00007f7f4c54c7d8 00007f7f4c556221 00007f7f4c5561d9 00007f7f4c556169
0709 12:10:39.366633 (+  4626us) raft_consensus.cc:1685] finished
0709 12:10:39.366681 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:39.375012 (+  8331us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1307081,"raft.queue_time_us":1307197,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":3198,"spinlock_wait_cycles":327944192,"thread_start_us":182659,"threads_started":1,"wal-append.queue_time_us":293646}
I20260709 12:10:39.370129 20622 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:39.385578 20234 leader_election.cc:290] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:39.386550 18097 raft_consensus.cc:1240] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:39.371027 18637 rpcz_store.cc:276] 0709 12:10:37.519567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.519699 (+   132us) service_pool.cc:224] Handling call
0709 12:10:37.520034 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:37.520393 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:37.520421 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:37.520888 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 12:10:37.617861 (+ 96973us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:37.617916 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:37.618006 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:39.363148 (+1745142us) spinlock_profiling.cc:243] Waited 7.72 ms on lock 0x7b4400022b4c. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f497ebc85 00007f7f497ec6a2 00007f7f4c55e1db 00007f7f4c559aaf 00007f7f4c54d86e 00007f7f4c54cbb6 00007f7f4c54c7d8 00007f7f4c556221 00007f7f4c5561d9 00007f7f4c556169
0709 12:10:39.366329 (+  3181us) raft_consensus.cc:1685] finished
0709 12:10:39.366348 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:39.367611 (+  1263us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5530,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":74,"spinlock_wait_cycles":17767296,"thread_start_us":96555,"threads_started":1,"wal-append.queue_time_us":96884}
I20260709 12:10:39.388159 20466 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:39.389400 20704 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:39.389878 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 59475.7us
W20260709 12:10:39.392267 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.393486 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:39.395506 20622 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:39.396258 20721 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.396950 20721 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:39.397701 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:39.399055 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:39.399470 20721 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:39.399727 18095 raft_consensus.cc:2468] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 5.
I20260709 12:10:39.400360 20622 raft_consensus.cc:493] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.401403 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:39.401639 20448 consensus_queue.cc:1048] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:39.402189 20721 raft_consensus.cc:493] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.396469 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:39.402853 20721 raft_consensus.cc:515] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:39.403430 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:39.404155 18635 raft_consensus.cc:2376] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6. Re-sending same reply.
I20260709 12:10:39.404529 20469 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
W20260709 12:10:39.404752 18635 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60412 (request call id 822) took 1633 ms (client timeout 2032 ms). Trace:
I20260709 12:10:39.405193 20469 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:39.405241 18635 rpcz_store.cc:269] 0709 12:10:37.771113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.772795 (+  1682us) service_pool.cc:224] Handling call
0709 12:10:39.403127 (+1630332us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b58001c4a98. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4988db71 00007f7f4988da22 00007f7f527a68d9 00007f7f51900ee0 00007f7f519ca0ab 00007f7f519ca131 00007f7f519780a0 00007f7f51977984 00007f7f4aef26d4 00007f7f4aef2662
0709 12:10:39.404698 (+  1571us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5198592}
I20260709 12:10:39.406248 20732 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:39.376875 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:39.407171 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:39.377766 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:39.379292 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:39.380411 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:39.382637 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:39.401087 20622 raft_consensus.cc:515] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:39.376178 20386 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:39.377408 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:39.417024 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:39.417586 20439 raft_consensus.cc:493] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:39.417896 17944 raft_consensus.cc:2393] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 5: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:39.418284 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:39.418200 20439 raft_consensus.cc:515] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:39.419054 18018 raft_consensus.cc:2468] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:10:39.419957 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:39.420295 20503 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:39.420547 20439 leader_election.cc:290] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:39.420692 17947 raft_consensus.cc:2376] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7. Re-sending same reply.
I20260709 12:10:39.405278 20721 leader_election.cc:290] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:39.421756 18022 raft_consensus.cc:2468] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 2.
I20260709 12:10:39.421756 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:39.408492 18020 raft_consensus.cc:2468] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:39.407928 20732 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:39.423556 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:39.376796 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:39.423475 17987 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:39.408058 17949 raft_consensus.cc:2468] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 6.
I20260709 12:10:39.396332 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:39.425606 18090 raft_consensus.cc:2468] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:10:39.425745 20732 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:39.423785 18093 raft_consensus.cc:1813] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Handling vote request from an unknown peer 63f5bddeebd84e5788d671a176cfa8e1
W20260709 12:10:39.426894 18608 connection.cc:256] RPC call timeout handler was delayed by -1.0290351840001222s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1819s for a response
W20260709 12:10:39.427366 18608 connection.cc:256] RPC call timeout handler was delayed by -1.0135156010001083s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2222s for a response
I20260709 12:10:39.407707 20469 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:39.426841 18093 raft_consensus.cc:2410] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 6 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:10:39.433854 20503 raft_consensus.cc:2749] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:39.433847 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:39.435283 18669 heartbeater.cc:646] Failed to heartbeat to 127.16.98.254:38823 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.16.98.254:38823 timed out after 15.000s (SENT)
I20260709 12:10:39.435616 18095 raft_consensus.cc:2468] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 7.
I20260709 12:10:39.436319 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:39.436892 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:39.439493 20637 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:39.439874 20644 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:39.440157 20637 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:39.440634 20644 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:39.443086 20717 consensus_queue.cc:1048] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:39.444975 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:39.428030 20622 leader_election.cc:290] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:39.447062 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:10:39.448514 20434 consensus_meta.cc:287] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 1.052s	user 0.007s	sys 0.012s
I20260709 12:10:39.449047 20434 raft_consensus.cc:515] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:39.449973 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:39.451383 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:39.453119 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:39.451599 20434 leader_election.cc:290] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:39.443235 20637 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:39.451289 18062 leader_election.cc:304] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:39.382246 20491 raft_consensus.cc:515] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:39.461773 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:39.466985 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:39.467828 17945 raft_consensus.cc:2468] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
W20260709 12:10:39.468364 18092 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41818 (request call id 759) took 2015 ms (client timeout 1928 ms). Trace:
W20260709 12:10:39.468807 18092 rpcz_store.cc:269] 0709 12:10:37.446775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.447277 (+   502us) service_pool.cc:224] Handling call
0709 12:10:39.462425 (+2015148us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b5400337a54. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:39.462541 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4077923200}
I20260709 12:10:39.470367 17987 leader_election.cc:304] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:39.471372 20522 raft_consensus.cc:2749] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:39.462672 20704 consensus_queue.cc:1048] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
W20260709 12:10:39.472453 17987 consensus_peers.cc:597] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 137ed415b9d242989f28f349c1618c74. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:39.472172 20522 consensus_queue.cc:1048] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:39.473176 17987 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:39.473290 20503 consensus_queue.cc:1048] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:39.474541 20522 raft_consensus.cc:2804] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:39.475091 20522 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:39.475344 20734 log.cc:927] Time spent T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 12:10:39.475541 20522 raft_consensus.cc:3060] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:39.475840 20695 log.cc:927] Time spent T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.581s	user 0.000s	sys 0.001s
I20260709 12:10:39.476900 20644 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:39.461982 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:39.464375 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 88570.9us
I20260709 12:10:39.478430 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:39.479267 18093 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
W20260709 12:10:39.486379 20709 log.cc:927] Time spent T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.551s	user 0.000s	sys 0.001s
W20260709 12:10:39.488245 20714 log.cc:927] Time spent T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.521s	user 0.000s	sys 0.001s
I20260709 12:10:39.491637 18096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53954 (request call id 1953) took 1727 ms. Trace:
I20260709 12:10:39.492854 17847 catalog_manager.cc:5697] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:39.492206 18096 rpcz_store.cc:276] 0709 12:10:37.762902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.763034 (+   132us) service_pool.cc:224] Handling call
0709 12:10:37.763291 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:37.763479 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:10:37.785245 (+ 21766us) log.cc:844] Serialized 14 byte log entry
0709 12:10:37.822123 (+ 36878us) log.cc:844] Serialized 14 byte log entry
0709 12:10:38.469636 (+647513us) spinlock_profiling.cc:243] Waited 4.27 ms on lock 0x7b48001ec258. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f518dbaa1 00007f7f518d2b37 00007f7f518d29ca 00007f7f519ca26f 00007f7f519c9f37 00007f7f519de55c 00007f7f519de508 00007f7f519de488 00007f7f519de443 00007f7f519dd6ec 00007f7f50907a96
0709 12:10:39.467933 (+998297us) spinlock_profiling.cc:243] Waited 9.95 ms on lock 0x7b18002ac400. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f498932a6 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f498c53f3 00007f7f498c77c1
0709 12:10:39.489699 (+ 21766us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b18002ac400. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f4c55a4bc 00007f7f498a848b 00007f7f527029a9 00007f7f498c469b 00007f7f498c293f 00007f7f498c2455 00007f7f4c9aa060 00007f7f4c9bc716 00007f7f4c9cd287
0709 12:10:39.489875 (+   176us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:39.490001 (+   126us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:10:39.490190 (+   189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:39.490310 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:39.490502 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":257546,"prepare.queue_time_us":24672,"raft.queue_time_us":106864,"raft.run_cpu_time_us":7503,"raft.run_wall_time_us":851916,"spinlock_wait_cycles":74193536,"thread_start_us":265186,"threads_started":1}
W20260709 12:10:39.501149 18607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.502028 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:39.508880 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:39.507350 17944 raft_consensus.cc:2468] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
I20260709 12:10:39.498865 17989 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:39.460713 20698 consensus_queue.cc:1048] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:10:39.527352 18608 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:39.529474 20732 raft_consensus.cc:2749] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:39.530427 20732 consensus_queue.cc:1048] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:39.530817 20721 consensus_queue.cc:1059] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:39.531675 20721 raft_consensus.cc:3055] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:39.532009 20721 raft_consensus.cc:740] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:39.532918 20721 consensus_queue.cc:260] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:39.533176 17847 catalog_manager.cc:5697] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 1 to 3, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 3 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:10:39.534152 20721 raft_consensus.cc:3060] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:39.535179 18094 raft_consensus.cc:1240] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:39.516360 20644 raft_consensus.cc:2804] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:39.535914 20506 consensus_meta.cc:287] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 1.475s	user 0.017s	sys 0.002s
I20260709 12:10:39.536158 20644 raft_consensus.cc:493] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:39.536664 20644 raft_consensus.cc:3060] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.536568 20506 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:39.551431 18640 raft_consensus.cc:1275] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:39.551999 18608 leader_election.cc:304] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:39.553752 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:39.554440 20725 raft_consensus.cc:2749] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:39.555976 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:39.556843 20725 consensus_queue.cc:1048] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:10:39.557603 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 106463us
I20260709 12:10:39.558660 20434 consensus_queue.cc:1048] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:39.559440 20470 consensus_queue.cc:1048] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:39.559952 20706 raft_consensus.cc:2804] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:39.560451 20706 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.560159 20434 consensus_queue.cc:1048] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:39.560835 20706 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:39.561100 18062 leader_election.cc:304] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:39.561956 20434 raft_consensus.cc:2804] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:39.562412 20434 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.562839 20434 raft_consensus.cc:3060] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:39.563118 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.564296 18062 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:39.565898 18608 leader_election.cc:304] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:39.515885 20161 consensus_queue.cc:1048] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:10:39.576043 20716 consensus_queue.cc:1059] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:39.576301 17988 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:39.577152 20716 raft_consensus.cc:3055] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:39.577370 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:39.578153 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:39.578774 17945 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
I20260709 12:10:39.579896 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:39.580950 18023 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 8.
I20260709 12:10:39.581302 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:39.577508 20443 raft_consensus.cc:2804] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:39.577491 20716 raft_consensus.cc:740] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:39.582141 20725 raft_consensus.cc:2749] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:39.582964 20716 consensus_queue.cc:260] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:39.574554 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:39.582165 20443 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:39.584303 18637 raft_consensus.cc:2468] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 5.
I20260709 12:10:39.584595 20443 raft_consensus.cc:3060] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.584637 18608 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:39.585819 20541 raft_consensus.cc:2804] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:39.586369 20541 raft_consensus.cc:697] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:39.586431 18608 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:39.587282 20716 raft_consensus.cc:3060] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:39.587491 20541 consensus_queue.cc:237] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:39.588404 20712 log.cc:927] Time spent T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.617s	user 0.000s	sys 0.003s
I20260709 12:10:39.588718 20491 leader_election.cc:290] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:39.590143 20644 raft_consensus.cc:515] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:39.583436 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:39.591289 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:39.591997 20707 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:39.592011 18643 raft_consensus.cc:2468] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3.
I20260709 12:10:39.593154 18017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53022 (request call id 469) took 1855 ms. Trace:
I20260709 12:10:39.593638 18017 rpcz_store.cc:276] 0709 12:10:37.738054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:37.738326 (+   272us) service_pool.cc:224] Handling call
0709 12:10:37.738734 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:37.739186 (+   452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:37.739226 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:37.747727 (+  8501us) log.cc:844] Serialized 26 byte log entry
0709 12:10:38.138551 (+390824us) spinlock_profiling.cc:243] Waited 3.06 ms on lock 0x7b180001e820. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f498a7e07 00007f7f527029a9 00007f7f498c469b 00007f7f498c293f 00007f7f498c4c02 00007f7f4c54c20b 00007f7f4c551d23 00007f7f4c5520d1 00007f7f4c96da0f
0709 12:10:38.815921 (+677370us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:39.025232 (+209311us) log.cc:844] Serialized 14 byte log entry
0709 12:10:39.025844 (+   612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:39.026010 (+   166us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:39.587746 (+561736us) spinlock_profiling.cc:243] Waited 7.13 ms on lock 0x7b4400022b4c. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f497ebc85 00007f7f497ec6a2 00007f7f4c55e1db 00007f7f4c559aaf 00007f7f4c54d86e 00007f7f4c54cbb6 00007f7f4c54c7d8 00007f7f4c556221 00007f7f4c5561d9 00007f7f4c556169
0709 12:10:39.592767 (+  5021us) raft_consensus.cc:1685] finished
0709 12:10:39.592794 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:39.592933 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27162,"prepare.queue_time_us":317874,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":78,"raft.queue_time_us":72318,"raft.run_cpu_time_us":573,"raft.run_wall_time_us":48992,"spinlock_wait_cycles":23445504,"thread_start_us":677150,"threads_started":1,"wal-append.queue_time_us":1204238}
I20260709 12:10:39.596205 20644 leader_election.cc:290] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:39.598059 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:39.598589 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
W20260709 12:10:39.598774 18091 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53964 (request call id 1684) took 1179 ms (client timeout 1555 ms). Trace:
I20260709 12:10:39.598673 18640 raft_consensus.cc:2468] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 5.
I20260709 12:10:39.600133 17943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2018) took 2020 ms. Trace:
W20260709 12:10:39.599498 18091 rpcz_store.cc:269] 0709 12:10:38.419363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.419496 (+   133us) service_pool.cc:224] Handling call
0709 12:10:39.598586 (+1179090us) spinlock_profiling.cc:243] Waited 534 ms on lock 0x7b5400109d54. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:39.598723 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1227737984}
I20260709 12:10:39.600627 17943 rpcz_store.cc:276] 0709 12:10:37.579905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.093728 (+513823us) service_pool.cc:224] Handling call
0709 12:10:38.259603 (+165875us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:38.259789 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:38.259817 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:38.259862 (+    45us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:10:38.259910 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.259983 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:39.599822 (+1339839us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b54002be8d0. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b18ad 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:39.599968 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":380697984}
I20260709 12:10:39.599483 18638 raft_consensus.cc:3060] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.601435 20434 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:39.603427 17949 raft_consensus.cc:1275] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:10:39.605659 20434 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:39.602342 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:39.606691 20683 consensus_queue.cc:260] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:39.607303 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:39.607777 20683 raft_consensus.cc:3060] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:39.607969 18635 raft_consensus.cc:2468] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
I20260709 12:10:39.579983 18609 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:39.617925 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:39.622452 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:39.624642 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:39.628613 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:39.629757 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:39.616250 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:39.627260 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
W20260709 12:10:39.630016 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 50117.9us
I20260709 12:10:39.618367 18643 raft_consensus.cc:1240] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:39.587505 18608 leader_election.cc:304] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:39.626070 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:39.616658 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:39.616395 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:39.665581 17949 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:39.624450 17945 pending_rounds.cc:85] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1: Aborting all ops after (but not including) 4
W20260709 12:10:39.620293 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 76597.3us
W20260709 12:10:39.672756 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 85318.9us
W20260709 12:10:39.673254 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 120598us
I20260709 12:10:39.678937 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:39.678392 18062 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:39.666491 17945 pending_rounds.cc:107] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:10:39.629858 20622 raft_consensus.cc:2804] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:39.623531 20161 raft_consensus.cc:2804] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:39.621886 20637 raft_consensus.cc:2804] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:39.616802 20715 log.cc:927] Time spent T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.641s	user 0.001s	sys 0.002s
I20260709 12:10:39.691533 18089 raft_consensus.cc:2468] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:10:39.633337 17847 catalog_manager.cc:5697] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 2 to 3, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 3 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:39.700793 17914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.700788 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:39.696930 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:39.696237 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:39.696734 18062 leader_election.cc:304] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:39.697650 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.691449 17945 raft_consensus.cc:2889] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:39.691856 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:39.614542 17831 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 4ccf0bcc20ae40e79c32530091613e1e with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260709 12:10:39.716526 17831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 104524us
I20260709 12:10:39.716997 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:39.717335 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:39.718014 18098 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 9.
I20260709 12:10:39.719231 18098 raft_consensus.cc:1240] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:39.694154 20434 raft_consensus.cc:2749] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:39.688957 20725 raft_consensus.cc:2804] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:39.720094 17943 raft_consensus.cc:3060] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.711926 18024 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
I20260709 12:10:39.737599 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:39.698089 20161 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:39.742190 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 45865.1us
I20260709 12:10:39.738441 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:39.732758 18092 raft_consensus.cc:3060] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:39.743017 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:39.739049 17944 raft_consensus.cc:2468] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:10:39.709108 20637 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.694900 20622 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.745848 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:39.737026 20725 raft_consensus.cc:493] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.748955 18062 leader_election.cc:304] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1
W20260709 12:10:39.758733 20607 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.004s	sys 0.009s
I20260709 12:10:39.752166 17912 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:39.752486 18637 raft_consensus.cc:1275] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:39.764739 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:39.721228 20644 raft_consensus.cc:2749] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:39.735327 18609 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:39.738124 20506 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:39.746680 20161 raft_consensus.cc:3060] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:39.776860 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 200763us
I20260709 12:10:39.750773 20637 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.778770 18062 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:39.764393 20622 raft_consensus.cc:3060] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:39.772034 20607 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.860s	user 0.004s	sys 0.010s
I20260709 12:10:39.783319 17914 leader_election.cc:304] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:39.801785 17914 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:39.802949 20469 raft_consensus.cc:2804] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:39.803328 20469 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.803900 20732 raft_consensus.cc:2804] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:39.804327 20732 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:39.777633 18638 raft_consensus.cc:2468] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 5.
I20260709 12:10:39.804735 20732 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:39.788086 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 46234.4us
I20260709 12:10:39.789425 18635 raft_consensus.cc:1275] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:39.789558 20655 consensus_queue.cc:1048] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:10:39.810614 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:39.811422 17940 raft_consensus.cc:3060] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.782256 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:39.790288 18061 leader_election.cc:304] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:39.790830 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 55608.5us
I20260709 12:10:39.770817 20725 raft_consensus.cc:3060] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:39.796711 20746 log.cc:927] Time spent T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:10:39.803687 17914 leader_election.cc:304] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:39.804411 20607 raft_consensus.cc:2804] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:39.780886 17943 raft_consensus.cc:2468] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
W20260709 12:10:39.824811 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 46124.3us
I20260709 12:10:39.777693 20466 raft_consensus.cc:2749] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:39.823864 20644 raft_consensus.cc:2749] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:39.828316 20655 raft_consensus.cc:2749] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:39.782353 20707 raft_consensus.cc:2804] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:39.830791 18062 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:10:39.828751 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.838397 18636 raft_consensus.cc:2393] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 8: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:39.845192 20721 consensus_queue.cc:1059] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:39.838271 20596 raft_consensus.cc:2804] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:39.855017 20596 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:39.855520 20596 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:39.857944 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 246995us
I20260709 12:10:39.859294 17941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2015) took 2281 ms. Trace:
I20260709 12:10:39.860124 17912 leader_election.cc:304] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:39.860337 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:39.859692 17941 rpcz_store.cc:276] 0709 12:10:37.578113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:38.048839 (+470726us) service_pool.cc:224] Handling call
0709 12:10:38.049205 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:38.049880 (+   675us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:10:38.049917 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:38.057212 (+  7295us) log.cc:844] Serialized 26 byte log entry
0709 12:10:38.680164 (+622952us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:38.680190 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:38.680235 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:39.615812 (+935577us) spinlock_profiling.cc:243] Waited 3.77 ms on lock 0x7b4400022b4c. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f497ebc85 00007f7f497ec6a2 00007f7f4c55e1db 00007f7f4c559aaf 00007f7f4c54d86e 00007f7f4c54cbb6 00007f7f4c54c7d8 00007f7f4c556221 00007f7f4c5561d9 00007f7f4c556169
0709 12:10:39.858827 (+243015us) raft_consensus.cc:1685] finished
0709 12:10:39.858853 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:39.859116 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21613,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":4856,"spinlock_wait_cycles":8679808,"thread_start_us":342839,"threads_started":1,"wal-append.queue_time_us":689414}
I20260709 12:10:39.861478 17912 leader_election.cc:304] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:39.803684 20469 raft_consensus.cc:3060] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:39.902907 20683 raft_consensus.cc:2804] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:39.903451 20683 raft_consensus.cc:493] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:39.903825 20683 raft_consensus.cc:3060] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:39.907791 20627 ts_tablet_manager.cc:1929] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:10:39.908416 20627 log.cc:1199] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-0-root/wals/3cdd445b25e5404da2f578c388210925
I20260709 12:10:39.908979 17988 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:39.827550 20607 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:39.862296 20655 raft_consensus.cc:2804] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:39.863348 20707 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:39.915462 18092 raft_consensus.cc:2468] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
I20260709 12:10:39.916126 18096 raft_consensus.cc:1240] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:39.916523 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:39.919499 20622 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:39.917173 20707 raft_consensus.cc:3060] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:39.911435 20607 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.921830 18635 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
mode: GRACEFUL
new_leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:52812
I20260709 12:10:39.936395 17940 raft_consensus.cc:2468] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
W20260709 12:10:39.939728 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.952700 17949 raft_consensus.cc:2468] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 8.
W20260709 12:10:39.963608 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 173429us
I20260709 12:10:39.966991 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:39.917215 20655 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:39.977165 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 113645us
I20260709 12:10:39.967854 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:10:39.979370 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:39.983261 18062 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:39.909016 20706 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:39.991842 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:39.964721 20466 raft_consensus.cc:2749] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:39.994882 18637 raft_consensus.cc:1240] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:39.995316 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:39.982249 20655 raft_consensus.cc:3060] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:39.997355 18642 raft_consensus.cc:2468] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
I20260709 12:10:40.002110 18018 raft_consensus.cc:2393] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 10: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:39.964354 20506 consensus_queue.cc:1048] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:10:39.992249 20448 raft_consensus.cc:2804] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:40.019292 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:40.020045 18608 leader_election.cc:304] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:40.021693 18644 raft_consensus.cc:2468] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 5.
I20260709 12:10:40.025532 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:39.967942 20725 raft_consensus.cc:515] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:40.026520 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:40.033622 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:40.006448 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:40.040144 18062 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:40.045013 18639 raft_consensus.cc:1240] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:40.022840 20448 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:40.049253 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:40.050627 18097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53954 (request call id 1956) took 1005 ms. Trace:
I20260709 12:10:40.051059 18097 rpcz_store.cc:276] 0709 12:10:39.045699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:39.049789 (+  4090us) service_pool.cc:224] Handling call
0709 12:10:39.179186 (+129397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:39.386951 (+207765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:40.050365 (+663414us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b54003589d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:40.050542 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":476132224}
W20260709 12:10:40.053990 20743 log.cc:927] Time spent T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.487s	user 0.001s	sys 0.003s
W20260709 12:10:40.054955 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 68221.1us
I20260709 12:10:40.055948 20627 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50326 (request call id 81) took 4273 ms. Trace:
I20260709 12:10:40.057049 20466 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.057631 20466 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:40.059079 20491 raft_consensus.cc:2804] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:40.059507 20491 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:40.059902 20491 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:40.023037 20750 raft_consensus.cc:2749] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:40.065047 20506 raft_consensus.cc:493] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:40.065593 20506 raft_consensus.cc:515] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:40.067446 20596 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:40.069859 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:40.070924 18638 raft_consensus.cc:2393] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 3: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:40.071902 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
W20260709 12:10:40.072364 17946 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44668 (request call id 419) took 4238 ms (client timeout 2177 ms). Trace:
W20260709 12:10:40.072788 17946 rpcz_store.cc:269] 0709 12:10:35.833641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.857884 (+ 24243us) service_pool.cc:224] Handling call
0709 12:10:40.072007 (+4214123us) spinlock_profiling.cc:243] Waited 3.73 s on lock 0x7b54001fd954. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:40.072157 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8574549888}
I20260709 12:10:40.074971 17988 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
W20260709 12:10:40.076525 20742 log.cc:927] Time spent T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.368s	user 0.003s	sys 0.000s
I20260709 12:10:40.077248 18061 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:40.079070 20470 raft_consensus.cc:2749] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:40.079644 20523 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:40.080272 20523 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:40.080582 18061 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:40.082383 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:40.083138 20557 raft_consensus.cc:2749] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:40.090550 18635 raft_consensus.cc:606] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Received request to transfer leadership to TS 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:40.090783 20448 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:40.091017 18635 raft_consensus.cc:614] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:40.092249 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:40.096856 20515 raft_consensus.cc:2749] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:40.097586 20515 raft_consensus.cc:3055] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:40.097952 20515 raft_consensus.cc:740] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:40.098764 20515 consensus_queue.cc:260] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:40.101150 20503 raft_consensus.cc:2955] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 LEADER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:10:40.103520 20622 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:40.104610 17988 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:40.104887 20731 raft_consensus.cc:2804] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:40.105274 20731 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.105484 17988 leader_election.cc:304] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:40.106259 20750 raft_consensus.cc:2804] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:40.106618 20750 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:40.106964 20750 raft_consensus.cc:3060] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.108793 20725 leader_election.cc:290] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:40.110890 20698 raft_consensus.cc:2804] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:10:40.111299 20698 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.111666 20698 raft_consensus.cc:3060] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:10:40.111483 20637 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:40.105620 20731 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.083170 18641 raft_consensus.cc:2393] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 5: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:40.056385 20627 rpcz_store.cc:276] 0709 12:10:35.830196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:35.871442 (+ 41246us) service_pool.cc:224] Handling call
0709 12:10:36.352771 (+481329us) ts_tablet_manager.cc:1151] Deleting tablet 3cdd445b25e5404da2f578c388210925
0709 12:10:36.388183 (+ 35412us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:10:39.618901 (+3230718us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:39.907632 (+288731us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:40.055836 (+148204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1910660,"tablet-delete.queue_time_us":215774,"thread_start_us":62660,"threads_started":1}
I20260709 12:10:40.121913 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:40.044025 20522 consensus_meta.cc:287] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.568s	user 0.008s	sys 0.005s
I20260709 12:10:40.128352 18642 raft_consensus.cc:2468] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
I20260709 12:10:40.086086 20732 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:40.131752 18061 leader_election.cc:304] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:40.039170 20644 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:40.124603 18022 raft_consensus.cc:2468] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:40.144853 20644 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:40.147065 20644 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:40.032639 20443 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:40.082401 20523 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:40.153990 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 48579.5us
W20260709 12:10:40.149928 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 325476us
I20260709 12:10:40.149029 18641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
mode: GRACEFUL
new_leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:52812
I20260709 12:10:40.158458 18637 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
I20260709 12:10:40.116080 20161 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:40.160338 18609 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:40.156917 18641 raft_consensus.cc:606] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Received request to transfer leadership to TS 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:40.131598 20704 consensus_queue.cc:1048] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:10:40.139680 20522 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:40.180717 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 59399.3us
I20260709 12:10:40.185150 17987 leader_election.cc:304] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:40.185963 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:40.067457 20491 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:10:40.190361 18062 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:40.185828 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:40.154946 20469 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:40.194428 18062 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:40.200065 18092 raft_consensus.cc:1240] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:40.194603 17987 leader_election.cc:304] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
W20260709 12:10:40.199363 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 337973us
I20260709 12:10:40.204718 17912 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:40.205370 17912 raft_consensus.cc:2686] T 3cdd445b25e5404da2f578c388210925 P 63f5bddeebd84e5788d671a176cfa8e1: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:10:40.206938 17912 leader_election.cc:304] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:40.213271 17941 raft_consensus.cc:1275] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:40.193147 20717 raft_consensus.cc:2804] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:40.220326 17942 raft_consensus.cc:2393] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 4: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:40.224555 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:40.199355 20470 raft_consensus.cc:2749] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:40.227144 20236 raft_consensus.cc:2749] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:40.227694 18610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.203693 20706 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:40.203976 20725 raft_consensus.cc:2804] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:40.228899 17912 leader_election.cc:304] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:40.226398 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:40.230842 17946 raft_consensus.cc:3060] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.216753 18636 raft_consensus.cc:2393] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 7: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:40.230376 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:40.210445 20434 raft_consensus.cc:2804] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:40.236353 18096 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:40.195014 20523 consensus_queue.cc:1059] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.033s
W20260709 12:10:40.240506 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.242288 17912 leader_election.cc:304] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:40.247892 20716 raft_consensus.cc:2804] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:40.248322 20716 raft_consensus.cc:493] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:40.248684 20716 raft_consensus.cc:3060] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.250473 20506 leader_election.cc:290] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:40.250918 20523 raft_consensus.cc:3055] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:40.251317 20523 raft_consensus.cc:740] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:40.251549 20506 raft_consensus.cc:2749] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:40.252202 20506 raft_consensus.cc:2804] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:40.252681 20446 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:40.252269 20523 consensus_queue.cc:260] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:40.208094 20644 consensus_queue.cc:1048] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:10:40.232398 20596 leader_election.cc:290] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:40.256043 20756 log.cc:927] Time spent T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:10:40.256291 20161 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:40.257387 20443 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:40.192523 20557 consensus_queue.cc:1048] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
W20260709 12:10:40.263290 20757 log.cc:927] Time spent T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 12:10:40.264122 20758 log.cc:927] Time spent T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 12:10:40.264981 20761 log.cc:927] Time spent T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:10:40.265682 20752 log.cc:927] Time spent T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 12:10:40.265991 20434 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:40.267254 18638 raft_consensus.cc:2468] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:40.267901 20732 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:40.268888 18093 raft_consensus.cc:1275] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:40.225315 20717 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.246469 20439 raft_consensus.cc:2804] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:40.330828 20439 raft_consensus.cc:493] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:40.331233 20439 raft_consensus.cc:3060] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.279214 20506 raft_consensus.cc:493] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:40.334954 20506 raft_consensus.cc:3060] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:40.282513 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:40.228513 20621 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:40.342411 20621 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:40.343729 20731 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:40.296873 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:40.235126 20725 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:40.269364 20637 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:40.302909 17948 raft_consensus.cc:1240] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:10:40.307643 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
W20260709 12:10:40.316250 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 126993us
I20260709 12:10:40.281987 20690 consensus_queue.cc:1059] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:10:40.354910 17943 raft_consensus.cc:3060] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.355155 17987 leader_election.cc:304] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:40.356380 17987 leader_election.cc:304] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:40.328047 17914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.329926 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:40.359215 17914 leader_election.cc:304] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:40.262498 20655 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:40.349123 20731 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:40.283020 20706 consensus_queue.cc:1059] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:10:40.316440 20523 raft_consensus.cc:3060] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.364557 20775 raft_consensus.cc:2749] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:40.364779 20365 consensus_queue.cc:1059] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 12:10:40.364276 18096 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 10.
I20260709 12:10:40.345180 20621 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:40.320513 20491 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:40.322902 20434 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.330561 20717 raft_consensus.cc:3060] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:40.345935 20469 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:40.353322 20725 raft_consensus.cc:3060] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.398277 17987 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:40.402740 18089 raft_consensus.cc:2393] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 5: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
W20260709 12:10:40.395617 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 153421us
W20260709 12:10:40.406297 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 194043us
I20260709 12:10:40.407042 18062 leader_election.cc:304] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:40.408670 17943 raft_consensus.cc:2468] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 6.
I20260709 12:10:40.317343 20446 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:40.393939 20772 raft_consensus.cc:2804] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:40.414026 17912 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:40.375149 20750 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:40.440383 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 154518us
I20260709 12:10:40.410737 20621 raft_consensus.cc:2749] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:40.417929 20772 raft_consensus.cc:697] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:40.421550 20522 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:40.451152 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 52963.6us
I20260709 12:10:40.453878 18062 leader_election.cc:304] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:40.457883 17987 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:40.457995 18062 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:40.455060 20731 consensus_queue.cc:1048] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:10:40.462396 20236 raft_consensus.cc:2804] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:40.463788 17832 catalog_manager.cc:5028] TS 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): tablet 3cdd445b25e5404da2f578c388210925 (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:10:40.465740 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:40.466166 20779 raft_consensus.cc:2804] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:40.466542 18097 raft_consensus.cc:2393] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 6: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:40.467032 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:40.472386 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:40.473037 18641 raft_consensus.cc:3060] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:40.475466 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:40.477931 20515 raft_consensus.cc:3060] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.478289 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:10:40.456756 20683 consensus_meta.cc:287] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.552s	user 0.012s	sys 0.000s
I20260709 12:10:40.480894 20683 raft_consensus.cc:515] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:40.481649 20466 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:40.483171 20683 leader_election.cc:290] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:40.483323 18636 raft_consensus.cc:1240] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:40.483894 20655 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:40.442163 20769 raft_consensus.cc:2804] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:40.484891 20769 raft_consensus.cc:697] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:40.485867 20769 consensus_queue.cc:237] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:40.487751 20365 raft_consensus.cc:3055] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:40.488123 20365 raft_consensus.cc:740] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:40.489068 20775 raft_consensus.cc:2804] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:40.488991 20365 consensus_queue.cc:260] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:40.489542 20775 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:40.489935 20775 raft_consensus.cc:3060] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:40.490231 20365 raft_consensus.cc:3060] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:40.491214 20707 consensus_meta.cc:287] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.502s	user 0.009s	sys 0.000s
I20260709 12:10:40.491624 20707 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:40.493685 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:40.495466 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:40.495929 20707 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:40.499929 17987 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:40.500837 20690 raft_consensus.cc:2804] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:40.501356 20690 raft_consensus.cc:697] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:40.502326 20690 consensus_queue.cc:237] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:40.504527 20683 consensus_queue.cc:1059] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:40.506021 20766 raft_consensus.cc:3055] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:40.506408 20766 raft_consensus.cc:740] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:40.507226 20766 consensus_queue.cc:260] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:40.508351 20766 raft_consensus.cc:3060] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:40.509752 20448 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:40.446449 20607 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:40.513600 20607 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:40.522383 18608 leader_election.cc:304] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:40.440518 20443 raft_consensus.cc:3060] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:10:40.529178 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 71280.2us
I20260709 12:10:40.537855 18639 raft_consensus.cc:1275] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:10:40.544291 17943 raft_consensus.cc:3055] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:40.544562 17946 raft_consensus.cc:2468] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:10:40.551185 20716 raft_consensus.cc:515] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:40.553435 20716 leader_election.cc:290] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:40.544806 17943 raft_consensus.cc:740] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:40.546604 17989 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:40.571856 17946 raft_consensus.cc:1240] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:40.535775 20637 raft_consensus.cc:2804] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:40.571135 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:40.578800 17948 raft_consensus.cc:3060] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:40.535683 20236 raft_consensus.cc:697] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
W20260709 12:10:40.581348 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 77040.2us
I20260709 12:10:40.540964 20732 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:40.583153 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 48331us
I20260709 12:10:40.583236 17943 consensus_queue.cc:260] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:40.585038 17943 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:40.588105 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:40.593971 18094 raft_consensus.cc:1275] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:10:40.532279 20522 consensus_queue.cc:1048] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:10:40.603412 18091 raft_consensus.cc:1240] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:40.603960 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:40.604362 18020 raft_consensus.cc:1240] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:40.599332 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:40.605630 18639 raft_consensus.cc:3060] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.531941 20723 consensus_queue.cc:1048] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:10:40.607326 18015 raft_consensus.cc:1240] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:40.607743 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:40.603652 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:40.609397 18090 raft_consensus.cc:2368] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 2. Current term is 3.
I20260709 12:10:40.611549 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:40.612457 18096 raft_consensus.cc:2393] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 4: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:40.613859 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:40.613986 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:40.614181 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:40.614473 18021 raft_consensus.cc:3060] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:10:40.615262 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:40.592047 20621 raft_consensus.cc:2804] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:40.597862 20732 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:40.616470 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:40.617133 18094 raft_consensus.cc:2368] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 5. Current term is 6.
I20260709 12:10:40.590782 20779 raft_consensus.cc:697] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:40.602085 20637 raft_consensus.cc:697] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:40.619426 20779 consensus_queue.cc:237] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:40.541714 20439 raft_consensus.cc:515] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:40.535287 20775 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:40.618402 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:40.635892 18024 raft_consensus.cc:2393] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 6: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:40.635988 18021 raft_consensus.cc:2468] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:10:40.636970 18023 raft_consensus.cc:1240] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:40.653736 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:40.593286 20707 consensus_queue.cc:1059] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
W20260709 12:10:40.672524 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 138260us
I20260709 12:10:40.673651 18608 leader_election.cc:304] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:40.665103 20769 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:40.665719 20766 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
W20260709 12:10:40.669731 20778 log.cc:927] Time spent T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 12:10:40.665162 17943 raft_consensus.cc:1275] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:10:40.677556 17943 pending_rounds.cc:85] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1: Aborting all ops after (but not including) 7
I20260709 12:10:40.679203 17943 pending_rounds.cc:107] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:10:40.680655 17943 raft_consensus.cc:2889] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:40.682108 20515 consensus_queue.cc:1059] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:40.683442 20774 raft_consensus.cc:2749] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:40.682061 17989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.602968 20506 raft_consensus.cc:515] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:40.655095 20466 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:40.686040 20622 raft_consensus.cc:993] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db: : Instructing follower 63f5bddeebd84e5788d671a176cfa8e1 to start an election
I20260709 12:10:40.683844 20723 raft_consensus.cc:2804] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:40.679169 20439 leader_election.cc:290] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:40.713009 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:40.704119 20466 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:40.706053 20506 leader_election.cc:290] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:40.742192 17941 raft_consensus.cc:1240] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 12:10:40.706158 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:40.742980 18638 raft_consensus.cc:2393] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 9: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:40.619432 20637 consensus_queue.cc:237] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:40.706665 20161 raft_consensus.cc:1081] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Signalling peer 63f5bddeebd84e5788d671a176cfa8e1 to start an election
I20260709 12:10:40.707469 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:40.722594 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.687206 20236 consensus_queue.cc:237] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:40.737355 18642 raft_consensus.cc:1240] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 8 LEADER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:40.739161 18640 raft_consensus.cc:2468] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
W20260709 12:10:40.759002 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.759277 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:40.759848 18640 raft_consensus.cc:3060] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.759277 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:40.760490 18642 raft_consensus.cc:3060] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:40.760766 20503 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:53006 (request call id 14) took 4376 ms. Trace:
I20260709 12:10:40.740624 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:40.761876 17947 raft_consensus.cc:3060] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:10:40.741930 17944 raft_consensus.cc:1240] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:40.743851 17948 raft_consensus.cc:2468] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
W20260709 12:10:40.751506 17914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.751432 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:40.763103 17912 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:40.771090 17943 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.770437 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:40.775199 17946 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:40.684211 20766 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:10:40.794471 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:40.741675 20717 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:40.803891 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:40.805734 17912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.807513 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:40.810148 18638 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 9.
I20260709 12:10:40.810376 18098 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
I20260709 12:10:40.811594 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:40.750154 20697 raft_consensus.cc:3055] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:40.807921 18640 raft_consensus.cc:2468] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
I20260709 12:10:40.808434 17947 raft_consensus.cc:2468] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:40.691897 20769 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:40.770356 20791 log.cc:927] Time spent T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.055s	user 0.002s	sys 0.000s
W20260709 12:10:40.776363 20789 log.cc:927] Time spent T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.058s	user 0.000s	sys 0.002s
I20260709 12:10:40.774914 20723 raft_consensus.cc:697] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:40.822753 17943 raft_consensus.cc:2468] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
I20260709 12:10:40.826187 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:40.794272 20443 raft_consensus.cc:2749] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:10:40.811765 18609 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:40.833902 18642 raft_consensus.cc:2468] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 7.
I20260709 12:10:40.835419 20763 raft_consensus.cc:2804] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:40.835623 20622 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.835731 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:40.835912 20763 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:40.836535 20763 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:40.836432 20622 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:40.838413 20622 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:40.839432 18638 raft_consensus.cc:2393] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 5: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:40.840636 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:40.841461 18638 raft_consensus.cc:3060] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.761281 20503 rpcz_store.cc:276] 0709 12:10:36.384767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:36.384886 (+   119us) service_pool.cc:224] Handling call
0709 12:10:37.309565 (+924679us) log.cc:844] Serialized 506 byte log entry
0709 12:10:37.373706 (+ 64141us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b540030c5d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b8735 00007f7f51978d29 00007f7f4aef71d4 00007f7f4aef7162 00007f7f4aef7091 00007f7f4aef700c 00007f7f4aef62c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:37.508284 (+134578us) spinlock_profiling.cc:243] Waited 6.43 ms on lock 0x7b18001bda20. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f4983fc0a 00007f7f52f7f219 00007f7f498c7a40 00007f7f498c24e4 00007f7f498c2455 00007f7f4c90bb0b 00007f7f4c990b63 00007f7f4c9b8752 00007f7f51978d29
0709 12:10:38.017171 (+508887us) spinlock_profiling.cc:243] Waited 7.63 ms on lock 0x7b54000d05a0. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c92b142 00007f7f4c90beaa 00007f7f4c912d53 00007f7f4c912cd9 00007f7f4c912c69 00007f7f4c912c31 00007f7f4c911dfd 0000000000388634 0000000000388479 00007f7f498c5475
0709 12:10:38.135739 (+118568us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b2c0005beb8. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4b2aba11 00007f7f4b2baa0a 00007f7f4b2ba693 00007f7f4b2ba631 00007f7f4c9eeb52 00007f7f4c9eecf5 00007f7f4c92b691 00007f7f4c90beaa 00007f7f4c912d53 00007f7f4c912cd9 00007f7f4c912c69
0709 12:10:38.140480 (+  4741us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b1800281a00. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9eed01 00007f7f4c92b691 00007f7f4c90beaa 00007f7f4c912d53 00007f7f4c912cd9 00007f7f4c912c69 00007f7f4c912c31 00007f7f4c911dfd 0000000000388634 0000000000388479
0709 12:10:38.152447 (+ 11967us) spinlock_profiling.cc:243] Waited 597 ms on lock 0x7b1800281a00. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9eed01 00007f7f4c92b691 00007f7f4c90beaa 00007f7f4c912d53 00007f7f4c912cd9 00007f7f4c912c69 00007f7f4c912c31 00007f7f4c911dfd 0000000000388634 0000000000388479
0709 12:10:40.760634 (+2608187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":642103,"raft.queue_time_us":178235,"raft.run_cpu_time_us":22795,"raft.run_wall_time_us":1912383,"spinlock_wait_cycles":3666215424}
I20260709 12:10:40.847967 20503 raft_consensus.cc:3055] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:40.848522 20503 raft_consensus.cc:740] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:40.849370 20503 consensus_queue.cc:260] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:10:40.803246 20732 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:40.857043 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:40.851272 20790 log.cc:927] Time spent T 00000000000000000000000000000000 P b852ae4791e4401b8356c71ae33bbc7d: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:10:40.783910 20775 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:40.750303 20683 consensus_queue.cc:1048] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 12:10:40.814033 20506 raft_consensus.cc:2804] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:40.830854 20698 consensus_meta.cc:287] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.719s	user 0.008s	sys 0.004s
I20260709 12:10:40.654254 20772 consensus_queue.cc:237] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:40.852861 18642 raft_consensus.cc:2468] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:10:40.827756 20750 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:40.870741 17946 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 7.
I20260709 12:10:40.814839 20697 raft_consensus.cc:740] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
W20260709 12:10:40.872248 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 268925us
I20260709 12:10:40.870409 18638 raft_consensus.cc:2468] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
I20260709 12:10:40.877899 18643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60412 (request call id 832) took 1182 ms. Trace:
I20260709 12:10:40.878680 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:40.876575 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:40.882473 18608 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:40.828088 20448 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:40.894011 20607 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:40.905135 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:40.907218 18642 raft_consensus.cc:3060] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:40.915927 18062 leader_election.cc:304] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:40.919937 18641 raft_consensus.cc:2468] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 4.
I20260709 12:10:40.921169 18641 raft_consensus.cc:1240] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:40.923055 18061 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:40.927757 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:40.928575 18639 raft_consensus.cc:2468] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
I20260709 12:10:40.929620 18640 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:40.931921 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:40.932669 17987 leader_election.cc:304] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:40.934952 18641 raft_consensus.cc:1240] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 6. Current term is 7. Ops: [6.9-6.9]
I20260709 12:10:40.896344 20506 raft_consensus.cc:697] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:40.936826 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:40.939214 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:10:40.927896 20725 consensus_meta.cc:287] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.518s	user 0.002s	sys 0.008s
I20260709 12:10:40.907719 20607 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:40.946770 18641 raft_consensus.cc:1240] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:40.944816 18637 raft_consensus.cc:1275] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:40.910416 20621 raft_consensus.cc:697] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:40.919751 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:40.893517 18643 rpcz_store.cc:276] 0709 12:10:39.699270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:39.700363 (+  1093us) service_pool.cc:224] Handling call
0709 12:10:39.745633 (+ 45270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:40.029278 (+283645us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:40.029308 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:40.044032 (+ 14724us) log.cc:844] Serialized 26 byte log entry
0709 12:10:40.357857 (+313825us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:40.451632 (+ 93775us) log.cc:844] Serialized 14 byte log entry
0709 12:10:40.451838 (+   206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:40.451904 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:40.668998 (+217094us) spinlock_profiling.cc:243] Waited 4.71 ms on lock 0x7b4400022b4c. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f497ebc85 00007f7f497ec6a2 00007f7f4c55e1db 00007f7f4c559aaf 00007f7f4c54d86e 00007f7f4c54cbb6 00007f7f4c54c7d8 00007f7f4c556221 00007f7f4c5561d9 00007f7f4c556169
0709 12:10:40.871902 (+202904us) raft_consensus.cc:1685] finished
0709 12:10:40.877665 (+  5763us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:40.877826 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":126156,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":168379,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":11502,"spinlock_wait_cycles":10837760,"thread_start_us":462641,"threads_started":3,"wal-append.queue_time_us":277908}
I20260709 12:10:40.942271 17943 raft_consensus.cc:2468] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:10:40.884208 20698 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:40.951354 17940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44668 (request call id 445) took 1016 ms. Trace:
I20260709 12:10:40.927660 20774 raft_consensus.cc:2804] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:40.934237 20503 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:40.955440 18642 raft_consensus.cc:2468] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 7.
I20260709 12:10:40.893752 20161 consensus_queue.cc:1048] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
W20260709 12:10:40.960851 17914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:40.964862 18640 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 10.
I20260709 12:10:40.967144 18641 raft_consensus.cc:1240] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:40.953812 17940 rpcz_store.cc:276] 0709 12:10:39.934991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:39.966889 (+ 31898us) service_pool.cc:224] Handling call
0709 12:10:39.993440 (+ 26551us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:40.360584 (+367144us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:40.360690 (+   106us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:40.408749 (+ 48059us) log.cc:844] Serialized 26 byte log entry
0709 12:10:40.514770 (+106021us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:40.539870 (+ 25100us) log.cc:844] Serialized 14 byte log entry
0709 12:10:40.540148 (+   278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:40.540245 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:40.951103 (+410858us) raft_consensus.cc:1685] finished
0709 12:10:40.951131 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:40.951284 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1367,"prepare.queue_time_us":25248,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":155895,"raft.run_cpu_time_us":350,"raft.run_wall_time_us":28054,"thread_start_us":373294,"threads_started":2,"wal-append.queue_time_us":240225}
I20260709 12:10:40.938555 20706 raft_consensus.cc:2804] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:40.949484 17894 auto_rebalancer.cc:629] Failed to schedule move for tablet 528748760fc743e3a2bce89e03314aab: Illegal state: Replica 63f5bddeebd84e5788d671a176cfa8e1 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } }
I20260709 12:10:40.971557 18093 raft_consensus.cc:1240] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:40.973798 18090 raft_consensus.cc:1240] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:40.972570 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:40.987185 18019 raft_consensus.cc:2393] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 3: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:40.959342 18635 raft_consensus.cc:3060] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:40.957265 17947 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:44668
I20260709 12:10:40.998945 17947 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:40.999310 17947 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:40.923013 20723 consensus_queue.cc:237] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:40.975023 20781 raft_consensus.cc:2764] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 12:10:40.994084 20434 consensus_meta.cc:287] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.597s	user 0.010s	sys 0.001s
I20260709 12:10:40.938441 20763 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:40.970104 20798 raft_consensus.cc:2804] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:41.011673 18018 raft_consensus.cc:1240] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:10:40.951381 20725 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:41.016263 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 72864.2us
I20260709 12:10:40.988775 20706 raft_consensus.cc:697] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:41.016562 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:41.017674 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:41.001581 20466 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:41.024367 17987 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:40.947881 20697 consensus_queue.cc:260] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:41.027153 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:41.027872 18022 raft_consensus.cc:2393] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 4: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:41.017609 20766 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:41.042527 20793 log.cc:927] Time spent T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 12:10:41.044471 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:41.032904 20801 raft_consensus.cc:2804] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:41.047252 20801 raft_consensus.cc:697] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:41.000905 20804 consensus_queue.cc:1059] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:10:41.023285 20717 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:41.009995 20704 consensus_queue.cc:1059] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:10:41.055601 20607 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:41.059116 20805 consensus_queue.cc:1048] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:10:41.063082 20769 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:41.063354 20763 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:41.052220 17947 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:41.019901 20434 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:41.070122 17912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.023478 20448 consensus_queue.cc:1059] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:10:41.033751 20798 raft_consensus.cc:697] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 4 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:41.074911 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:41.076684 17947 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:41.077628 18608 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:41.091385 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:41.102135 18097 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:41.052757 20774 raft_consensus.cc:697] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
W20260709 12:10:41.105962 17894 auto_rebalancer.cc:629] Failed to schedule move for tablet ee9612b75b8d458dab1e3d254afae227: Illegal state: Replica 63f5bddeebd84e5788d671a176cfa8e1 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } }
I20260709 12:10:41.021036 20621 consensus_queue.cc:237] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:41.107663 18095 raft_consensus.cc:1240] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:41.111809 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:41.030043 20506 consensus_queue.cc:237] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:41.115361 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 71177.2us
I20260709 12:10:41.103660 20697 raft_consensus.cc:3060] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:41.122308 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:41.125208 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 91828.4us
I20260709 12:10:41.098281 20808 consensus_queue.cc:1059] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 12:10:41.132865 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:41.120138 20704 raft_consensus.cc:3055] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:41.102576 20807 consensus_queue.cc:1059] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:10:41.127173 20779 raft_consensus.cc:3055] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:41.140865 20779 raft_consensus.cc:740] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:41.137181 20704 raft_consensus.cc:740] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:41.125064 20809 raft_consensus.cc:2804] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:41.146795 18062 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:41.144014 20704 consensus_queue.cc:260] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:41.133282 20801 consensus_queue.cc:237] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:41.152297 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:41.153055 18018 raft_consensus.cc:2393] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 6: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:41.142242 20779 consensus_queue.cc:260] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:41.113849 20706 consensus_queue.cc:237] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:41.156015 20779 raft_consensus.cc:3060] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:41.133494 20698 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:41.129292 20805 consensus_queue.cc:1059] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:10:41.161056 18635 raft_consensus.cc:2468] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 7.
I20260709 12:10:41.154603 20774 consensus_queue.cc:237] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:41.161842 18641 raft_consensus.cc:1240] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:41.163105 20796 log.cc:927] Time spent T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 12:10:41.139226 20811 ts_tablet_manager.cc:933] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:41.173511 18089 raft_consensus.cc:1240] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:41.167158 20809 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:41.176812 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:41.186775 20725 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:41.188279 20541 raft_consensus.cc:3055] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:41.188685 20541 raft_consensus.cc:740] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:41.188742 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:41.189561 20541 consensus_queue.cc:260] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:41.172317 20704 raft_consensus.cc:3060] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:41.191916 17912 leader_election.cc:304] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:41.193033 17912 leader_election.cc:304] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:41.194099 17912 leader_election.cc:304] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:41.195405 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:41.196092 18021 raft_consensus.cc:2368] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 5. Current term is 6.
I20260709 12:10:41.196724 18640 raft_consensus.cc:1240] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:10:41.196674 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:41.205572 18642 raft_consensus.cc:2468] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3.
W20260709 12:10:41.205699 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 58986.7us
I20260709 12:10:41.198019 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:41.206904 18640 raft_consensus.cc:3055] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:41.207209 18640 raft_consensus.cc:740] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:41.190557 20541 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:41.215205 17912 leader_election.cc:304] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:41.219738 18062 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:41.220641 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.173115 20810 consensus_queue.cc:1059] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:10:41.222440 18642 raft_consensus.cc:1275] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:10:41.224961 20434 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:41.227540 18640 consensus_queue.cc:260] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:41.228828 18640 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:41.233256 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:41.233875 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:41.235996 18019 raft_consensus.cc:1240] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:10:41.237038 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:41.237797 18019 raft_consensus.cc:2410] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:10:41.239110 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:41.240273 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:41.241469 18018 raft_consensus.cc:1240] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:41.241891 17831 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 4ccf0bcc20ae40e79c32530091613e1e with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:10:41.238490 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:41.248121 18097 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 8.
I20260709 12:10:41.250339 17912 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:41.254169 18016 raft_consensus.cc:2468] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 5.
I20260709 12:10:41.257094 17987 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:41.183331 20809 raft_consensus.cc:3060] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:41.260922 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:41.204363 20769 raft_consensus.cc:2804] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:41.265676 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:41.271322 18016 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:41.263505 20466 raft_consensus.cc:2804] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:41.267038 18636 raft_consensus.cc:1275] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:41.276065 20606 raft_consensus.cc:2804] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:41.276774 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:41.267127 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:41.277587 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:41.268131 20446 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:41.255261 20448 raft_consensus.cc:2749] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:41.211118 20439 raft_consensus.cc:2804] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:41.273729 18640 raft_consensus.cc:2468] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
I20260709 12:10:41.274324 18638 raft_consensus.cc:1240] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:41.272018 20466 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:41.298821 20466 raft_consensus.cc:3060] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:41.302858 20446 consensus_queue.cc:1048] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:41.273196 20683 consensus_queue.cc:1048] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:10:41.279093 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:41.287003 20439 raft_consensus.cc:697] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:41.304234 18020 raft_consensus.cc:3060] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:41.279585 18019 raft_consensus.cc:3060] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:41.304786 20439 consensus_queue.cc:237] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.9, Last appended by leader: 9, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:41.217447 20772 raft_consensus.cc:2804] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:41.283281 18018 raft_consensus.cc:1275] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 12:10:41.284291 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:41.270509 20698 raft_consensus.cc:2804] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:41.283398 20606 raft_consensus.cc:697] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
W20260709 12:10:41.369365 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 74007.8us
I20260709 12:10:41.297227 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:41.294996 18024 raft_consensus.cc:2468] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 5.
I20260709 12:10:41.286715 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
W20260709 12:10:41.350632 17989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.339613 18018 pending_rounds.cc:85] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb: Aborting all ops after (but not including) 4
I20260709 12:10:41.371227 18018 pending_rounds.cc:107] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 12:10:41.297664 18016 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 7.
W20260709 12:10:41.296430 18062 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.369803 17914 leader_election.cc:400] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 election: Vote denied by peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931) with higher term. Message: Invalid argument: T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 5. Current term is 6.
I20260709 12:10:41.175066 20798 consensus_queue.cc:237] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:41.260694 20766 consensus_queue.cc:1059] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 12:10:41.254603 20637 consensus_queue.cc:1059] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.117s
I20260709 12:10:41.371539 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:41.384899 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:41.385218 18643 raft_consensus.cc:2393] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 6: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
W20260709 12:10:41.438009 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.447490 18095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41818 (request call id 784) took 1237 ms. Trace:
I20260709 12:10:41.447854 18095 rpcz_store.cc:276] 0709 12:10:40.210087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.211107 (+  1020us) service_pool.cc:224] Handling call
0709 12:10:40.211389 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:41.114774 (+903385us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:41.447283 (+332509us) spinlock_profiling.cc:243] Waited 894 ms on lock 0x7b5400144bd4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:41.447440 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2056907008}
W20260709 12:10:41.284931 17912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.454128 17912 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:41.371474 18018 raft_consensus.cc:2889] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:41.290342 20780 log.cc:927] Time spent T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.584s	user 0.004s	sys 0.001s
W20260709 12:10:41.288837 20794 log.cc:927] Time spent T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.296s	user 0.000s	sys 0.001s
I20260709 12:10:41.479660 17914 leader_election.cc:403] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 12:10:41.381661 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.285645 20769 raft_consensus.cc:697] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:41.514855 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
W20260709 12:10:41.531798 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 80759.4us
I20260709 12:10:41.535451 18021 raft_consensus.cc:2368] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 5. Current term is 6.
W20260709 12:10:41.532172 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 237714us
I20260709 12:10:41.440310 18015 raft_consensus.cc:2410] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:10:41.504528 18019 raft_consensus.cc:2410] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:41.540197 20596 raft_consensus.cc:2749] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931) with higher term. Message: Invalid argument: T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 5. Current term is 6.
I20260709 12:10:41.540648 20606 consensus_queue.cc:237] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:41.541996 20822 log.cc:927] Time spent T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
W20260709 12:10:41.541122 20828 log.cc:927] Time spent T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
W20260709 12:10:41.551190 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 97169.4us
I20260709 12:10:41.555375 17914 leader_election.cc:400] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931) with higher term. Message: Invalid argument: T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 2. Current term is 3.
I20260709 12:10:41.384649 20819 raft_consensus.cc:2804] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:41.485843 20698 raft_consensus.cc:697] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:41.385577 20772 raft_consensus.cc:697] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
W20260709 12:10:41.558403 17912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.514403 20774 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:41.560072 18020 raft_consensus.cc:2468] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
I20260709 12:10:41.560272 17914 leader_election.cc:403] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:10:41.567808 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.577746 17940 raft_consensus.cc:1240] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:41.559780 20766 raft_consensus.cc:2804] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:41.559031 20596 raft_consensus.cc:493] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.543488 20506 consensus_queue.cc:1048] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
W20260709 12:10:41.587469 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.588431 17945 raft_consensus.cc:1240] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 7. Current term is 8. Ops: [7.9-7.9]
W20260709 12:10:41.589598 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.551438 20491 consensus_queue.cc:1048] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:10:41.590883 18095 raft_consensus.cc:1240] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:41.591624 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:41.598970 18093 raft_consensus.cc:2393] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 3: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:41.597864 18609 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:41.607617 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:41.575022 20819 raft_consensus.cc:697] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:41.612059 17945 raft_consensus.cc:1240] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:41.561579 20469 consensus_queue.cc:1059] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:10:41.618536 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
W20260709 12:10:41.621447 17913 leader_election.cc:336] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 1.814s (SENT)
I20260709 12:10:41.622030 17913 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:41.622867 18610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:41.623800 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 152050us
I20260709 12:10:41.624831 18062 leader_election.cc:304] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:41.626405 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:41.598812 20766 raft_consensus.cc:697] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:41.603181 20386 raft_consensus.cc:2749] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931) with higher term. Message: Invalid argument: T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 2. Current term is 3.
I20260709 12:10:41.570487 20774 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:41.632717 18062 leader_election.cc:304] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:41.653563 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.617470 20817 raft_consensus.cc:2804] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:41.598827 20596 raft_consensus.cc:515] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:41.667586 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:41.632369 20644 raft_consensus.cc:2749] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:41.602288 20811 tablet_copy_client.cc:323] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.194:36297
I20260709 12:10:41.663523 20817 raft_consensus.cc:697] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 8 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:41.663592 20779 consensus_queue.cc:1059] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:41.665185 18089 raft_consensus.cc:1240] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:41.666432 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:41.687695 18092 raft_consensus.cc:2468] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
I20260709 12:10:41.662982 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
W20260709 12:10:41.662977 20826 log.cc:927] Time spent T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:10:41.677906 18020 raft_consensus.cc:1275] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:41.678594 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:41.662129 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:41.687673 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:41.660495 20637 raft_consensus.cc:2804] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:41.701587 18091 raft_consensus.cc:2393] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 6: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:41.707899 18018 raft_consensus.cc:1240] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:41.616590 20769 consensus_queue.cc:237] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:41.676546 20804 consensus_queue.cc:1059] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:10:41.726255 18644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60424 (request call id 816) took 1712 ms. Trace:
I20260709 12:10:41.657823 20698 consensus_queue.cc:237] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:41.725174 20637 raft_consensus.cc:697] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:41.735510 20637 consensus_queue.cc:237] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:41.735991 20596 leader_election.cc:290] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:41.737435 18095 raft_consensus.cc:2468] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
W20260709 12:10:41.729368 17914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.727063 18644 rpcz_store.cc:276] 0709 12:10:40.014146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.141944 (+127798us) service_pool.cc:224] Handling call
0709 12:10:40.153325 (+ 11381us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:10:40.167234 (+ 13909us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:40.167278 (+    44us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:10:40.182097 (+ 14819us) log.cc:844] Serialized 78 byte log entry
0709 12:10:40.392454 (+210357us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:10:40.437625 (+ 45171us) log.cc:844] Serialized 14 byte log entry
0709 12:10:40.438270 (+   645us) log.cc:844] Serialized 14 byte log entry
0709 12:10:40.442079 (+  3809us) log.cc:844] Serialized 14 byte log entry
0709 12:10:40.442769 (+   690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:40.442863 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:40.500462 (+ 57599us) spinlock_profiling.cc:243] Waited 4.52 ms on lock 0x7b1800380500. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f498c5522 00007f7f498c77c1 00007f7f498c7779 00007f7f498c7709 00007f7f498c76d1 00007f7f498c69cd 0000000000388634 0000000000388479 00007f7f498a883a
0709 12:10:40.705495 (+205033us) spinlock_profiling.cc:243] Waited 6.45 ms on lock 0x7b1800380500. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f498932a6 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f498c53f3 00007f7f498c77c1
0709 12:10:40.706121 (+   626us) spinlock_profiling.cc:243] Waited 4.12 ms on lock 0x7b1800380500. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f498c53f3 00007f7f498c77c1 00007f7f498c7779 00007f7f498c7709 00007f7f498c76d1 00007f7f498c69cd 0000000000388634 0000000000388479 00007f7f498a883a
0709 12:10:40.741671 (+ 35550us) spinlock_profiling.cc:243] Waited 4.5 ms on lock 0x7b1800380500. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f498c5557 00007f7f498c77c1 00007f7f498c7779 00007f7f498c7709 00007f7f498c76d1 00007f7f498c69cd 0000000000388634 0000000000388479 00007f7f498a883a
0709 12:10:41.290100 (+548429us) spinlock_profiling.cc:243] Waited 31.6 ms on lock 0x7b2400364898. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4974b9c4 00007f7f49749acb 00007f7f49904dc9 00007f7f49904a55 00007f7f4990409d 00007f7f4c53610e 00007f7f4c54d88c 00007f7f4c54cbb6 00007f7f4c54c7d8 00007f7f4c556221
0709 12:10:41.726023 (+435923us) raft_consensus.cc:1685] finished
0709 12:10:41.726042 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:41.726197 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21105,"prepare.queue_time_us":180752,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":23639,"raft.run_cpu_time_us":525,"raft.run_wall_time_us":21224,"spinlock_wait_cycles":117696384,"thread_start_us":218990,"threads_started":2,"wal-append.queue_time_us":244100}
W20260709 12:10:41.730453 20830 log.cc:927] Time spent T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:10:41.730700 20817 consensus_queue.cc:237] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:41.731621 20774 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:41.738195 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 116781us
I20260709 12:10:41.660771 20772 consensus_queue.cc:237] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:41.756211 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:41.745831 17913 leader_election.cc:336] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 1.827s (SENT)
I20260709 12:10:41.756932 17913 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:41.753705 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:41.754828 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:41.751209 20523 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.772151 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:41.774555 18018 raft_consensus.cc:2393] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 5: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:41.803112 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:41.803396 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:41.804234 18022 raft_consensus.cc:2468] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 6.
I20260709 12:10:41.741722 20439 raft_consensus.cc:2749] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:41.746197 20596 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.812084 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:41.824191 18022 raft_consensus.cc:3060] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:41.826920 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:41.827291 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:41.822748 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:41.827960 18020 raft_consensus.cc:2393] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 5: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:41.807301 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:41.830081 18018 raft_consensus.cc:2393] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 7: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
W20260709 12:10:41.830824 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 85217.2us
W20260709 12:10:41.807830 20827 log.cc:927] Time spent T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 12:10:41.835245 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:41.835767 17943 raft_consensus.cc:1275] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:41.833860 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:41.839927 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:41.840940 18018 raft_consensus.cc:1240] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:41.841756 18023 raft_consensus.cc:1240] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:41.848109 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.850237 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:41.849133 18018 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3cdd445b25e5404da2f578c388210925"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
 from {username='slave'} at 127.0.0.1:53022
I20260709 12:10:41.852344 18018 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:10:41.852726 18018 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:41.848942 18062 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:41.854568 20779 raft_consensus.cc:2804] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:41.855136 20779 raft_consensus.cc:697] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
W20260709 12:10:41.855157 20704 consensus_meta.cc:287] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.658s	user 0.011s	sys 0.000s
I20260709 12:10:41.856125 20779 consensus_queue.cc:237] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:41.774864 20523 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:41.775648 20766 consensus_queue.cc:237] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:41.861265 17914 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:41.879372 18023 raft_consensus.cc:2393] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 5: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
W20260709 12:10:41.876456 17989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.867409 18022 raft_consensus.cc:2468] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 9.
I20260709 12:10:41.869056 18093 raft_consensus.cc:2468] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 7.
I20260709 12:10:41.881218 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:41.884092 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:41.875264 17913 leader_election.cc:304] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:41.726423 20819 consensus_queue.cc:237] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:41.887060 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
W20260709 12:10:41.863270 20841 log.cc:927] Time spent T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:10:41.832123 20596 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:41.906586 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:41.911114 18019 raft_consensus.cc:1240] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:41.913419 17947 raft_consensus.cc:2468] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
I20260709 12:10:41.876441 20716 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:41.874118 20236 raft_consensus.cc:3055] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:41.909338 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:41.920305 18022 raft_consensus.cc:3060] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:41.909297 18023 raft_consensus.cc:1240] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 LEADER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:41.915072 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:41.866556 20842 raft_consensus.cc:2749] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:41.917924 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:41.918016 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:10:41.998672 18610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.872877 20850 consensus_queue.cc:1059] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:10:41.973395 17945 raft_consensus.cc:2468] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
I20260709 12:10:42.025470 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:42.025825 20855 raft_consensus.cc:2804] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:42.026265 20855 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:42.026630 20855 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:42.026712 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:42.027472 18023 raft_consensus.cc:2393] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 5: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:42.028688 20557 raft_consensus.cc:493] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:42.029186 20557 raft_consensus.cc:515] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:42.030757 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.031272 20557 leader_election.cc:290] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:42.031921 20523 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:42.032582 20523 raft_consensus.cc:493] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.033092 20523 raft_consensus.cc:515] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:42.034341 18022 raft_consensus.cc:2468] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
I20260709 12:10:41.920117 20236 raft_consensus.cc:740] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:42.036233 20596 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:42.036935 20236 consensus_queue.cc:260] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:42.038239 20236 raft_consensus.cc:3060] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:41.927870 20716 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:42.040277 18023 raft_consensus.cc:1275] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:42.047128 20850 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.046893 20802 raft_consensus.cc:3055] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:42.047763 20802 raft_consensus.cc:740] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:42.047637 20850 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:42.048602 20802 consensus_queue.cc:260] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:42.049708 20802 raft_consensus.cc:3060] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:42.051785 18062 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:41.860381 20854 consensus_queue.cc:1048] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.147s
W20260709 12:10:42.050940 20823 log.cc:927] Time spent T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.609s	user 0.000s	sys 0.001s
I20260709 12:10:42.067209 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:42.068257 17943 raft_consensus.cc:2393] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 7: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:41.973693 20844 raft_consensus.cc:2749] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:42.101095 20466 consensus_meta.cc:287] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.802s	user 0.012s	sys 0.005s
I20260709 12:10:42.101733 20466 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:42.104391 20466 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:42.107698 18639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60412 (request call id 851) took 1419 ms. Trace:
W20260709 12:10:42.092183 20809 consensus_meta.cc:287] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.807s	user 0.009s	sys 0.000s
I20260709 12:10:42.092759 20839 raft_consensus.cc:3055] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:42.108213 18639 rpcz_store.cc:276] 0709 12:10:40.688525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.929899 (+241374us) service_pool.cc:224] Handling call
0709 12:10:40.930228 (+   329us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:41.026067 (+ 95839us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:41.026098 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:41.030714 (+  4616us) log.cc:844] Serialized 52 byte log entry
0709 12:10:41.195379 (+164665us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:41.259935 (+ 64556us) log.cc:844] Serialized 14 byte log entry
0709 12:10:41.260205 (+   270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:41.260304 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:42.050279 (+789975us) spinlock_profiling.cc:243] Waited 55.8 ms on lock 0x7b4400022b4c. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f497ebc85 00007f7f497ec6a2 00007f7f4c55e1db 00007f7f4c559aaf 00007f7f4c54d86e 00007f7f4c54cbb6 00007f7f4c54c7d8 00007f7f4c556221 00007f7f4c5561d9 00007f7f4c556169
0709 12:10:42.098033 (+ 47754us) raft_consensus.cc:1685] finished
0709 12:10:42.098143 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:42.107604 (+  9461us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":65252,"raft.queue_time_us":87289,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":20764,"spinlock_wait_cycles":135431808,"thread_start_us":215477,"threads_started":2,"wal-append.queue_time_us":225087}
W20260709 12:10:42.118580 17989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.118934 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:42.050387 20850 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:42.160974 18022 raft_consensus.cc:2393] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 8: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
W20260709 12:10:42.164966 17988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.149534 18018 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:42.175465 17943 raft_consensus.cc:1240] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 LEADER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:42.191398 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:42.120147 20839 raft_consensus.cc:740] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:42.193871 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:42.127804 20716 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:42.195127 17943 raft_consensus.cc:2468] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
I20260709 12:10:42.195930 18018 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:42.196664 20853 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:42.220010 17940 raft_consensus.cc:1240] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 LEADER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:42.136794 20809 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:42.229547 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:42.230212 17947 raft_consensus.cc:2468] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
I20260709 12:10:42.231319 20523 leader_election.cc:290] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:42.228468 20853 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:42.267182 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:42.268193 17946 raft_consensus.cc:2393] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 6: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:42.270481 20853 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:42.271131 20809 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:42.275262 18091 raft_consensus.cc:3055] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:42.275632 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:42.275756 18091 raft_consensus.cc:740] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:42.275075 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:42.277949 18091 consensus_queue.cc:260] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:42.283210 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:42.286532 18091 raft_consensus.cc:3060] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.296902 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:42.297513 17946 raft_consensus.cc:3060] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.315673 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:10:42.319815 20862 log.cc:927] Time spent T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:10:42.318979 20855 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:42.328842 20855 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:42.374258 18091 raft_consensus.cc:1275] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:10:42.439600 18610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:42.454653 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.475193 17947 raft_consensus.cc:1240] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:10:42.476574 17949 raft_consensus.cc:1275] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:42.484642 20839 consensus_queue.cc:260] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:42.485411 17949 raft_consensus.cc:1240] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:42.485651 20839 raft_consensus.cc:3060] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:42.477102 20622 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:42.487207 20622 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:42.478542 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:42.488776 17947 raft_consensus.cc:2393] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 3: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:42.486464 17949 raft_consensus.cc:3055] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:42.490121 17949 raft_consensus.cc:740] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:42.475855 17946 raft_consensus.cc:2468] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
W20260709 12:10:42.482417 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.479058 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
W20260709 12:10:42.502043 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.506597 20622 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:42.508204 17949 consensus_queue.cc:260] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:42.511240 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:42.512099 17946 raft_consensus.cc:2468] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:42.513221 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:42.513959 17946 raft_consensus.cc:2468] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
I20260709 12:10:42.515727 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:42.516824 18022 raft_consensus.cc:2410] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 7 because replica has last-logged OpId of term: 6 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:10:42.522718 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:10:42.524631 17989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.526664 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:42.525838 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:42.531010 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:42.531566 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:42.532294 18018 raft_consensus.cc:2393] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 6: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:42.533574 17913 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:42.536074 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:42.533517 20769 raft_consensus.cc:493] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:42.537113 17988 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:42.538602 17988 leader_election.cc:304] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:42.502965 20805 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:42.542454 17988 leader_election.cc:304] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:42.531206 20503 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.543751 18089 raft_consensus.cc:1275] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:42.543102 17946 raft_consensus.cc:1275] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:10:42.544245 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:42.546066 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:42.544775 17988 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:42.547537 18097 raft_consensus.cc:3055] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:42.547964 18097 raft_consensus.cc:740] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:42.541320 20769 raft_consensus.cc:515] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:42.549739 20503 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:42.551822 20769 leader_election.cc:290] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:42.543380 20805 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:10:42.553364 20864 raft_consensus.cc:2749] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:42.554246 18020 raft_consensus.cc:2468] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3.
I20260709 12:10:42.555418 17988 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:42.556372 17988 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:42.557166 17988 leader_election.cc:304] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:42.553802 20805 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123)
I20260709 12:10:42.551774 20503 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:42.561475 17988 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:42.562240 20446 raft_consensus.cc:2764] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:10:42.562357 20697 raft_consensus.cc:2804] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:42.562780 20697 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:42.562964 20446 raft_consensus.cc:2749] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:42.563175 20697 raft_consensus.cc:3060] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:42.542889 20866 raft_consensus.cc:2804] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:42.567188 20866 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:42.567669 20866 raft_consensus.cc:3060] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:42.568169 18098 raft_consensus.cc:1275] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:42.543473 20865 raft_consensus.cc:2804] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:42.571069 20865 raft_consensus.cc:493] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:42.571557 20865 raft_consensus.cc:3060] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:42.575290 18024 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45464 (request call id 1756) took 1449 ms (client timeout 1536 ms). Trace:
W20260709 12:10:42.575712 18024 rpcz_store.cc:269] 0709 12:10:41.125680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.125792 (+   112us) service_pool.cc:224] Handling call
0709 12:10:42.575120 (+1449328us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b5400320354. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:42.575214 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":367633152}
I20260709 12:10:42.578979 20161 raft_consensus.cc:3055] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:42.579543 20161 raft_consensus.cc:740] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:42.580612 20161 consensus_queue.cc:260] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:42.581982 20161 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:42.584232 17912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.584829 20697 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:42.589068 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:42.591624 20697 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:42.592257 18015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45464 (request call id 1767) took 1358 ms. Trace:
I20260709 12:10:42.593051 18015 rpcz_store.cc:276] 0709 12:10:41.233454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.233593 (+   139us) service_pool.cc:224] Handling call
0709 12:10:42.591991 (+1358398us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b540030c5d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:42.592182 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":437541120}
I20260709 12:10:42.593532 20797 raft_consensus.cc:3055] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:42.594097 20797 raft_consensus.cc:740] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:42.595222 20797 consensus_queue.cc:260] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:42.596599 20797 raft_consensus.cc:3060] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.600764 17940 raft_consensus.cc:1240] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 12:10:42.558423 20716 raft_consensus.cc:2749] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:42.554495 20766 raft_consensus.cc:2749] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:42.558188 20443 raft_consensus.cc:2749] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:42.539176 20523 consensus_queue.cc:1059] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
W20260709 12:10:42.605279 18607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.605639 20523 raft_consensus.cc:3055] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:42.605998 20523 raft_consensus.cc:740] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:42.606846 20523 consensus_queue.cc:260] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:42.607977 20523 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:42.608451 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:42.609483 18635 raft_consensus.cc:2410] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:42.612238 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:42.612921 17949 raft_consensus.cc:3060] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:42.613267 18637 raft_consensus.cc:2410] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:10:42.614282 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:42.615007 18642 raft_consensus.cc:2468] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 9.
I20260709 12:10:42.616516 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:42.617400 18643 raft_consensus.cc:1240] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:42.548849 18097 consensus_queue.cc:260] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:42.623481 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:42.624208 17947 raft_consensus.cc:2468] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:42.625290 18097 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:42.629838 18643 raft_consensus.cc:1275] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:10:42.630556 17912 leader_election.cc:304] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:42.630834 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:42.631702 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:42.632000 17912 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:42.632265 18639 raft_consensus.cc:3060] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:42.633075 17912 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:42.633191 17949 raft_consensus.cc:1275] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:10:42.633450 20769 raft_consensus.cc:2749] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:42.633600 17949 pending_rounds.cc:85] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1: Aborting all ops after (but not including) 7
I20260709 12:10:42.633942 17949 pending_rounds.cc:107] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:10:42.634181 17949 raft_consensus.cc:2889] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:42.634141 20769 raft_consensus.cc:2749] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:42.632158 18637 raft_consensus.cc:1240] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:42.635783 17831 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 4ccf0bcc20ae40e79c32530091613e1e with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:10:42.634491 20850 raft_consensus.cc:2804] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:42.642870 18097 raft_consensus.cc:2410] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:10:42.647811 17946 raft_consensus.cc:1275] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:10:42.650085 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 116633us
I20260709 12:10:42.659013 17913 leader_election.cc:304] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:42.645117 20850 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.660552 18639 raft_consensus.cc:2468] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 4.
W20260709 12:10:42.677480 18608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:42.682008 20506 raft_consensus.cc:2749] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:42.687060 20866 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:42.687469 18093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53964 (request call id 1714) took 1025 ms. Trace:
I20260709 12:10:42.688015 18093 rpcz_store.cc:276] 0709 12:10:41.662059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.662183 (+   124us) service_pool.cc:224] Handling call
0709 12:10:42.687219 (+1025036us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b540015efd4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:42.687364 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":370261888}
I20260709 12:10:42.689754 18095 raft_consensus.cc:1275] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 10. (index mismatch)
I20260709 12:10:42.689926 20866 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:42.691962 17912 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:42.692792 20386 raft_consensus.cc:2804] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:10:42.697237 18608 connection.cc:256] RPC call timeout handler was delayed by -1.2329828859999452s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24860000000000004s for a response
W20260709 12:10:42.698879 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 137498us
I20260709 12:10:42.699009 18639 raft_consensus.cc:1275] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:10:42.700775 18608 connection.cc:256] RPC call timeout handler was delayed by -1.1386986070001512s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19690000000000002s for a response
W20260709 12:10:42.701145 18608 connection.cc:256] RPC call timeout handler was delayed by -1.1015828859999601s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26320000000000005s for a response
I20260709 12:10:42.704587 17988 leader_election.cc:304] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:42.669302 20850 raft_consensus.cc:3060] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:42.693266 20386 raft_consensus.cc:697] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:42.720620 17988 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:42.662784 20769 consensus_queue.cc:1048] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:10:42.661098 20606 consensus_queue.cc:1059] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:10:42.730440 20716 raft_consensus.cc:2804] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:42.735981 18015 raft_consensus.cc:1275] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:42.736093 20716 raft_consensus.cc:697] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:42.737211 20503 raft_consensus.cc:493] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.737274 20716 consensus_queue.cc:237] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:42.737812 20503 raft_consensus.cc:515] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:42.739177 20801 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.739881 20503 leader_election.cc:290] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:42.739660 20801 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:10:42.728924 20697 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:42.741611 20697 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:42.742020 20801 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:42.742818 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:42.743621 20697 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:42.744999 18033 tablet_copy_service.cc:140] P c5ffa786c8fb43f7864fa8fbe76534cb: Received BeginTabletCopySession request for tablet 137ed415b9d242989f28f349c1618c74 from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:53022)
I20260709 12:10:42.745575 18033 tablet_copy_service.cc:161] P c5ffa786c8fb43f7864fa8fbe76534cb: Beginning new tablet copy session on tablet 137ed415b9d242989f28f349c1618c74 from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:53022: session id = e28f77912a9c4ba2b9841f6fedddc2db-137ed415b9d242989f28f349c1618c74
I20260709 12:10:42.745728 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:42.746145 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:42.746390 18019 raft_consensus.cc:2468] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 6.
I20260709 12:10:42.746758 18015 raft_consensus.cc:3060] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:42.747440 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:42.748054 18093 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 7.
I20260709 12:10:42.748747 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:42.749342 18018 raft_consensus.cc:2468] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 9.
I20260709 12:10:42.750967 18641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60412 (request call id 856) took 1750 ms. Trace:
I20260709 12:10:42.751334 18641 rpcz_store.cc:276] 0709 12:10:41.000165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.000311 (+   146us) service_pool.cc:224] Handling call
0709 12:10:41.161662 (+161351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:41.162189 (+   527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:42.750769 (+1588580us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54001fbdd0. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b18ad 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:42.750895 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":331849088}
I20260709 12:10:42.715742 20557 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:42.753268 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:42.754890 18018 raft_consensus.cc:1240] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:10:42.755867 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:42.757452 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:42.717629 20732 raft_consensus.cc:493] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:42.758283 18017 raft_consensus.cc:2393] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 4: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:42.723439 20698 raft_consensus.cc:2749] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:10:42.766007 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:42.767577 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:42.769162 18033 tablet_copy_source_session.cc:215] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:10:42.769321 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:42.770092 18023 raft_consensus.cc:2468] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 5.
I20260709 12:10:42.771956 20683 raft_consensus.cc:3055] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:42.772372 20683 raft_consensus.cc:740] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:42.773123 20683 consensus_queue.cc:260] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:42.774286 20683 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:42.775127 20557 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:42.783258 18015 raft_consensus.cc:2468] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
I20260709 12:10:42.764158 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:42.717785 20775 consensus_queue.cc:1048] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:10:42.718588 20523 consensus_queue.cc:1059] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:10:42.785239 17989 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:42.733511 20621 raft_consensus.cc:493] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:42.801420 18022 raft_consensus.cc:2368] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 2. Current term is 3.
I20260709 12:10:42.803750 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:42.778455 20557 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:42.800976 20161 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:42.809895 20698 raft_consensus.cc:2749] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:42.810040 20161 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:42.808257 20697 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:42.811193 20697 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:42.812255 20161 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:42.813289 20697 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:42.814046 20707 raft_consensus.cc:3055] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:42.814460 20707 raft_consensus.cc:740] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:42.753553 20469 consensus_queue.cc:1048] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:10:42.781337 20732 raft_consensus.cc:515] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:42.833909 20698 raft_consensus.cc:493] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:42.834498 20698 raft_consensus.cc:515] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:42.836696 20698 leader_election.cc:290] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:42.820405 20697 consensus_queue.cc:1048] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:10:42.837469 20707 consensus_queue.cc:260] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:42.807530 20621 raft_consensus.cc:515] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:42.847245 17989 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:42.845305 20707 raft_consensus.cc:3060] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:42.816156 20386 consensus_queue.cc:237] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:42.861843 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:42.871671 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:42.844365 20864 consensus_queue.cc:1048] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:10:42.877414 17945 raft_consensus.cc:1275] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:42.888370 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:42.889209 17948 raft_consensus.cc:3060] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:42.864758 20866 raft_consensus.cc:2804] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:42.876199 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:10:42.899248 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 240322us
I20260709 12:10:42.900075 17913 leader_election.cc:400] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 election: Vote denied by peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297) with higher term. Message: Invalid argument: T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 5. Current term is 6.
I20260709 12:10:42.905921 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:42.909226 17913 leader_election.cc:304] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:42.910306 18637 raft_consensus.cc:1240] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:42.911770 18637 raft_consensus.cc:1240] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 LEADER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 12:10:42.913084 18642 raft_consensus.cc:1275] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:42.914418 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:42.916846 17948 raft_consensus.cc:2468] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
I20260709 12:10:42.896946 20866 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:42.918391 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:42.925084 18643 raft_consensus.cc:1275] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 12:10:42.925406 18643 pending_rounds.cc:85] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db: Aborting all ops after (but not including) 8
I20260709 12:10:42.925637 18643 pending_rounds.cc:107] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 12:10:42.925846 18643 raft_consensus.cc:2889] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:42.928551 17913 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:42.927313 20769 raft_consensus.cc:2749] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:42.929821 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:42.930581 18640 raft_consensus.cc:2393] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 5: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:42.984323 17913 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:42.919987 20866 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:42.989064 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 47244.7us
I20260709 12:10:42.992372 17913 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:43.003340 17913 leader_election.cc:304] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:43.004068 18640 raft_consensus.cc:1275] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:43.005679 18640 raft_consensus.cc:1275] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:10:42.989682 20869 log.cc:927] Time spent T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.725s	user 0.002s	sys 0.002s
I20260709 12:10:43.010465 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: true dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:43.012163 17988 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:43.013779 18640 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:43.014549 17988 leader_election.cc:304] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:43.014814 18021 raft_consensus.cc:1240] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 LEADER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:43.016014 17988 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:43.016130 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:42.984813 20885 raft_consensus.cc:2749] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:43.001808 20769 raft_consensus.cc:3060] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:43.002889 20891 raft_consensus.cc:493] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.015285 20469 raft_consensus.cc:2764] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:43.003263 20886 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
W20260709 12:10:43.044891 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:43.045624 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.021040 20716 raft_consensus.cc:2764] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:43.011596 20880 raft_consensus.cc:2749] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:43.023650 20698 raft_consensus.cc:2804] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:43.062616 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:43.054579 18640 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
W20260709 12:10:43.037258 20821 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:10:43.058991 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:43.065876 17941 raft_consensus.cc:3060] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:43.059010 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:43.059209 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:43.059729 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:43.067202 17945 raft_consensus.cc:3060] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:43.059026 20900 consensus_queue.cc:1048] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:10:43.060026 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:43.068390 17947 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 7.
I20260709 12:10:43.025522 18636 raft_consensus.cc:1275] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:43.026155 20732 leader_election.cc:290] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:43.069249 18642 raft_consensus.cc:1275] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:10:43.062374 17914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.029505 20864 raft_consensus.cc:2749] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:10:43.054379 18610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:43.072613 18607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.063723 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:43.057096 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:43.073700 18640 raft_consensus.cc:2393] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 4: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
W20260709 12:10:43.064759 17989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.060848 20901 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:43.045676 20891 raft_consensus.cc:515] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:43.076167 20901 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:43.078231 20901 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:43.088236 20849 log.cc:927] Time spent T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 1.226s	user 0.012s	sys 0.007s
I20260709 12:10:43.089764 18638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60430 (request call id 616) took 1629 ms. Trace:
W20260709 12:10:43.090951 20879 log.cc:927] Time spent T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 12:10:43.090133 18638 rpcz_store.cc:276] 0709 12:10:41.460375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.460493 (+   118us) service_pool.cc:224] Handling call
0709 12:10:41.534372 (+ 73879us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:41.559543 (+ 25171us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:41.559582 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:41.593877 (+ 34295us) log.cc:844] Serialized 26 byte log entry
0709 12:10:41.729794 (+135917us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:41.738164 (+  8370us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:41.738260 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:43.087959 (+1349699us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b2400369008. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4974b9c4 00007f7f49749acb 00007f7f49904dc9 00007f7f49904a55 00007f7f4990409d 00007f7f4c53610e 00007f7f4c54d88c 00007f7f4c54cbb6 00007f7f4c54c7d8 00007f7f4c556221
0709 12:10:43.089473 (+  1514us) raft_consensus.cc:1685] finished
0709 12:10:43.089494 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:43.089700 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11548,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":21595,"spinlock_wait_cycles":38887168,"thread_start_us":78975,"threads_started":1,"wal-append.queue_time_us":146702}
I20260709 12:10:43.091341 20848 raft_consensus.cc:3055] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:43.091836 20848 raft_consensus.cc:740] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:43.092758 20848 consensus_queue.cc:260] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:43.094116 20848 raft_consensus.cc:3060] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:43.063069 20698 raft_consensus.cc:493] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:43.098908 17949 raft_consensus.cc:2468] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 3.
I20260709 12:10:43.100591 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:43.095121 20878 log.cc:927] Time spent T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 12:10:43.078164 20891 leader_election.cc:290] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:43.120229 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.116530 17941 raft_consensus.cc:2468] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 7.
I20260709 12:10:43.129885 17945 raft_consensus.cc:2468] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 7.
I20260709 12:10:43.118745 17942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2058) took 1859 ms. Trace:
I20260709 12:10:43.098588 20446 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
W20260709 12:10:43.132522 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.104951 20698 raft_consensus.cc:3060] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:43.109637 20876 log.cc:927] Time spent T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
W20260709 12:10:43.117544 20890 log.cc:927] Time spent T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:10:43.140223 20839 consensus_meta.cc:287] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.654s	user 0.010s	sys 0.005s
I20260709 12:10:43.122735 20621 leader_election.cc:290] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:43.118875 20606 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:43.047721 20886 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:43.153025 17944 raft_consensus.cc:2410] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
W20260709 12:10:43.158727 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:43.159176 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.131448 17942 rpcz_store.cc:276] 0709 12:10:41.259444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:41.260584 (+  1140us) service_pool.cc:224] Handling call
0709 12:10:41.267937 (+  7353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:41.268128 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:41.268429 (+   301us) log.cc:844] Serialized 14 byte log entry
0709 12:10:43.118303 (+1849874us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b18002083c0. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f4c55a4bc 00007f7f498a848b 00007f7f527029a9 00007f7f498c469b 00007f7f498c293f 00007f7f498c2455 00007f7f4c9aa060 00007f7f4c9bc716 00007f7f4c9cd287
0709 12:10:43.118394 (+    91us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:43.118439 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:43.118491 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:43.118557 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:43.118690 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23989,"prepare.queue_time_us":561,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":112879,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":9295,"spinlock_wait_cycles":2843392,"thread_start_us":438201,"threads_started":2,"wal-append.queue_time_us":389006,"wal-append.run_cpu_time_us":1281,"wal-append.run_wall_time_us":1070705}
W20260709 12:10:43.167307 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 149767us
I20260709 12:10:43.145431 20446 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:43.179047 20888 log.cc:927] Time spent T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:10:43.179425 20850 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:43.180501 17913 leader_election.cc:304] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:43.181475 20850 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:43.182092 17913 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:43.189421 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:43.182094 20850 raft_consensus.cc:3060] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:43.203248 18017 raft_consensus.cc:1275] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:43.204999 20901 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.205544 20901 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:43.210171 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:43.210960 17945 raft_consensus.cc:2468] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 7.
I20260709 12:10:43.212095 20469 consensus_queue.cc:1048] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:10:43.209336 20865 consensus_meta.cc:287] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.637s	user 0.013s	sys 0.000s
I20260709 12:10:43.200441 20839 raft_consensus.cc:2749] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:43.201984 20697 raft_consensus.cc:493] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:43.158597 20606 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:43.209211 20855 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
W20260709 12:10:43.252080 17914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.249716 18093 raft_consensus.cc:1275] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 8. (term mismatch)
I20260709 12:10:43.239049 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:43.270442 18093 pending_rounds.cc:85] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110: Aborting all ops after (but not including) 7
I20260709 12:10:43.250865 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:43.270850 18093 pending_rounds.cc:107] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 12:10:43.271138 18093 raft_consensus.cc:2889] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:43.248354 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:43.272032 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:43.233798 17913 leader_election.cc:400] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 2 pre-election: Vote denied by peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297) with higher term. Message: Invalid argument: T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 2. Current term is 3.
I20260709 12:10:43.273993 20446 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:43.239413 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:43.253473 20886 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:43.251291 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:43.276165 18092 raft_consensus.cc:2410] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for term 8 because replica has last-logged OpId of term: 6 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 12:10:43.276491 17988 leader_election.cc:304] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:43.225754 20697 raft_consensus.cc:515] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:43.277426 20797 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:43.281358 17988 leader_election.cc:304] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:43.282859 17988 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:43.227882 20821 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.228560 20906 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.311426 20821 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:43.311678 20906 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:43.312517 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:43.313055 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:43.313653 18017 raft_consensus.cc:3060] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:43.313728 20821 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:43.314059 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:43.315511 18098 raft_consensus.cc:1275] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:43.313732 20906 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:43.317762 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:43.278038 20797 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:43.320866 17988 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:43.323045 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:43.323572 18018 raft_consensus.cc:2376] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8. Re-sending same reply.
I20260709 12:10:43.310220 20621 raft_consensus.cc:2804] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:43.324800 20621 raft_consensus.cc:697] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:43.325721 20621 consensus_queue.cc:237] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:43.329057 20769 raft_consensus.cc:2749] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:43.318513 18021 raft_consensus.cc:2368] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 5. Current term is 6.
I20260709 12:10:43.319643 18022 raft_consensus.cc:1275] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:10:43.331359 17945 raft_consensus.cc:1275] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:43.313155 18020 raft_consensus.cc:2468] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
I20260709 12:10:43.329622 20803 raft_consensus.cc:2804] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:43.333961 20803 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:43.334374 20803 raft_consensus.cc:3060] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:43.335858 20697 leader_election.cc:290] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:43.336141 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:43.336942 18608 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:43.281888 20523 raft_consensus.cc:2804] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:43.337237 18062 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.337584 20523 raft_consensus.cc:493] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:43.337988 20523 raft_consensus.cc:3060] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:43.338912 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:43.339051 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:43.343549 18640 raft_consensus.cc:3055] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:43.303947 20902 raft_consensus.cc:2804] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:43.345357 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:43.346342 20443 raft_consensus.cc:3055] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:43.347606 20866 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:10:43.348953 20901 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:43.280768 20855 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:43.222388 20865 raft_consensus.cc:515] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:43.350569 18640 raft_consensus.cc:740] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:43.352871 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:43.344005 18017 raft_consensus.cc:2468] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 10.
W20260709 12:10:43.337999 18062 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.367455 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:43.381577 18020 raft_consensus.cc:2410] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:10:43.381619 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:43.382277 18017 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 8.
I20260709 12:10:43.368103 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:43.350014 20607 consensus_queue.cc:1048] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:43.383849 18020 raft_consensus.cc:1275] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:10:43.350124 20803 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:43.407241 18018 raft_consensus.cc:2368] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 7. Current term is 8.
I20260709 12:10:43.371558 20523 raft_consensus.cc:515] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:43.365579 20443 raft_consensus.cc:740] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:43.366313 20851 consensus_queue.cc:1048] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.084s
W20260709 12:10:43.705117 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.503921 18022 raft_consensus.cc:2468] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
W20260709 12:10:43.678066 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 141168us
I20260709 12:10:43.386337 18640 consensus_queue.cc:260] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:43.714704 18640 raft_consensus.cc:3060] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:43.714768 17945 raft_consensus.cc:1240] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:43.386842 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:43.397226 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:43.594666 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.717206 17988 leader_election.cc:304] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:43.587285 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.718819 18023 raft_consensus.cc:1275] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 12:10:43.540874 17913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.722329 17945 raft_consensus.cc:1275] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:10:43.382860 20797 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:43.726835 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:43.378372 20902 raft_consensus.cc:697] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:43.745460 18016 raft_consensus.cc:1240] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:43.717435 20810 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.007s	sys 0.021s
W20260709 12:10:43.751019 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:43.680640 20804 raft_consensus.cc:493] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:43.709820 20821 raft_consensus.cc:493] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.437314 20881 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.679986 20885 raft_consensus.cc:493] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.769292 17941 raft_consensus.cc:1240] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:43.669624 20707 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
W20260709 12:10:43.727386 20850 consensus_meta.cc:287] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.523s	user 0.008s	sys 0.000s
I20260709 12:10:43.703203 20803 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:43.776219 17913 leader_election.cc:400] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Vote denied by peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297) with higher term. Message: Invalid argument: T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 5. Current term is 6.
I20260709 12:10:43.776167 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:43.777274 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:43.791364 17948 raft_consensus.cc:2410] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:10:43.727255 20906 raft_consensus.cc:2749] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:43.729713 20717 consensus_queue.cc:1048] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:10:43.782614 20855 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:43.783893 20865 leader_election.cc:290] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:43.766732 20810 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.007s	sys 0.021s
I20260709 12:10:43.709632 20781 consensus_queue.cc:1048] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:10:43.791520 17949 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 8.
I20260709 12:10:43.796522 17913 leader_election.cc:304] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:43.769784 20839 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:43.904058 18061 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.98.196:43647 timed out after 1.988s (SENT) [suppressed 39 similar messages]
I20260709 12:10:43.799108 20850 raft_consensus.cc:2749] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:43.786475 20821 raft_consensus.cc:515] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:43.818264 20810 raft_consensus.cc:493] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:43.956635 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 160158us
I20260709 12:10:43.799973 20506 consensus_queue.cc:1048] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.144s
I20260709 12:10:43.962783 17913 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:43.789763 20804 raft_consensus.cc:515] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:43.963991 17913 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:43.961139 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 246170us
I20260709 12:10:43.797185 20707 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:43.971194 17913 leader_election.cc:304] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:43.972713 17913 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:43.973873 18640 raft_consensus.cc:1275] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:43.965083 20866 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:43.960318 20855 raft_consensus.cc:2749] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:43.976106 20855 raft_consensus.cc:2749] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:43.901799 20839 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:43.968336 20851 raft_consensus.cc:2804] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:43.983470 20898 raft_consensus.cc:2804] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:43.987015 20882 raft_consensus.cc:2749] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:43.966948 20810 raft_consensus.cc:515] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:44.003000 20851 raft_consensus.cc:697] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
W20260709 12:10:44.005470 20916 log.cc:927] Time spent T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:10:43.996281 20919 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:43.789167 20881 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:44.038133 20910 log.cc:927] Time spent T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:10:44.029371 20919 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:44.052750 20914 log.cc:927] Time spent T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:10:43.793771 20885 raft_consensus.cc:515] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:44.063571 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 90941us
I20260709 12:10:44.075726 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:44.075776 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:10:44.063238 20915 log.cc:927] Time spent T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:10:44.078673 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:44.071296 20920 raft_consensus.cc:493] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:43.960875 20902 consensus_queue.cc:237] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:44.099100 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:44.099882 18018 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
I20260709 12:10:44.102458 18018 raft_consensus.cc:3060] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:44.088527 20917 log.cc:927] Time spent T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:10:44.091663 20898 raft_consensus.cc:697] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:44.118120 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:44.118883 17942 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:44.115728 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:44.124816 17948 raft_consensus.cc:1275] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:10:44.126462 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 222424us
W20260709 12:10:44.127576 18021 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.014s	sys 0.027s
W20260709 12:10:44.128059 18021 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.014s	sys 0.027s
I20260709 12:10:44.132442 20882 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.133119 20882 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:44.136633 20925 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.137315 20925 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:44.140059 20925 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:44.141475 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 174004us
I20260709 12:10:44.121790 20707 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:44.146010 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:44.146618 18022 raft_consensus.cc:2468] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 7.
I20260709 12:10:44.146669 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:44.111932 20900 consensus_queue.cc:1059] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:10:44.147387 18020 raft_consensus.cc:2468] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3.
I20260709 12:10:44.141228 20924 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:44.152990 20928 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:44.153074 20924 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:44.153865 20928 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:44.155995 20924 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:44.156966 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:44.157828 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:44.158998 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:44.147912 20882 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:44.157580 18023 raft_consensus.cc:2468] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
I20260709 12:10:44.159420 20839 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:44.088956 20851 consensus_queue.cc:237] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:44.083134 20920 raft_consensus.cc:515] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:44.173135 20920 leader_election.cc:290] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:44.170739 20921 log.cc:927] Time spent T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:10:44.175868 20885 leader_election.cc:290] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:44.148273 20898 consensus_queue.cc:237] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:44.159078 20821 leader_election.cc:290] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:44.156652 20928 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:44.159919 20901 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.159909 20707 raft_consensus.cc:493] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:44.190495 20707 raft_consensus.cc:515] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:44.193745 20606 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:44.194892 20707 leader_election.cc:290] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:44.159921 20865 consensus_queue.cc:1048] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:10:44.212585 20901 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:44.214874 20901 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:44.215461 20810 leader_election.cc:290] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:44.216521 20523 leader_election.cc:290] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:44.221067 17913 leader_election.cc:400] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Vote denied by peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297) with higher term. Message: Invalid argument: T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 7. Current term is 8.
I20260709 12:10:44.221437 17913 leader_election.cc:403] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:44.223065 17913 leader_election.cc:304] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:44.223150 20881 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:44.223919 17913 leader_election.cc:304] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:10:44.224324 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.225129 17913 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:10:44.227985 20698 consensus_meta.cc:287] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 1.075s	user 0.010s	sys 0.000s
I20260709 12:10:44.228281 17942 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:10:44.228394 20698 raft_consensus.cc:515] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:44.231033 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:44.167443 20919 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:44.237447 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:44.243517 17989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.245118 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:44.245749 18089 raft_consensus.cc:2468] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
I20260709 12:10:44.249480 17988 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:44.250866 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:44.252789 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:44.253588 18092 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:44.253875 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.230531 20698 leader_election.cc:290] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:44.296564 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:44.297317 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:44.297649 17943 raft_consensus.cc:3060] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:44.265795 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:44.258605 20769 raft_consensus.cc:2804] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:44.299656 20769 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:44.300046 20769 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:44.277663 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.303853 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:44.232174 20885 raft_consensus.cc:2749] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297) with higher term. Message: Invalid argument: T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 7. Current term is 8.
I20260709 12:10:44.304503 17946 raft_consensus.cc:2468] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
W20260709 12:10:44.276140 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 133748us
I20260709 12:10:44.296537 17989 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:44.324575 17943 raft_consensus.cc:2468] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 7.
I20260709 12:10:44.325835 18092 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:10:44.324116 18062 leader_election.cc:304] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:44.254797 20466 raft_consensus.cc:2804] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:44.330470 18062 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:44.259501 20855 raft_consensus.cc:2804] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:44.333427 18062 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:44.336328 18062 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:44.265012 20903 raft_consensus.cc:2804] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:44.347929 18062 leader_election.cc:304] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:44.327766 20882 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.330899 20698 raft_consensus.cc:2804] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:44.330798 20466 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:44.352468 18015 raft_consensus.cc:1240] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 LEADER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:44.339671 20810 raft_consensus.cc:2804] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:10:44.348834 20781 raft_consensus.cc:2804] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:44.348639 20797 raft_consensus.cc:2764] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 12:10:44.335203 20855 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:44.347488 20707 raft_consensus.cc:2749] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:44.368337 17989 leader_election.cc:304] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:44.359634 20821 raft_consensus.cc:493] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.358186 20698 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:44.360709 20466 raft_consensus.cc:3060] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:44.351938 20928 consensus_queue.cc:1048] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:10:44.403360 20810 raft_consensus.cc:697] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 3 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:44.370575 20919 raft_consensus.cc:2749] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:44.400409 20855 raft_consensus.cc:3060] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:44.360641 20882 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:44.408335 20698 raft_consensus.cc:3060] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:44.406428 20911 raft_consensus.cc:2749] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:44.425212 20707 consensus_queue.cc:1048] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:44.426419 18062 leader_election.cc:304] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
W20260709 12:10:44.435082 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 108983us
I20260709 12:10:44.461658 17940 raft_consensus.cc:1240] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:44.410341 20821 raft_consensus.cc:515] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:44.419646 20903 raft_consensus.cc:697] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
W20260709 12:10:44.470306 17913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.441217 20606 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:44.475071 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 85538us
W20260709 12:10:44.482230 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 46336.5us
I20260709 12:10:44.460435 20930 raft_consensus.cc:2804] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:44.460616 20919 consensus_queue.cc:1048] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
W20260709 12:10:44.496174 20929 log.cc:927] Time spent T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:10:44.499579 20882 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:44.503335 20903 consensus_queue.cc:237] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:10:44.506317 20466 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:44.482890 20606 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:44.490994 20810 consensus_queue.cc:237] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:44.509364 20443 consensus_queue.cc:260] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:44.510368 20443 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:44.486183 20930 raft_consensus.cc:493] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:44.516462 20930 raft_consensus.cc:3060] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:44.521698 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:44.502208 20769 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:44.554124 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 71149.1us
I20260709 12:10:44.510582 20606 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:44.524117 20882 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.567026 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:44.574813 20804 leader_election.cc:290] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:44.578048 18092 raft_consensus.cc:1275] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:10:44.579252 18610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.556910 20781 raft_consensus.cc:697] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:44.592209 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:44.594102 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 1.25712e+06us
I20260709 12:10:44.594709 18092 raft_consensus.cc:1240] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 7. Current term is 8. Ops: [5.8-7.9]
I20260709 12:10:44.596603 20622 raft_consensus.cc:2749] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:44.596796 18092 raft_consensus.cc:1275] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:10:44.598959 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 1.33793e+06us
I20260709 12:10:44.599123 18092 raft_consensus.cc:1275] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:44.601028 18092 raft_consensus.cc:1275] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:10:44.601614 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:44.601985 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.602253 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:44.602840 18089 raft_consensus.cc:2376] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 7. Re-sending same reply.
I20260709 12:10:44.603564 20821 leader_election.cc:290] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:44.603474 20723 consensus_queue.cc:1048] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:44.567909 20882 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:44.605165 20723 consensus_queue.cc:1048] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:44.607074 20907 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:44.607604 20907 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:44.608891 20930 raft_consensus.cc:515] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:44.588876 20763 raft_consensus.cc:493] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.610023 20763 raft_consensus.cc:515] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:44.567359 20707 consensus_queue.cc:1059] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 6.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:10:44.558486 20949 consensus_queue.cc:1048] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:10:44.613466 20466 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:44.614786 20622 raft_consensus.cc:493] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:44.615001 18607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.615325 20622 raft_consensus.cc:515] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:44.617102 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:44.618906 18643 raft_consensus.cc:1275] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 10. (index mismatch)
I20260709 12:10:44.611927 20769 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:44.590543 20891 raft_consensus.cc:493] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.587519 20887 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.646703 18637 raft_consensus.cc:1275] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:44.759538 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:44.670892 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:44.672454 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:44.762096 18092 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
W20260709 12:10:44.763665 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 150208us
I20260709 12:10:44.762253 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:44.762010 20891 raft_consensus.cc:515] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:44.767549 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:44.741884 20698 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:44.738250 20466 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.771433 20466 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:44.771781 20386 consensus_queue.cc:1048] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:44.764364 20855 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:44.761598 20882 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:44.780715 20698 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:44.781248 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:44.738368 20781 consensus_queue.cc:237] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:44.781819 18091 raft_consensus.cc:3060] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:44.778798 20386 consensus_queue.cc:1048] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:44.783910 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:44.784858 20775 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:44.741811 20930 leader_election.cc:290] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:44.763867 20717 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.799151 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:44.800496 18637 raft_consensus.cc:2468] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
I20260709 12:10:44.804173 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:44.805058 18637 raft_consensus.cc:3060] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:44.808655 18091 raft_consensus.cc:2468] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 7.
I20260709 12:10:44.815007 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:44.777127 20466 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:44.832036 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:44.802254 20907 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:44.833402 18091 raft_consensus.cc:2393] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 4: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:44.836483 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:44.837644 18094 raft_consensus.cc:2468] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 6.
I20260709 12:10:44.809857 20707 raft_consensus.cc:3055] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:44.840569 18609 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:44.795648 20887 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:44.844249 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:44.795960 20775 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:44.845561 18091 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
I20260709 12:10:44.797852 20717 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:44.846172 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 81289.6us
W20260709 12:10:44.848142 17988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.848155 18608 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:44.839325 20961 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.841518 20707 raft_consensus.cc:740] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
W20260709 12:10:44.859365 17989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.855166 18635 raft_consensus.cc:2468] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 7.
I20260709 12:10:44.864368 17945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2067) took 1140 ms. Trace:
I20260709 12:10:44.864749 17945 rpcz_store.cc:276] 0709 12:10:43.724354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.724503 (+   149us) service_pool.cc:224] Handling call
0709 12:10:43.724920 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:43.731166 (+  6246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:43.731212 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:44.579175 (+847963us) spinlock_profiling.cc:243] Waited 9.55 ms on lock 0x7b2c000fd188. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4b2aba11 00007f7f4b2bb372 00007f7f4c9eda01 00007f7f4c9b243a 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2
0709 12:10:44.589843 (+ 10668us) log.cc:844] Serialized 26 byte log entry
0709 12:10:44.754719 (+164876us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:44.754772 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.754846 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:44.864119 (+109273us) raft_consensus.cc:1685] finished
0709 12:10:44.864136 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:44.864309 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1375,"raft.queue_time_us":5598,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":34973,"spinlock_wait_cycles":21974400,"thread_start_us":147657,"threads_started":1,"wal-append.queue_time_us":236336}
I20260709 12:10:44.868192 20717 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:44.872474 18091 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:44.843644 20907 consensus_queue.cc:1048] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:10:44.890921 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:44.849570 20963 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.889391 17914 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:44.896545 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 63730.7us
I20260709 12:10:44.898242 17914 leader_election.cc:304] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:44.899338 18091 raft_consensus.cc:1275] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:44.899771 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:44.900378 18021 raft_consensus.cc:2468] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:10:44.900853 20769 consensus_queue.cc:1048] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:44.900218 20606 consensus_queue.cc:1048] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:44.903012 17914 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:44.904284 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:44.883256 20717 raft_consensus.cc:493] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:44.906728 18098 raft_consensus.cc:2410] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:10:44.883694 20855 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:44.910183 18608 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:44.907393 17914 leader_election.cc:304] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:44.896865 20466 raft_consensus.cc:2749] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:44.912880 17914 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:44.913054 18021 raft_consensus.cc:1240] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:10:44.913975 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:44.914227 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:44.914004 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:44.914489 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:44.905076 20607 raft_consensus.cc:2749] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:44.916023 18020 raft_consensus.cc:1240] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:44.916320 17912 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:44.917080 18022 raft_consensus.cc:1240] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:44.917500 18015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 1989) took 1552 ms. Trace:
I20260709 12:10:44.923599 18015 rpcz_store.cc:276] 0709 12:10:43.365016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.365157 (+   141us) service_pool.cc:224] Handling call
0709 12:10:43.365451 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:44.358881 (+993430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:44.917333 (+558452us) spinlock_profiling.cc:243] Waited 987 ms on lock 0x7b5400030cd4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:44.917456 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2269540608}
I20260709 12:10:44.926482 20466 raft_consensus.cc:2804] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:44.927021 18062 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:44.928202 20923 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.923277 20877 raft_consensus.cc:493] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:44.928645 20887 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:44.929005 18062 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:44.929474 20887 raft_consensus.cc:2804] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:44.929281 20877 raft_consensus.cc:515] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:44.927035 20466 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:44.930390 20466 raft_consensus.cc:3060] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:44.931420 20877 leader_election.cc:290] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:44.920514 20839 raft_consensus.cc:3060] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:44.910230 20707 consensus_queue.cc:260] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.2, Last appended by leader: 2, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:44.934881 20810 raft_consensus.cc:2749] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:44.908082 20596 raft_consensus.cc:2804] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:44.918397 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:44.855413 20961 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:44.915536 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:44.922166 18023 raft_consensus.cc:2468] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 9.
I20260709 12:10:44.903694 20966 raft_consensus.cc:2804] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:44.904217 20851 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:44.929975 20887 raft_consensus.cc:697] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:44.903855 20963 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:44.949846 20963 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:44.898885 20882 consensus_queue.cc:1048] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:10:44.898999 20386 consensus_queue.cc:1048] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
W20260709 12:10:44.951114 20964 log.cc:927] Time spent T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:10:44.951198 20949 consensus_queue.cc:1048] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:10:44.951663 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:44.952188 20707 raft_consensus.cc:3060] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:44.943132 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:44.952467 20386 raft_consensus.cc:2804] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:44.952533 20949 consensus_queue.cc:1048] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:44.953018 20386 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:44.953426 20386 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:44.953632 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:44.953936 20949 consensus_queue.cc:1059] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:10:44.954686 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:44.920356 20970 raft_consensus.cc:2749] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:44.911641 20717 raft_consensus.cc:515] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:44.940312 20596 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:44.928665 20923 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:44.946235 20851 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:10:44.947460 20887 consensus_queue.cc:237] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:44.943086 18062 leader_election.cc:304] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:10:45.006009 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 63029.5us
I20260709 12:10:44.958541 18637 raft_consensus.cc:2468] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 10.
W20260709 12:10:44.956616 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 43783.8us
I20260709 12:10:44.957036 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:45.013018 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:45.013746 18093 raft_consensus.cc:2468] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:10:44.959347 20810 raft_consensus.cc:3055] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:44.959398 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:44.960732 18642 raft_consensus.cc:2468] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 5.
I20260709 12:10:44.961089 20763 leader_election.cc:290] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:44.961797 20596 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:44.962735 20961 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:44.963300 20775 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:44.941075 20919 raft_consensus.cc:2804] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:44.968055 20891 leader_election.cc:290] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:44.972447 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:45.037009 18097 raft_consensus.cc:2410] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:44.972754 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:44.973132 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:45.038708 18092 raft_consensus.cc:2410] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:10:44.973407 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:45.039979 18643 raft_consensus.cc:3060] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:10:44.979317 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:44.942013 20966 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:44.983603 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:44.986989 17988 leader_election.cc:304] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:44.968679 20466 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:44.989739 20717 leader_election.cc:290] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:45.003216 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:45.006174 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:45.017969 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:45.018951 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:45.052742 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:45.052922 17942 raft_consensus.cc:2468] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
I20260709 12:10:45.053761 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:45.054323 17942 raft_consensus.cc:2468] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 5.
I20260709 12:10:45.020020 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:45.055737 17943 raft_consensus.cc:2393] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 9: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:45.020339 17949 raft_consensus.cc:1240] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 6. Current term is 7. Ops: [5.4-6.5]
I20260709 12:10:44.988459 20839 raft_consensus.cc:2749] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:45.017028 20810 raft_consensus.cc:740] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:45.022498 20821 raft_consensus.cc:2804] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:45.033491 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:10:45.047086 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 60176.6us
W20260709 12:10:45.063491 17988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.064343 17941 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:10:45.052253 17945 raft_consensus.cc:2468] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:10:45.068467 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:45.069238 18021 raft_consensus.cc:2468] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 7.
I20260709 12:10:45.024989 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:45.060492 18062 leader_election.cc:304] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:45.063498 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:45.022716 20606 consensus_queue.cc:1048] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:10:45.034507 20919 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:45.080024 17946 raft_consensus.cc:1275] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 6 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 12:10:45.023826 20928 consensus_queue.cc:1059] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:10:45.086804 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:45.095381 18021 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:45.058390 20937 raft_consensus.cc:2804] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:45.052040 20877 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.049304 20966 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:45.062441 20821 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
W20260709 12:10:45.112550 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.112071 17947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2069) took 1385 ms. Trace:
I20260709 12:10:45.104490 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:45.120209 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:45.123077 18019 raft_consensus.cc:3060] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:45.122990 18644 raft_consensus.cc:2376] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 10. Re-sending same reply.
I20260709 12:10:45.121958 17947 rpcz_store.cc:276] 0709 12:10:43.726804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:43.728552 (+  1748us) service_pool.cc:224] Handling call
0709 12:10:43.728893 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:43.969815 (+240922us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:43.969853 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:43.969891 (+    38us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:43.969930 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.111784 (+1141854us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b5400254ed4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:45.111844 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:45.112007 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2800,"raft.queue_time_us":3177,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":12929,"spinlock_wait_cycles":546874752}
I20260709 12:10:45.092128 20919 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:45.151928 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.157894 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:45.124868 20821 raft_consensus.cc:3060] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:45.160027 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:45.160786 18018 raft_consensus.cc:2410] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:45.161495 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:45.162138 17942 raft_consensus.cc:2468] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:45.162611 20937 raft_consensus.cc:697] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:45.125406 20930 raft_consensus.cc:2804] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:45.170871 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:45.171713 18018 raft_consensus.cc:3060] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:45.183996 18607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.186486 18024 raft_consensus.cc:1275] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:10:45.195664 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 107642us
I20260709 12:10:45.194530 18062 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:45.196807 17988 leader_election.cc:304] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:10:45.210297 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.198099 17988 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:45.155309 20882 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:45.222383 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 312239us
I20260709 12:10:45.163719 20466 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:45.225901 18019 raft_consensus.cc:2468] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 4.
I20260709 12:10:45.227185 18021 raft_consensus.cc:2468] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 7.
I20260709 12:10:45.119588 20877 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:45.231976 18018 raft_consensus.cc:2468] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
I20260709 12:10:45.164633 20928 consensus_queue.cc:1059] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
W20260709 12:10:45.255720 20954 log.cc:927] Time spent T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.513s	user 0.003s	sys 0.000s
I20260709 12:10:45.269709 18636 raft_consensus.cc:1275] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:45.271943 20951 raft_consensus.cc:3055] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:45.224045 20864 raft_consensus.cc:2804] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:45.233106 20707 raft_consensus.cc:2804] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:45.139590 20810 consensus_queue.cc:260] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:45.324389 20951 raft_consensus.cc:740] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:45.273793 20717 raft_consensus.cc:2804] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:45.341120 18640 consensus_queue.cc:237] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:45.324899 20979 log.cc:927] Time spent T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:10:45.229772 20882 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:45.193766 20937 consensus_queue.cc:237] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:45.338027 20926 log.cc:927] Time spent T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:10:45.385020 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:45.243671 20698 consensus_queue.cc:1048] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.101s
I20260709 12:10:45.388255 18643 raft_consensus.cc:2468] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
I20260709 12:10:45.328385 20864 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:45.341877 20707 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
W20260709 12:10:45.384238 20978 log.cc:927] Time spent T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:10:45.334296 20386 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:45.358475 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 122974us
W20260709 12:10:45.409649 20976 log.cc:927] Time spent T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.071s	user 0.007s	sys 0.000s
I20260709 12:10:45.391830 20923 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:45.554780 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 327973us
I20260709 12:10:45.557842 20966 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:45.564474 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:45.565363 18018 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 8.
I20260709 12:10:45.568020 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:45.568778 17943 raft_consensus.cc:3060] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:45.570307 20998 raft_consensus.cc:493] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:45.570856 20998 raft_consensus.cc:515] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:45.572561 20622 leader_election.cc:290] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:45.574395 20930 raft_consensus.cc:493] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
W20260709 12:10:45.578395 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 634113us
W20260709 12:10:45.580117 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:45.539417 20991 log.cc:927] Time spent T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.199s	user 0.000s	sys 0.000s
W20260709 12:10:45.547654 20989 log.cc:927] Time spent T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 12:10:45.582353 17912 leader_election.cc:304] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:45.588791 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 365374us
I20260709 12:10:45.592602 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:45.593328 18642 raft_consensus.cc:3060] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:45.596495 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:45.596877 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:45.597026 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:45.597406 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.599437 20877 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:45.603489 20810 raft_consensus.cc:3060] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:45.606958 20864 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:45.611151 20707 raft_consensus.cc:3060] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:45.587596 20839 raft_consensus.cc:493] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:45.615021 20466 consensus_queue.cc:1048] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:45.615406 20839 raft_consensus.cc:515] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:45.616407 17989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.617841 20848 raft_consensus.cc:2749] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:45.464705 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 52476.1us
I20260709 12:10:45.621722 18608 leader_election.cc:304] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:45.617758 17989 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
W20260709 12:10:45.663336 18607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.665275 18093 raft_consensus.cc:1275] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 6 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 12:10:45.670872 18641 raft_consensus.cc:1240] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:45.675990 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 58321.1us
I20260709 12:10:45.622308 17912 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
W20260709 12:10:45.679076 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 56900.4us
I20260709 12:10:45.680279 17912 leader_election.cc:304] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:45.685104 18638 raft_consensus.cc:1275] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:10:45.670418 17943 raft_consensus.cc:2468] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 7.
I20260709 12:10:45.583954 20930 raft_consensus.cc:3060] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:45.704005 17913 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:45.710868 18062 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:45.673074 20926 log.cc:927] Time spent T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:10:45.713809 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:45.715790 18642 raft_consensus.cc:2468] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
I20260709 12:10:45.673393 20943 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.677922 20851 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:45.695255 20606 raft_consensus.cc:2804] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:45.699700 20987 raft_consensus.cc:2804] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:45.696781 20698 raft_consensus.cc:2749] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:10:45.732679 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 141287us
W20260709 12:10:45.749923 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.721388 20622 raft_consensus.cc:2749] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:45.731060 20821 consensus_meta.cc:287] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.571s	user 0.006s	sys 0.014s
W20260709 12:10:45.731526 20596 consensus_meta.cc:287] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.683s	user 0.015s	sys 0.006s
W20260709 12:10:45.768191 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:45.770160 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:45.776813 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:45.777712 18018 raft_consensus.cc:2393] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 7: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:45.770959 18021 raft_consensus.cc:1275] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:10:45.771308 17988 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:45.779462 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:45.780350 18021 raft_consensus.cc:2393] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 5: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:45.784273 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:45.768993 18608 leader_election.cc:304] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:45.735546 20606 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:45.756878 20839 leader_election.cc:290] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:45.765552 20386 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:45.768718 20987 raft_consensus.cc:697] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:45.769258 20698 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:45.733875 20943 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:45.792788 20821 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:45.768100 20986 raft_consensus.cc:2804] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:45.795416 20606 raft_consensus.cc:3060] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:45.841975 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 126000us
I20260709 12:10:46.026002 17912 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:45.810434 20886 raft_consensus.cc:2749] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:45.841068 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 138614us
W20260709 12:10:46.063009 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 311018us
W20260709 12:10:45.940644 18607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:46.022030 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:45.809378 20919 consensus_meta.cc:287] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.648s	user 0.006s	sys 0.012s
W20260709 12:10:46.039340 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 325357us
I20260709 12:10:46.073416 17913 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:46.064036 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.063967 18608 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:46.064023 18607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.076730 17913 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:46.076975 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:45.794709 20596 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:45.807341 20983 consensus_queue.cc:1048] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.255s
W20260709 12:10:46.061370 20991 log.cc:927] Time spent T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.251s	user 0.000s	sys 0.000s
I20260709 12:10:46.024391 20986 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:46.116839 18637 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.953s	user 0.017s	sys 0.011s
W20260709 12:10:46.154812 18637 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.991s	user 0.018s	sys 0.012s
I20260709 12:10:46.061249 20386 raft_consensus.cc:493] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:46.155481 17942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2083) took 1100 ms. Trace:
W20260709 12:10:46.164134 20988 log.cc:927] Time spent T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 12:10:46.164170 21007 raft_consensus.cc:2804] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:46.164652 21010 raft_consensus.cc:2749] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:46.165246 21012 raft_consensus.cc:2749] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:46.165867 21008 consensus_queue.cc:1048] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:10:46.168334 20986 raft_consensus.cc:3060] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:46.125665 20848 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:46.151895 20839 raft_consensus.cc:2804] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:10:46.175815 20984 log.cc:927] Time spent T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
W20260709 12:10:46.177040 21006 log.cc:927] Time spent T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 12:10:45.814397 20987 consensus_queue.cc:237] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:46.184518 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.266072 17942 rpcz_store.cc:276] 0709 12:10:45.026026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.063294 (+ 37268us) service_pool.cc:224] Handling call
0709 12:10:46.094716 (+1031422us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b54002521d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:46.126014 (+ 31298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26306816}
W20260709 12:10:46.147606 20981 log.cc:927] Time spent T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
W20260709 12:10:46.280699 17990 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.000s	sys 0.012s
W20260709 12:10:46.182569 20864 consensus_meta.cc:287] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.575s	user 0.008s	sys 0.000s
I20260709 12:10:46.027364 20698 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:46.109524 20919 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:46.187806 20943 leader_election.cc:290] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:46.298862 18643 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.029s	sys 0.048s
I20260709 12:10:46.184348 20821 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:46.183022 20966 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:46.155730 20886 raft_consensus.cc:2749] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:10:46.365967 18643 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.031s	sys 0.049s
W20260709 12:10:46.340740 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 267534us
I20260709 12:10:46.284004 21007 raft_consensus.cc:697] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:46.276801 20386 raft_consensus.cc:515] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:46.296123 20466 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.000s	sys 0.047s
W20260709 12:10:46.381984 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 318089us
I20260709 12:10:46.388303 18608 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:46.390163 18016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 2003) took 1380 ms. Trace:
I20260709 12:10:46.390195 17944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2079) took 1379 ms. Trace:
W20260709 12:10:46.391616 17988 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.044s	sys 0.083s
W20260709 12:10:46.391927 17988 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.044s	sys 0.083s
I20260709 12:10:46.391086 18090 raft_consensus.cc:1240] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 8. Current term is 9. Ops: []
W20260709 12:10:46.392266 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 621020us
I20260709 12:10:46.393083 18608 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:46.390671 18016 rpcz_store.cc:276] 0709 12:10:45.010198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.010362 (+   164us) service_pool.cc:224] Handling call
0709 12:10:45.010757 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:45.011182 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.011223 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:45.033937 (+ 22714us) log.cc:844] Serialized 26 byte log entry
0709 12:10:45.232737 (+198800us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:45.232776 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.232836 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:46.389967 (+1157131us) raft_consensus.cc:1685] finished
0709 12:10:46.389986 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.390108 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11772,"raft.queue_time_us":625,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":6119,"thread_start_us":152895,"threads_started":1,"wal-append.queue_time_us":733631}
I20260709 12:10:46.395881 17948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2081) took 1382 ms. Trace:
W20260709 12:10:46.391208 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 312313us
I20260709 12:10:46.397038 17913 leader_election.cc:304] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:46.396385 17948 rpcz_store.cc:276] 0709 12:10:45.013297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.014545 (+  1248us) service_pool.cc:224] Handling call
0709 12:10:45.033386 (+ 18841us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:45.239683 (+206297us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.239729 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:45.395864 (+156135us) log.cc:844] Serialized 26 byte log entry
0709 12:10:45.732168 (+336304us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:45.732221 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.732308 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:46.395658 (+663350us) raft_consensus.cc:1685] finished
0709 12:10:46.395676 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.395810 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28686,"raft.queue_time_us":68641,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":3738,"thread_start_us":255136,"threads_started":2,"wal-append.queue_time_us":232722}
I20260709 12:10:46.397333 17989 leader_election.cc:304] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:46.300160 20848 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:46.390933 20466 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.000s	sys 0.048s
I20260709 12:10:46.390877 17944 rpcz_store.cc:276] 0709 12:10:45.010697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.011606 (+   909us) service_pool.cc:224] Handling call
0709 12:10:45.023495 (+ 11889us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:45.048771 (+ 25276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.048816 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:45.077249 (+ 28433us) log.cc:844] Serialized 52 byte log entry
0709 12:10:45.230632 (+153383us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:45.230689 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.230753 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:46.389904 (+1159151us) raft_consensus.cc:1685] finished
0709 12:10:46.389932 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.390121 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":375,"raft.queue_time_us":38821,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":10541,"thread_start_us":111156,"threads_started":1,"wal-append.queue_time_us":653553}
W20260709 12:10:46.406045 17940 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.006s	sys 0.013s
W20260709 12:10:46.421020 17940 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.006s	sys 0.013s
I20260709 12:10:46.398051 17913 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
W20260709 12:10:46.400429 20867 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.004s	sys 0.008s
I20260709 12:10:46.369457 20864 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:46.399601 20886 raft_consensus.cc:2749] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:46.423844 20974 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:46.451987 20867 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.005s	sys 0.009s
W20260709 12:10:46.483117 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 107103us
W20260709 12:10:46.485461 17987 leader_election.cc:336] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Timed out: RequestConsensusVote RPC to 127.16.98.196:43647 timed out after 1.547s (SENT)
W20260709 12:10:46.488561 18607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.459951 20903 raft_consensus.cc:493] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:46.497788 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 100493us
I20260709 12:10:46.459780 20902 raft_consensus.cc:2804] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:46.492662 20466 raft_consensus.cc:2804] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:46.507450 20386 leader_election.cc:290] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:46.511682 20864 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:46.515223 20606 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:46.517961 21005 log.cc:927] Time spent T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
W20260709 12:10:46.519021 20930 consensus_meta.cc:287] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.800s	user 0.007s	sys 0.004s
I20260709 12:10:46.519541 20930 raft_consensus.cc:515] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:46.522007 20930 leader_election.cc:290] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:46.522713 20919 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:46.524950 20996 log.cc:927] Time spent T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.370s	user 0.001s	sys 0.000s
I20260709 12:10:46.526382 18024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45464 (request call id 1830) took 1452 ms. Trace:
W20260709 12:10:46.531219 21019 log.cc:927] Time spent T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:10:46.532550 18637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60430 (request call id 654) took 1722 ms. Trace:
I20260709 12:10:46.532927 18637 rpcz_store.cc:276] 0709 12:10:44.810662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.039292 (+228630us) service_pool.cc:224] Handling call
0709 12:10:45.039818 (+   526us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:45.042625 (+  2807us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.042686 (+    61us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:45.049920 (+  7234us) log.cc:844] Serialized 52 byte log entry
0709 12:10:46.155310 (+1105390us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:46.155366 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.155457 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:46.532339 (+376882us) raft_consensus.cc:1685] finished
0709 12:10:46.532362 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.532493 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100,"spinlock_wait_cycles":9478016,"thread_start_us":991515,"threads_started":1,"wal-append.queue_time_us":1221430}
I20260709 12:10:46.530628 18024 rpcz_store.cc:276] 0709 12:10:45.073705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.189483 (+115778us) service_pool.cc:224] Handling call
0709 12:10:45.189827 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:45.190082 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.190117 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:45.190549 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 12:10:45.719619 (+529070us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:45.719657 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:45.719714 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:46.526123 (+806409us) raft_consensus.cc:1685] finished
0709 12:10:46.526149 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:46.526313 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":477968,"threads_started":1,"wal-append.queue_time_us":618583}
I20260709 12:10:46.463198 20839 raft_consensus.cc:697] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
W20260709 12:10:46.560091 17987 leader_election.cc:336] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Timed out: RequestConsensusVote RPC to 127.16.98.196:43647 timed out after 1.601s (SENT)
W20260709 12:10:46.564301 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 65067.8us
W20260709 12:10:46.522547 20707 consensus_meta.cc:287] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.911s	user 0.003s	sys 0.007s
W20260709 12:10:46.566774 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 173757us
I20260709 12:10:46.500772 20902 raft_consensus.cc:493] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:46.464579 20974 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:46.577740 17945 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.003s	sys 0.007s
W20260709 12:10:46.578109 17945 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.003s	sys 0.007s
I20260709 12:10:46.567473 20864 consensus_queue.cc:1048] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:10:46.569271 21012 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:46.583439 21012 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:46.585594 21012 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:46.587390 20810 consensus_meta.cc:287] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.983s	user 0.005s	sys 0.005s
I20260709 12:10:46.588229 18096 raft_consensus.cc:2410] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:10:46.590490 18096 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53954 (request call id 2049) took 2331 ms (client timeout 1978 ms). Trace:
I20260709 12:10:46.458005 21007 consensus_queue.cc:237] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:46.592837 18096 rpcz_store.cc:269] 0709 12:10:44.259421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.259589 (+   168us) service_pool.cc:224] Handling call
0709 12:10:45.384830 (+1125241us) spinlock_profiling.cc:243] Waited 5.89 ms on lock 0x7b58001b0998. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4988db71 00007f7f4988da22 00007f7f527a68d9 00007f7f51900ee0 00007f7f519ca0ab 00007f7f519ca131 00007f7f519780a0 00007f7f51977984 00007f7f4aef26d4 00007f7f4aef2662
0709 12:10:46.590236 (+1205406us) spinlock_profiling.cc:243] Waited 982 ms on lock 0x7b54002efc54. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:46.590394 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2273120256}
I20260709 12:10:46.568881 20707 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:46.595950 20707 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:46.595639 20839 consensus_queue.cc:237] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:46.539765 20903 raft_consensus.cc:515] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:46.600941 18608 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:46.571165 20902 raft_consensus.cc:3060] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:46.604574 21033 raft_consensus.cc:2749] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:46.568434 21023 raft_consensus.cc:2804] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:46.605381 20998 leader_election.cc:290] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:46.620054 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:46.663131 20848 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:46.624920 21023 raft_consensus.cc:697] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:46.636253 20698 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:46.682600 20848 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:46.683238 20848 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:46.685288 20848 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:46.664386 20974 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:46.701089 20717 raft_consensus.cc:493] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:46.701648 20717 raft_consensus.cc:3060] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:46.703697 20902 raft_consensus.cc:515] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:46.711356 20902 leader_election.cc:290] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:46.760821 18641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60430 (request call id 634) took 2143 ms. Trace:
I20260709 12:10:46.761256 18641 rpcz_store.cc:276] 0709 12:10:44.617155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.619095 (+  1940us) service_pool.cc:224] Handling call
0709 12:10:44.974440 (+355345us) spinlock_profiling.cc:243] Waited 4.94 ms on lock 0x7b58001c4a98. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4988db71 00007f7f4988da22 00007f7f527a68d9 00007f7f51900ee0 00007f7f519ca0ab 00007f7f519ca131 00007f7f5198bfc0 00007f7f51976929 00007f7f519763d2 00007f7f4aeedbd4
0709 12:10:44.974694 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:45.683062 (+708368us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.760539 (+1077477us) spinlock_profiling.cc:243] Waited 662 ms on lock 0x7b54006d0e54. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:46.760734 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1533837440}
I20260709 12:10:46.762812 18090 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41818 (request call id 818) took 1424 ms. Trace:
I20260709 12:10:46.763239 18090 rpcz_store.cc:276] 0709 12:10:45.338637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.391440 (+ 52803us) service_pool.cc:224] Handling call
0709 12:10:45.410717 (+ 19277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:46.395165 (+984448us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:46.762599 (+367434us) spinlock_profiling.cc:243] Waited 980 ms on lock 0x7b54000389d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:46.762759 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2254228736}
W20260709 12:10:47.026237 18642 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.023s	sys 0.033s
W20260709 12:10:47.161082 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 556697us
W20260709 12:10:47.161371 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:47.006565 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 69774.7us
W20260709 12:10:47.163594 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:47.165074 17989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:47.160856 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 762800us
I20260709 12:10:46.882815 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
W20260709 12:10:47.006343 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 400392us
I20260709 12:10:46.882004 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:47.171595 21022 raft_consensus.cc:2764] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 12:10:47.165182 18608 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:47.172923 20961 raft_consensus.cc:2749] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:47.167712 18638 raft_consensus.cc:3060] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:46.742086 20466 raft_consensus.cc:697] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
W20260709 12:10:47.099773 20986 consensus_meta.cc:287] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.797s	user 0.008s	sys 0.004s
I20260709 12:10:47.226452 20986 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:46.881119 21003 log.cc:927] Time spent T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 1.112s	user 0.010s	sys 0.018s
I20260709 12:10:47.228193 20961 consensus_queue.cc:1048] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:47.228749 20986 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:47.229364 20986 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:47.207177 18638 raft_consensus.cc:2468] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
W20260709 12:10:47.198825 17987 leader_election.cc:336] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Timed out: RequestConsensusVote RPC to 127.16.98.196:43647 timed out after 1.764s (SENT)
I20260709 12:10:46.805325 20882 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:46.882390 21013 log.cc:927] Time spent T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.499s	user 0.002s	sys 0.000s
W20260709 12:10:47.242496 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 75190.1us
I20260709 12:10:47.199884 18608 leader_election.cc:304] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:47.244306 20898 consensus_queue.cc:1048] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:10:47.243721 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 44931.6us
I20260709 12:10:46.882477 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:46.807811 20596 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:46.936215 20987 raft_consensus.cc:493] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:46.841917 20903 leader_election.cc:290] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:47.231016 20797 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:47.255429 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 55653.1us
I20260709 12:10:47.263165 18095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53964 (request call id 1749) took 2232 ms. Trace:
I20260709 12:10:47.264412 17945 raft_consensus.cc:1275] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:47.263518 18095 rpcz_store.cc:276] 0709 12:10:45.024412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.143365 (+118953us) service_pool.cc:224] Handling call
0709 12:10:45.153452 (+ 10087us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:45.220101 (+ 66649us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.220149 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:45.227759 (+  7610us) log.cc:844] Serialized 26 byte log entry
0709 12:10:45.609494 (+381735us) spinlock_profiling.cc:243] Waited 7.88 ms on lock 0x7b180007ba00. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f498a7e07 00007f7f527029a9 00007f7f498c469b 00007f7f498c293f 00007f7f498c4c02 00007f7f4c54c20b 00007f7f4c551d23 00007f7f4c5520d1 00007f7f4c96da0f
0709 12:10:45.772115 (+162621us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:46.278563 (+506448us) log.cc:844] Serialized 14 byte log entry
0709 12:10:47.256640 (+978077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.256712 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:47.256753 (+    41us) raft_consensus.cc:1685] finished
0709 12:10:47.256825 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.256927 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1333363,"prepare.queue_time_us":67212,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":70436,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":3161,"spinlock_wait_cycles":18118016,"thread_start_us":627857,"threads_started":2,"wal-append.queue_time_us":1015388}
I20260709 12:10:47.265419 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:46.937772 20983 consensus_queue.cc:1059] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.315s
I20260709 12:10:47.268155 17945 raft_consensus.cc:1240] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:47.270080 17943 raft_consensus.cc:2410] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:47.236990 20986 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:47.252826 20952 raft_consensus.cc:493] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:46.833519 20951 consensus_queue.cc:260] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:47.010275 20717 raft_consensus.cc:515] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:47.256531 20961 raft_consensus.cc:2804] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:47.274200 17943 raft_consensus.cc:1240] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:47.259258 18635 raft_consensus.cc:2468] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 5.
I20260709 12:10:46.805364 21023 consensus_queue.cc:237] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:47.279804 18062 leader_election.cc:304] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
W20260709 12:10:47.283239 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:47.283667 18061 connection.cc:256] RPC call timeout handler was delayed by -1.2067212039999049s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20990000000000003s for a response
W20260709 12:10:47.285328 18061 connection.cc:256] RPC call timeout handler was delayed by -1.1649661809999543s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1674s for a response
I20260709 12:10:47.289269 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:47.282927 20386 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:47.276497 20804 raft_consensus.cc:493] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:47.262998 20987 raft_consensus.cc:515] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:47.269013 20797 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:47.291760 17943 raft_consensus.cc:1240] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:47.282819 20769 raft_consensus.cc:493] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.300838 17943 raft_consensus.cc:1240] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:47.280594 20961 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:47.294139 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:47.299765 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:47.284839 20951 raft_consensus.cc:3060] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.285233 20707 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:47.285414 21000 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:47.292083 20928 raft_consensus.cc:2804] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:47.310423 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:47.311721 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:47.311913 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:47.311784 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:47.314833 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:47.315507 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:47.321132 17947 raft_consensus.cc:2468] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 5.
I20260709 12:10:47.321687 18637 raft_consensus.cc:2393] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 5: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:47.316113 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:47.321959 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:47.322182 18639 raft_consensus.cc:2468] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:47.316349 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:47.323038 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:47.323587 18644 raft_consensus.cc:2468] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:47.323724 18639 raft_consensus.cc:2468] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 5.
I20260709 12:10:47.324407 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:47.322989 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:47.324815 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:47.325443 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:47.325783 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:47.325783 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:47.319978 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:47.327308 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:47.327472 17949 raft_consensus.cc:1275] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:47.328145 17945 raft_consensus.cc:1275] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:47.328722 17947 raft_consensus.cc:2468] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
I20260709 12:10:47.329420 18639 raft_consensus.cc:2410] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:10:47.329702 17949 raft_consensus.cc:1240] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 6. Current term is 7. Ops: [5.4-6.5]
I20260709 12:10:47.329905 17947 raft_consensus.cc:1240] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:47.330215 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:47.331202 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:47.332729 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:47.333204 17941 raft_consensus.cc:2468] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
I20260709 12:10:47.333784 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:47.277431 20952 raft_consensus.cc:515] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:47.334849 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:47.296043 21039 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:47.297787 20998 raft_consensus.cc:493] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:47.336920 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:47.278100 20466 consensus_queue.cc:237] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:47.339313 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:47.341156 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:47.341380 17949 raft_consensus.cc:3060] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.341596 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:47.341774 18644 raft_consensus.cc:2468] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:47.307353 20961 raft_consensus.cc:3060] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:47.339787 18062 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.339664 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:47.342624 18062 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.342617 18643 raft_consensus.cc:2468] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:47.344048 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:47.344738 17946 raft_consensus.cc:2393] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 9: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:47.345362 17948 raft_consensus.cc:1240] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 7. Current term is 8. Ops: [3.5-7.7]
I20260709 12:10:47.344058 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:47.351424 17941 raft_consensus.cc:2468] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:10:47.301076 20804 raft_consensus.cc:515] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:47.331310 20781 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:47.298203 20386 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:47.357386 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:47.309876 20769 raft_consensus.cc:515] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:47.340132 21020 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:47.356178 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:47.339434 20928 raft_consensus.cc:697] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:47.349386 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:47.364080 18644 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:10:47.345739 20810 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:47.369714 18062 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:47.349035 21001 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.372258 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:47.351734 20717 leader_election.cc:290] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:47.327236 20707 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:47.334993 21000 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:47.354637 20930 raft_consensus.cc:493] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:47.374080 17949 raft_consensus.cc:2468] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 7.
I20260709 12:10:47.377652 17945 raft_consensus.cc:1240] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:47.375795 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:47.372870 18643 raft_consensus.cc:2468] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:10:47.398865 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:47.398984 21052 consensus_queue.cc:1059] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:47.349587 20998 raft_consensus.cc:515] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:47.400437 21052 raft_consensus.cc:2804] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:47.400960 21052 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:47.399078 18089 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53964 (request call id 1746) took 2380 ms. Trace:
I20260709 12:10:47.360138 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:47.401497 20998 leader_election.cc:290] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:47.399467 18643 raft_consensus.cc:2468] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 5.
I20260709 12:10:47.403055 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:47.401396 21052 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:47.349471 21039 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:47.371341 20821 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
W20260709 12:10:47.406091 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 153993us
W20260709 12:10:47.406534 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.407142 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:47.379307 20986 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:47.363515 20781 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:47.415117 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:47.416975 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:47.417232 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:47.417713 18016 raft_consensus.cc:2393] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 5: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:47.417888 18017 raft_consensus.cc:2468] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:10:47.372614 20810 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:47.420209 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:47.421716 17949 raft_consensus.cc:3060] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:47.401692 18089 rpcz_store.cc:276] 0709 12:10:45.023399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:45.046305 (+ 22906us) service_pool.cc:224] Handling call
0709 12:10:45.046710 (+   405us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:10:45.051323 (+  4613us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:45.051361 (+    38us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:10:45.057559 (+  6198us) log.cc:844] Serialized 78 byte log entry
0709 12:10:45.179243 (+121684us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:45.227654 (+ 48411us) log.cc:844] Serialized 14 byte log entry
0709 12:10:45.726000 (+498346us) log.cc:844] Serialized 14 byte log entry
0709 12:10:45.735014 (+  9014us) log.cc:844] Serialized 14 byte log entry
0709 12:10:46.806861 (+1071847us) spinlock_profiling.cc:243] Waited 9.1 ms on lock 0x7b48001ec258. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f518dbaa1 00007f7f518d2b37 00007f7f518d29ca 00007f7f519ca26f 00007f7f519c9f37 00007f7f519de55c 00007f7f519de508 00007f7f519de488 00007f7f519de443 00007f7f519dd6ec 00007f7f50907a96
0709 12:10:47.180438 (+373577us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b1800217300. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f4983fc0a 00007f7f52f7f219 00007f7f498c7a40 00007f7f498c24e4 00007f7f498c2455 00007f7f4c9aa060 00007f7f4c9bc716 00007f7f4c9cd287 00007f7f4c9cd208
0709 12:10:47.398774 (+218336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.398851 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:47.398888 (+    37us) raft_consensus.cc:1685] finished
0709 12:10:47.398901 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.399027 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":931759,"prepare.queue_time_us":91993,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":106,"raft.queue_time_us":3290681,"raft.run_cpu_time_us":24548,"raft.run_wall_time_us":1788508,"spinlock_wait_cycles":45945344,"thread_start_us":542582,"threads_started":4,"wal-append.queue_time_us":121606,"wal-append.run_cpu_time_us":13271,"wal-append.run_wall_time_us":2201325}
I20260709 12:10:47.420570 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:47.420637 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:47.423970 18016 raft_consensus.cc:2368] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 7. Current term is 8.
I20260709 12:10:47.429020 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:47.429095 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:47.429833 20769 leader_election.cc:290] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:47.430534 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:47.432561 20707 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:47.433173 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:47.433880 18024 raft_consensus.cc:2376] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7. Re-sending same reply.
I20260709 12:10:47.435956 20810 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:10:47.436738 21040 log.cc:927] Time spent T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:10:47.438807 18642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60430 (request call id 660) took 1076 ms. Trace:
I20260709 12:10:47.439152 18642 rpcz_store.cc:276] 0709 12:10:46.361966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:46.362129 (+   163us) service_pool.cc:224] Handling call
0709 12:10:46.362456 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:46.377419 (+ 14963us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:10:46.462012 (+ 84593us) log.cc:844] Serialized 14 byte log entry
0709 12:10:47.169807 (+707795us) log.cc:844] Serialized 14 byte log entry
0709 12:10:47.170182 (+   375us) log.cc:844] Serialized 14 byte log entry
0709 12:10:47.170686 (+   504us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:47.171216 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 12:10:47.171341 (+   125us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:47.171375 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:47.171512 (+   137us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:47.438591 (+267079us) raft_consensus.cc:1685] finished
0709 12:10:47.438617 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:47.438755 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":212873,"prepare.run_cpu_time_us":118,"prepare.run_wall_time_us":1462,"raft.queue_time_us":28755,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":2806,"spinlock_wait_cycles":23936384,"thread_start_us":740675,"threads_started":2,"wal-append.queue_time_us":808004}
I20260709 12:10:47.441357 18642 raft_consensus.cc:3055] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:47.441705 18642 raft_consensus.cc:740] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:47.442523 18642 consensus_queue.cc:260] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:47.443265 20987 leader_election.cc:290] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:47.443842 18642 raft_consensus.cc:3060] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.444761 21000 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:47.447875 20386 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:47.448765 17949 raft_consensus.cc:2468] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
I20260709 12:10:47.449752 21014 raft_consensus.cc:3055] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:47.450124 21014 raft_consensus.cc:740] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:47.450270 20781 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:47.451946 20804 leader_election.cc:290] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:47.368462 21020 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:47.457962 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:47.458604 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:47.460400 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:47.414083 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:47.452569 20928 consensus_queue.cc:237] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:47.465216 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:47.465209 18636 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:10:47.384294 21001 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:10:47.468389 21001 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:47.412945 20811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 137ed415b9d242989f28f349c1618c74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:10:47.458328 18642 raft_consensus.cc:1275] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:47.490438 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:47.491268 18017 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 8.
I20260709 12:10:47.408136 20930 raft_consensus.cc:515] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:47.500017 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:47.414708 20821 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:47.504732 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:47.512077 18017 raft_consensus.cc:1240] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:47.535858 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:47.504498 20797 leader_election.cc:290] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:47.538451 17943 raft_consensus.cc:1240] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:47.514856 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:47.503046 21014 consensus_queue.cc:260] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:47.541064 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 255173us
W20260709 12:10:47.541802 18061 connection.cc:256] RPC call timeout handler was delayed by -1.0436995969998861s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1759s for a response
I20260709 12:10:47.543517 17947 raft_consensus.cc:1240] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:47.544962 21061 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:47.545504 21061 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:10:47.546389 20919 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:47.547009 20919 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:47.548039 21061 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123)
I20260709 12:10:47.549116 20919 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:47.550346 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:47.551148 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:47.551726 18093 raft_consensus.cc:2468] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
W20260709 12:10:47.553180 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 182120us
W20260709 12:10:47.549201 18061 leader_election.cc:336] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Timed out: RequestConsensusVote RPC to 127.16.98.196:43647 timed out after 1.759s (SENT)
I20260709 12:10:47.555425 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:47.555513 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:47.556053 18017 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:47.556989 18061 leader_election.cc:336] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Timed out: RequestConsensusVote RPC to 127.16.98.196:43647 timed out after 1.988s (SENT)
I20260709 12:10:47.557686 18093 raft_consensus.cc:1275] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:47.514422 21039 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:47.560132 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:47.562626 18095 raft_consensus.cc:3060] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:47.560181 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:47.561754 17940 raft_consensus.cc:1240] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 LEADER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:47.494143 21050 consensus_queue.cc:1059] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 12:10:47.569772 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:47.572886 18089 raft_consensus.cc:2410] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:47.570847 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:47.573158 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:47.534813 20386 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:47.582501 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:47.583105 18642 raft_consensus.cc:2468] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:47.584332 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:47.581704 18062 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:10:47.586261 17987 leader_election.cc:336] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Timed out: RequestConsensusVote RPC to 127.16.98.196:43647 timed out after 2.032s (SENT)
I20260709 12:10:47.586722 17987 leader_election.cc:304] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:47.587486 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:47.588119 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:47.588474 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:47.588790 18097 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:47.589067 18096 raft_consensus.cc:2468] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 5.
I20260709 12:10:47.589825 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:47.590351 18096 raft_consensus.cc:2468] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 3.
I20260709 12:10:47.592003 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:47.594326 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:47.595024 18016 raft_consensus.cc:2393] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 8: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:47.595698 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:47.599656 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:47.600337 18017 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 9.
I20260709 12:10:47.598234 17989 leader_election.cc:304] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:10:47.601012 17987 leader_election.cc:336] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Timed out: RequestConsensusVote RPC to 127.16.98.196:43647 timed out after 2.118s (SENT)
I20260709 12:10:47.601544 17987 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:47.602460 18094 raft_consensus.cc:1240] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:47.603392 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:47.607203 18016 raft_consensus.cc:3055] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:47.616298 18016 raft_consensus.cc:740] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:47.608071 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:47.621958 18096 raft_consensus.cc:2468] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 5.
I20260709 12:10:47.622320 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:47.622761 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:47.623282 18096 raft_consensus.cc:2468] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
I20260709 12:10:47.623323 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:47.618085 18097 raft_consensus.cc:2468] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
I20260709 12:10:47.624384 18609 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:47.606418 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:47.625269 18609 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:47.625710 18094 raft_consensus.cc:2393] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 9: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:47.625651 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:47.626782 18097 raft_consensus.cc:2410] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:10:47.628822 18095 raft_consensus.cc:2468] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
I20260709 12:10:47.646999 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:47.585603 20810 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.616992 18016 consensus_queue.cc:260] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:47.649938 18016 raft_consensus.cc:3060] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:47.650120 18094 raft_consensus.cc:1240] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 LEADER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:47.599473 20804 raft_consensus.cc:2804] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:10:47.613903 20622 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.591s	user 0.010s	sys 0.034s
I20260709 12:10:47.605286 20707 raft_consensus.cc:493] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.748785 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:47.615295 21035 raft_consensus.cc:2804] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:10:47.737213 21068 log.cc:927] Time spent T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:10:47.605924 21065 raft_consensus.cc:2749] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:47.631704 20781 raft_consensus.cc:493] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.586526 20797 consensus_queue.cc:1048] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:10:47.742795 20940 raft_consensus.cc:2749] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:47.651875 21060 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.746012 21052 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:47.731333 21054 raft_consensus.cc:2804] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:47.747718 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:47.815682 18637 raft_consensus.cc:2468] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
I20260709 12:10:47.659471 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:47.749810 18641 raft_consensus.cc:2410] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:10:47.750857 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:47.585565 20386 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:47.732865 20622 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.710s	user 0.011s	sys 0.034s
I20260709 12:10:47.827000 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:47.800697 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:47.770565 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:47.808706 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 207718us
I20260709 12:10:47.813484 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:47.814569 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:47.830927 18642 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:10:47.817054 18097 raft_consensus.cc:2468] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
I20260709 12:10:47.754069 20804 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.835199 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:47.837013 18022 raft_consensus.cc:3060] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:47.837807 21063 log.cc:927] Time spent T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
I20260709 12:10:47.751974 21035 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:47.838479 21035 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:47.839164 18017 raft_consensus.cc:1240] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:47.651434 21061 consensus_queue.cc:1048] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.120s
I20260709 12:10:47.733783 21062 raft_consensus.cc:2804] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:47.842411 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:47.843072 18017 raft_consensus.cc:2393] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 9: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:47.845032 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:47.755266 20466 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:47.755066 20919 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:47.651858 20972 consensus_queue.cc:1059] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.162s
I20260709 12:10:47.770205 21020 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:47.770843 21055 raft_consensus.cc:493] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.730974 20810 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:47.850792 18015 raft_consensus.cc:1240] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:47.763072 20966 consensus_queue.cc:1059] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 12:10:47.871361 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:47.815330 21054 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.873670 18023 raft_consensus.cc:1240] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 LEADER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:10:47.843583 20804 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:47.755957 20707 raft_consensus.cc:515] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:47.829236 21033 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.885632 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:47.808087 20781 raft_consensus.cc:515] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:47.834662 20961 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:47.878178 20930 leader_election.cc:290] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:47.904290 18093 raft_consensus.cc:2410] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:47.884356 21054 raft_consensus.cc:3060] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:47.889879 20972 raft_consensus.cc:493] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:47.883486 18022 raft_consensus.cc:2468] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
I20260709 12:10:47.870200 20919 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:47.870404 20466 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:47.916076 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 154121us
I20260709 12:10:47.897765 20821 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:47.882756 20717 consensus_queue.cc:1048] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:10:47.828644 21060 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:47.909987 21053 consensus_queue.cc:1048] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:10:47.896945 21033 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:47.932096 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 82073.8us
I20260709 12:10:47.938071 20386 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:47.939682 20952 leader_election.cc:290] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:47.940325 17987 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
W20260709 12:10:47.944984 21073 log.cc:927] Time spent T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:10:47.945815 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:47.947818 17912 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:47.948822 17912 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
W20260709 12:10:47.951789 21066 log.cc:927] Time spent T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
W20260709 12:10:47.955662 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 379948us
I20260709 12:10:47.958676 18637 raft_consensus.cc:1275] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:47.887207 21055 raft_consensus.cc:515] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:47.914547 20972 raft_consensus.cc:515] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:47.954110 20866 consensus_queue.cc:1048] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:47.968357 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:47.956830 20386 raft_consensus.cc:2804] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:47.970110 18061 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:47.960179 20769 raft_consensus.cc:2804] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:47.965950 17988 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:47.985100 21052 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:47.986331 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:47.989780 20386 raft_consensus.cc:697] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:48.029417 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:48.042099 18644 raft_consensus.cc:2468] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 4.
I20260709 12:10:47.969435 21083 raft_consensus.cc:2804] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:48.016037 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 50179.9us
I20260709 12:10:48.045812 17988 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:48.044306 21083 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:48.050351 21083 raft_consensus.cc:3060] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:47.990520 20769 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:47.991179 21050 raft_consensus.cc:2749] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:47.987186 21077 consensus_queue.cc:1048] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
W20260709 12:10:48.071557 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 131329us
I20260709 12:10:48.072679 17987 leader_election.cc:304] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:48.077253 17987 leader_election.cc:304] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:48.047410 20855 consensus_queue.cc:1048] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
W20260709 12:10:48.078298 21080 log.cc:927] Time spent T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:10:48.044865 21079 raft_consensus.cc:2804] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:48.082175 17987 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:48.045735 20966 consensus_queue.cc:1243] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer 4813437da0a74e65b61eb7bd1d18f110 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:10:48.083797 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 92894.9us
I20260709 12:10:48.049379 18635 raft_consensus.cc:2468] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
I20260709 12:10:48.063117 20769 raft_consensus.cc:3060] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.062021 20961 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:48.061571 20707 leader_election.cc:290] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:48.066218 21086 raft_consensus.cc:2749] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:48.102277 21086 raft_consensus.cc:2749] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:48.103017 21086 raft_consensus.cc:2804] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:48.103447 21086 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:48.103859 21086 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:48.107206 20386 consensus_queue.cc:237] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:48.110632 20940 consensus_queue.cc:1048] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:48.112155 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:48.113588 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:48.114782 21033 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:48.116017 20972 leader_election.cc:290] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:48.116243 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: true dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:48.085191 20466 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:48.083493 20866 raft_consensus.cc:2749] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:48.094023 21084 log.cc:927] Time spent T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:10:48.094957 21093 log.cc:927] Time spent T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:10:48.100234 21022 raft_consensus.cc:3055] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:48.114307 18639 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 8.
W20260709 12:10:48.128024 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 83425.1us
I20260709 12:10:48.138594 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:48.139281 18635 raft_consensus.cc:2468] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
I20260709 12:10:48.084599 21079 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:48.154846 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.155802 21079 raft_consensus.cc:3060] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.143553 21022 raft_consensus.cc:740] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
W20260709 12:10:48.159842 18608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:48.160228 18608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.159683 21022 consensus_queue.cc:260] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:48.160864 21022 raft_consensus.cc:3060] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.164474 21035 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:48.168278 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 122564us
I20260709 12:10:48.168431 21054 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:48.169536 18638 raft_consensus.cc:2368] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for earlier term 5. Current term is 6.
I20260709 12:10:48.173259 18608 leader_election.cc:304] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:48.169541 17988 leader_election.cc:304] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:48.166564 21035 leader_election.cc:290] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:48.178013 20769 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:48.158378 20781 leader_election.cc:290] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:48.198216 21102 raft_consensus.cc:2804] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:48.222172 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 136668us
I20260709 12:10:48.224891 18024 raft_consensus.cc:1240] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:48.223742 20866 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.226141 20866 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:48.227437 21043 log.cc:927] Time spent T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.997s	user 0.001s	sys 0.001s
I20260709 12:10:48.228258 20866 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:48.223774 20698 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.229176 20698 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:48.231220 20698 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:48.238528 17989 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.011s	sys 0.006s
W20260709 12:10:48.238972 17989 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.013s	sys 0.006s
W20260709 12:10:48.239280 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 637000us
I20260709 12:10:48.241711 20982 raft_consensus.cc:3055] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:48.242139 20982 raft_consensus.cc:740] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:48.243780 20769 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:48.244602 20919 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:48.244942 21054 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:48.245653 21044 log.cc:927] Time spent T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.926s	user 0.003s	sys 0.000s
W20260709 12:10:48.246614 21074 log.cc:927] Time spent T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.406s	user 0.000s	sys 0.001s
I20260709 12:10:48.196868 21083 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:48.249780 21083 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:48.216110 21094 consensus_queue.cc:1048] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:10:48.224012 20781 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:48.251091 20698 consensus_queue.cc:1048] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:48.251698 20781 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:48.254181 20781 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:48.249927 21071 log.cc:927] Time spent T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.374s	user 0.000s	sys 0.000s
I20260709 12:10:48.256596 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
W20260709 12:10:48.261112 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 87951.6us
I20260709 12:10:48.224341 17987 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:48.265830 18062 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:48.272413 17989 leader_election.cc:304] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:48.255376 21102 raft_consensus.cc:493] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:48.276672 21086 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:48.277979 20949 raft_consensus.cc:2749] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:48.276443 21079 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:48.279103 21086 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:48.273355 18062 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:48.280242 20949 raft_consensus.cc:2804] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:48.280579 18062 leader_election.cc:304] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:48.280933 20949 raft_consensus.cc:697] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:48.284633 20949 consensus_queue.cc:237] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:48.285961 21076 raft_consensus.cc:2804] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:48.287302 20606 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:48.265730 20919 consensus_queue.cc:1059] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:10:48.297482 21076 raft_consensus.cc:697] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:48.287459 21079 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:48.220357 20804 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:48.298148 20928 raft_consensus.cc:3055] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:48.298820 20928 raft_consensus.cc:740] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:48.298362 21076 consensus_queue.cc:237] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:48.288574 21064 raft_consensus.cc:2749] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:48.292501 21105 consensus_queue.cc:1059] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:48.298116 20919 raft_consensus.cc:3055] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:48.299624 21105 consensus_queue.cc:1243] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer 63f5bddeebd84e5788d671a176cfa8e1 log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:10:48.299927 20919 raft_consensus.cc:740] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:48.300240 21105 raft_consensus.cc:3055] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:48.300621 21105 raft_consensus.cc:740] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:48.300823 20919 consensus_queue.cc:260] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:48.301682 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.301373 21105 consensus_queue.cc:260] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:48.302227 20919 raft_consensus.cc:3060] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.302989 21105 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:48.304450 17989 leader_election.cc:304] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:48.306171 21060 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:48.307721 20775 raft_consensus.cc:2804] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:48.308141 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:48.294791 20982 consensus_queue.cc:260] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:48.319224 20811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:60424 (request call id 821) took 7515 ms. Trace:
I20260709 12:10:48.319737 20982 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.319682 20811 rpcz_store.cc:276] 0709 12:10:40.810269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.952836 (+142567us) service_pool.cc:224] Handling call
0709 12:10:41.173529 (+220693us) ts_tablet_manager.cc:934] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
0709 12:10:47.267368 (+6093839us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:10:48.139254 (+871886us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:48.139376 (+   122us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:10:48.298719 (+159343us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:10:48.299001 (+   282us) tablet_replica.cc:206] Creating consensus instance
0709 12:10:48.309009 (+ 10008us) ts_tablet_manager.cc:989] Replica registered.
0709 12:10:48.309075 (+    66us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":43322,"tablet-copy.queue_time_us":150863,"thread_start_us":314939,"threads_started":2}
I20260709 12:10:48.321149 20811 tablet_copy_client.cc:806] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:10:48.321691 20811 tablet_copy_client.cc:670] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:10:48.299669 20928 consensus_queue.cc:260] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:48.323805 20928 raft_consensus.cc:3060] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.295365 20866 raft_consensus.cc:2749] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:48.329476 18094 raft_consensus.cc:1240] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:48.330812 18095 raft_consensus.cc:1240] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:48.331998 18097 raft_consensus.cc:1275] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:48.332864 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:48.296123 21102 raft_consensus.cc:3060] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:48.296335 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 72057.7us
I20260709 12:10:48.323829 18638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60412 (request call id 885) took 1006 ms. Trace:
I20260709 12:10:48.337778 18638 rpcz_store.cc:276] 0709 12:10:47.317374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:47.321863 (+  4489us) service_pool.cc:224] Handling call
0709 12:10:48.111958 (+790095us) spinlock_profiling.cc:243] Waited 6.64 ms on lock 0x7b58001c4a98. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4988db71 00007f7f4988da22 00007f7f527a68d9 00007f7f51900ee0 00007f7f519ca0ab 00007f7f519ca131 00007f7f519780a0 00007f7f51977984 00007f7f4aef26d4 00007f7f4aef2662
0709 12:10:48.323638 (+211680us) spinlock_profiling.cc:243] Waited 56.6 ms on lock 0x7b54004628d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:48.323758 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":145460992}
I20260709 12:10:48.339354 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:48.341709 17912 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:48.342419 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:48.343827 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:48.345178 21014 raft_consensus.cc:3060] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:48.349370 17987 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:48.351714 21053 raft_consensus.cc:2749] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:48.353554 18094 raft_consensus.cc:1240] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:48.308244 20775 raft_consensus.cc:697] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:48.294286 18608 leader_election.cc:304] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:48.353618 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:48.355427 20977 raft_consensus.cc:2749] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:48.264983 21054 raft_consensus.cc:2749] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:48.315922 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:48.316944 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:47.295357 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:48.359072 17987 leader_election.cc:304] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
W20260709 12:10:48.358297 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 64087.3us
I20260709 12:10:48.359779 20606 raft_consensus.cc:2804] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:48.360191 20606 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:48.360616 20606 raft_consensus.cc:3060] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:48.360685 18608 leader_election.cc:304] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:48.360442 17842 catalog_manager.cc:5697] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 2 to 5, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 5 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:48.362833 20977 raft_consensus.cc:2749] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:48.363463 20977 consensus_queue.cc:1048] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:48.364430 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:48.365512 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:48.366505 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:48.367090 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:48.367223 18642 raft_consensus.cc:2468] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 7.
I20260709 12:10:48.367663 18638 raft_consensus.cc:2468] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
W20260709 12:10:48.367842 17987 consensus_peers.cc:597] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 137ed415b9d242989f28f349c1618c74. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:10:48.368144 21085 raft_consensus.cc:3055] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:48.368541 21085 raft_consensus.cc:740] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:48.369316 21085 consensus_queue.cc:260] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:48.370347 21085 raft_consensus.cc:3060] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:48.366611 21054 consensus_queue.cc:1059] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:10:48.411904 21054 raft_consensus.cc:3055] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:48.412358 21054 raft_consensus.cc:740] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:48.413364 21054 consensus_queue.cc:260] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:48.370860 21094 raft_consensus.cc:2804] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:48.370812 17912 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:48.414847 21094 raft_consensus.cc:493] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
W20260709 12:10:48.415073 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 44421.8us
I20260709 12:10:48.415406 21094 raft_consensus.cc:3060] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:48.415784 17912 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:48.418838 21101 raft_consensus.cc:2804] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:48.418903 21039 raft_consensus.cc:2804] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:48.419348 21101 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:48.419529 21039 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:48.419790 21101 raft_consensus.cc:3060] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.420086 21039 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:48.369956 20606 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:48.388029 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:48.422446 21054 raft_consensus.cc:3060] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:48.422556 20606 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:48.371827 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:48.423259 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:48.423599 18639 raft_consensus.cc:2410] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:10:48.423766 18644 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:48.424355 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:48.425376 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:48.426316 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:48.373848 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:48.374475 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:48.374716 20810 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:48.375290 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:48.427395 18637 raft_consensus.cc:2468] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 3.
I20260709 12:10:48.382221 17988 leader_election.cc:304] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:48.428237 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:48.383001 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:48.429034 18016 raft_consensus.cc:2393] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 6: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:48.429877 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:48.385138 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:48.431737 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:48.432400 18024 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:48.385444 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:48.434604 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:48.435878 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:48.437040 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:48.437697 18020 raft_consensus.cc:2468] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:10:48.385766 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:48.439563 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:48.440794 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:48.442029 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:48.386478 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:48.443795 18023 raft_consensus.cc:1240] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:48.444984 18023 raft_consensus.cc:1240] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:48.386502 18015 raft_consensus.cc:1240] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:48.387399 20769 raft_consensus.cc:493] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:48.446630 20769 raft_consensus.cc:515] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:48.388098 21041 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.388253 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:48.448226 21041 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:48.366606 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:48.449113 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:48.449539 18636 raft_consensus.cc:2468] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:48.449920 18638 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 8.
I20260709 12:10:48.450663 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:48.388985 20887 consensus_queue.cc:1059] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:48.451964 20887 raft_consensus.cc:3055] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:48.452138 20940 raft_consensus.cc:2804] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:48.452463 20887 raft_consensus.cc:740] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:48.452924 20940 raft_consensus.cc:697] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:48.453819 20940 consensus_queue.cc:237] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:48.389608 20386 consensus_queue.cc:1059] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:48.455053 20386 raft_consensus.cc:3055] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:48.455463 20386 raft_consensus.cc:740] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:48.456374 20386 consensus_queue.cc:260] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:48.457790 20386 raft_consensus.cc:3060] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:48.457912 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:48.390769 18094 raft_consensus.cc:3055] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:48.458858 18094 raft_consensus.cc:740] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
W20260709 12:10:48.459632 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.391775 17913 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:48.460618 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 68913us
I20260709 12:10:48.388469 20977 consensus_queue.cc:1059] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:48.393924 18061 leader_election.cc:400] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Vote denied by peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647) with higher term. Message: Invalid argument: T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for earlier term 5. Current term is 6.
I20260709 12:10:48.391271 20775 consensus_queue.cc:237] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:48.396348 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:48.397459 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:48.398135 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:48.399590 20466 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.400660 17987 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:48.400846 17914 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:48.404989 18607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:48.490413 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 89818.5us
I20260709 12:10:48.405786 18608 leader_election.cc:304] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:48.406536 18098 raft_consensus.cc:2468] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
I20260709 12:10:48.366737 18095 raft_consensus.cc:1240] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 LEADER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:48.378017 21102 raft_consensus.cc:515] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:48.373208 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:48.428959 18639 raft_consensus.cc:2468] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 7.
I20260709 12:10:48.453567 20887 consensus_queue.cc:260] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:48.459388 20882 consensus_queue.cc:1175] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4813437da0a74e65b61eb7bd1d18f110" responder_term: 8 status { last_received { term: 8 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 8 index: 5 } }
I20260709 12:10:48.394564 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:48.392282 20804 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:48.390493 21055 leader_election.cc:290] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:48.458554 18635 raft_consensus.cc:3060] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:48.473515 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:48.519418 17989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:48.480495 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 98364.5us
W20260709 12:10:48.480557 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 86760.5us
I20260709 12:10:48.438632 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:48.520912 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:48.484990 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
W20260709 12:10:48.490592 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 89806.7us
I20260709 12:10:48.522099 18061 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:48.493300 18642 raft_consensus.cc:2468] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:48.522301 17842 catalog_manager.cc:5697] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 1 to 4, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 4 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } }
I20260709 12:10:48.491340 17987 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:48.480664 18094 consensus_queue.cc:260] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:48.524425 18094 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.507653 18089 raft_consensus.cc:1275] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:10:48.514801 17947 raft_consensus.cc:1240] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:48.525219 18089 pending_rounds.cc:85] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110: Aborting all ops after (but not including) 4
I20260709 12:10:48.525466 18089 pending_rounds.cc:107] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:10:48.517593 17945 raft_consensus.cc:1275] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:48.525676 18089 raft_consensus.cc:2889] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:48.518347 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:48.570989 18023 raft_consensus.cc:1240] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 6. Current term is 8. Ops: []
I20260709 12:10:48.568487 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
W20260709 12:10:48.569056 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 77799.7us
I20260709 12:10:48.461283 20986 raft_consensus.cc:2749] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:48.573002 18639 raft_consensus.cc:3060] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:48.578600 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:48.581393 17987 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:48.527979 17914 leader_election.cc:304] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:48.573621 17842 catalog_manager.cc:5697] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 1 to 3, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 3 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:48.567473 21103 raft_consensus.cc:2749] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:10:48.568684 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 48518us
I20260709 12:10:48.499701 21064 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.598136 18062 leader_election.cc:304] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:48.600759 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 78726us
W20260709 12:10:48.602483 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 196747us
I20260709 12:10:48.603437 18608 leader_election.cc:304] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:48.609895 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:48.499142 20877 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:48.619061 21099 raft_consensus.cc:3055] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:48.619515 21099 raft_consensus.cc:740] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:48.619624 21050 raft_consensus.cc:2804] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:48.620029 21050 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:48.611565 17842 catalog_manager.cc:5697] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 2 to 5, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 5 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
W20260709 12:10:48.627964 18610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.601436 18061 leader_election.cc:304] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:48.576180 20887 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:48.620400 21050 raft_consensus.cc:3060] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:48.526319 20839 raft_consensus.cc:2749] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:48.525920 21014 consensus_queue.cc:1059] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.088s
I20260709 12:10:48.680612 18635 raft_consensus.cc:2468] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
I20260709 12:10:48.681546 18642 raft_consensus.cc:1240] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 12:10:48.694314 17847 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45912 (request call id 379) took 18117 ms (client timeout 15000 ms). Trace:
W20260709 12:10:48.694818 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 93515.5us
W20260709 12:10:48.667771 21062 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.000s	sys 0.020s
I20260709 12:10:48.698055 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:48.699363 17947 raft_consensus.cc:3060] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:48.700819 17842 catalog_manager.cc:5697] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 4 to 5, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 5 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:48.676864 18096 raft_consensus.cc:2955] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:10:48.503612 20466 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:48.697578 20769 leader_election.cc:290] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:48.673337 20982 raft_consensus.cc:2804] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:48.674964 20949 raft_consensus.cc:2804] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:10:48.700970 21062 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.000s	sys 0.020s
W20260709 12:10:48.747241 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 143892us
I20260709 12:10:48.743239 18639 raft_consensus.cc:2468] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 5.
I20260709 12:10:48.750770 17912 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:48.750968 17949 raft_consensus.cc:1240] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:48.752746 17942 raft_consensus.cc:1275] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:48.756239 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:48.621742 21060 consensus_queue.cc:1059] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 12:10:48.713569 21000 raft_consensus.cc:2804] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:48.765728 17842 catalog_manager.cc:5697] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 1 to 2, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:48.763841 18608 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:48.775920 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:48.675271 20877 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:48.715127 20977 raft_consensus.cc:2804] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:48.777280 18608 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:48.777083 17842 catalog_manager.cc:5697] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 2 to 4, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 4 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:10:48.611244 21064 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:48.747668 21014 consensus_queue.cc:1243] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer 63f5bddeebd84e5788d671a176cfa8e1 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 12:10:48.788182 18062 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.745560 20982 raft_consensus.cc:493] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:48.758931 20864 raft_consensus.cc:2749] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:48.797434 18608 leader_election.cc:400] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Vote denied by peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297) with higher term. Message: Invalid argument: T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 7. Current term is 8.
I20260709 12:10:48.823422 18608 leader_election.cc:403] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:48.791667 20855 raft_consensus.cc:2804] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:48.797782 21103 raft_consensus.cc:2749] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:48.753316 21062 raft_consensus.cc:697] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:48.817903 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:48.817611 17842 catalog_manager.cc:5697] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 3 to 5, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 5 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:48.778584 21022 raft_consensus.cc:2749] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:48.694783 17847 rpcz_store.cc:269] 0709 12:10:30.556316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.742416 (+186100us) service_pool.cc:224] Handling call
0709 12:10:48.673322 (+17930906us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:40.258722 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:40.259388 (+   666us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:40.259437 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:10:40.259464 (+    27us) tablet.cc:662] Decoding operations
0709 12:10:40.260047 (+   583us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:40.260121 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:40.260149 (+    28us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:10:40.260582 (+   433us) tablet.cc:701] Row locks acquired
0709 12:10:40.260631 (+    49us) write_op.cc:260] PREPARE: finished
0709 12:10:40.260814 (+   183us) write_op.cc:270] Start()
0709 12:10:40.260955 (+   141us) write_op.cc:276] Timestamp: P: 1783599040260754 usec, L: 0
0709 12:10:40.260971 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 12:10:40.328257 (+ 67286us) log.cc:844] Serialized 1307 byte log entry
0709 12:10:41.176590 (+848333us) op_driver.cc:464] REPLICATION: finished
0709 12:10:41.609873 (+433283us) write_op.cc:301] APPLY: starting
0709 12:10:41.625739 (+ 15866us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:41.663019 (+ 37280us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:41.663156 (+   137us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:41.663719 (+   563us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:41.663987 (+   268us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:10:41.664028 (+    41us) write_op.cc:312] APPLY: finished
0709 12:10:41.664527 (+   499us) log.cc:844] Serialized 35 byte log entry
0709 12:10:41.664775 (+   248us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:41.665014 (+   239us) write_op.cc:454] Released schema lock
0709 12:10:41.665080 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:41.665502 (+   422us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:41.674972 (+  9470us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8149,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":387955,"apply.run_cpu_time_us":2991,"apply.run_wall_time_us":81239,"num_ops":3,"prepare.queue_time_us":396855,"prepare.run_cpu_time_us":44213,"prepare.run_wall_time_us":428882,"raft.queue_time_us":148703,"raft.run_cpu_time_us":26451,"raft.run_wall_time_us":398084,"replication_time_us":875679,"thread_start_us":820130,"threads_started":4,"wal-append.queue_time_us":308645,"wal-append.run_cpu_time_us":22852,"wal-append.run_wall_time_us":2054185}]]}
I20260709 12:10:48.821815 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:48.772086 21000 raft_consensus.cc:493] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:48.801700 17947 raft_consensus.cc:2468] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
W20260709 12:10:48.840934 18062 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.852720 20855 raft_consensus.cc:697] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:48.782204 20977 raft_consensus.cc:493] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:48.782224 20949 raft_consensus.cc:697] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:48.820637 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:48.854166 17940 raft_consensus.cc:2468] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
I20260709 12:10:48.822906 21023 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:48.819406 20982 raft_consensus.cc:3060] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:48.883877 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.890349 18639 raft_consensus.cc:1240] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:48.878997 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:48.853174 21105 raft_consensus.cc:2749] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297) with higher term. Message: Invalid argument: T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 7. Current term is 8.
I20260709 12:10:48.881608 21000 raft_consensus.cc:3060] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:48.892253 20977 raft_consensus.cc:3060] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:48.536487 20810 consensus_queue.cc:1175] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "63f5bddeebd84e5788d671a176cfa8e1" responder_term: 7 status { last_received { term: 7 index: 4 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 6. Current term is 7. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:10:48.980089 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 452176us
I20260709 12:10:48.987170 17914 leader_election.cc:304] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:48.979802 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 389145us
W20260709 12:10:48.983763 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 402405us
W20260709 12:10:48.991640 18024 consensus_meta.cc:287] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.559s	user 0.012s	sys 0.014s
I20260709 12:10:48.992168 18024 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 9.
I20260709 12:10:48.994889 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:48.995088 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:48.996403 18062 leader_election.cc:304] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:48.999050 18021 raft_consensus.cc:1275] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:10:48.999464 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:48.999758 17914 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:49.001106 18020 raft_consensus.cc:2468] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 9.
W20260709 12:10:49.001730 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 390378us
I20260709 12:10:49.002753 18018 raft_consensus.cc:1275] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:10:49.005344 17914 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:49.007261 17914 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:49.013942 17914 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:49.015197 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 232136us
I20260709 12:10:49.015720 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:49.016134 18608 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:49.019157 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:49.019776 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:49.029765 18610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:49.012967 21110 log.cc:927] Time spent T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 12:10:48.985064 20877 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:49.037901 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:49.010579 20769 raft_consensus.cc:3060] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:49.004488 21086 raft_consensus.cc:2764] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:10:49.014037 21035 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.041323 18608 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:48.915596 21023 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:49.012953 21102 leader_election.cc:290] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:49.046208 21064 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:49.019248 21076 raft_consensus.cc:2804] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:10:49.036397 21112 log.cc:927] Time spent T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.360s	user 0.001s	sys 0.000s
I20260709 12:10:49.027275 21022 raft_consensus.cc:2749] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:49.048241 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:49.050164 18608 leader_election.cc:304] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:49.056891 18608 leader_election.cc:304] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:49.048866 21116 raft_consensus.cc:2749] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:49.058862 18608 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:49.039438 21119 raft_consensus.cc:2804] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:49.063318 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:49.068326 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:49.069000 17941 raft_consensus.cc:2468] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:49.070149 17940 raft_consensus.cc:2393] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 9: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
W20260709 12:10:49.063620 18094 consensus_meta.cc:287] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.539s	user 0.019s	sys 0.031s
I20260709 12:10:49.070922 18094 raft_consensus.cc:1275] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:10:49.071353 18094 pending_rounds.cc:85] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110: Aborting all ops after (but not including) 3
I20260709 12:10:49.071908 18094 pending_rounds.cc:107] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:10:49.072193 18094 raft_consensus.cc:2889] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:49.052345 21079 raft_consensus.cc:2749] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:49.079417 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:49.004762 21062 consensus_queue.cc:237] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:49.117053 18607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:49.070657 21113 log.cc:927] Time spent T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 12:10:49.050465 21118 raft_consensus.cc:2749] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:49.076170 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:49.077116 18608 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:49.073849 17946 raft_consensus.cc:1275] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 12:10:49.132097 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 55054.7us
I20260709 12:10:49.132817 18608 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:49.090036 20928 raft_consensus.cc:3055] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:49.091754 20882 raft_consensus.cc:2749] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:10:49.099517 18061 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.98.196:43647 timed out after 1.555s (SENT) [suppressed 30 similar messages]
W20260709 12:10:49.100718 21111 log.cc:927] Time spent T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.116s	user 0.002s	sys 0.000s
I20260709 12:10:49.049214 20949 consensus_queue.cc:237] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:49.069566 21114 log.cc:927] Time spent T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.306s	user 0.001s	sys 0.001s
I20260709 12:10:49.074966 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:49.176374 17941 raft_consensus.cc:2468] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 7.
I20260709 12:10:49.052019 21076 raft_consensus.cc:493] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.064450 21103 raft_consensus.cc:2749] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:49.121090 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:49.183904 18021 raft_consensus.cc:3060] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:49.121615 18023 raft_consensus.cc:1240] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:49.126480 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:49.185086 18094 raft_consensus.cc:2468] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 7.
I20260709 12:10:49.179654 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:49.167878 17944 raft_consensus.cc:2955] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:10:49.191185 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:49.191757 17941 raft_consensus.cc:2468] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 7.
I20260709 12:10:49.195214 18021 raft_consensus.cc:2468] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
I20260709 12:10:49.135097 21116 raft_consensus.cc:2749] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:49.130554 18019 raft_consensus.cc:1240] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 8. Current term is 9. Ops: []
W20260709 12:10:49.086433 20386 consensus_meta.cc:287] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.628s	user 0.009s	sys 0.038s
I20260709 12:10:49.070416 21119 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:49.207033 21119 raft_consensus.cc:3060] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.211105 21116 raft_consensus.cc:2749] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:49.214108 20887 consensus_meta.cc:287] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.535s	user 0.021s	sys 0.000s
I20260709 12:10:49.214840 17948 raft_consensus.cc:2468] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 9.
W20260709 12:10:49.215190 21085 consensus_meta.cc:287] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.804s	user 0.013s	sys 0.007s
I20260709 12:10:49.138543 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:49.053651 21035 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:49.039098 20855 consensus_queue.cc:237] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:49.140507 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:49.218782 18093 raft_consensus.cc:3060] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:49.110405 21041 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:49.143652 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.116132 21022 raft_consensus.cc:2804] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:49.183938 21076 raft_consensus.cc:3060] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.161439 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:49.237216 18093 raft_consensus.cc:2468] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:10:49.237429 18643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60430 (request call id 681) took 1099 ms. Trace:
I20260709 12:10:49.237622 18090 raft_consensus.cc:2468] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
I20260709 12:10:49.178825 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:49.054143 21036 consensus_queue.cc:1048] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.128s
I20260709 12:10:49.092017 21099 consensus_queue.cc:260] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:49.127247 18644 consensus_meta.cc:287] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.703s	user 0.007s	sys 0.018s
I20260709 12:10:49.135270 20928 raft_consensus.cc:740] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:49.110724 21121 consensus_queue.cc:1048] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.103s
I20260709 12:10:49.220849 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:49.162382 21086 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:49.184381 20466 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:49.237792 18643 rpcz_store.cc:276] 0709 12:10:48.137695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.143995 (+  6300us) service_pool.cc:224] Handling call
0709 12:10:48.144306 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:48.197743 (+ 53437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.197771 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:48.199056 (+  1285us) log.cc:844] Serialized 26 byte log entry
0709 12:10:48.696486 (+497430us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:48.696554 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:48.696654 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:49.100078 (+403424us) spinlock_profiling.cc:243] Waited 7.53 ms on lock 0x7b4400022b4c. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f497ebc85 00007f7f497ec6a2 00007f7f4c55e1db 00007f7f4c559aaf 00007f7f4c54d86e 00007f7f4c54cbb6 00007f7f4c54c7d8 00007f7f4c556221 00007f7f4c5561d9 00007f7f4c556169
0709 12:10:49.237156 (+137078us) raft_consensus.cc:1685] finished
0709 12:10:49.237179 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.237373 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53003,"raft.queue_time_us":67557,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":4494,"spinlock_wait_cycles":17312128,"thread_start_us":497053,"threads_started":1,"wal-append.queue_time_us":682497}
I20260709 12:10:49.251477 21099 raft_consensus.cc:3060] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:49.255486 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 259164us
I20260709 12:10:49.256124 17941 raft_consensus.cc:1275] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:10:49.258564 18015 raft_consensus.cc:1240] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:49.259347 18023 raft_consensus.cc:1240] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:49.260500 18016 raft_consensus.cc:1240] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:49.239410 18644 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
I20260709 12:10:49.228732 18640 raft_consensus.cc:2468] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:49.240365 17946 raft_consensus.cc:2468] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 7.
I20260709 12:10:49.287555 18019 raft_consensus.cc:1275] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:49.290562 17988 leader_election.cc:304] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:49.298156 17988 leader_election.cc:304] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:49.242312 21022 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.312039 18062 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:49.239612 21119 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:49.297223 21120 raft_consensus.cc:2749] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:49.308300 18636 raft_consensus.cc:1240] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:49.309444 21022 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:49.261200 21086 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:49.308775 20940 raft_consensus.cc:2749] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:49.294358 20930 consensus_queue.cc:1059] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:10:49.297006 21060 consensus_queue.cc:1059] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:10:49.296892 20804 consensus_queue.cc:1059] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:10:49.305575 21065 consensus_queue.cc:1059] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
W20260709 12:10:49.322894 21101 consensus_meta.cc:287] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.903s	user 0.016s	sys 0.026s
I20260709 12:10:49.310935 21122 consensus_queue.cc:1048] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 12:10:49.368220 21023 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:49.431974 21077 raft_consensus.cc:3055] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:49.432596 21077 raft_consensus.cc:740] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:49.417215 21101 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:49.445446 21101 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:49.486255 21086 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:49.487803 21094 consensus_meta.cc:287] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 1.072s	user 0.024s	sys 0.000s
I20260709 12:10:49.488440 21094 raft_consensus.cc:515] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:49.492404 21119 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:49.525693 17842 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.009s	sys 0.009s
W20260709 12:10:49.539593 17914 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.016s	sys 0.011s
W20260709 12:10:49.540215 17914 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.017s	sys 0.011s
W20260709 12:10:49.543547 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 231410us
W20260709 12:10:49.544121 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.549901 18021 raft_consensus.cc:1240] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:49.539955 17945 raft_consensus.cc:1240] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 6. Current term is 7. Ops: []
W20260709 12:10:49.551739 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 452066us
I20260709 12:10:49.553932 18091 raft_consensus.cc:1240] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 5. Current term is 6. Ops: []
W20260709 12:10:49.555235 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 542687us
I20260709 12:10:49.555109 17988 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:49.564441 17988 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:49.567525 17914 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:49.574198 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
W20260709 12:10:49.575685 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 442752us
W20260709 12:10:49.577876 18638 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.116s	user 0.003s	sys 0.022s
I20260709 12:10:49.581455 18641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60412 (request call id 905) took 1206 ms. Trace:
I20260709 12:10:49.577275 18608 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:49.578424 18638 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.117s	user 0.003s	sys 0.022s
W20260709 12:10:49.587617 18607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:49.591423 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:49.599735 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 52828.4us
W20260709 12:10:49.379443 20717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.005s	sys 0.031s
I20260709 12:10:49.628705 20810 raft_consensus.cc:2804] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:49.615717 20503 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:49.634883 20503 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:49.639196 21065 raft_consensus.cc:2749] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:49.641669 18638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60412 (request call id 903) took 1267 ms. Trace:
I20260709 12:10:49.643290 21035 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:49.642246 18638 rpcz_store.cc:276] 0709 12:10:48.374425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.450715 (+ 76290us) service_pool.cc:224] Handling call
0709 12:10:48.451082 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:48.460390 (+  9308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.460439 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:48.460992 (+   553us) log.cc:844] Serialized 26 byte log entry
0709 12:10:49.591198 (+1130206us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:49.632326 (+ 41128us) log.cc:844] Serialized 14 byte log entry
0709 12:10:49.641180 (+  8854us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.641305 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:49.641353 (+    48us) raft_consensus.cc:1685] finished
0709 12:10:49.641364 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.641582 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6555,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":339,"thread_start_us":1169691,"threads_started":2,"wal-append.queue_time_us":998790}
I20260709 12:10:49.645969 20930 raft_consensus.cc:3055] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:49.647643 21130 raft_consensus.cc:3055] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:49.647142 20928 consensus_queue.cc:260] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:49.648247 21130 raft_consensus.cc:740] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:49.648186 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:49.650058 21094 leader_election.cc:290] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:49.650341 21099 raft_consensus.cc:493] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.650220 21130 consensus_queue.cc:260] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:49.651257 20810 raft_consensus.cc:697] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:49.651197 21099 raft_consensus.cc:515] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:49.653165 21130 raft_consensus.cc:3060] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:49.654960 20986 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.032s	sys 0.044s
W20260709 12:10:49.655576 20986 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.032s	sys 0.044s
I20260709 12:10:49.660132 21086 consensus_queue.cc:1048] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:49.653517 20810 consensus_queue.cc:237] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:49.433689 21077 consensus_queue.cc:260] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:49.664196 21077 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:49.638414 20503 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:49.670439 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 103175us
W20260709 12:10:49.638345 20977 consensus_meta.cc:287] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.632s	user 0.005s	sys 0.005s
I20260709 12:10:49.674424 20977 raft_consensus.cc:515] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:49.675287 21020 consensus_queue.cc:1048] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:10:49.677373 20977 leader_election.cc:290] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:49.677515 21020 consensus_queue.cc:1048] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:10:49.678308 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:49.679569 17946 raft_consensus.cc:2468] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
I20260709 12:10:49.679955 21062 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:49.680860 21062 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:49.683184 21023 raft_consensus.cc:2804] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:49.683750 21023 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:49.684211 21023 raft_consensus.cc:3060] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:49.685078 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
W20260709 12:10:49.686790 20717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.006s	sys 0.032s
I20260709 12:10:49.687330 21036 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.688088 21036 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:49.646631 20930 raft_consensus.cc:740] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:49.692139 20930 consensus_queue.cc:260] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:49.694106 21099 leader_election.cc:290] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:49.695603 17914 leader_election.cc:304] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:49.696031 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:49.697911 20986 raft_consensus.cc:2749] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:49.702962 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 96186.4us
I20260709 12:10:49.704525 18608 leader_election.cc:304] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:49.705181 20811 tablet_copy_client.cc:538] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:10:49.706432 21085 raft_consensus.cc:2804] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:49.706934 21121 raft_consensus.cc:2804] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:49.707257 21099 consensus_queue.cc:1059] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:49.708364 21099 raft_consensus.cc:3055] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:49.708809 21099 raft_consensus.cc:740] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:49.708652 21076 raft_consensus.cc:515] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:49.710659 21085 raft_consensus.cc:697] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:49.712149 21085 consensus_queue.cc:237] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:49.712967 21036 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:49.713699 21076 leader_election.cc:290] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:49.715667 18017 raft_consensus.cc:1240] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:49.714232 21116 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.717331 21116 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:49.707551 21121 raft_consensus.cc:697] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:49.719887 21121 consensus_queue.cc:237] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:49.698125 17914 leader_election.cc:304] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:49.650233 21141 raft_consensus.cc:2749] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:49.693918 20930 raft_consensus.cc:3060] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:49.735843 21000 consensus_meta.cc:287] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.734s	user 0.010s	sys 0.005s
I20260709 12:10:49.736449 21000 raft_consensus.cc:515] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:49.737390 18061 leader_election.cc:336] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Timed out: RequestConsensusVote RPC to 127.16.98.196:43647 timed out after 1.674s (SENT)
I20260709 12:10:49.721968 21099 consensus_queue.cc:260] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:49.791949 20466 raft_consensus.cc:2749] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:49.796507 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:10:49.797636 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 46589.7us
I20260709 12:10:49.798602 18062 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:49.799464 21099 raft_consensus.cc:3060] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.799774 21155 consensus_queue.cc:1059] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:10:49.801347 21155 raft_consensus.cc:2804] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:49.801913 21155 raft_consensus.cc:697] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:49.802896 21076 raft_consensus.cc:3055] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:49.803390 21076 raft_consensus.cc:740] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:49.804867 18061 leader_election.cc:304] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:49.804720 21076 consensus_queue.cc:260] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:49.806169 21157 raft_consensus.cc:2749] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:49.807142 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 109220us
I20260709 12:10:49.806274 21076 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:49.808323 17914 leader_election.cc:304] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:49.810803 20882 raft_consensus.cc:2749] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:49.811466 21023 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:49.812160 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:49.813081 17943 raft_consensus.cc:3060] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.813465 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:49.814103 20882 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:49.815003 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:49.815281 18644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60424 (request call id 878) took 1409 ms. Trace:
I20260709 12:10:49.816259 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:49.816568 21000 leader_election.cc:290] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:49.817499 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:49.818357 17940 raft_consensus.cc:2393] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 8: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:49.819520 20977 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:49.819692 18643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60424 (request call id 877) took 1414 ms. Trace:
I20260709 12:10:49.821166 17943 raft_consensus.cc:2468] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
I20260709 12:10:49.820135 18643 rpcz_store.cc:276] 0709 12:10:48.405107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.249165 (+844058us) service_pool.cc:224] Handling call
0709 12:10:49.249457 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:49.249780 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:49.249806 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:49.264020 (+ 14214us) log.cc:844] Serialized 26 byte log entry
0709 12:10:49.634220 (+370200us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:49.732101 (+ 97881us) log.cc:844] Serialized 14 byte log entry
0709 12:10:49.819140 (+ 87039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.819238 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:49.819281 (+    43us) raft_consensus.cc:1685] finished
0709 12:10:49.819303 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.819490 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":174173,"prepare.queue_time_us":104819,"raft.queue_time_us":79927,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":200,"thread_start_us":369606,"threads_started":1,"wal-append.queue_time_us":466183}
I20260709 12:10:49.822685 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:49.832507 18061 leader_election.cc:304] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:49.834369 21116 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:49.834729 18061 leader_election.cc:304] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:49.835266 21054 consensus_meta.cc:287] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 1.412s	user 0.016s	sys 0.017s
I20260709 12:10:49.836328 21000 raft_consensus.cc:2804] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:10:49.836858 21000 raft_consensus.cc:493] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:49.836453 21155 consensus_queue.cc:237] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:49.837298 21000 raft_consensus.cc:3060] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:10:49.838860 18022 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.012s	sys 0.005s
W20260709 12:10:49.839282 18022 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.013s	sys 0.005s
I20260709 12:10:49.840981 17945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50334 (request call id 2127) took 1167 ms. Trace:
I20260709 12:10:49.841389 17945 rpcz_store.cc:276] 0709 12:10:48.673822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.674945 (+  1123us) service_pool.cc:224] Handling call
0709 12:10:48.675330 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.551200 (+875870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.840687 (+289487us) spinlock_profiling.cc:243] Waited 864 ms on lock 0x7b540031cc54. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:49.840898 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1986834816}
I20260709 12:10:49.820152 20977 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:49.846132 20882 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:49.848817 21039 consensus_meta.cc:287] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 1.428s	user 0.028s	sys 0.023s
I20260709 12:10:49.849370 20882 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:49.851969 18091 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41818 (request call id 830) took 1098 ms. Trace:
I20260709 12:10:49.852387 18091 rpcz_store.cc:276] 0709 12:10:48.753418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.753596 (+   178us) service_pool.cc:224] Handling call
0709 12:10:48.776234 (+ 22638us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.554475 (+778241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.851637 (+297162us) spinlock_profiling.cc:243] Waited 777 ms on lock 0x7b54003593d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:49.851858 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1786848640}
I20260709 12:10:49.853291 21077 raft_consensus.cc:2749] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:49.854713 18636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60412 (request call id 904) took 1480 ms. Trace:
W20260709 12:10:49.855252 18062 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.856350 18640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60412 (request call id 898) took 1483 ms. Trace:
I20260709 12:10:49.856935 18640 rpcz_store.cc:276] 0709 12:10:48.373167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.373639 (+   472us) service_pool.cc:224] Handling call
0709 12:10:49.855947 (+1482308us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b5400543654. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:49.856139 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1813643648}
I20260709 12:10:49.857383 21062 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:49.859763 18637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60412 (request call id 911) took 1480 ms. Trace:
I20260709 12:10:49.860217 18637 rpcz_store.cc:276] 0709 12:10:48.378788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.427984 (+ 49196us) service_pool.cc:224] Handling call
0709 12:10:49.859394 (+1431410us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54006d0e54. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:49.859553 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2642336000}
I20260709 12:10:49.862066 18637 raft_consensus.cc:1275] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:49.864164 18637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60430 (request call id 686) took 1371 ms. Trace:
I20260709 12:10:49.864653 18637 rpcz_store.cc:276] 0709 12:10:48.491664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.861177 (+1369513us) service_pool.cc:224] Handling call
0709 12:10:49.861628 (+   451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.862380 (+   752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.862573 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:49.815722 18644 rpcz_store.cc:276] 0709 12:10:48.405327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.266403 (+861076us) service_pool.cc:224] Handling call
0709 12:10:49.266771 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:49.267022 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:49.267049 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:49.296964 (+ 29915us) log.cc:844] Serialized 26 byte log entry
0709 12:10:49.639609 (+342645us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:10:49.738101 (+ 98492us) log.cc:844] Serialized 14 byte log entry
0709 12:10:49.814813 (+ 76712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.814928 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:49.814967 (+    39us) raft_consensus.cc:1685] finished
0709 12:10:49.814983 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.815099 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99347,"prepare.queue_time_us":115331,"raft.queue_time_us":80471,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"spinlock_wait_cycles":44573056,"thread_start_us":319925,"threads_started":1,"wal-append.queue_time_us":395283}
W20260709 12:10:49.868758 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 60776.6us
I20260709 12:10:49.858492 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:49.845749 20977 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:49.829649 21023 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:49.875988 18635 raft_consensus.cc:1275] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:49.855106 18636 rpcz_store.cc:276] 0709 12:10:48.374635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.451560 (+ 76925us) service_pool.cc:224] Handling call
0709 12:10:49.289920 (+838360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.577678 (+287758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.854372 (+276694us) spinlock_profiling.cc:243] Waited 814 ms on lock 0x7b54006707d0. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b18ad 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:49.854530 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1872787840}
I20260709 12:10:49.877120 21020 consensus_queue.cc:1048] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:49.878777 18640 raft_consensus.cc:1240] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:49.881016 20940 raft_consensus.cc:3055] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:49.886315 17941 raft_consensus.cc:1240] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:10:49.886782 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:49.849799 21039 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:49.890470 18640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60430 (request call id 689) took 1395 ms. Trace:
I20260709 12:10:49.885143 20940 raft_consensus.cc:740] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:49.891220 18640 rpcz_store.cc:276] 0709 12:10:48.492812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.878180 (+1385368us) service_pool.cc:224] Handling call
0709 12:10:49.878569 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.888165 (+  9596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.888338 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:49.897732 20919 consensus_meta.cc:287] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 1.566s	user 0.010s	sys 0.009s
I20260709 12:10:49.904194 17914 leader_election.cc:304] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:49.904848 18637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60430 (request call id 688) took 1407 ms. Trace:
I20260709 12:10:49.905241 18637 rpcz_store.cc:276] 0709 12:10:48.492510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.872126 (+1379616us) service_pool.cc:224] Handling call
0709 12:10:49.883866 (+ 11740us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.888488 (+  4622us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:49.888519 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:49.890537 (+  2018us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:10:49.899805 (+  9268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.899879 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.899982 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:49.899257 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:49.908259 18061 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:49.910604 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:49.916764 21146 log.cc:927] Time spent T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.441s	user 0.000s	sys 0.002s
I20260709 12:10:49.912041 21105 raft_consensus.cc:2749] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:49.928413 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:49.929211 18016 raft_consensus.cc:2468] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 9.
I20260709 12:10:49.930140 21020 raft_consensus.cc:2749] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:49.932343 20855 consensus_queue.cc:1059] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:49.932742 18643 raft_consensus.cc:1275] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:10:49.934847 20986 raft_consensus.cc:3055] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:49.935297 20986 raft_consensus.cc:740] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:49.938783 20986 consensus_queue.cc:260] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:49.939749 18061 leader_election.cc:336] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Timed out: RequestConsensusVote RPC to 127.16.98.196:43647 timed out after 1.938s (SENT)
W20260709 12:10:49.940165 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.940363 18061 leader_election.cc:304] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:49.914800 20919 raft_consensus.cc:2804] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:49.912482 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:49.901854 20882 consensus_queue.cc:1059] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:10:49.921540 18644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60430 (request call id 687) took 1429 ms. Trace:
W20260709 12:10:49.908093 17944 consensus_meta.cc:287] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.681s	user 0.006s	sys 0.018s
I20260709 12:10:49.908165 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:49.911518 17942 raft_consensus.cc:1240] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 8. Current term is 9. Ops: []
W20260709 12:10:49.925290 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.898123 20940 consensus_queue.cc:260] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:49.944293 18644 rpcz_store.cc:276] 0709 12:10:48.492011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.871593 (+1379582us) service_pool.cc:224] Handling call
0709 12:10:49.896777 (+ 25184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.920998 (+ 24221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:49.921050 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:49.921141 (+    91us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:49.921210 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.921291 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.921452 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:49.945531 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:49.949292 20940 raft_consensus.cc:3060] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:49.940351 20986 raft_consensus.cc:3060] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:49.955740 20810 raft_consensus.cc:2749] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:49.956409 18061 leader_election.cc:304] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:49.957748 21014 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:49.958117 18061 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:49.959475 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 52033.9us
I20260709 12:10:49.959826 18022 raft_consensus.cc:3060] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:49.967216 18091 raft_consensus.cc:1240] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:49.967442 17944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50334 (request call id 2129) took 1222 ms. Trace:
W20260709 12:10:49.967247 21050 consensus_meta.cc:287] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 1.252s	user 0.017s	sys 0.013s
I20260709 12:10:49.968654 20606 raft_consensus.cc:2749] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:49.968461 21050 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:49.969511 21157 raft_consensus.cc:2749] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:49.969686 20949 raft_consensus.cc:2804] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:49.970077 20949 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:49.970510 20949 raft_consensus.cc:3060] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:49.958395 21014 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:49.971149 21050 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:49.971971 21135 log.cc:927] Time spent T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.536s	user 0.000s	sys 0.002s
I20260709 12:10:49.972846 21014 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:49.973371 18639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60424 (request call id 873) took 1569 ms. Trace:
I20260709 12:10:49.973820 18639 rpcz_store.cc:276] 0709 12:10:48.404255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.913279 (+509024us) service_pool.cc:224] Handling call
0709 12:10:48.992344 (+ 79065us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:49.000297 (+  7953us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:49.000326 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:49.011268 (+ 10942us) log.cc:844] Serialized 26 byte log entry
0709 12:10:49.292464 (+281196us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:49.717283 (+424819us) log.cc:844] Serialized 14 byte log entry
0709 12:10:49.717649 (+   366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.717756 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:49.927703 (+209947us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x7b18002a7cc0. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f498c53f3 00007f7f498c77c1 00007f7f498c7779 00007f7f498c7709 00007f7f498c76d1 00007f7f498c69cd 0000000000388634 0000000000388479 00007f7f498a883a
0709 12:10:49.971159 (+ 43456us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b4400022b4c. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f497ebc85 00007f7f497ec6a2 00007f7f4c55e1db 00007f7f4c559aaf 00007f7f4c54d86e 00007f7f4c54cbb6 00007f7f4c54c7d8 00007f7f4c556221 00007f7f4c5561d9 00007f7f4c556169
0709 12:10:49.972995 (+  1836us) raft_consensus.cc:1685] finished
0709 12:10:49.973020 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.973201 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":390155,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":770,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":8790,"spinlock_wait_cycles":118870144,"thread_start_us":617844,"threads_started":2,"wal-append.queue_time_us":400541}
I20260709 12:10:49.967885 17944 rpcz_store.cc:276] 0709 12:10:48.745461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.745579 (+   118us) service_pool.cc:224] Handling call
0709 12:10:48.746085 (+   506us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:48.758962 (+ 12877us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.759001 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:48.766500 (+  7499us) log.cc:844] Serialized 532 byte log entry
0709 12:10:49.167700 (+401200us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:49.948187 (+780487us) log.cc:844] Serialized 14 byte log entry
0709 12:10:49.967027 (+ 18840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.967153 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:49.967201 (+    48us) raft_consensus.cc:1685] finished
0709 12:10:49.967215 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.967383 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18801,"raft.queue_time_us":39294,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":7209,"thread_start_us":347388,"threads_started":1,"wal-append.queue_time_us":580543}
I20260709 12:10:49.976269 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:49.976305 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:49.977213 18089 raft_consensus.cc:1240] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:49.977308 18090 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 9.
I20260709 12:10:49.978966 18091 raft_consensus.cc:1275] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:49.979318 18609 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:49.978163 20987 consensus_queue.cc:1048] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:49.982888 21062 raft_consensus.cc:2804] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:49.983361 21062 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:49.983784 21062 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:49.988739 20949 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:50.005301 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 101151us
W20260709 12:10:50.009337 21160 log.cc:927] Time spent T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:10:50.013664 21116 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.014665 21116 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:50.017470 21116 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:50.020287 21022 consensus_meta.cc:287] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.636s	user 0.016s	sys 0.001s
I20260709 12:10:50.020917 21022 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:50.027801 18096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53954 (request call id 2092) took 1533 ms. Trace:
I20260709 12:10:50.031226 18635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60412 (request call id 910) took 1652 ms. Trace:
I20260709 12:10:49.942453 20919 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
W20260709 12:10:50.065078 21124 log.cc:927] Time spent T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.699s	user 0.000s	sys 0.005s
I20260709 12:10:50.006799 20977 consensus_queue.cc:1048] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:10:50.066545 17989 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:50.067101 21054 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
W20260709 12:10:50.067826 21144 log.cc:927] Time spent T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.594s	user 0.002s	sys 0.002s
W20260709 12:10:50.068912 18061 leader_election.cc:336] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Timed out: RequestConsensusVote RPC to 127.16.98.196:43647 timed out after 2.013s (SENT)
I20260709 12:10:50.043977 18642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60424 (request call id 871) took 1506 ms. Trace:
I20260709 12:10:50.069972 18635 rpcz_store.cc:276] 0709 12:10:48.378523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.689837 (+311314us) service_pool.cc:224] Handling call
0709 12:10:49.875355 (+1185518us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.882735 (+  7380us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.030975 (+148240us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400543650. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b18ad 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:50.031155 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2697763200}
I20260709 12:10:50.063951 21022 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:50.088358 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:50.088922 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:50.090504 18636 raft_consensus.cc:1240] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:50.089115 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:50.075768 20919 raft_consensus.cc:3060] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:50.095140 18637 raft_consensus.cc:2393] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 9: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:50.097776 18090 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 8.
I20260709 12:10:50.069651 18096 rpcz_store.cc:276] 0709 12:10:48.493833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.493975 (+   142us) service_pool.cc:224] Handling call
0709 12:10:48.570430 (+ 76455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:48.676746 (+106316us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:49.010716 (+333970us) log.cc:844] Serialized 14 byte log entry
0709 12:10:49.789675 (+778959us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:49.924730 (+135055us) log.cc:844] Serialized 26 byte log entry
0709 12:10:49.947815 (+ 23085us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:49.947839 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.005061 (+ 57222us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:50.005125 (+    64us) raft_consensus.cc:1685] finished
0709 12:10:50.005142 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:50.027605 (+ 22463us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":377856,"raft.queue_time_us":435762,"raft.run_cpu_time_us":443,"raft.run_wall_time_us":11501,"thread_start_us":426360,"threads_started":2,"wal-append.queue_time_us":443832}
I20260709 12:10:50.098475 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:50.102593 18062 leader_election.cc:304] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:50.084451 18642 rpcz_store.cc:276] 0709 12:10:48.403784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.784468 (+380684us) service_pool.cc:224] Handling call
0709 12:10:48.784892 (+   424us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:48.785368 (+   476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.785409 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:48.803369 (+ 17960us) log.cc:844] Serialized 52 byte log entry
0709 12:10:49.130239 (+326870us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b180042b5c0. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f498a7e07 00007f7f527029a9 00007f7f498c469b 00007f7f498c293f 00007f7f498c4c02 00007f7f4c54c20b 00007f7f4c551d23 00007f7f4c5520d1 00007f7f4c96da0f
0709 12:10:49.324529 (+194290us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:49.632434 (+307905us) log.cc:844] Serialized 14 byte log entry
0709 12:10:49.873474 (+241040us) log.cc:844] Serialized 14 byte log entry
0709 12:10:49.890234 (+ 16760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.899342 (+  9108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:49.910163 (+ 10821us) raft_consensus.cc:1685] finished
0709 12:10:49.910178 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.910268 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":98889,"prepare.queue_time_us":551518,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":73,"raft.queue_time_us":14190,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":5045,"spinlock_wait_cycles":6504192,"thread_start_us":365973,"threads_started":3,"wal-append.queue_time_us":644510}
I20260709 12:10:50.090097 20811 tablet_bootstrap.cc:492] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
W20260709 12:10:50.104920 20769 consensus_meta.cc:287] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 1.047s	user 0.011s	sys 0.008s
I20260709 12:10:50.086226 21054 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:50.116741 17989 leader_election.cc:304] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:50.114117 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:50.122730 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:50.122486 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:50.124442 18637 raft_consensus.cc:2468] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
I20260709 12:10:50.118438 17914 leader_election.cc:304] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:50.126464 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 57622us
I20260709 12:10:50.127247 17987 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
W20260709 12:10:50.128474 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 163595us
W20260709 12:10:50.127434 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.123656 21120 raft_consensus.cc:2804] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:50.140079 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:50.147099 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 76156.2us
I20260709 12:10:50.147279 21036 raft_consensus.cc:2804] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:50.148061 21036 raft_consensus.cc:697] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:50.148612 18062 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:50.149080 21036 consensus_queue.cc:237] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:50.150108 20930 raft_consensus.cc:2804] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:50.124187 20769 raft_consensus.cc:2749] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:50.152848 20940 raft_consensus.cc:2804] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:50.153507 20940 raft_consensus.cc:697] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:50.154497 20940 consensus_queue.cc:237] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:50.155014 18096 raft_consensus.cc:1240] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:50.141693 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 45258.2us
I20260709 12:10:50.150151 18062 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:50.131016 20928 raft_consensus.cc:3060] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:50.168453 18637 raft_consensus.cc:1275] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:10:50.168762 18022 raft_consensus.cc:2468] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
W20260709 12:10:50.158002 20982 consensus_meta.cc:287] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.960s	user 0.008s	sys 0.008s
I20260709 12:10:50.118199 21000 raft_consensus.cc:515] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:50.172068 21062 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:50.172833 21039 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:50.150574 20930 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
W20260709 12:10:50.175415 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 46159.7us
I20260709 12:10:50.165982 21076 raft_consensus.cc:2749] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:50.187867 17988 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:50.191022 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:50.218585 18637 raft_consensus.cc:2468] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:10:50.166867 21155 raft_consensus.cc:2749] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:50.184542 20930 raft_consensus.cc:3060] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.190761 20882 raft_consensus.cc:2749] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:50.227080 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:50.229236 21062 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:50.229815 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
W20260709 12:10:50.233481 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 51024.6us
W20260709 12:10:50.235517 21169 log.cc:927] Time spent T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:10:50.238881 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:50.239598 18098 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
W20260709 12:10:50.240557 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 224678us
I20260709 12:10:50.242219 18093 raft_consensus.cc:1240] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 3. Current term is 4. Ops: []
W20260709 12:10:50.242789 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.243248 20698 raft_consensus.cc:2804] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:50.243731 20698 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.244089 20698 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:50.247249 21120 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:50.247733 21120 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:50.259811 18638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60424 (request call id 879) took 1854 ms. Trace:
I20260709 12:10:50.183840 20982 raft_consensus.cc:515] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:50.263067 18636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60430 (request call id 690) took 1766 ms. Trace:
I20260709 12:10:50.264400 18636 rpcz_store.cc:276] 0709 12:10:48.493183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.891560 (+1398377us) service_pool.cc:224] Handling call
0709 12:10:49.907879 (+ 16319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:50.094840 (+186961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.258550 (+163710us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b54006946d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:50.259166 (+   616us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":419384704}
I20260709 12:10:50.263862 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:50.261262 18638 rpcz_store.cc:276] 0709 12:10:48.405533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.644707 (+1239174us) service_pool.cc:224] Handling call
0709 12:10:49.645449 (+   742us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:49.671984 (+ 26535us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:49.672033 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:49.980987 (+308954us) spinlock_profiling.cc:243] Waited 7.34 ms on lock 0x7b2c000e00c8. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4b2aba11 00007f7f4b2bb372 00007f7f4c9eda01 00007f7f4c9b243a 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2
0709 12:10:49.981512 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 12:10:50.078580 (+ 97068us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:50.100570 (+ 21990us) log.cc:844] Serialized 14 byte log entry
0709 12:10:50.259258 (+158688us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b1800106660. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f4983fc0a 00007f7f52f7f219 00007f7f498c7a40 00007f7f498c24e4 00007f7f498c2455 00007f7f4c9aa060 00007f7f4c9bc716 00007f7f4c9cd287 00007f7f4c9cd208
0709 12:10:50.259439 (+   181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.259512 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:50.259562 (+    50us) raft_consensus.cc:1685] finished
0709 12:10:50.259577 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:50.259738 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15877,"prepare.queue_time_us":23679,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":182913,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":49488,"spinlock_wait_cycles":19480320,"thread_start_us":96619,"threads_started":1,"wal-append.queue_time_us":128326}
W20260709 12:10:50.267134 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 158567us
I20260709 12:10:50.232795 20949 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:50.276283 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 126257us
I20260709 12:10:50.289114 21162 raft_consensus.cc:493] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:50.289961 21162 raft_consensus.cc:515] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:50.293022 21162 leader_election.cc:290] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:50.295245 17947 raft_consensus.cc:2393] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 4: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:50.269591 21023 consensus_queue.cc:1059] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:10:50.299566 21023 raft_consensus.cc:3055] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:50.300064 21023 raft_consensus.cc:740] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:50.300684 17914 leader_election.cc:304] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:50.301086 21023 consensus_queue.cc:260] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:50.302623 20769 raft_consensus.cc:2749] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:50.307386 17913 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:50.308643 17913 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:50.309667 20769 raft_consensus.cc:2749] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:50.308837 20882 raft_consensus.cc:2804] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:50.271250 20977 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.302428 17914 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:50.335354 21054 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:50.336001 21023 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:50.338172 20982 leader_election.cc:290] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:50.333272 20977 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:50.341591 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 159418us
I20260709 12:10:50.343369 20977 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:50.344565 17942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2098) took 1570 ms. Trace:
I20260709 12:10:50.345366 17946 raft_consensus.cc:1240] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:50.345816 21141 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.343402 21036 consensus_queue.cc:1059] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:10:50.345000 17942 rpcz_store.cc:276] 0709 12:10:48.773693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.774589 (+   896us) service_pool.cc:224] Handling call
0709 12:10:48.774879 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.959102 (+1184223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.344253 (+385151us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54003c0d54. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:50.344497 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2599248640}
I20260709 12:10:50.346452 21141 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:50.348888 21141 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:50.353907 18061 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:50.355290 18061 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
W20260709 12:10:50.346243 17947 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2107) took 1298 ms (client timeout 1596 ms). Trace:
W20260709 12:10:50.359318 17947 rpcz_store.cc:269] 0709 12:10:49.047824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.047988 (+   164us) service_pool.cc:224] Handling call
0709 12:10:50.345021 (+1297033us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b540031bd54. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:50.346175 (+  1154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2817533824}
I20260709 12:10:50.369112 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:50.369767 18098 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:50.369540 18609 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:50.368909 21155 consensus_queue.cc:1048] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:10:50.377717 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:50.332703 20882 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.379231 20882 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:50.365151 20949 raft_consensus.cc:2749] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:50.380281 21039 consensus_queue.cc:1059] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:50.381100 21039 consensus_queue.cc:1243] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer e28f77912a9c4ba2b9841f6fedddc2db log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:10:50.382987 20982 raft_consensus.cc:2804] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:50.383412 20982 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:50.387955 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:50.388545 18635 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:50.390659 18062 leader_election.cc:304] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:50.369925 20928 raft_consensus.cc:2804] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:50.385455 20982 raft_consensus.cc:3060] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:50.409188 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:50.411194 18607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.392323 21105 raft_consensus.cc:2804] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:50.397572 20928 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.424680 18017 raft_consensus.cc:1275] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:50.420567 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:50.429472 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:50.434295 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:50.435269 18022 raft_consensus.cc:2393] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 9: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:50.425747 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:50.437844 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 135566us
I20260709 12:10:49.582005 18641 rpcz_store.cc:276] 0709 12:10:48.377182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.484021 (+106839us) service_pool.cc:224] Handling call
0709 12:10:48.524985 (+ 40964us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:48.568133 (+ 43148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:48.568163 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:48.572102 (+  3939us) log.cc:844] Serialized 26 byte log entry
0709 12:10:48.768391 (+196289us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b1800133660. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f498a7e07 00007f7f527029a9 00007f7f498c469b 00007f7f498c293f 00007f7f498c4c02 00007f7f4c54c20b 00007f7f4c551d23 00007f7f4c5520d1 00007f7f4c96da0f
0709 12:10:49.182037 (+413646us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:10:49.579945 (+397908us) log.cc:844] Serialized 14 byte log entry
0709 12:10:49.580497 (+   552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:49.580677 (+   180us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:49.580786 (+   109us) raft_consensus.cc:1685] finished
0709 12:10:49.580916 (+   130us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:49.581134 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42730,"raft.queue_time_us":64759,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":13542,"spinlock_wait_cycles":33363200,"thread_start_us":810664,"threads_started":2,"wal-append.queue_time_us":748826}
I20260709 12:10:50.415167 21105 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.427805 20928 raft_consensus.cc:3060] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.452193 18096 raft_consensus.cc:2468] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:10:50.429046 21077 raft_consensus.cc:2749] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:50.430357 21000 leader_election.cc:290] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:50.456703 18015 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 9.
I20260709 12:10:50.461102 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:50.463802 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:50.449520 21105 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:50.405546 20949 consensus_queue.cc:1048] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:10:50.472026 17944 raft_consensus.cc:1240] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 LEADER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 4. Current term is 5. Ops: []
W20260709 12:10:50.479331 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 106710us
I20260709 12:10:50.469799 17914 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:50.491461 17943 raft_consensus.cc:1275] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:10:50.490869 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 89236.9us
W20260709 12:10:50.491330 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 88727.5us
I20260709 12:10:50.493355 17942 raft_consensus.cc:1275] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:50.488224 18609 leader_election.cc:304] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:50.493858 17989 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:50.502151 18022 raft_consensus.cc:2393] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 9: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
W20260709 12:10:50.504804 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 173109us
I20260709 12:10:50.506791 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:50.511101 21079 consensus_queue.cc:1059] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:10:50.512120 18062 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:50.513441 21079 raft_consensus.cc:2804] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:50.513818 21079 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.514148 21079 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:50.514712 20977 raft_consensus.cc:2804] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:50.514819 21000 raft_consensus.cc:2749] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:50.515218 20977 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:50.515656 20977 raft_consensus.cc:3060] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:50.515739 20839 raft_consensus.cc:3055] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:50.516258 20839 raft_consensus.cc:740] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:50.515664 20903 consensus_queue.cc:1059] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:10:50.517174 20839 consensus_queue.cc:260] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:50.520934 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:50.473709 20940 consensus_queue.cc:1059] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:10:50.522456 18089 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53954 (request call id 2097) took 1445 ms. Trace:
I20260709 12:10:50.522966 18089 rpcz_store.cc:276] 0709 12:10:49.077066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:49.077226 (+   160us) service_pool.cc:224] Handling call
0709 12:10:49.077459 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:49.977700 (+900241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:50.522195 (+544495us) spinlock_profiling.cc:243] Waited 899 ms on lock 0x7b540024a754. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:50.522397 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2068364032}
I20260709 12:10:50.523391 20940 raft_consensus.cc:3055] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:50.523613 18636 raft_consensus.cc:1275] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:50.523875 20940 raft_consensus.cc:740] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:50.524873 20940 consensus_queue.cc:260] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:50.529445 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:50.530527 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.526355 21083 raft_consensus.cc:3055] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:50.531209 21083 raft_consensus.cc:740] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:50.532490 20839 raft_consensus.cc:3060] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.532274 21083 consensus_queue.cc:260] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:50.536221 20698 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:50.536480 21079 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:50.514544 18635 raft_consensus.cc:2468] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 9.
I20260709 12:10:50.538461 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:50.518267 18062 leader_election.cc:304] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:50.546314 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 78224us
I20260709 12:10:50.538904 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:50.570672 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:50.470964 20919 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:50.538307 20698 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:50.580529 18643 raft_consensus.cc:1240] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:50.591566 18091 raft_consensus.cc:1240] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:50.592854 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:50.538612 20882 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:50.545620 21079 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:50.594760 18608 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:50.605813 18608 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:50.583214 20940 raft_consensus.cc:3060] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.584216 20466 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.581008 20769 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
W20260709 12:10:50.594728 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 134086us
I20260709 12:10:50.615477 18643 raft_consensus.cc:1275] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:10:50.601778 18639 raft_consensus.cc:2376] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9. Re-sending same reply.
I20260709 12:10:50.602015 20386 consensus_queue.cc:1048] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:10:50.585736 21076 raft_consensus.cc:2749] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:50.607498 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 89322.3us
I20260709 12:10:50.615820 18643 pending_rounds.cc:85] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db: Aborting all ops after (but not including) 6
W20260709 12:10:50.631268 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 129344us
I20260709 12:10:50.596057 21000 consensus_queue.cc:1048] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:10:50.638561 18062 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:50.628731 18643 pending_rounds.cc:107] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:50.639456 18643 raft_consensus.cc:2889] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:50.610478 21141 raft_consensus.cc:2749] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:50.615295 21041 raft_consensus.cc:2749] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:50.631518 21176 log.cc:927] Time spent T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.247s	user 0.001s	sys 0.001s
I20260709 12:10:50.626236 21162 raft_consensus.cc:2749] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:50.646080 17913 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:50.663575 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 78477.1us
I20260709 12:10:50.609678 21154 consensus_queue.cc:1059] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:10:50.667210 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:50.668080 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:50.668756 18018 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:50.665323 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:50.616071 21023 consensus_queue.cc:1059] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:10:50.628438 20769 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:10:50.676949 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:50.674153 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:50.633170 21155 consensus_queue.cc:1048] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:10:50.679915 18062 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:50.680075 18021 raft_consensus.cc:1275] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:50.625208 20466 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:50.676141 17987 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
W20260709 12:10:50.690011 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 51741.2us
I20260709 12:10:50.693059 18015 raft_consensus.cc:2468] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 6.
I20260709 12:10:50.678290 20855 raft_consensus.cc:2749] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:50.695561 18608 leader_election.cc:304] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:50.697705 18608 leader_election.cc:304] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:50.684762 21139 raft_consensus.cc:3055] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:50.689253 21154 raft_consensus.cc:2804] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:50.719904 20769 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:50.721575 20804 raft_consensus.cc:2804] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:50.722039 20804 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:50.722402 20804 raft_consensus.cc:3060] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:50.724098 20982 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:50.725373 21083 raft_consensus.cc:3060] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:50.711298 21054 raft_consensus.cc:2749] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:50.711542 21022 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:50.726195 20982 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:50.703208 18020 raft_consensus.cc:2468] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
W20260709 12:10:50.735579 21182 log.cc:927] Time spent T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:10:50.696182 20930 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:50.727509 21022 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:50.748494 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:50.752106 21039 raft_consensus.cc:3055] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:50.752656 21039 raft_consensus.cc:740] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:50.753648 21039 consensus_queue.cc:260] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:50.711717 21085 raft_consensus.cc:2804] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:50.779006 21085 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.779448 21085 raft_consensus.cc:3060] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:50.785002 20977 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:50.788237 21155 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.788822 21155 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:50.707962 21139 raft_consensus.cc:740] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:50.758518 21116 raft_consensus.cc:493] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:50.763617 20877 raft_consensus.cc:3055] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:50.879967 20877 raft_consensus.cc:740] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:50.881072 20877 consensus_queue.cc:260] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:50.883134 21039 raft_consensus.cc:3060] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:50.887620 21181 log.cc:927] Time spent T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:10:50.890415 17912 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
W20260709 12:10:50.891403 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 87540.3us
I20260709 12:10:50.894734 18642 raft_consensus.cc:1275] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:50.895195 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:50.895961 18096 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:50.766831 18094 raft_consensus.cc:1240] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:50.767382 21196 raft_consensus.cc:2804] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:50.767446 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:50.768290 21000 raft_consensus.cc:493] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.772639 21076 raft_consensus.cc:3055] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:10:50.919842 18098 consensus_meta.cc:287] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.532s	user 0.003s	sys 0.009s
I20260709 12:10:50.776952 18062 leader_election.cc:304] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:50.777680 20930 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:50.757581 18608 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:50.712739 20919 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:50.730597 21154 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:50.826545 20466 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:50.831734 20977 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:50.941871 20977 raft_consensus.cc:2804] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:50.942299 20977 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:50.942732 20977 raft_consensus.cc:3060] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:50.942844 21188 log.cc:927] Time spent T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
I20260709 12:10:50.945173 21000 raft_consensus.cc:515] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:50.832134 21022 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:10:50.836874 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.838065 20698 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:50.947780 21000 leader_election.cc:290] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:50.947870 20698 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:50.920540 21120 consensus_meta.cc:287] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.671s	user 0.005s	sys 0.008s
I20260709 12:10:50.950134 20698 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:50.841046 17989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.950209 21120 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:50.841846 21198 raft_consensus.cc:493] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:50.952466 21198 raft_consensus.cc:515] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:50.952920 21120 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:50.953912 21079 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:50.850857 20882 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:50.856287 21139 consensus_queue.cc:260] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:50.869467 21105 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:50.799576 20804 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:50.878122 21155 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:10:50.982544 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 205661us
I20260709 12:10:50.954525 21198 leader_election.cc:290] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:50.912634 18638 raft_consensus.cc:2393] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 9: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:50.875445 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
W20260709 12:10:50.912168 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 233838us
I20260709 12:10:50.774662 18018 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 10.
I20260709 12:10:50.920248 18098 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 10.
I20260709 12:10:50.917739 20987 raft_consensus.cc:2804] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:50.940500 18643 raft_consensus.cc:1240] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:50.941105 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:51.000808 18639 raft_consensus.cc:2410] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 7 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:50.941645 20982 consensus_queue.cc:1048] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:50.698787 21141 consensus_queue.cc:1048] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:10:50.728574 21023 consensus_queue.cc:1048] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 12:10:50.912448 21054 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.917950 21196 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:50.919780 20877 raft_consensus.cc:3060] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:51.016012 21196 raft_consensus.cc:3060] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.016489 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
W20260709 12:10:50.984668 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:50.878942 21116 raft_consensus.cc:515] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:50.955291 21154 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:50.988535 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 321313us
I20260709 12:10:50.995020 21200 consensus_queue.cc:1059] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:10:50.998304 21185 consensus_queue.cc:1059] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:10:50.954416 21079 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:51.004659 18609 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:50.979782 21022 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:50.954623 21120 consensus_queue.cc:1059] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:10:50.982816 21077 raft_consensus.cc:2749] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:50.920135 21076 raft_consensus.cc:740] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:50.942245 21085 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:51.022226 17987 leader_election.cc:304] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:51.016160 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:51.024652 18062 leader_election.cc:304] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:51.012907 20928 consensus_meta.cc:287] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.543s	user 0.009s	sys 0.001s
I20260709 12:10:51.032354 18094 raft_consensus.cc:1275] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:10:51.035950 18098 raft_consensus.cc:1240] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:51.007767 20987 raft_consensus.cc:697] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:51.044474 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:51.040161 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:51.045037 18090 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.040768 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:51.045243 18095 raft_consensus.cc:3060] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:51.008392 21198 consensus_queue.cc:1048] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:10:51.008443 20769 consensus_queue.cc:1048] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:10:51.042537 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:51.041990 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:51.019452 20698 consensus_queue.cc:1048] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:10:51.010758 21155 consensus_queue.cc:1048] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:10:51.048472 18021 raft_consensus.cc:2393] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 10: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:51.047531 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:51.040177 21139 raft_consensus.cc:3060] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.055325 18022 raft_consensus.cc:2393] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 8: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:51.019744 21054 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:51.058405 18607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.060950 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:51.028062 21193 consensus_queue.cc:1059] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:10:51.048759 20930 raft_consensus.cc:2804] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:51.067070 17942 raft_consensus.cc:2410] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:51.071187 17943 raft_consensus.cc:1240] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260709 12:10:51.074256 20804 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:51.054618 20987 consensus_queue.cc:237] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:51.066541 20503 raft_consensus.cc:3055] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:51.076467 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:51.076678 20503 raft_consensus.cc:740] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:51.077242 17947 raft_consensus.cc:2468] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
I20260709 12:10:51.077661 20503 consensus_queue.cc:260] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:51.078334 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:51.078915 21105 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:51.079782 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:51.047637 21022 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:51.044970 20928 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:51.061103 21194 raft_consensus.cc:2749] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:51.078030 21076 consensus_queue.cc:260] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:51.103282 18062 leader_election.cc:304] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:51.063133 21141 raft_consensus.cc:2804] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:51.112756 17944 raft_consensus.cc:2468] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
W20260709 12:10:51.113493 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 44609.5us
I20260709 12:10:51.107775 18096 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 10.
I20260709 12:10:51.114235 17987 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:51.053711 20882 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.108597 18090 raft_consensus.cc:2468] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:10:51.054009 20940 raft_consensus.cc:3055] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:51.112187 17949 raft_consensus.cc:2393] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 6: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:51.112965 18095 raft_consensus.cc:2468] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
I20260709 12:10:51.193696 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:51.135107 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
W20260709 12:10:51.176570 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 62395.6us
I20260709 12:10:51.211220 17944 raft_consensus.cc:2410] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:51.116680 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:51.219964 17987 leader_election.cc:304] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:51.128177 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:51.221539 17943 raft_consensus.cc:2468] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 8.
I20260709 12:10:51.129066 17945 raft_consensus.cc:1275] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:51.068658 20930 raft_consensus.cc:493] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:51.222908 20930 raft_consensus.cc:3060] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.220526 18092 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:10:51.116552 18062 leader_election.cc:304] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:51.225214 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
W20260709 12:10:51.168809 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.195649 21187 raft_consensus.cc:493] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:51.134033 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:51.226330 21155 raft_consensus.cc:2804] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:51.187772 17948 raft_consensus.cc:2468] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
W20260709 12:10:51.225627 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 468131us
I20260709 12:10:51.166734 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:51.245230 18094 raft_consensus.cc:2410] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:10:51.245744 18096 raft_consensus.cc:1240] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:51.126549 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:51.247131 17947 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 9.
I20260709 12:10:51.111188 20503 raft_consensus.cc:3060] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.184533 21076 raft_consensus.cc:3060] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:51.145630 21077 raft_consensus.cc:2804] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:51.161257 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:51.210842 20940 raft_consensus.cc:740] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
W20260709 12:10:51.250553 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 134069us
I20260709 12:10:51.133571 21022 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:51.250018 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:51.226452 21079 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:51.256314 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:51.224975 21085 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:51.259590 17948 raft_consensus.cc:2393] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 10: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:51.237982 20804 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.265303 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:51.265467 18089 raft_consensus.cc:1275] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:51.266304 17989 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:51.246405 21155 raft_consensus.cc:493] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:51.267457 17987 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:51.293320 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:51.294704 21085 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:51.295274 21085 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:51.295908 21209 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:51.295960 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:51.296680 17948 raft_consensus.cc:2376] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7. Re-sending same reply.
I20260709 12:10:51.296567 21209 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:51.297348 21085 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:51.297668 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:51.298425 17948 raft_consensus.cc:2393] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 7: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:51.298592 21209 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:51.281329 20804 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:51.299538 21198 raft_consensus.cc:2804] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:51.300088 21198 raft_consensus.cc:697] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:51.301064 20804 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:51.300894 21198 consensus_queue.cc:237] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:51.301451 21154 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:51.282085 17989 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:51.250031 21036 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:51.304441 18093 raft_consensus.cc:1240] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:51.281462 21204 log.cc:927] Time spent T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
W20260709 12:10:51.328778 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 68341.6us
I20260709 12:10:51.298769 21079 raft_consensus.cc:2804] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:51.333954 21189 consensus_queue.cc:1048] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:10:51.303931 21155 raft_consensus.cc:3060] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:51.259021 20882 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:51.343048 18608 leader_election.cc:304] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:51.260479 21193 consensus_queue.cc:1048] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 12:10:51.268752 21116 leader_election.cc:290] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:51.354126 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 58541.1us
I20260709 12:10:51.357227 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:51.253743 21187 raft_consensus.cc:515] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:51.328455 21209 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:51.366835 18608 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:51.370704 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:51.371713 18097 raft_consensus.cc:2393] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 8: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:51.298919 21211 consensus_queue.cc:1059] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:10:51.374306 21187 leader_election.cc:290] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:51.354480 21085 raft_consensus.cc:2804] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:51.375854 21085 raft_consensus.cc:493] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:51.376225 21085 raft_consensus.cc:3060] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.348307 21120 consensus_queue.cc:1048] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:10:51.311056 20877 consensus_queue.cc:1059] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:10:51.384876 20877 raft_consensus.cc:3055] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:51.385221 20877 raft_consensus.cc:740] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:51.385968 20877 consensus_queue.cc:260] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:51.360285 21116 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.386868 20877 raft_consensus.cc:3060] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:51.386996 21116 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:51.389199 21116 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:51.351610 20928 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:51.346364 20977 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:51.354811 21079 raft_consensus.cc:697] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:51.392448 20977 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:51.392316 21219 consensus_queue.cc:1059] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:10:51.393721 21154 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:51.394099 20882 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:51.394342 21154 raft_consensus.cc:3055] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:51.394824 21154 raft_consensus.cc:740] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:51.395519 21211 raft_consensus.cc:3055] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:51.395871 21211 raft_consensus.cc:740] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:51.396451 21212 raft_consensus.cc:2804] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:51.396673 21211 consensus_queue.cc:260] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:51.397903 21211 raft_consensus.cc:3060] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:51.344833 20940 consensus_queue.cc:260] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:51.367952 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:51.397192 21212 raft_consensus.cc:697] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:51.399863 21212 consensus_queue.cc:237] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:51.402788 17940 raft_consensus.cc:1275] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:51.403468 21120 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:51.403646 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 45776.5us
I20260709 12:10:51.403947 21120 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:51.404352 18608 leader_election.cc:304] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:51.405879 21120 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:51.408707 21196 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:51.332096 21141 raft_consensus.cc:697] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 10 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:51.329986 21036 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:51.392099 21079 consensus_queue.cc:237] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:51.405454 18608 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:51.412317 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:51.399005 20940 raft_consensus.cc:3060] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:51.410907 21105 raft_consensus.cc:2749] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:10:51.396520 21039 consensus_meta.cc:287] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.513s	user 0.012s	sys 0.000s
W20260709 12:10:51.427034 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:51.429400 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 122244us
I20260709 12:10:51.410961 21162 raft_consensus.cc:2804] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:51.416103 18092 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 10.
I20260709 12:10:51.432302 18062 leader_election.cc:304] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:51.434840 18608 leader_election.cc:304] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:51.435740 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:51.394896 21209 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:51.451289 21036 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:51.455938 20949 raft_consensus.cc:3060] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:51.421662 21077 raft_consensus.cc:697] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:51.431954 21116 raft_consensus.cc:2749] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:51.475646 20949 raft_consensus.cc:2749] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:51.476006 20882 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.479287 21209 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:51.447916 21162 raft_consensus.cc:697] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:51.481086 21162 consensus_queue.cc:237] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:51.482352 21105 raft_consensus.cc:2749] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:51.435019 20977 consensus_queue.cc:1048] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:10:51.420631 21154 consensus_queue.cc:260] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:51.485285 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.458204 21196 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:51.519444 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:51.520025 17942 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:51.524231 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
W20260709 12:10:51.528276 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 93519.4us
I20260709 12:10:51.539880 18022 raft_consensus.cc:2468] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 8.
I20260709 12:10:51.516916 21154 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:51.544078 18022 raft_consensus.cc:1275] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:10:51.545406 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:51.517166 21193 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.548667 18021 raft_consensus.cc:1275] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:51.549592 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:51.524712 21139 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:51.554551 18635 raft_consensus.cc:1240] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:10:51.476720 20882 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:51.563453 18641 raft_consensus.cc:1240] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:51.564599 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:51.550772 20949 raft_consensus.cc:493] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:51.566368 21223 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.566494 20949 raft_consensus.cc:515] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:51.567045 21223 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:51.569263 21223 leader_election.cc:290] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:51.569085 21139 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:51.571246 21139 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:51.573752 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:51.566390 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:51.574880 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:51.576472 18636 raft_consensus.cc:1275] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:51.585323 18018 raft_consensus.cc:1240] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:51.583442 21077 consensus_queue.cc:237] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:51.591023 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:51.591663 18090 raft_consensus.cc:2468] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:51.591794 21085 raft_consensus.cc:515] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:51.593384 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:51.593998 18097 raft_consensus.cc:2468] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:10:51.594905 18635 raft_consensus.cc:1240] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:51.595566 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:51.595772 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:51.594806 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:51.598160 20811 tablet_bootstrap.cc:492] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:10:51.598807 18097 raft_consensus.cc:1240] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:51.602452 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:51.602375 21155 raft_consensus.cc:515] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:51.676158 18016 raft_consensus.cc:2468] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 8.
I20260709 12:10:51.590580 18022 raft_consensus.cc:2468] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:51.726984 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:51.729038 18637 raft_consensus.cc:2468] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
I20260709 12:10:51.727270 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:51.832844 17912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:51.764142 18640 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 9.
W20260709 12:10:51.889640 21225 log.cc:927] Time spent T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.250s	user 0.004s	sys 0.000s
W20260709 12:10:51.764770 20930 consensus_meta.cc:287] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.000s
I20260709 12:10:51.554726 21193 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:51.703894 21085 leader_election.cc:290] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:51.542428 21141 consensus_queue.cc:237] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:51.929514 21217 raft_consensus.cc:493] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
W20260709 12:10:51.935755 21226 log.cc:927] Time spent T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
I20260709 12:10:51.923417 21162 raft_consensus.cc:493] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:51.923585 20804 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.924028 21000 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:51.981240 18097 raft_consensus.cc:1275] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
W20260709 12:10:51.995872 21076 consensus_meta.cc:287] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.744s	user 0.006s	sys 0.002s
I20260709 12:10:51.996852 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:52.176713 18015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45464 (request call id 1884) took 1138 ms. Trace:
I20260709 12:10:51.997071 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:51.997737 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:51.998513 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
W20260709 12:10:51.999224 21227 log.cc:927] Time spent T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.415s	user 0.001s	sys 0.000s
I20260709 12:10:52.004105 21155 leader_election.cc:290] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:52.006039 20882 leader_election.cc:290] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:52.184975 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
W20260709 12:10:52.061569 17942 consensus_meta.cc:287] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.532s	user 0.006s	sys 0.000s
I20260709 12:10:51.563371 21116 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:52.194738 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:52.195510 18640 raft_consensus.cc:2468] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 5.
I20260709 12:10:52.091416 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:52.092375 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:52.156670 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:52.171963 21083 raft_consensus.cc:2749] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:10:52.099712 17990 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.011s	sys 0.059s
W20260709 12:10:52.203187 17990 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.011s	sys 0.066s
I20260709 12:10:52.203219 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:52.204012 18096 raft_consensus.cc:2368] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 9. Current term is 10.
W20260709 12:10:52.169613 18020 consensus_meta.cc:287] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.624s	user 0.009s	sys 0.001s
I20260709 12:10:51.977538 20811 tablet_bootstrap.cc:492] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:10:52.171937 18097 pending_rounds.cc:85] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110: Aborting all ops after (but not including) 1
I20260709 12:10:52.213191 18097 pending_rounds.cc:107] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:10:52.213524 18097 raft_consensus.cc:2889] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:52.066546 20940 consensus_meta.cc:287] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.627s	user 0.008s	sys 0.000s
I20260709 12:10:52.184478 18089 raft_consensus.cc:2393] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 8: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:52.195011 21217 raft_consensus.cc:515] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:52.186352 17942 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 10.
I20260709 12:10:52.199416 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:52.199735 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:52.227312 18090 raft_consensus.cc:2393] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 7: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:52.227572 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:52.228577 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:52.230404 18090 raft_consensus.cc:1240] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:52.177784 18015 rpcz_store.cc:276] 0709 12:10:51.031029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.031153 (+   124us) service_pool.cc:224] Handling call
0709 12:10:51.041785 (+ 10632us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:51.041954 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:10:51.052533 (+ 10579us) log.cc:844] Serialized 14 byte log entry
0709 12:10:51.603268 (+550735us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b1800088900. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f498a7e07 00007f7f527029a9 00007f7f498c469b 00007f7f498c293f 00007f7f498c4c02 00007f7f4c54c20b 00007f7f4c551d23 00007f7f4c55223a 00007f7f4c9bca2a
0709 12:10:52.168535 (+565267us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:52.168909 (+   374us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:10:52.169196 (+   287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:52.169265 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:52.169379 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10496,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":1687,"raft.queue_time_us":525,"spinlock_wait_cycles":7679744,"thread_start_us":491904,"threads_started":1}
I20260709 12:10:52.102005 20977 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:52.209484 18020 raft_consensus.cc:2468] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 8.
I20260709 12:10:52.109711 18062 leader_election.cc:304] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:52.243803 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:52.175176 20930 raft_consensus.cc:515] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:52.243988 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 134400us
I20260709 12:10:52.254318 18062 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:52.252099 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:52.249341 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:52.227398 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:52.257593 17942 raft_consensus.cc:2393] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 6: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:52.259413 18636 raft_consensus.cc:2368] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 8. Current term is 9.
I20260709 12:10:52.233276 20977 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:52.181180 21000 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:52.264894 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:52.182013 21162 raft_consensus.cc:515] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:52.199848 21116 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:52.200624 20804 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:52.306591 21116 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:52.306703 20804 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:52.270486 21076 raft_consensus.cc:2804] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:52.270354 20919 consensus_queue.cc:1048] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:10:52.312142 21234 raft_consensus.cc:493] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:52.312458 18095 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41818 (request call id 843) took 1479 ms (client timeout 1940 ms). Trace:
I20260709 12:10:52.312613 21234 raft_consensus.cc:515] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:52.312868 18095 rpcz_store.cc:269] 0709 12:10:50.833225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.874942 (+ 41717us) service_pool.cc:224] Handling call
0709 12:10:52.312263 (+1437321us) spinlock_profiling.cc:243] Waited 57.3 ms on lock 0x7b5400061654. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:52.312374 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":131727616}
I20260709 12:10:52.319590 18062 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:52.320259 21076 raft_consensus.cc:697] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:52.320420 18090 raft_consensus.cc:1240] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:52.321216 21076 consensus_queue.cc:237] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:52.322801 21218 consensus_queue.cc:1059] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:52.323958 21077 raft_consensus.cc:2804] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:52.324294 21039 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:52.324828 21039 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:52.325312 18062 leader_election.cc:304] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:52.326298 21237 raft_consensus.cc:493] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.326987 21237 raft_consensus.cc:515] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:52.327790 20804 raft_consensus.cc:2804] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:10:52.328286 20804 raft_consensus.cc:697] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 4 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:52.329164 20804 consensus_queue.cc:237] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:52.329972 21193 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:52.330821 21220 consensus_queue.cc:1048] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:52.331504 20928 consensus_queue.cc:1059] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:52.332260 20928 raft_consensus.cc:3055] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:52.332573 20928 raft_consensus.cc:740] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:52.301632 20811 ts_tablet_manager.cc:1403] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 2.402s	user 0.043s	sys 0.020s
I20260709 12:10:52.246133 21079 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:52.330303 18061 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:52.334587 18062 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:52.273838 17987 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:52.338495 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 64743.8us
I20260709 12:10:52.341586 18608 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:52.304138 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:52.256208 21155 raft_consensus.cc:2749] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:52.322443 21000 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:52.343436 17942 raft_consensus.cc:2468] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
I20260709 12:10:52.350838 18021 raft_consensus.cc:2468] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:10:52.348587 18096 raft_consensus.cc:2468] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
I20260709 12:10:52.352473 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:52.345695 18637 raft_consensus.cc:1275] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:10:52.277601 18091 raft_consensus.cc:1240] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:52.342377 20928 consensus_queue.cc:260] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:52.349181 20386 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.358554 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:52.357508 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:52.343153 21234 leader_election.cc:290] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:52.358012 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:52.354526 17914 leader_election.cc:304] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:52.357443 21000 raft_consensus.cc:2804] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:52.349365 21036 raft_consensus.cc:2749] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:52.393754 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:52.365640 21211 consensus_meta.cc:287] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.967s	user 0.003s	sys 0.010s
I20260709 12:10:52.361589 18095 raft_consensus.cc:2393] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 8: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:52.359831 17987 leader_election.cc:304] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:52.366255 21230 consensus_queue.cc:1048] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:10:52.367178 21039 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:52.367513 20386 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:52.368026 21121 raft_consensus.cc:3055] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:52.364813 21000 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.369616 21234 raft_consensus.cc:493] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:52.365301 21219 raft_consensus.cc:2804] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:52.370208 18089 raft_consensus.cc:1240] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:10:52.359818 21116 raft_consensus.cc:2804] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:52.396364 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:52.361436 18090 raft_consensus.cc:2468] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
I20260709 12:10:52.348613 21079 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:52.400009 21236 raft_consensus.cc:493] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:52.400306 17914 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:52.408584 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 48818.1us
I20260709 12:10:52.409317 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:52.412954 21036 raft_consensus.cc:2804] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:52.376636 21217 leader_election.cc:290] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:52.428248 17948 raft_consensus.cc:2468] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
I20260709 12:10:52.411300 21000 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:52.433202 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:52.434106 18095 raft_consensus.cc:2393] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 10: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:52.411966 21211 raft_consensus.cc:2749] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:52.418965 21154 consensus_meta.cc:287] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.869s	user 0.009s	sys 0.003s
I20260709 12:10:52.431496 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:52.406546 21121 raft_consensus.cc:740] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
W20260709 12:10:52.445343 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 45125.5us
I20260709 12:10:52.448792 17914 leader_election.cc:304] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:52.449872 17987 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:52.450402 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:52.450955 17942 raft_consensus.cc:3060] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:52.429684 21036 raft_consensus.cc:493] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:52.460070 21036 raft_consensus.cc:3060] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.429940 21116 raft_consensus.cc:697] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 10 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:52.453944 17987 leader_election.cc:400] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 election: Vote denied by peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647) with higher term. Message: Invalid argument: T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 8. Current term is 9.
I20260709 12:10:52.455770 21079 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:52.436255 21217 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:52.445581 21039 raft_consensus.cc:2749] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:52.453375 17914 leader_election.cc:400] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931) with higher term. Message: Invalid argument: T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 9. Current term is 10.
I20260709 12:10:52.481938 17914 leader_election.cc:403] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:52.416028 21234 raft_consensus.cc:515] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:52.471844 17987 leader_election.cc:403] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:10:52.459504 20386 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:52.431164 21236 raft_consensus.cc:515] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:52.475327 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:52.475682 20919 raft_consensus.cc:3055] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:52.477576 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:52.453524 21083 raft_consensus.cc:2804] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:52.479176 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:52.480370 21116 consensus_queue.cc:237] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:52.488481 17944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44668 (request call id 504) took 1205 ms. Trace:
I20260709 12:10:52.503950 17944 rpcz_store.cc:276] 0709 12:10:51.283152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.475034 (+1191882us) service_pool.cc:224] Handling call
0709 12:10:52.488406 (+ 13372us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:52.489487 17947 raft_consensus.cc:3060] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.491415 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:52.471855 20930 leader_election.cc:290] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:52.483004 21211 raft_consensus.cc:2749] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:10:52.452280 21154 consensus_queue.cc:1059] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:10:52.519362 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:52.486160 21230 raft_consensus.cc:3060] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:52.520138 17944 raft_consensus.cc:2468] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 6.
I20260709 12:10:52.496212 18098 raft_consensus.cc:2468] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 9.
I20260709 12:10:52.519429 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:52.521574 18020 raft_consensus.cc:2468] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 8.
I20260709 12:10:52.522841 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:52.523602 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:52.488974 20386 raft_consensus.cc:493] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.492074 21222 consensus_queue.cc:1048] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:10:52.487736 21077 raft_consensus.cc:697] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:52.489303 20919 raft_consensus.cc:740] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:52.502421 21083 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.502089 21193 raft_consensus.cc:493] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.529412 17942 raft_consensus.cc:2468] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 9.
I20260709 12:10:52.511507 21039 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:52.536942 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:52.540339 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:52.530580 21218 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.542706 17944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2124) took 1024 ms. Trace:
I20260709 12:10:52.545912 17944 rpcz_store.cc:276] 0709 12:10:51.517935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.530366 (+1012431us) service_pool.cc:224] Handling call
0709 12:10:52.542599 (+ 12233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:52.503449 21217 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:10:52.555222 17942 raft_consensus.cc:2468] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 7.
I20260709 12:10:52.556094 17942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2128) took 1013 ms. Trace:
I20260709 12:10:52.556545 17942 rpcz_store.cc:276] 0709 12:10:51.543174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.540109 (+996935us) service_pool.cc:224] Handling call
0709 12:10:52.556023 (+ 15914us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:52.546916 18062 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:52.531272 21211 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:52.539515 21083 raft_consensus.cc:3060] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:52.537726 20930 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:52.543762 21242 raft_consensus.cc:3055] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:52.533757 20386 raft_consensus.cc:515] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:52.588060 21242 raft_consensus.cc:740] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:52.588935 21242 consensus_queue.cc:260] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:52.589519 20386 leader_election.cc:290] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:52.573365 21234 leader_election.cc:290] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:52.590058 21242 raft_consensus.cc:3060] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.573493 21054 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:52.573814 21217 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:52.548885 21039 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:10:52.577127 21036 raft_consensus.cc:515] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:52.568986 21218 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:52.579465 21236 leader_election.cc:290] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:52.578142 21077 consensus_queue.cc:237] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:52.580955 20811 raft_consensus.cc:359] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:10:52.542229 21240 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:10:52.530153 21121 consensus_queue.cc:260] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:52.567231 21233 log.cc:927] Time spent T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 12:10:52.571895 21211 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:52.583012 21162 leader_election.cc:290] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:52.583578 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:52.583668 17946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44668 (request call id 486) took 1573 ms. Trace:
I20260709 12:10:52.584064 20930 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:52.586764 18062 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:52.587297 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:52.586705 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:52.600262 17912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.606385 17947 raft_consensus.cc:2468] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 8.
I20260709 12:10:52.613009 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:52.614504 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:52.637109 17947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2129) took 1090 ms. Trace:
I20260709 12:10:52.637529 18098 raft_consensus.cc:2393] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 7: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:52.616721 18019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45464 (request call id 1885) took 1579 ms. Trace:
I20260709 12:10:52.543710 21193 raft_consensus.cc:515] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:52.596395 21219 raft_consensus.cc:697] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:52.610874 21234 raft_consensus.cc:493] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.611667 21243 raft_consensus.cc:3060] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:52.626736 17944 raft_consensus.cc:2393] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 7: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:52.607640 21205 raft_consensus.cc:2749] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:52.645553 17944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2125) took 1119 ms. Trace:
I20260709 12:10:52.626518 17946 rpcz_store.cc:276] 0709 12:10:51.010411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.010523 (+   112us) service_pool.cc:224] Handling call
0709 12:10:52.583492 (+1572969us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b54003c0d54. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:52.583615 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":722570624}
I20260709 12:10:52.637580 17947 rpcz_store.cc:276] 0709 12:10:51.547083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.477335 (+930252us) service_pool.cc:224] Handling call
0709 12:10:52.637032 (+159697us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:52.642310 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 58919.3us
W20260709 12:10:52.646834 17988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.647650 18062 leader_election.cc:304] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:52.644168 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:52.621803 20811 raft_consensus.cc:740] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:10:52.645936 17944 rpcz_store.cc:276] 0709 12:10:51.525647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.568532 (+1042885us) service_pool.cc:224] Handling call
0709 12:10:52.645495 (+ 76963us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:52.651320 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:52.641990 21121 raft_consensus.cc:3060] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:10:52.652814 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 199744us
I20260709 12:10:52.653679 17914 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:52.655747 21218 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:52.608392 20919 consensus_queue.cc:260] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:52.656421 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:52.658485 17947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44668 (request call id 507) took 1094 ms. Trace:
I20260709 12:10:52.662593 18062 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:52.638422 18019 rpcz_store.cc:276] 0709 12:10:51.037447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.037570 (+   123us) service_pool.cc:224] Handling call
0709 12:10:51.048051 (+ 10481us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:51.111367 (+ 63316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:51.111400 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:51.125666 (+ 14266us) log.cc:844] Serialized 52 byte log entry
0709 12:10:51.260373 (+134707us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:10:51.287004 (+ 26631us) log.cc:844] Serialized 14 byte log entry
0709 12:10:52.485637 (+1198633us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b180045fbe0. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f4983fc0a 00007f7f52f7f219 00007f7f498c7a40 00007f7f498c24e4 00007f7f498c2455 00007f7f503aa3c7 00007f7f4c9bc9a7 00007f7f4c9cc0bf 00007f7f4c9cc038
0709 12:10:52.485817 (+   180us) log.cc:844] Serialized 14 byte log entry
0709 12:10:52.606840 (+121023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:52.606911 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:52.615711 (+  8800us) raft_consensus.cc:1685] finished
0709 12:10:52.615731 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:52.616667 (+   936us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1236062,"prepare.queue_time_us":1231002,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":66,"raft.queue_time_us":59017,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":39808,"spinlock_wait_cycles":23739776,"thread_start_us":254700,"threads_started":2,"wal-append.queue_time_us":222028,"wal-append.run_cpu_time_us":2120,"wal-append.run_wall_time_us":1042350}
I20260709 12:10:52.664158 17946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2132) took 1054 ms. Trace:
I20260709 12:10:52.666898 17946 rpcz_store.cc:276] 0709 12:10:51.692502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.646191 (+953689us) service_pool.cc:224] Handling call
0709 12:10:52.664079 (+ 17888us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:10:52.668056 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.664023 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:52.669010 18062 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:52.665405 17947 rpcz_store.cc:276] 0709 12:10:51.563897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.651078 (+1087181us) service_pool.cc:224] Handling call
0709 12:10:52.658419 (+  7341us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:52.650697 20903 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.673992 20903 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:52.671288 21218 raft_consensus.cc:2749] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:52.659571 21217 raft_consensus.cc:2804] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:52.677438 21217 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:52.677795 21217 raft_consensus.cc:3060] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.680179 20903 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:52.681035 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:52.682152 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:52.682772 17944 raft_consensus.cc:2368] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 8. Current term is 9.
I20260709 12:10:52.683415 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:52.684378 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:52.684855 17944 raft_consensus.cc:2468] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
I20260709 12:10:52.685740 17944 raft_consensus.cc:1240] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:52.686223 17944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50334 (request call id 2152) took 1441 ms. Trace:
I20260709 12:10:52.670903 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:52.663743 21244 raft_consensus.cc:2749] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:52.672595 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:52.687369 17946 raft_consensus.cc:2393] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 5: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:52.690176 17914 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:52.691421 17914 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:52.673301 21249 raft_consensus.cc:2804] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:52.673133 21083 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:52.652998 21154 raft_consensus.cc:493] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:52.695200 17914 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:52.700438 18018 raft_consensus.cc:2468] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 7.
I20260709 12:10:52.691941 21076 raft_consensus.cc:2749] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:52.686507 17944 rpcz_store.cc:276] 0709 12:10:51.244805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.685377 (+1440572us) service_pool.cc:224] Handling call
0709 12:10:52.685599 (+   222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:52.686007 (+   408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:52.686146 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:52.705396 17944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50334 (request call id 2155) took 1459 ms. Trace:
I20260709 12:10:52.645457 21234 raft_consensus.cc:515] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:52.704025 21154 raft_consensus.cc:515] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:52.705150 20386 consensus_queue.cc:1059] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:10:52.707597 21083 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:52.708618 21154 leader_election.cc:290] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:52.705227 21251 raft_consensus.cc:2749] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:52.710434 20982 raft_consensus.cc:3055] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:52.710821 20982 raft_consensus.cc:740] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:52.711658 20982 consensus_queue.cc:260] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:52.712875 20982 raft_consensus.cc:3060] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.693677 21244 raft_consensus.cc:2749] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:52.692708 21249 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.717149 17941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50334 (request call id 2156) took 1471 ms. Trace:
I20260709 12:10:52.717406 21020 consensus_queue.cc:1048] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:10:52.718667 18637 raft_consensus.cc:1275] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:10:52.718736 21237 leader_election.cc:290] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:52.719141 20466 raft_consensus.cc:493] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.720037 21036 leader_election.cc:290] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:52.720393 17914 leader_election.cc:304] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:52.722807 21193 leader_election.cc:290] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:52.728256 17941 rpcz_store.cc:276] 0709 12:10:51.245731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.715455 (+1469724us) service_pool.cc:224] Handling call
0709 12:10:52.716624 (+  1169us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:52.716818 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:52.716843 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:52.716879 (+    36us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:52.716947 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:52.716993 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:52.717080 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:52.706143 17944 rpcz_store.cc:276] 0709 12:10:51.245503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.704467 (+1458964us) service_pool.cc:224] Handling call
0709 12:10:52.704751 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:52.705096 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:52.705123 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:52.705161 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:52.705196 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:52.705246 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:52.705341 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:52.762301 17944 raft_consensus.cc:1240] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:52.851794 21234 leader_election.cc:290] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:52.852239 17944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2123) took 1336 ms. Trace:
I20260709 12:10:52.738844 21249 raft_consensus.cc:3060] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:52.852617 17944 rpcz_store.cc:276] 0709 12:10:51.516021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.761853 (+1245832us) service_pool.cc:224] Handling call
0709 12:10:52.762146 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:52.852022 (+ 89876us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:52.852188 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:52.853596 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:52.854151 17944 raft_consensus.cc:2468] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 7.
I20260709 12:10:52.855044 21211 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:52.852262 21085 raft_consensus.cc:493] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:52.855757 21085 raft_consensus.cc:515] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:52.715946 21219 consensus_queue.cc:237] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:52.852020 21039 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:52.763181 21210 raft_consensus.cc:493] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:52.859160 21228 log.cc:927] Time spent T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.607s	user 0.000s	sys 0.003s
I20260709 12:10:52.855067 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:52.866906 17913 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:52.860566 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:10:52.861127 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 97164.4us
I20260709 12:10:52.861552 17946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50334 (request call id 2153) took 1616 ms. Trace:
I20260709 12:10:52.796802 17941 raft_consensus.cc:1240] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:52.775648 21154 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.868265 21000 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:52.846048 21250 raft_consensus.cc:2749] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:52.850242 21217 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:52.880497 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 94439.5us
I20260709 12:10:52.846431 21239 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.881809 21000 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:52.881498 21239 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:52.882232 21217 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:52.846261 21236 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:52.777714 20986 raft_consensus.cc:2804] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:52.882899 21236 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:52.883371 20986 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.883797 20986 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:52.884123 20769 raft_consensus.cc:2749] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:52.876967 18637 raft_consensus.cc:2468] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 4.
I20260709 12:10:52.886469 17989 leader_election.cc:304] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:10:52.849448 21252 log.cc:927] Time spent T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260709 12:10:52.887602 17989 leader_election.cc:304] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:52.696805 20811 consensus_queue.cc:260] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:10:52.879832 17941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50334 (request call id 2157) took 1633 ms. Trace:
I20260709 12:10:52.851389 20930 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:52.850040 21054 raft_consensus.cc:493] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:52.775707 20466 raft_consensus.cc:515] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:52.891040 18092 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53954 (request call id 2135) took 1449 ms. Trace:
I20260709 12:10:52.890969 21054 raft_consensus.cc:515] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:52.891479 18092 rpcz_store.cc:276] 0709 12:10:51.441361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.441526 (+   165us) service_pool.cc:224] Handling call
0709 12:10:51.441928 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:51.454856 (+ 12928us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:51.454895 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:51.455396 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 12:10:51.534062 (+ 78666us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:51.534100 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:51.534162 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:52.858546 (+1324384us) spinlock_profiling.cc:243] Waited 6.3 ms on lock 0x7b4400022b4c. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f497ebc85 00007f7f497ec6a2 00007f7f4c55e1db 00007f7f4c559aaf 00007f7f4c54d86e 00007f7f4c54cbb6 00007f7f4c54c7d8 00007f7f4c556221 00007f7f4c5561d9 00007f7f4c556169
0709 12:10:52.888528 (+ 29982us) raft_consensus.cc:1685] finished
0709 12:10:52.888549 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:52.890981 (+  2432us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51283,"raft.queue_time_us":17746,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":4976,"spinlock_wait_cycles":14483328,"thread_start_us":78317,"threads_started":1,"wal-append.queue_time_us":721988}
I20260709 12:10:52.892987 20698 raft_consensus.cc:2804] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:52.893399 20698 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:52.893720 20698 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:52.895056 17940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44668 (request call id 492) took 1824 ms. Trace:
I20260709 12:10:52.895406 17940 rpcz_store.cc:276] 0709 12:10:51.070155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.105808 (+ 35653us) service_pool.cc:224] Handling call
0709 12:10:51.129478 (+ 23670us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:51.403115 (+273637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:52.894851 (+1491736us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b540022ced4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:52.895003 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":544590080}
I20260709 12:10:52.896569 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:52.897119 17940 raft_consensus.cc:3060] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.897683 20466 leader_election.cc:290] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:52.897903 17947 raft_consensus.cc:3060] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.898736 20986 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:52.900588 20811 ts_tablet_manager.cc:1434] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.567s	user 0.009s	sys 0.000s
W20260709 12:10:52.900914 20811 ts_tablet_manager.cc:1467] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db: Tablet startup took 567ms
I20260709 12:10:52.901863 21193 raft_consensus.cc:2804] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:52.901978 20986 leader_election.cc:290] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:52.902318 21193 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:52.902796 21193 raft_consensus.cc:3060] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:52.903045 21240 raft_consensus.cc:2749] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931) with higher term. Message: Invalid argument: T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 9. Current term is 10.
I20260709 12:10:52.888913 21230 raft_consensus.cc:2749] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647) with higher term. Message: Invalid argument: T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 8. Current term is 9.
I20260709 12:10:52.905004 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:52.859804 21244 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.875317 18021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45472 (request call id 2049) took 1290 ms. Trace:
I20260709 12:10:52.906432 17988 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:52.873118 20928 raft_consensus.cc:3060] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:52.923673 20949 leader_election.cc:290] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:52.926061 21020 raft_consensus.cc:493] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:52.926204 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:52.930260 18089 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
I20260709 12:10:52.931238 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:52.931851 18094 raft_consensus.cc:2468] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 7.
I20260709 12:10:52.932256 17914 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:52.933789 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:52.878928 17946 rpcz_store.cc:276] 0709 12:10:51.245040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.687869 (+1442829us) service_pool.cc:224] Handling call
0709 12:10:52.688187 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:52.688368 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:52.688660 (+   292us) log.cc:844] Serialized 14 byte log entry
0709 12:10:52.861211 (+172551us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:52.861261 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:52.861306 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:52.861364 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:52.861503 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15204,"prepare.queue_time_us":2316,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":18735,"spinlock_wait_cycles":15232,"thread_start_us":138383,"threads_started":1,"wal-append.queue_time_us":182155}
I20260709 12:10:52.909942 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:52.778853 21116 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:52.909037 18021 rpcz_store.cc:276] 0709 12:10:51.585253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.607824 (+ 22571us) service_pool.cc:224] Handling call
0709 12:10:52.875129 (+1267305us) spinlock_profiling.cc:243] Waited 39.4 ms on lock 0x7b540038d454. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:52.875239 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90593152}
I20260709 12:10:52.911986 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:52.939343 18096 raft_consensus.cc:2376] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5. Re-sending same reply.
I20260709 12:10:52.912734 18644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60430 (request call id 719) took 1604 ms. Trace:
I20260709 12:10:52.916149 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:52.916837 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:52.916710 21244 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:52.939983 18644 rpcz_store.cc:276] 0709 12:10:51.308269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.308532 (+   263us) service_pool.cc:224] Handling call
0709 12:10:51.338045 (+ 29513us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:51.484494 (+146449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:51.484522 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:51.484579 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:51.484609 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:52.912520 (+1427911us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b5400075654. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:52.912566 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:52.912679 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":336301952}
I20260709 12:10:52.917568 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:52.917605 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.941316 18092 raft_consensus.cc:2393] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 10: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:52.918241 20919 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:52.795089 21237 consensus_queue.cc:1059] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.124s
I20260709 12:10:52.926578 21020 raft_consensus.cc:515] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:52.934049 17914 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:52.907709 17941 rpcz_store.cc:276] 0709 12:10:51.245948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.761850 (+1515902us) service_pool.cc:224] Handling call
0709 12:10:52.796620 (+ 34770us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:52.879602 (+ 82982us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:52.879781 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:52.934212 18089 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Advancing to term 10
W20260709 12:10:52.937949 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 50420.4us
I20260709 12:10:52.828735 21162 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:52.933341 20982 raft_consensus.cc:2804] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:52.943037 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:52.943042 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:52.945703 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:52.958807 18015 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 10.
I20260709 12:10:52.951262 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:52.942929 21116 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:52.952939 21162 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:52.961961 17947 raft_consensus.cc:1275] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:52.959486 18062 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:52.964394 18024 raft_consensus.cc:1240] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:52.963218 17914 leader_election.cc:304] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:52.967653 17947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50334 (request call id 2154) took 1722 ms. Trace:
I20260709 12:10:52.968307 17947 rpcz_store.cc:276] 0709 12:10:51.245273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.687875 (+1442602us) service_pool.cc:224] Handling call
0709 12:10:52.897675 (+209800us) spinlock_profiling.cc:243] Waited 2.61 ms on lock 0x7b5800003698. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4988df8c 00007f7f4988def6 000000000036eb39 00007f7f519011e0 00007f7f519ca0c4 00007f7f519ca131 00007f7f5198bfc0 00007f7f51976929 00007f7f519763d2 00007f7f4aeedbd4
0709 12:10:52.897795 (+   120us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:52.965739 (+ 67944us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:52.967407 (+  1668us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6008192}
W20260709 12:10:52.971273 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:52.971664 18020 raft_consensus.cc:1240] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 LEADER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:52.967332 18609 leader_election.cc:304] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:52.974459 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:52.938921 21036 raft_consensus.cc:2749] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:52.982272 17947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2133) took 1196 ms. Trace:
I20260709 12:10:52.984867 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:52.985286 17947 rpcz_store.cc:276] 0709 12:10:52.100248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.969556 (+869308us) service_pool.cc:224] Handling call
0709 12:10:52.969909 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:52.970137 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:52.970177 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:52.970237 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:52.970297 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:52.970716 (+   419us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:52.974548 (+  3832us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:10:52.986218 18096 raft_consensus.cc:1275] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:10:52.986889 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:52.990866 18091 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53954 (request call id 2132) took 1860 ms. Trace:
I20260709 12:10:52.971033 21250 raft_consensus.cc:2804] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:52.980930 21240 raft_consensus.cc:2804] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:52.991690 21250 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:52.992075 21240 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:52.992239 21250 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:52.992507 21240 raft_consensus.cc:3060] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:52.993757 21200 raft_consensus.cc:3055] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:10:52.994136 21200 raft_consensus.cc:740] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:52.994915 21200 consensus_queue.cc:260] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:52.995851 21116 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:52.995918 21200 raft_consensus.cc:3060] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:52.981173 21022 raft_consensus.cc:2804] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:52.997298 21022 raft_consensus.cc:697] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:52.997635 21244 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:52.991235 18091 rpcz_store.cc:276] 0709 12:10:51.130675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.133912 (+  3237us) service_pool.cc:224] Handling call
0709 12:10:51.134176 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:52.359300 (+1225124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:52.990624 (+631324us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54003589d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:52.990804 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2629086464}
I20260709 12:10:52.910995 21154 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:52.998162 21022 consensus_queue.cc:237] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:53.007881 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:53.008517 18644 raft_consensus.cc:2468] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
W20260709 12:10:53.009774 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.004901 18018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45472 (request call id 2050) took 1411 ms. Trace:
I20260709 12:10:53.010792 18018 rpcz_store.cc:276] 0709 12:10:51.593763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.727995 (+134232us) service_pool.cc:224] Handling call
0709 12:10:52.587185 (+859190us) spinlock_profiling.cc:243] Waited 56.6 ms on lock 0x7b5800055898. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4988db71 00007f7f4988da22 00007f7f527a68d9 00007f7f51900ee0 00007f7f519ca0ab 00007f7f519ca131 00007f7f519780a0 00007f7f51977984 00007f7f4aef26d4 00007f7f4aef2662
0709 12:10:53.004744 (+417559us) spinlock_profiling.cc:243] Waited 54.6 ms on lock 0x7b540008ded4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:53.004844 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255701120}
I20260709 12:10:53.013306 20698 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:53.016185 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:52.971041 21077 raft_consensus.cc:2804] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:53.014549 18062 leader_election.cc:304] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:53.020685 18062 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:52.889052 21210 raft_consensus.cc:515] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:53.023144 18017 raft_consensus.cc:2393] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 10: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:52.973136 20982 raft_consensus.cc:697] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:52.984908 21243 raft_consensus.cc:2749] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:53.022300 18089 raft_consensus.cc:2468] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 10.
I20260709 12:10:53.028539 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:53.029273 18096 raft_consensus.cc:2468] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 7.
I20260709 12:10:53.030606 21249 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:53.032995 17947 raft_consensus.cc:3060] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:53.025970 20928 raft_consensus.cc:2804] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:53.034338 20928 raft_consensus.cc:493] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.034924 20928 raft_consensus.cc:3060] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:53.035423 21154 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:53.036240 20982 consensus_queue.cc:237] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:53.034505 18091 raft_consensus.cc:1240] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:53.059015 21222 raft_consensus.cc:493] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.059638 21222 raft_consensus.cc:515] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:53.025601 21155 raft_consensus.cc:2749] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:53.070024 17947 raft_consensus.cc:2468] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 10.
I20260709 12:10:53.070930 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:53.071139 18062 leader_election.cc:304] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:52.901248 20811 ts_tablet_manager.cc:1469] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db: Trace:
0709 12:10:40.810269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:40.952836 (+142567us) service_pool.cc:224] Handling call
0709 12:10:41.173529 (+220693us) ts_tablet_manager.cc:934] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
0709 12:10:47.267368 (+6093839us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:10:48.139254 (+871886us) tablet_metadata.cc:665] Metadata flushed
0709 12:10:48.139376 (+   122us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:10:48.298719 (+159343us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:10:48.299001 (+   282us) tablet_replica.cc:206] Creating consensus instance
0709 12:10:48.309009 (+ 10008us) ts_tablet_manager.cc:989] Replica registered.
0709 12:10:48.309075 (+    66us) inbound_call.cc:177] Queueing success response
0709 12:10:49.865935 (+1556860us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:10:52.333115 (+2467180us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:10:52.406381 (+ 73266us) tablet_replica.cc:261] Starting instrumentation
0709 12:10:52.488344 (+ 81963us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":43322,"mutex_wait_us":29496,"raft.queue_time_us":3094,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"tablet-copy.queue_time_us":150863,"tablet-download-pool.queue_time_us":122,"tablet-download-pool.run_cpu_time_us":1601,"tablet-download-pool.run_wall_time_us":1382562,"thread_start_us":314939,"threads_started":2}
I20260709 12:10:53.073881 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:53.074492 17947 raft_consensus.cc:3060] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.076643 17946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44668 (request call id 508) took 1495 ms. Trace:
I20260709 12:10:53.076808 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:53.077394 20977 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:53.074635 17912 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:53.079977 21243 raft_consensus.cc:2804] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:53.080613 21230 consensus_queue.cc:1059] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:53.081204 17989 leader_election.cc:304] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:53.081694 21036 raft_consensus.cc:493] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.032614 21249 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:53.102545 18096 raft_consensus.cc:1240] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:53.086526 17946 rpcz_store.cc:276] 0709 12:10:51.580780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.964111 (+1383331us) service_pool.cc:224] Handling call
0709 12:10:52.964355 (+   244us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:52.964680 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:52.964707 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:52.971062 (+  6355us) log.cc:844] Serialized 26 byte log entry
0709 12:10:53.063752 (+ 92690us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:53.063789 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.063856 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:53.076442 (+ 12586us) raft_consensus.cc:1685] finished
0709 12:10:53.076459 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:53.076584 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1704,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":6008,"thread_start_us":75681,"threads_started":1,"wal-append.queue_time_us":70548}
I20260709 12:10:53.027966 21077 raft_consensus.cc:697] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:53.100891 17912 leader_election.cc:304] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:53.098832 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:53.093514 17947 raft_consensus.cc:2468] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 8.
I20260709 12:10:53.105784 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:53.106415 17946 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 9.
I20260709 12:10:53.073042 21020 leader_election.cc:290] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:53.119706 21211 raft_consensus.cc:2804] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:53.121922 18062 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:53.098593 20769 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.121029 17912 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:53.121266 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:53.122709 18093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41818 (request call id 842) took 2324 ms. Trace:
I20260709 12:10:53.105504 20877 raft_consensus.cc:2804] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:53.101577 20606 raft_consensus.cc:2749] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:53.124697 17943 raft_consensus.cc:1240] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:10:53.124557 18093 rpcz_store.cc:276] 0709 12:10:50.792714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.792895 (+   181us) service_pool.cc:224] Handling call
0709 12:10:50.793240 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:51.305933 (+512693us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.117241 (+1811308us) spinlock_profiling.cc:243] Waited 509 ms on lock 0x7b5400144bd4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:53.117457 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1171048704}
I20260709 12:10:53.125736 20919 raft_consensus.cc:2749] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:53.105741 21023 consensus_queue.cc:1048] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:10:53.118360 20940 consensus_queue.cc:1059] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:10:53.106160 21243 raft_consensus.cc:697] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:53.129495 17949 raft_consensus.cc:1240] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:53.128242 18093 raft_consensus.cc:1240] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:53.130383 17942 raft_consensus.cc:1275] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:10:53.137501 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:53.109515 21036 raft_consensus.cc:515] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:53.139708 17948 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44668 (request call id 499) took 1876 ms (client timeout 1940 ms). Trace:
I20260709 12:10:53.140156 17943 raft_consensus.cc:1275] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:53.125737 20877 raft_consensus.cc:493] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.122202 21211 raft_consensus.cc:493] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.123437 21249 raft_consensus.cc:493] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:53.127955 21020 raft_consensus.cc:2804] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:53.146229 18093 raft_consensus.cc:1240] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:53.129128 21022 consensus_queue.cc:1059] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:10:53.127847 21271 consensus_queue.cc:1059] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
W20260709 12:10:53.218894 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.229667 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:53.171835 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:53.212066 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:53.215126 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:53.160706 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:53.145689 17948 rpcz_store.cc:269] 0709 12:10:51.263427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.346587 (+ 83160us) service_pool.cc:224] Handling call
0709 12:10:53.139563 (+1792976us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54002535d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:53.139655 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2305175296}
I20260709 12:10:53.144438 17940 raft_consensus.cc:2468] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 8.
I20260709 12:10:53.162813 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:53.289111 17943 raft_consensus.cc:2468] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
I20260709 12:10:53.159300 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:53.287796 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:53.290179 17945 raft_consensus.cc:1240] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 7. Current term is 8. Ops: [6.8-7.9]
I20260709 12:10:53.210938 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:53.215868 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:53.290722 18635 raft_consensus.cc:2468] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:53.291339 18096 raft_consensus.cc:2393] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 10: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:53.212996 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:53.130110 20940 raft_consensus.cc:3055] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:53.282832 18062 leader_election.cc:304] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:53.127951 20698 leader_election.cc:290] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:53.156352 17942 raft_consensus.cc:1240] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:53.164340 18640 raft_consensus.cc:1275] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:10:53.216908 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:53.296386 18090 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 10.
I20260709 12:10:53.299167 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:53.300449 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.292726 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:53.301447 18097 raft_consensus.cc:2393] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 7: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:53.128193 20769 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:53.162878 21162 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:53.278702 21211 raft_consensus.cc:3060] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:53.172508 21054 leader_election.cc:290] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:53.164258 20386 raft_consensus.cc:3055] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:53.349499 18635 raft_consensus.cc:3060] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:10:53.345703 18608 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:53.208766 21036 leader_election.cc:290] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:53.160104 21141 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:53.351814 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:53.402308 18641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60430 (request call id 723) took 1817 ms. Trace:
I20260709 12:10:53.402707 18643 raft_consensus.cc:2468] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
I20260709 12:10:53.402887 18641 rpcz_store.cc:276] 0709 12:10:51.585348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:51.597290 (+ 11942us) service_pool.cc:224] Handling call
0709 12:10:53.208516 (+1611226us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b58001c4a98. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4988db71 00007f7f4988da22 00007f7f527a68d9 00007f7f51900ee0 00007f7f519ca0ab 00007f7f519ca131 00007f7f5198bfc0 00007f7f51976929 00007f7f519763d2 00007f7f4aeedbd4
0709 12:10:53.401468 (+192952us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b58001c4a98. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4988de9c 00007f7f4988da5b 00007f7f527a68d9 00007f7f51900ee0 00007f7f519ca0ab 00007f7f519ca131 00007f7f5198bfc0 00007f7f51976929 00007f7f519763d2 00007f7f4aeedbd4
0709 12:10:53.401640 (+   172us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:53.401842 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:53.401871 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:53.401982 (+   111us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:10:53.402049 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.402125 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:53.402248 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":321444096}
I20260709 12:10:53.353801 18609 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:53.354763 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:53.278505 20877 raft_consensus.cc:3060] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.253713 21020 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:53.358493 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:53.170519 21085 leader_election.cc:290] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:53.298427 20940 raft_consensus.cc:740] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:53.360666 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:53.361034 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:53.363423 18644 raft_consensus.cc:3060] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.144816 20928 raft_consensus.cc:515] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:53.294795 21249 raft_consensus.cc:515] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:53.302772 20919 raft_consensus.cc:2804] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:53.341797 21022 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:53.162405 21250 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:10:53.303242 21077 consensus_queue.cc:237] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:53.434417 18089 raft_consensus.cc:1240] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 8. Current term is 9. Ops: []
W20260709 12:10:53.371785 21273 log.cc:927] Time spent T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.251s	user 0.002s	sys 0.000s
I20260709 12:10:53.404929 21141 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:53.350973 18640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
mode: GRACEFUL
new_leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:52812
I20260709 12:10:53.444809 18640 raft_consensus.cc:606] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Received request to transfer leadership to TS 63f5bddeebd84e5788d671a176cfa8e1
W20260709 12:10:53.445010 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 142346us
I20260709 12:10:53.164062 21210 leader_election.cc:290] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:53.167520 21236 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:53.396714 21240 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:53.399763 21265 log.cc:927] Time spent T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.429s	user 0.005s	sys 0.000s
W20260709 12:10:53.407467 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 53758us
I20260709 12:10:53.400231 21193 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:53.368566 21243 consensus_queue.cc:237] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:53.427719 18090 raft_consensus.cc:1275] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:10:53.428746 21249 leader_election.cc:290] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:53.429448 20919 raft_consensus.cc:697] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:53.432112 20928 leader_election.cc:290] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:53.432603 21022 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:53.400978 20386 raft_consensus.cc:740] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:53.445161 18640 raft_consensus.cc:614] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:53.174127 21222 leader_election.cc:290] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:53.445747 18608 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:53.447082 18635 raft_consensus.cc:1275] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:53.449620 18096 raft_consensus.cc:1275] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:10:53.451411 18644 raft_consensus.cc:1275] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:53.454138 18092 raft_consensus.cc:1275] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:53.412995 21116 raft_consensus.cc:2804] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:53.413645 21020 raft_consensus.cc:3060] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.471235 18062 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:53.483911 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:53.485245 17941 raft_consensus.cc:1275] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:53.486981 18090 raft_consensus.cc:1275] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:10:53.487622 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:53.489766 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:53.445258 21162 raft_consensus.cc:2749] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:53.490530 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:53.497954 17943 raft_consensus.cc:2468] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
I20260709 12:10:53.494565 18022 raft_consensus.cc:1240] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:53.497062 17942 raft_consensus.cc:3060] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:53.500517 18062 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:53.504621 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:53.504570 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:53.509888 18023 raft_consensus.cc:1275] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:10:53.493780 21120 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:53.511279 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:53.512022 18021 raft_consensus.cc:3060] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:53.500830 20949 raft_consensus.cc:2804] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:10:53.517028 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 71278.1us
I20260709 12:10:53.494983 21116 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:53.501627 20940 consensus_queue.cc:260] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:53.553066 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:53.604305 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:53.553925 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:53.554620 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:53.607016 18016 raft_consensus.cc:2393] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 10: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:53.555305 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:53.554505 17846 catalog_manager.cc:5697] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 2 to 4, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 4 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:53.556916 17942 raft_consensus.cc:2468] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 9.
W20260709 12:10:53.557041 17842 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45910 (request call id 352) took 23466 ms (client timeout 15000 ms). Trace:
I20260709 12:10:53.557669 21120 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:53.559087 21141 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:53.507918 20930 raft_consensus.cc:2804] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:53.519448 20386 consensus_queue.cc:260] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:53.543320 20919 consensus_queue.cc:237] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:53.603256 21116 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:53.509667 21249 consensus_queue.cc:1059] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:10:53.563782 17914 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:53.513613 21054 raft_consensus.cc:2804] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:53.596573 18021 raft_consensus.cc:2468] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 9.
I20260709 12:10:53.597358 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:53.599681 18608 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:53.561233 21185 raft_consensus.cc:3055] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:10:53.613992 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 110488us
I20260709 12:10:53.615126 20386 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:53.601065 21275 log.cc:927] Time spent T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:10:53.616221 18640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:52812
I20260709 12:10:53.634167 17846 catalog_manager.cc:5697] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:53.636413 18640 raft_consensus.cc:606] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:53.636776 18640 raft_consensus.cc:614] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:53.601256 20949 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:53.608673 17842 rpcz_store.cc:269] 0709 12:10:30.090862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:30.091144 (+   282us) service_pool.cc:224] Handling call
0709 12:10:53.556889 (+23465745us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:49.454353 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:49.633521 (+179168us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:49.633608 (+    87us) write_op.cc:435] Acquired schema lock
0709 12:10:49.633652 (+    44us) tablet.cc:662] Decoding operations
0709 12:10:49.732787 (+ 99135us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:49.752709 (+ 19922us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:49.817296 (+ 64587us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:10:49.818172 (+   876us) tablet.cc:701] Row locks acquired
0709 12:10:49.818217 (+    45us) write_op.cc:260] PREPARE: finished
0709 12:10:49.818595 (+   378us) write_op.cc:270] Start()
0709 12:10:49.818862 (+   267us) write_op.cc:276] Timestamp: P: 1783599049818324 usec, L: 0
0709 12:10:49.818882 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:10:49.820658 (+  1776us) log.cc:844] Serialized 3228 byte log entry
0709 12:10:50.400982 (+580324us) op_driver.cc:464] REPLICATION: finished
0709 12:10:50.683058 (+282076us) write_op.cc:301] APPLY: starting
0709 12:10:50.687589 (+  4531us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:50.737030 (+ 49441us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:50.814723 (+ 77693us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:50.816095 (+  1372us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:50.816518 (+   423us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:10:50.816592 (+    74us) write_op.cc:312] APPLY: finished
0709 12:10:50.817010 (+   418us) log.cc:844] Serialized 65 byte log entry
0709 12:10:50.817257 (+   247us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:50.817390 (+   133us) write_op.cc:454] Released schema lock
0709 12:10:50.817447 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:50.817908 (+   461us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:50.817950 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1932903,"reported_tablets":30,"spinlock_wait_cycles":3456,"child_traces":[["op",{"apply.queue_time_us":231922,"apply.run_cpu_time_us":4568,"apply.run_wall_time_us":151041,"num_ops":8,"prepare.queue_time_us":403112,"prepare.run_cpu_time_us":116875,"prepare.run_wall_time_us":676455,"raft.queue_time_us":257690,"raft.run_cpu_time_us":27044,"raft.run_wall_time_us":209635,"replication_time_us":560294,"thread_start_us":934003,"threads_started":4,"wal-append.queue_time_us":296466,"wal-append.run_cpu_time_us":42698,"wal-append.run_wall_time_us":1771933}]]}
I20260709 12:10:53.632313 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:53.634521 18062 leader_election.cc:304] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:53.642035 18021 raft_consensus.cc:1240] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:53.642340 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:53.643208 18015 raft_consensus.cc:2468] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 5.
I20260709 12:10:53.643985 17846 catalog_manager.cc:5697] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:53.639752 20769 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:53.651849 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:53.630836 21054 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:53.635883 21141 raft_consensus.cc:2804] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:53.651451 17846 catalog_manager.cc:5697] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 5 to 8, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 8 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:53.634155 21185 raft_consensus.cc:740] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:53.654568 18644 raft_consensus.cc:2468] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
I20260709 12:10:53.642398 20949 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:53.643730 20930 raft_consensus.cc:697] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:53.668761 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:53.637682 21085 consensus_queue.cc:1048] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:10:53.662729 17846 catalog_manager.cc:5697] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 5 to 8, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 8 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:53.668766 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:53.672547 18019 raft_consensus.cc:2468] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 4.
I20260709 12:10:53.672556 18015 raft_consensus.cc:2393] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 10: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:53.675633 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:53.658773 21054 raft_consensus.cc:3060] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:53.670805 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:53.690955 18097 raft_consensus.cc:2410] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:10:53.660940 21237 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:53.691843 18644 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7201987495494cf8a78424cb721d1c88"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
mode: GRACEFUL
new_leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:52812
I20260709 12:10:53.692544 18644 raft_consensus.cc:606] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Received request to transfer leadership to TS 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:53.692955 18644 raft_consensus.cc:614] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:53.657703 21249 raft_consensus.cc:2749] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:53.678031 21022 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:53.674137 21193 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:53.751981 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:53.893556 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 259090us
W20260709 12:10:53.837044 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.703096 17846 catalog_manager.cc:5697] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 2 to 3, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 3 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
W20260709 12:10:53.813984 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.897902 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:53.751399 17945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2130) took 2187 ms. Trace:
I20260709 12:10:53.900060 18093 raft_consensus.cc:1240] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:53.735162 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:53.730216 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:53.910792 17945 rpcz_store.cc:276] 0709 12:10:51.564207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.899966 (+1335759us) service_pool.cc:224] Handling call
0709 12:10:53.289853 (+389887us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:53.295709 (+  5856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.751204 (+455495us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b540015f4d0. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b18ad 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:53.751337 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":895832960}
W20260709 12:10:53.919692 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.923671 17912 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:53.898613 18019 raft_consensus.cc:2468] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 7.
I20260709 12:10:53.694584 21240 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:53.734594 21282 log.cc:927] Time spent T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:10:53.693969 21278 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:53.735124 21281 log.cc:927] Time spent T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 12:10:53.931650 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:53.936323 18023 raft_consensus.cc:1275] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:10:53.929853 17846 catalog_manager.cc:5697] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 2 to 4, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 4 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:53.938577 18642 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
mode: GRACEFUL
new_leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
 from {username='slave'} at 127.0.0.1:52812
I20260709 12:10:53.941864 18642 raft_consensus.cc:606] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Received request to transfer leadership to TS c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:53.942231 18642 raft_consensus.cc:614] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:53.737462 21243 raft_consensus.cc:3055] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:53.914850 21120 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:53.753263 21162 consensus_queue.cc:1048] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.187s
I20260709 12:10:53.957077 18095 raft_consensus.cc:1240] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:53.914274 20698 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
W20260709 12:10:53.945812 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 312569us
I20260709 12:10:53.945065 17846 catalog_manager.cc:5697] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:53.943542 18015 raft_consensus.cc:2468] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
I20260709 12:10:53.926692 21141 raft_consensus.cc:697] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 9 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:53.856585 21083 consensus_queue.cc:1059] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 12:10:53.934851 20882 raft_consensus.cc:2804] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:53.752169 21211 raft_consensus.cc:515] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:53.914132 21196 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:53.943825 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 138837us
I20260709 12:10:53.740258 21020 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:53.975200 17846 catalog_manager.cc:5697] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:53.732671 21185 consensus_queue.cc:260] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:53.978462 17846 catalog_manager.cc:5697] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 3 to 5, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 5 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:53.980041 21020 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:53.967934 20698 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:53.950783 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:53.746419 20949 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:53.981760 21116 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:53.938319 21193 consensus_queue.cc:1048] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:10:53.983510 18639 raft_consensus.cc:2393] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 11: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:53.941062 21036 consensus_queue.cc:1048] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:10:53.984380 18642 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9b0c864d78846698db31224c547a091"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:52812
I20260709 12:10:53.984676 20949 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:53.984964 18642 raft_consensus.cc:606] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
W20260709 12:10:53.985215 20877 consensus_meta.cc:287] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.546s	user 0.006s	sys 0.003s
I20260709 12:10:53.985384 18642 raft_consensus.cc:614] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:53.985698 20877 raft_consensus.cc:515] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:53.987183 20698 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:53.987668 20877 leader_election.cc:290] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:53.944669 21243 raft_consensus.cc:740] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:53.960997 18608 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:53.979923 17846 catalog_manager.cc:5697] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:53.754288 20930 consensus_queue.cc:237] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:53.987385 21141 consensus_queue.cc:237] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:53.989756 18608 leader_election.cc:304] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
W20260709 12:10:53.992530 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 433927us
I20260709 12:10:53.994254 17914 leader_election.cc:304] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:53.994446 18608 leader_election.cc:304] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:53.943296 21278 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:53.967469 20882 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.000139 18091 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53954 (request call id 2148) took 1042 ms. Trace:
W20260709 12:10:54.002586 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 67064.9us
I20260709 12:10:54.002933 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:54.007501 18636 raft_consensus.cc:3060] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:10:53.988426 21194 raft_consensus.cc:3055] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:53.991983 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:53.988519 21249 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.006404 18091 rpcz_store.cc:276] 0709 12:10:52.957710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.367928 (+410218us) service_pool.cc:224] Handling call
0709 12:10:53.389667 (+ 21739us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:53.390082 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:53.390109 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:53.393609 (+  3500us) log.cc:844] Serialized 26 byte log entry
0709 12:10:53.501551 (+107942us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:53.501588 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:53.501650 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:53.999949 (+498299us) raft_consensus.cc:1685] finished
0709 12:10:53.999966 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.000085 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":2579,"thread_start_us":94098,"threads_started":1,"wal-append.queue_time_us":213524}
I20260709 12:10:54.013835 17846 catalog_manager.cc:5697] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 5 to 8, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 8 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:53.999063 21162 raft_consensus.cc:2804] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:54.019395 18017 raft_consensus.cc:1275] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:54.020756 18642 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEARNER]: Advancing to term 8
I20260709 12:10:54.005216 21023 raft_consensus.cc:2804] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:10:54.009387 20882 raft_consensus.cc:3060] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.028131 21121 raft_consensus.cc:3055] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:54.003733 21290 raft_consensus.cc:2749] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:53.989542 21196 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:54.001838 20769 consensus_queue.cc:1048] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:10:54.046856 21023 raft_consensus.cc:697] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:54.054708 21023 consensus_queue.cc:237] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:54.056735 20919 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.056860 21237 raft_consensus.cc:2749] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:54.057265 20919 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:54.025900 21162 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:54.011560 21194 raft_consensus.cc:740] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:54.039492 18097 raft_consensus.cc:1240] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:54.041467 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:54.039659 17846 catalog_manager.cc:5697] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 2 to 5, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 5 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:54.059871 21194 consensus_queue.cc:260] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:54.060964 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:54.061862 18091 raft_consensus.cc:2410] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:54.061033 17846 catalog_manager.cc:5697] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:54.042400 21121 raft_consensus.cc:740] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
W20260709 12:10:54.063455 17989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.063944 21211 leader_election.cc:290] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:54.064109 21289 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.064582 21289 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:54.049011 18093 raft_consensus.cc:1240] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:10:54.051365 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:54.048391 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:54.058992 21162 raft_consensus.cc:3060] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.060418 21239 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:54.062769 17846 catalog_manager.cc:5697] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 3 to 6, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 6 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:54.051631 21116 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:54.006199 21291 raft_consensus.cc:2804] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:54.018692 21249 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:54.255875 18089 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53954 (request call id 2141) took 1307 ms. Trace:
I20260709 12:10:54.318671 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:54.319587 18090 raft_consensus.cc:3060] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.209185 17942 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:54.321135 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:54.321012 18089 rpcz_store.cc:276] 0709 12:10:52.948622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.028415 (+ 79793us) service_pool.cc:224] Handling call
0709 12:10:53.028661 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:53.434852 (+406191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.255573 (+820721us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b54002fa3d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:54.255797 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":932701056}
W20260709 12:10:54.321677 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.113644 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:54.322585 18023 raft_consensus.cc:2468] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
I20260709 12:10:54.113328 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:54.255844 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:54.104786 18096 raft_consensus.cc:1240] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 LEADER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 9. Current term is 10. Ops: []
I20260709 12:10:54.112838 17945 raft_consensus.cc:1275] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:54.258394 18095 raft_consensus.cc:1275] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:54.065546 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:54.326038 18638 raft_consensus.cc:3060] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:10:54.118520 18022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45464 (request call id 1887) took 1182 ms. Trace:
I20260709 12:10:54.102360 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:54.317523 18062 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:54.255365 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:54.334746 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:54.334823 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:54.335510 17989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.336086 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:54.337436 18021 raft_consensus.cc:3060] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.338243 18637 raft_consensus.cc:2410] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:10:54.326602 18022 rpcz_store.cc:276] 0709 12:10:52.936498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.943179 (+  6681us) service_pool.cc:224] Handling call
0709 12:10:52.943449 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:53.498756 (+555307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.118320 (+619564us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b540008d9d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:54.118465 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1267023232}
I20260709 12:10:54.339588 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:54.340219 18022 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:10:54.341758 17989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.341847 17944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2126) took 2811 ms. Trace:
I20260709 12:10:54.342279 17944 rpcz_store.cc:276] 0709 12:10:51.530352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:52.885958 (+1355606us) service_pool.cc:224] Handling call
0709 12:10:52.886260 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:53.061537 (+175277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:53.061565 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:53.089396 (+ 27831us) log.cc:844] Serialized 26 byte log entry
0709 12:10:53.342922 (+253526us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:53.342976 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.318690 (+975714us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b54002521d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:54.318733 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:54.318771 (+    38us) raft_consensus.cc:1685] finished
0709 12:10:54.318783 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:54.341782 (+ 22999us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":2187,"spinlock_wait_cycles":402264960,"thread_start_us":223194,"threads_started":1,"wal-append.queue_time_us":287725}
W20260709 12:10:54.345263 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.347585 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:54.348122 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:54.330724 21271 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.349310 18062 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:54.349720 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:54.349823 21271 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:54.060988 21194 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:54.350844 17913 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 1.504s (SENT) [suppressed 10 similar messages]
I20260709 12:10:54.349632 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:54.352489 18609 leader_election.cc:304] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:54.354295 18637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60430 (request call id 735) took 1178 ms. Trace:
I20260709 12:10:54.354660 18637 rpcz_store.cc:276] 0709 12:10:53.175453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.175564 (+   111us) service_pool.cc:224] Handling call
0709 12:10:54.102187 (+926623us) spinlock_profiling.cc:243] Waited 8.19 ms on lock 0x7b58001c4a98. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4988db71 00007f7f4988da22 00007f7f527a68d9 00007f7f51900ee0 00007f7f519ca0ab 00007f7f519ca131 00007f7f519780a0 00007f7f51977984 00007f7f4aef26d4 00007f7f4aef2662
0709 12:10:54.354241 (+252054us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18827136}
I20260709 12:10:54.359563 18062 leader_election.cc:304] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:54.360694 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:54.362375 17944 raft_consensus.cc:2468] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 10.
I20260709 12:10:54.364208 17942 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 11.
W20260709 12:10:54.113899 21299 log.cc:927] Time spent T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 12:10:54.367708 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.216804 20977 raft_consensus.cc:3055] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:54.173386 21219 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.317560 21196 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:54.368616 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:54.097101 20949 raft_consensus.cc:493] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.368772 17846 catalog_manager.cc:5697] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:54.066541 21289 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:54.065708 21077 raft_consensus.cc:493] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.372036 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:54.390971 21236 consensus_queue.cc:1048] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:54.391764 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:54.392055 20928 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.390985 21077 raft_consensus.cc:515] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:54.392813 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:54.393121 21278 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:54.393402 18017 raft_consensus.cc:2468] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 10.
I20260709 12:10:54.348536 20940 raft_consensus.cc:3060] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.317335 20919 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:54.372753 18090 raft_consensus.cc:2468] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:10:54.395251 21239 consensus_queue.cc:1048] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:10:54.368148 21155 raft_consensus.cc:2804] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:54.396255 21155 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:54.396701 21155 raft_consensus.cc:3060] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.396860 21278 raft_consensus.cc:493] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.397398 21278 raft_consensus.cc:515] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:54.399266 21278 leader_election.cc:290] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:54.398864 20949 raft_consensus.cc:515] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:54.401487 20949 leader_election.cc:290] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:54.401779 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:54.373837 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:54.341334 21083 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.348392 21285 consensus_queue.cc:1048] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:10:54.411827 20949 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.412297 20949 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:54.382907 18021 raft_consensus.cc:2468] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
I20260709 12:10:54.413475 21249 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:54.413929 18021 raft_consensus.cc:1275] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:10:54.414171 20949 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:54.416038 18020 raft_consensus.cc:2468] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 9.
I20260709 12:10:54.235817 21237 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:54.366875 21303 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.067318 21121 consensus_queue.cc:260] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:54.387439 21116 raft_consensus.cc:2749] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:54.372110 20977 raft_consensus.cc:740] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:54.390219 21085 consensus_queue.cc:1048] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:54.392635 20928 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:54.394253 21077 leader_election.cc:290] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:54.410902 21083 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:54.373088 18016 raft_consensus.cc:1275] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:54.447679 18022 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 11.
I20260709 12:10:54.384938 21289 raft_consensus.cc:2749] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:54.352308 21300 raft_consensus.cc:2804] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:54.449090 21300 raft_consensus.cc:697] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:54.449952 21300 consensus_queue.cc:237] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:54.367950 21290 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:54.389493 17912 leader_election.cc:304] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:54.374534 21291 raft_consensus.cc:697] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:54.351982 21210 consensus_queue.cc:1059] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:10:54.038908 21243 consensus_queue.cc:260] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:54.463234 18017 raft_consensus.cc:1275] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:10:54.465334 20386 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:54.568346 20386 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:54.479022 21121 raft_consensus.cc:3060] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:54.483796 21054 consensus_meta.cc:287] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.781s	user 0.007s	sys 0.003s
I20260709 12:10:54.483990 21250 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:54.508457 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:54.600361 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.601217 20386 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:54.424171 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:54.433202 21020 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.383374 21219 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:54.547081 17846 catalog_manager.cc:5697] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
W20260709 12:10:54.623339 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.602277 17945 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 10.
I20260709 12:10:54.474340 20882 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:54.631202 17846 catalog_manager.cc:5697] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 1 to 7, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 7 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:10:54.635730 17846 catalog_manager.cc:5697] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 2 to 4, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 4 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:10:54.701223 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:54.437968 21237 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:54.672940 21020 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:54.599056 21289 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.566654 21290 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:54.440181 21303 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:54.678862 20977 consensus_queue.cc:260] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:54.698064 20928 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:54.699285 21083 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:54.701455 18020 raft_consensus.cc:3060] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:54.704313 17846 catalog_manager.cc:5697] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 4 to 7, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 7 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
W20260709 12:10:54.706928 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 317473us
I20260709 12:10:54.740092 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:54.741221 18022 raft_consensus.cc:2393] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 4: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:54.773402 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
W20260709 12:10:54.779309 18636 consensus_meta.cc:287] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.753s	user 0.007s	sys 0.003s
I20260709 12:10:54.779914 18636 raft_consensus.cc:2468] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
I20260709 12:10:54.617738 21054 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:54.834941 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:54.835650 20386 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.835340 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:54.837667 20386 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:54.837157 18017 raft_consensus.cc:1240] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 10. Current term is 11. Ops: []
W20260709 12:10:54.841627 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.841784 17989 leader_election.cc:304] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:54.846992 18020 raft_consensus.cc:1275] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:54.847296 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:54.848021 18018 raft_consensus.cc:2393] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 6: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:54.725811 20986 raft_consensus.cc:2749] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:54.855186 21083 consensus_queue.cc:1059] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:10:54.856271 20386 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:54.856768 18610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:54.862252 18638 consensus_meta.cc:287] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.536s	user 0.008s	sys 0.000s
I20260709 12:10:54.895819 18638 raft_consensus.cc:2468] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
W20260709 12:10:54.897094 17989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:54.868294 18024 raft_consensus.cc:1275] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:54.881258 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:54.775468 21271 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:54.903098 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:54.785547 20977 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:54.776124 21085 raft_consensus.cc:493] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:54.907008 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:54.910673 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:54.899422 18062 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.024s	sys 0.039s
I20260709 12:10:54.911769 20386 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:54.913672 18062 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.024s	sys 0.039s
I20260709 12:10:54.913944 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:54.913964 20386 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:54.914580 18093 raft_consensus.cc:2468] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:54.682209 21291 consensus_queue.cc:237] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:54.869771 20940 raft_consensus.cc:2804] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:54.712613 21289 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:54.914242 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 554750us
I20260709 12:10:54.935346 20386 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:54.933609 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:54.935897 18062 leader_election.cc:304] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:54.928535 20606 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:54.943874 17912 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:54.928283 21039 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
W20260709 12:10:54.946286 18091 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.006s	sys 0.034s
W20260709 12:10:54.956904 18094 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.004s	sys 0.007s
W20260709 12:10:54.957314 18094 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.004s	sys 0.007s
I20260709 12:10:54.946019 20606 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:54.939759 20940 raft_consensus.cc:697] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
W20260709 12:10:54.944950 21162 consensus_meta.cc:287] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.579s	user 0.009s	sys 0.000s
W20260709 12:10:54.958431 18609 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.005s	sys 0.005s
W20260709 12:10:54.955966 18091 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.007s	sys 0.034s
W20260709 12:10:54.966153 18609 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.006s	sys 0.006s
I20260709 12:10:54.967074 20386 raft_consensus.cc:2804] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:54.967708 20386 raft_consensus.cc:697] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:54.916290 21085 raft_consensus.cc:515] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:54.969602 17942 raft_consensus.cc:1240] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:54.971202 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:54.971835 17947 raft_consensus.cc:2468] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
I20260709 12:10:54.939251 20928 consensus_queue.cc:1048] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.022s
W20260709 12:10:54.978369 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 344725us
I20260709 12:10:54.978608 17944 raft_consensus.cc:1240] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 3. Current term is 4. Ops: []
I20260709 12:10:54.979210 17912 leader_election.cc:304] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
W20260709 12:10:54.980286 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 598080us
I20260709 12:10:54.977391 20386 consensus_queue.cc:237] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:54.983088 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 282447us
I20260709 12:10:54.985865 17949 raft_consensus.cc:1275] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:54.988598 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:54.989522 18644 raft_consensus.cc:3060] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:54.991305 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:54.971999 20930 raft_consensus.cc:2804] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:54.995085 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
W20260709 12:10:54.999514 18015 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.020s	sys 0.049s
W20260709 12:10:55.000164 18015 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.020s	sys 0.049s
W20260709 12:10:54.982867 21023 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.019s	sys 0.027s
I20260709 12:10:54.959369 21039 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:10:54.996534 20882 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:55.005165 21023 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.019s	sys 0.027s
I20260709 12:10:54.971459 21162 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:55.018828 18644 raft_consensus.cc:2468] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 7.
I20260709 12:10:55.016458 20928 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.019873 20928 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:55.021468 21054 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:10:55.022123 21306 log.cc:927] Time spent T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 12:10:55.023447 21039 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:55.025362 21155 consensus_meta.cc:287] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.628s	user 0.009s	sys 0.000s
I20260709 12:10:55.025779 21155 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:55.027024 17989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:55.027624 21307 log.cc:927] Time spent T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:10:55.029822 21289 leader_election.cc:290] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:55.030361 21289 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.030807 21289 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:55.031342 20606 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:55.013862 20940 consensus_queue.cc:237] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:55.039788 21185 raft_consensus.cc:3060] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:55.006453 21314 raft_consensus.cc:2804] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:55.012724 21310 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:55.055740 21289 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:10:55.056972 21194 consensus_meta.cc:287] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.706s	user 0.002s	sys 0.008s
I20260709 12:10:55.016896 21020 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:55.058955 21314 raft_consensus.cc:697] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:55.101249 21237 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:55.103225 18642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60424 (request call id 909) took 1083 ms. Trace:
I20260709 12:10:55.108166 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:55.105331 18642 rpcz_store.cc:276] 0709 12:10:54.019887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.020155 (+   268us) service_pool.cc:224] Handling call
0709 12:10:54.020546 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:54.696586 (+676040us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:54.696630 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:54.697173 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 12:10:54.920356 (+223183us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:55.102466 (+182110us) log.cc:844] Serialized 14 byte log entry
0709 12:10:55.102948 (+   482us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.103013 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:55.103050 (+    37us) raft_consensus.cc:1685] finished
0709 12:10:55.103061 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:55.103172 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":188311,"raft.queue_time_us":229359,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":17058,"thread_start_us":768944,"threads_started":3,"wal-append.queue_time_us":322506}
I20260709 12:10:55.109254 17989 leader_election.cc:304] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:10:55.109495 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:55.109982 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.111496 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:55.117282 18639 raft_consensus.cc:2393] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 8: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:55.075942 21310 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
W20260709 12:10:55.124326 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 164230us
I20260709 12:10:55.123697 18638 raft_consensus.cc:1240] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:55.152680 18095 raft_consensus.cc:1240] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:10:55.153311 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:55.153913 18642 raft_consensus.cc:2468] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
I20260709 12:10:55.155889 21310 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123)
W20260709 12:10:55.158591 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.123415 21290 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:55.152072 17988 connection.cc:256] RPC call timeout handler was delayed by -1.0651395020001928s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15710000000000002s for a response
I20260709 12:10:55.158360 21222 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.164789 21222 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:55.123617 21219 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:55.150197 21083 raft_consensus.cc:2804] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:55.163957 18638 raft_consensus.cc:1240] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 10. Current term is 11. Ops: []
W20260709 12:10:55.167405 17988 connection.cc:256] RPC call timeout handler was delayed by -1.0426395020001564s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15960000000000002s for a response
I20260709 12:10:55.172254 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:55.173799 18095 raft_consensus.cc:2393] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 10: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
W20260709 12:10:55.174736 17988 connection.cc:256] RPC call timeout handler was delayed by -1.0174395020001157s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16240000000000002s for a response
I20260709 12:10:55.170305 18062 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:55.176183 17988 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:55.178030 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:55.178635 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:55.171890 21083 raft_consensus.cc:493] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.178836 18638 raft_consensus.cc:2393] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 6: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:55.183732 18062 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:55.185302 17988 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:55.169456 21222 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:55.176313 21314 consensus_queue.cc:237] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:55.189640 21311 consensus_queue.cc:1048] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:10:55.191521 21326 raft_consensus.cc:2804] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:55.192991 18096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53954 (request call id 2158) took 1912 ms. Trace:
I20260709 12:10:55.205081 18096 rpcz_store.cc:276] 0709 12:10:53.280439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.492999 (+212560us) service_pool.cc:224] Handling call
0709 12:10:53.501661 (+  8662us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:54.104590 (+602929us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b5400209a20. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c929dc0 00007f7f4c9b41c0 00007f7f4c9b5231 00007f7f4c9b1d8f 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c
0709 12:10:54.337169 (+232579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.192726 (+855557us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54001b3d54. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:55.192918 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":291378432}
I20260709 12:10:55.194033 21121 raft_consensus.cc:2749] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:55.195025 18033 tablet_copy_service.cc:342] P c5ffa786c8fb43f7864fa8fbe76534cb: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-137ed415b9d242989f28f349c1618c74 received from {username='slave'} at 127.0.0.1:53022
W20260709 12:10:55.196692 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.198299 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:55.173321 21310 consensus_queue.cc:1048] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
W20260709 12:10:55.233266 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 48061.1us
W20260709 12:10:55.201455 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.203114 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:55.236871 18638 raft_consensus.cc:2393] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 7: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:55.182950 21083 raft_consensus.cc:3060] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:55.198995 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:55.239450 18097 raft_consensus.cc:2393] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 7: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:55.240510 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:55.241561 18097 raft_consensus.cc:2410] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 12:10:55.244434 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:55.245227 18638 raft_consensus.cc:2468] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:10:55.204921 21326 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.187356 20698 raft_consensus.cc:2749] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:55.199455 21219 raft_consensus.cc:2804] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:55.234606 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:55.264199 21219 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:55.264371 18643 raft_consensus.cc:3060] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.264647 21219 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:55.235237 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:55.267284 18637 raft_consensus.cc:2468] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:10:55.247893 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:55.268123 18089 raft_consensus.cc:2468] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
I20260709 12:10:55.269477 18089 raft_consensus.cc:1240] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 10. Current term is 11. Ops: [8.9-10.10]
W20260709 12:10:55.247884 17989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.247852 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:55.272933 21319 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:55.273453 21319 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:55.275522 21319 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:55.276433 21319 consensus_queue.cc:1048] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:55.232755 21162 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:55.251590 18097 raft_consensus.cc:1240] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:55.252720 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:55.299489 18638 raft_consensus.cc:2468] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 7.
W20260709 12:10:55.253122 21320 log.cc:927] Time spent T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:10:55.302623 21303 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:55.303874 18019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53022 (request call id 535) took 1191 ms. Trace:
I20260709 12:10:55.304204 18019 rpcz_store.cc:276] 0709 12:10:54.112406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.116109 (+  3703us) service_pool.cc:224] Handling call
0709 12:10:54.416858 (+300749us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b5800055898. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4988db71 00007f7f4988da22 00007f7f527a68d9 00007f7f51900ee0 00007f7f519ca0ab 00007f7f519ca131 00007f7f5198bfc0 00007f7f51976929 00007f7f519763d2 00007f7f4aeedbd4
0709 12:10:54.417087 (+   229us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:54.417493 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:54.417532 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:54.706578 (+289046us) log.cc:844] Serialized 26 byte log entry
0709 12:10:54.988510 (+281932us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:54.988566 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:54.988667 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:55.303604 (+314937us) raft_consensus.cc:1685] finished
0709 12:10:55.303622 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:55.303816 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":276866,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":5389,"spinlock_wait_cycles":24562048,"thread_start_us":139878,"threads_started":1,"wal-append.queue_time_us":374489}
I20260709 12:10:55.253427 18033 tablet_copy_service.cc:434] P c5ffa786c8fb43f7864fa8fbe76534cb: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-137ed415b9d242989f28f349c1618c74 on tablet 137ed415b9d242989f28f349c1618c74 with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:55.254108 21154 consensus_queue.cc:1048] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:55.257861 21244 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.163913 20930 raft_consensus.cc:697] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:55.261315 17988 leader_election.cc:400] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 election: Vote denied by peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123) with higher term. Message: Invalid argument: T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 8. Current term is 9.
W20260709 12:10:55.338883 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 77718.2us
I20260709 12:10:55.339195 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:55.278410 18643 raft_consensus.cc:2468] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:10:55.243409 21185 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.270993 21326 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:55.246732 21324 consensus_queue.cc:1048] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
W20260709 12:10:55.301589 21327 log.cc:927] Time spent T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:10:55.301759 21085 leader_election.cc:290] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:55.292678 21036 raft_consensus.cc:3055] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:55.302521 18091 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53954 (request call id 2166) took 1235 ms. Trace:
I20260709 12:10:55.294399 21083 raft_consensus.cc:515] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:55.253496 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:55.355283 18635 raft_consensus.cc:2468] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:10:55.317147 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:55.356139 17942 raft_consensus.cc:3060] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.324196 17944 raft_consensus.cc:1275] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:10:55.331248 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 128729us
I20260709 12:10:55.336781 17941 raft_consensus.cc:1275] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:10:55.359659 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:55.333915 17987 leader_election.cc:304] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:55.341573 17988 leader_election.cc:304] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:55.360205 18062 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:55.344193 17949 raft_consensus.cc:1275] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:10:55.324659 21250 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.361819 18091 rpcz_store.cc:276] 0709 12:10:54.066928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:54.347505 (+280577us) service_pool.cc:224] Handling call
0709 12:10:54.373405 (+ 25900us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:54.966488 (+593083us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:54.966546 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:54.974476 (+  7930us) log.cc:844] Serialized 26 byte log entry
0709 12:10:55.107211 (+132735us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:55.107263 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.107351 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:55.302323 (+194972us) raft_consensus.cc:1685] finished
0709 12:10:55.302343 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:55.302466 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11893,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":69,"thread_start_us":675604,"threads_started":2,"wal-append.queue_time_us":199525}
I20260709 12:10:55.360391 18098 raft_consensus.cc:2393] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 7: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
W20260709 12:10:55.345189 18608 connection.cc:256] RPC call timeout handler was delayed by -2.036406493999948s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18510000000000001s for a response
W20260709 12:10:55.363781 18608 connection.cc:256] RPC call timeout handler was delayed by -1.9923064939998767s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19s for a response
I20260709 12:10:55.364830 17913 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:55.368112 21321 raft_consensus.cc:2749] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:55.368384 21334 consensus_queue.cc:1048] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:10:55.369935 21334 consensus_queue.cc:1048] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:55.371932 17913 leader_election.cc:304] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:55.335040 21162 consensus_queue.cc:1059] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:10:55.373026 20386 raft_consensus.cc:2804] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:55.376108 20386 raft_consensus.cc:493] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.376492 20386 raft_consensus.cc:3060] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.351913 21291 raft_consensus.cc:493] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:55.334280 20698 consensus_queue.cc:1059] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:10:55.362305 21335 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.363499 21036 raft_consensus.cc:740] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:55.352190 21271 consensus_queue.cc:1059] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:10:55.346869 21244 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:55.376297 21077 raft_consensus.cc:2804] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:55.350566 21185 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:55.411141 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:55.419811 20986 raft_consensus.cc:493] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.422837 21210 raft_consensus.cc:493] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:55.427042 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.427219 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:55.427772 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:55.366384 21303 consensus_queue.cc:1048] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:10:55.397140 21020 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.436514 17942 raft_consensus.cc:2468] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
I20260709 12:10:55.427840 20882 consensus_queue.cc:1059] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:10:55.439764 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:55.440858 17946 raft_consensus.cc:2410] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:10:55.366606 21250 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:55.356139 21194 consensus_queue.cc:1059] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:10:55.433967 17944 raft_consensus.cc:2468] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 8.
I20260709 12:10:55.447182 17914 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:55.374903 21314 consensus_queue.cc:1059] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:10:55.407969 21291 raft_consensus.cc:515] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:55.444124 18610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.478050 21315 raft_consensus.cc:2804] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:55.454682 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:55.448807 21020 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:55.447129 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:55.456152 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:55.455042 20928 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:55.448817 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:55.476794 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:10:55.462890 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 129032us
I20260709 12:10:55.443626 21077 raft_consensus.cc:697] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 11 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
W20260709 12:10:55.483238 18062 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:55.593732 18062 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.446084 21271 raft_consensus.cc:2749] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:55.412894 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 71398.8us
I20260709 12:10:55.444746 21162 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:55.589476 17987 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:55.452361 20386 raft_consensus.cc:515] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:55.494112 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 129819us
I20260709 12:10:55.439091 20986 raft_consensus.cc:515] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:55.428287 21335 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:55.460661 21346 raft_consensus.cc:2749] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:55.447270 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:55.433775 20930 consensus_queue.cc:237] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:55.588536 21340 log.cc:927] Time spent T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:10:55.505024 17946 raft_consensus.cc:2468] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
I20260709 12:10:55.505455 21349 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.591315 21250 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:55.591405 21244 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:55.505478 17942 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 10.
I20260709 12:10:55.504737 18643 raft_consensus.cc:3060] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.629451 17949 raft_consensus.cc:2468] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
W20260709 12:10:55.545002 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 209230us
I20260709 12:10:55.491261 17948 raft_consensus.cc:2468] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
W20260709 12:10:55.598663 18608 connection.cc:256] RPC call timeout handler was delayed by -1.9122064939999746s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19890000000000002s for a response
W20260709 12:10:55.637696 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 141536us
I20260709 12:10:55.493856 21240 raft_consensus.cc:3055] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:10:55.638583 18608 connection.cc:256] RPC call timeout handler was delayed by -1.5656442229999357s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2717s for a response
W20260709 12:10:55.638947 18608 connection.cc:256] RPC call timeout handler was delayed by -1.545906493999837s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2396s for a response
I20260709 12:10:55.439006 21210 raft_consensus.cc:515] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:55.490754 21036 consensus_queue.cc:260] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:55.503089 21315 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.627596 17988 leader_election.cc:304] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:55.639220 18608 connection.cc:256] RPC call timeout handler was delayed by -1.4982746069999848s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1557s for a response
W20260709 12:10:55.647480 18608 connection.cc:256] RPC call timeout handler was delayed by -1.4721746069999426s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
W20260709 12:10:55.647794 18608 connection.cc:256] RPC call timeout handler was delayed by -1.3073485700001584s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
W20260709 12:10:55.648084 18608 connection.cc:256] RPC call timeout handler was delayed by -1.1894442230000095s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3135s for a response
I20260709 12:10:55.590293 21219 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:55.603946 21162 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:55.639823 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:55.639940 21185 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:55.640278 21236 raft_consensus.cc:493] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
W20260709 12:10:55.642671 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 153952us
I20260709 12:10:55.655577 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:55.653643 18094 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 10.
I20260709 12:10:55.656579 18643 raft_consensus.cc:2468] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 7.
I20260709 12:10:55.647859 17912 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:55.645380 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.648737 18608 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:55.622151 21344 raft_consensus.cc:3055] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:10:55.658988 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.661267 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:55.661746 17912 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:55.661975 18019 raft_consensus.cc:2393] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 5: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:55.664119 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:55.664561 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:55.665438 18017 raft_consensus.cc:2468] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 10.
I20260709 12:10:55.665540 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:55.666038 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:55.666854 18643 raft_consensus.cc:2468] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 7.
I20260709 12:10:55.667229 17941 raft_consensus.cc:1275] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:10:55.667898 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:55.668805 17912 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:55.666224 18020 raft_consensus.cc:2468] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
I20260709 12:10:55.640316 21354 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.641919 21240 raft_consensus.cc:740] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:55.606516 20940 raft_consensus.cc:3055] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:55.668490 18023 raft_consensus.cc:2468] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 7.
I20260709 12:10:55.643999 21346 raft_consensus.cc:2804] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:55.676226 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:55.677564 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:55.682951 17940 raft_consensus.cc:2468] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:10:55.686142 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:55.685796 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:55.653157 21315 raft_consensus.cc:3060] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.664872 21036 raft_consensus.cc:3060] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:55.695298 18020 raft_consensus.cc:1240] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:55.696058 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:55.696766 18023 raft_consensus.cc:2393] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 5: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:55.667167 21344 raft_consensus.cc:740] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:55.668898 21185 raft_consensus.cc:493] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:55.677067 21321 raft_consensus.cc:2804] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:55.674829 21083 leader_election.cc:290] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:55.708145 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:10:55.676455 20940 raft_consensus.cc:740] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:55.681318 21346 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:55.672225 21356 raft_consensus.cc:2749] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:55.689728 20466 raft_consensus.cc:493] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:55.719375 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:55.723248 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:55.634178 21349 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:55.732333 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 89079.4us
I20260709 12:10:55.667801 21236 raft_consensus.cc:515] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:55.768376 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.714810 21357 raft_consensus.cc:2804] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:55.767207 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 497339us
W20260709 12:10:55.767460 21339 log.cc:927] Time spent T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
I20260709 12:10:55.777468 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:55.776818 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:55.777554 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:55.776077 18061 leader_election.cc:304] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:55.776839 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:55.779934 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:55.780063 18061 leader_election.cc:304] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:55.767207 21243 raft_consensus.cc:3060] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:55.709107 21185 raft_consensus.cc:515] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:55.760910 21346 raft_consensus.cc:3060] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:55.764694 20698 consensus_queue.cc:1243] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer 4813437da0a74e65b61eb7bd1d18f110 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:10:55.783692 18094 raft_consensus.cc:1240] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 LEADER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:10:55.789131 21289 raft_consensus.cc:2749] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:55.790262 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:55.778475 21357 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:55.769001 21332 log.cc:927] Time spent T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.280s	user 0.000s	sys 0.001s
I20260709 12:10:55.683466 21354 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:55.729318 21321 raft_consensus.cc:697] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:55.773034 21083 raft_consensus.cc:2804] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:55.810719 18093 raft_consensus.cc:2393] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 7: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
W20260709 12:10:55.768929 21338 log.cc:927] Time spent T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 12:10:55.767544 20466 raft_consensus.cc:515] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:55.833256 20882 raft_consensus.cc:3055] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:55.833647 20882 raft_consensus.cc:740] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:55.775362 21291 leader_election.cc:290] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:55.834758 21291 raft_consensus.cc:2749] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:55.819568 18643 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
mode: GRACEFUL
new_leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
 from {username='slave'} at 127.0.0.1:52812
I20260709 12:10:55.836396 18643 raft_consensus.cc:606] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Received request to transfer leadership to TS c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:55.836724 18643 raft_consensus.cc:614] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:55.822003 17989 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:10:55.814137 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 186634us
I20260709 12:10:55.838069 17988 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:55.824100 17914 leader_election.cc:304] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:55.827136 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 178471us
I20260709 12:10:55.839254 18608 leader_election.cc:304] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:55.840059 21291 raft_consensus.cc:2749] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:55.841348 18608 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:55.841673 20982 raft_consensus.cc:3055] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:55.842061 21291 raft_consensus.cc:2749] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:55.842113 18643 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
mode: GRACEFUL
new_leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:52812
I20260709 12:10:55.842913 18643 raft_consensus.cc:606] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Received request to transfer leadership to TS 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:55.843238 18643 raft_consensus.cc:614] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:55.843497 20386 leader_election.cc:290] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:55.844177 18608 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:55.844933 21291 raft_consensus.cc:2749] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:55.845249 18608 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:55.846177 18643 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
mode: GRACEFUL
new_leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
 from {username='slave'} at 127.0.0.1:52812
I20260709 12:10:55.846402 21291 raft_consensus.cc:2749] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:55.846863 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:55.847000 18643 raft_consensus.cc:606] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Received request to transfer leadership to TS c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:55.848440 18643 raft_consensus.cc:614] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:55.848461 18608 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:55.850576 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:55.850728 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:55.852135 18090 raft_consensus.cc:2468] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 7.
I20260709 12:10:55.853860 18608 leader_election.cc:304] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:55.759809 21240 consensus_queue.cc:260] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:55.710906 21077 consensus_queue.cc:237] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:55.860970 20386 raft_consensus.cc:2749] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:10:55.861702 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.866164 17945 raft_consensus.cc:1240] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 12:10:55.820961 21357 raft_consensus.cc:3060] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.873588 18021 raft_consensus.cc:1275] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:10:55.807008 21300 consensus_queue.cc:1048] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:10:55.829221 21371 raft_consensus.cc:2749] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:55.851573 21083 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:55.842119 20982 raft_consensus.cc:740] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:55.858603 21291 raft_consensus.cc:2749] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:55.857486 21155 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:55.891855 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:55.895196 17945 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:55.811625 21154 consensus_queue.cc:1048] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 12:10:55.805092 20940 consensus_queue.cc:260] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:55.901294 21185 leader_election.cc:290] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:55.902153 21375 raft_consensus.cc:2749] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:55.904217 21375 raft_consensus.cc:2804] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:55.904531 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:55.905310 17946 raft_consensus.cc:2468] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
I20260709 12:10:55.911571 18638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
mode: GRACEFUL
new_leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
 from {username='slave'} at 127.0.0.1:52812
I20260709 12:10:55.912299 18638 raft_consensus.cc:606] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Received request to transfer leadership to TS c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:55.912701 18638 raft_consensus.cc:614] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:10:55.915894 18643 raft_consensus.cc:1275] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:10:55.910506 18610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:55.874445 21240 raft_consensus.cc:3060] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:55.925032 17913 leader_election.cc:336] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 1.504s (SENT)
I20260709 12:10:55.925631 17913 leader_election.cc:304] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:55.927181 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:55.922611 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 52222us
W20260709 12:10:55.923126 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 101228us
I20260709 12:10:55.888983 21162 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:55.891148 21083 raft_consensus.cc:3060] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:55.897181 21210 leader_election.cc:290] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:55.880204 21335 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:10:56.024068 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 168462us
I20260709 12:10:55.805296 21344 consensus_queue.cc:260] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:55.924438 21348 log.cc:927] Time spent T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 12:10:56.054628 18608 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:55.904582 21375 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:10:56.056104 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 131109us
W20260709 12:10:56.064986 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 125653us
I20260709 12:10:56.009932 20940 raft_consensus.cc:3060] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:56.068531 18608 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:56.107173 18092 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41818 (request call id 867) took 1119 ms. Trace:
W20260709 12:10:56.149328 17913 leader_election.cc:336] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 1.703s (SENT)
I20260709 12:10:56.058251 21162 raft_consensus.cc:2749] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:10:56.121227 18639 raft_consensus.cc:3060] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.214879 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:56.215756 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:56.216427 18640 raft_consensus.cc:2468] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 7.
I20260709 12:10:56.216889 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:56.076802 21375 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:56.094637 18642 raft_consensus.cc:3060] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:56.163769 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 142425us
W20260709 12:10:56.165867 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.009217 21185 consensus_queue.cc:1059] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:10:56.217046 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:56.056766 21355 raft_consensus.cc:2749] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:56.222899 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:56.218541 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 148484us
I20260709 12:10:56.150395 18092 rpcz_store.cc:276] 0709 12:10:54.987531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.264093 (+276562us) service_pool.cc:224] Handling call
0709 12:10:55.264387 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:55.264692 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:55.264718 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:55.265156 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 12:10:55.362656 (+ 97500us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:10:55.362692 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.362752 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:55.927920 (+565168us) raft_consensus.cc:1685] finished
0709 12:10:55.927942 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.107093 (+179151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8054,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"thread_start_us":97144,"threads_started":1,"wal-append.queue_time_us":218939}
I20260709 12:10:56.219697 21194 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:10:56.221460 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.225971 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:56.245760 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:56.246500 18644 raft_consensus.cc:2393] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 7: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:56.251348 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:56.222671 21351 log.cc:927] Time spent T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.310s	user 0.000s	sys 0.000s
I20260709 12:10:56.252502 18642 raft_consensus.cc:1275] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:10:56.252506 18636 raft_consensus.cc:2410] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:10:56.253279 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:56.254333 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:56.260228 18644 raft_consensus.cc:2393] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 7: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:56.260066 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:56.260684 18641 raft_consensus.cc:2468] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 4.
I20260709 12:10:56.313107 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:56.314199 18643 raft_consensus.cc:2393] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 11: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:56.148113 21291 consensus_queue.cc:1059] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.105s
I20260709 12:10:56.312613 21349 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:56.322016 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:56.326728 21348 log.cc:927] Time spent T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:10:56.148351 21373 consensus_queue.cc:1048] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.178s
I20260709 12:10:56.057147 21321 consensus_queue.cc:237] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:56.240060 21236 leader_election.cc:290] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:56.239845 21162 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:56.345062 18639 raft_consensus.cc:1275] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 12:10:56.351537 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.352226 17987 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
W20260709 12:10:56.353055 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 127918us
I20260709 12:10:56.356046 18098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41818 (request call id 872) took 1034 ms. Trace:
I20260709 12:10:56.357023 17947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44668 (request call id 518) took 1043 ms. Trace:
I20260709 12:10:56.357477 17947 rpcz_store.cc:276] 0709 12:10:55.313953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.314080 (+   127us) service_pool.cc:224] Handling call
0709 12:10:55.314447 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:55.319276 (+  4829us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:55.319320 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:55.344872 (+ 25552us) log.cc:844] Serialized 26 byte log entry
0709 12:10:55.504214 (+159342us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:55.650465 (+146251us) log.cc:844] Serialized 14 byte log entry
0709 12:10:55.675528 (+ 25063us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.675596 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:56.356839 (+681243us) raft_consensus.cc:1685] finished
0709 12:10:56.356856 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.356971 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30331,"prepare.queue_time_us":97503,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":73732,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":55385,"thread_start_us":188954,"threads_started":2,"wal-append.queue_time_us":406624}
I20260709 12:10:56.267871 21380 raft_consensus.cc:2749] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:56.356388 18098 rpcz_store.cc:276] 0709 12:10:55.321709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.365042 (+ 43333us) service_pool.cc:224] Handling call
0709 12:10:55.365333 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:55.378231 (+ 12898us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:55.378268 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:55.382056 (+  3788us) log.cc:844] Serialized 26 byte log entry
0709 12:10:55.488193 (+106137us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:55.488231 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:55.488292 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:56.355850 (+867558us) raft_consensus.cc:1685] finished
0709 12:10:56.355870 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.355986 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1379,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":4233,"thread_start_us":49175,"threads_started":1,"wal-append.queue_time_us":424310}
I20260709 12:10:56.363590 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:56.364423 17943 raft_consensus.cc:2468] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:10:56.253243 21194 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:56.356294 21315 consensus_meta.cc:287] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.645s	user 0.010s	sys 0.003s
I20260709 12:10:56.351526 21236 raft_consensus.cc:2749] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:56.374433 18096 raft_consensus.cc:1240] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 LEADER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:10:56.390990 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:56.379142 17987 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:56.391906 17943 raft_consensus.cc:2468] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
I20260709 12:10:56.393283 21222 raft_consensus.cc:2804] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:56.402272 17988 leader_election.cc:304] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:56.355626 21162 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:56.406277 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:56.409719 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.411347 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:56.412838 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:10:56.414626 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 66626.3us
I20260709 12:10:56.415868 21372 raft_consensus.cc:2804] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:56.416299 21372 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:56.416771 21372 raft_consensus.cc:3060] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:56.397892 21222 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:56.384764 21315 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:56.427210 17988 leader_election.cc:304] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:56.427389 17943 raft_consensus.cc:1275] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:10:56.400671 21374 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.429059 18608 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
W20260709 12:10:56.428231 21369 log.cc:927] Time spent T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:10:56.421371 21222 raft_consensus.cc:3060] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.437212 17940 raft_consensus.cc:2393] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 7: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:56.439157 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:56.439546 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:56.440135 18642 raft_consensus.cc:2376] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8. Re-sending same reply.
I20260709 12:10:56.400063 21360 consensus_queue.cc:1048] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 12:10:56.442303 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:56.445080 18641 raft_consensus.cc:1275] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:56.445230 18639 raft_consensus.cc:2393] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 8: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:56.443264 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:56.412966 21376 consensus_queue.cc:1048] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:10:56.428172 21365 consensus_queue.cc:1059] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
W20260709 12:10:56.451411 21346 consensus_meta.cc:287] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.625s	user 0.010s	sys 0.000s
W20260709 12:10:56.460973 17945 consensus_meta.cc:287] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.565s	user 0.007s	sys 0.002s
I20260709 12:10:56.465221 17945 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 11.
W20260709 12:10:56.465986 21384 log.cc:927] Time spent T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:10:56.466820 21383 log.cc:927] Time spent T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:10:56.468508 17942 raft_consensus.cc:1275] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:10:56.469074 21085 raft_consensus.cc:3055] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:10:56.469101 17913 leader_election.cc:336] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 1.508s (SENT)
I20260709 12:10:56.469682 21085 raft_consensus.cc:740] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:56.469820 17913 leader_election.cc:304] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:56.470254 21194 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:56.458567 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:56.432096 21291 consensus_queue.cc:1048] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:10:56.432221 21290 consensus_queue.cc:1048] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:10:56.436479 21389 raft_consensus.cc:2804] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:56.481966 18643 raft_consensus.cc:2376] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 7. Re-sending same reply.
I20260709 12:10:56.469964 21083 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:56.462355 21379 log.cc:927] Time spent T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
I20260709 12:10:56.470572 21085 consensus_queue.cc:260] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:56.487895 21085 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:56.488487 21083 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:56.479555 21315 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:56.482932 21237 raft_consensus.cc:2749] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:56.485206 21389 raft_consensus.cc:697] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
W20260709 12:10:56.478428 21036 consensus_meta.cc:287] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.775s	user 0.009s	sys 0.000s
W20260709 12:10:56.486636 21243 consensus_meta.cc:287] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.680s	user 0.007s	sys 0.003s
I20260709 12:10:56.492092 18095 raft_consensus.cc:2468] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
I20260709 12:10:56.492022 21389 consensus_queue.cc:237] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:56.492684 21311 raft_consensus.cc:493] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.493104 21311 raft_consensus.cc:515] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:56.500555 21162 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:56.504122 17946 raft_consensus.cc:1240] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:56.505710 17940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2164) took 1061 ms. Trace:
I20260709 12:10:56.506138 17940 rpcz_store.cc:276] 0709 12:10:55.444941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.767782 (+322841us) service_pool.cc:224] Handling call
0709 12:10:56.505479 (+737697us) spinlock_profiling.cc:243] Waited 656 ms on lock 0x7b54000a1254. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:56.505633 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1507705088}
I20260709 12:10:56.434317 21374 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:56.508309 18635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60430 (request call id 761) took 1078 ms. Trace:
I20260709 12:10:56.509012 21374 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:56.511979 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:56.458457 21185 raft_consensus.cc:2749] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:56.512991 18018 raft_consensus.cc:3055] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:10:56.513330 18018 raft_consensus.cc:740] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:56.514086 17949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2154) took 1087 ms. Trace:
I20260709 12:10:56.513978 18018 consensus_queue.cc:260] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:56.514424 17949 rpcz_store.cc:276] 0709 12:10:55.426719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.426920 (+   201us) service_pool.cc:224] Handling call
0709 12:10:56.513943 (+1087023us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b540031bd54. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:56.514035 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":450067840}
W20260709 12:10:56.519204 21387 log.cc:927] Time spent T 00000000000000000000000000000000 P b852ae4791e4401b8356c71ae33bbc7d: Append to log took a long time: real 0.100s	user 0.002s	sys 0.000s
W20260709 12:10:56.512230 21385 log.cc:927] Time spent T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:10:56.459527 21376 consensus_queue.cc:1243] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer 63f5bddeebd84e5788d671a176cfa8e1 log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:10:56.523387 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:56.504077 17941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2153) took 1079 ms. Trace:
I20260709 12:10:56.489892 21375 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:56.525604 17941 rpcz_store.cc:276] 0709 12:10:55.425323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.425554 (+   231us) service_pool.cc:224] Handling call
0709 12:10:55.425871 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:55.668303 (+242432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.503815 (+835512us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b540022ddd4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:56.504008 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":554319744}
I20260709 12:10:56.508773 18635 rpcz_store.cc:276] 0709 12:10:55.432276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.432485 (+   209us) service_pool.cc:224] Handling call
0709 12:10:55.450153 (+ 17668us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:55.678903 (+228750us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:55.678948 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:55.679004 (+    56us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:10:55.679058 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.508065 (+829007us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b5400721ad4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:56.508115 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:56.508247 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":525527936}
I20260709 12:10:56.529398 18018 raft_consensus.cc:3060] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:56.528477 18061 leader_election.cc:304] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
W20260709 12:10:56.535389 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 108252us
I20260709 12:10:56.536806 18097 raft_consensus.cc:1240] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:56.538596 17987 leader_election.cc:304] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:56.538970 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:56.536361 17988 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:56.539840 18090 raft_consensus.cc:3060] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:56.543578 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:56.544132 18636 raft_consensus.cc:2468] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 8.
I20260709 12:10:56.549407 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:56.550362 17988 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:56.526831 21319 raft_consensus.cc:493] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.554690 18061 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:56.555176 18097 raft_consensus.cc:1217] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 LEADER]: Deduplicated request from leader. Original: 8.5->[9.6-9.6]   Dedup: 9.6->[]
I20260709 12:10:56.530826 21194 raft_consensus.cc:3055] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:56.556528 18097 raft_consensus.cc:1240] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 LEADER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:10:56.538589 21154 raft_consensus.cc:2804] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:56.563674 18018 raft_consensus.cc:1275] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:10:56.569047 17988 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:56.482590 21346 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:56.571749 18090 raft_consensus.cc:2468] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 5.
I20260709 12:10:56.553004 21121 raft_consensus.cc:2749] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:56.573964 18640 raft_consensus.cc:1240] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:56.576309 18061 leader_election.cc:304] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:56.569003 21342 raft_consensus.cc:2749] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:10:56.577955 21392 consensus_queue.cc:1059] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:10:56.547991 21185 consensus_queue.cc:1048] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:10:56.579686 21390 raft_consensus.cc:2804] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:56.580255 21390 raft_consensus.cc:697] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:56.580396 20882 consensus_queue.cc:260] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:56.581040 21357 consensus_meta.cc:287] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.693s	user 0.009s	sys 0.000s
I20260709 12:10:56.581511 20882 raft_consensus.cc:3060] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:56.574450 21326 consensus_meta.cc:287] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 1.221s	user 0.011s	sys 0.001s
I20260709 12:10:56.581487 21357 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:56.582278 21326 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:56.583624 21357 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:56.584295 21326 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:56.584555 21020 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:56.584872 21243 consensus_queue.cc:1048] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:56.585523 18092 raft_consensus.cc:2393] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 11: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:56.586655 17946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50334 (request call id 2182) took 1127 ms. Trace:
I20260709 12:10:56.587069 17946 rpcz_store.cc:276] 0709 12:10:55.459670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.222529 (+762859us) service_pool.cc:224] Handling call
0709 12:10:56.503953 (+281424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:56.504693 (+   740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.586429 (+ 81736us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b540022ddd0. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b18ad 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:56.586562 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":645119744}
I20260709 12:10:56.578116 21083 raft_consensus.cc:2804] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:56.587946 21083 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.588443 21083 raft_consensus.cc:3060] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:56.589680 21337 log.cc:927] Time spent T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 1.207s	user 0.005s	sys 0.002s
W20260709 12:10:56.591925 21377 log.cc:927] Time spent T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
I20260709 12:10:56.595685 18061 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:56.568128 21154 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.557878 21194 raft_consensus.cc:740] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:56.581214 21390 consensus_queue.cc:237] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:56.580282 21375 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:56.600013 21372 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:56.603158 17948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44668 (request call id 524) took 1264 ms. Trace:
I20260709 12:10:56.603498 21194 consensus_queue.cc:260] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:56.604283 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:56.604933 21194 raft_consensus.cc:3060] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.605847 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:56.606212 18094 raft_consensus.cc:1240] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 11 LEADER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 10. Current term is 11. Ops: [8.9-10.10]
I20260709 12:10:56.606508 18093 raft_consensus.cc:2468] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 8.
W20260709 12:10:56.606838 21367 log.cc:927] Time spent T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.817s	user 0.000s	sys 0.015s
I20260709 12:10:56.608152 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:56.608644 20982 consensus_queue.cc:260] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:56.609537 21345 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:10:56.609843 20982 raft_consensus.cc:3060] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:56.612201 18023 raft_consensus.cc:1240] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:10:56.603521 17948 rpcz_store.cc:276] 0709 12:10:55.338828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.338976 (+   148us) service_pool.cc:224] Handling call
0709 12:10:56.603008 (+1264032us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b540031c754. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:56.603103 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":246154112}
I20260709 12:10:56.613936 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:56.615912 18609 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:56.571527 20940 raft_consensus.cc:3060] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.602414 21372 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:56.620007 18061 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:56.619354 21326 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:56.561761 21319 raft_consensus.cc:515] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:56.621652 21388 raft_consensus.cc:2804] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:56.629774 18091 raft_consensus.cc:1275] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:10:56.612140 21154 raft_consensus.cc:3060] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:56.613478 21243 raft_consensus.cc:2804] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:10:56.643752 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 72209.9us
I20260709 12:10:56.644901 17989 leader_election.cc:304] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:56.646587 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:56.647162 18098 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:56.648929 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:56.623916 21310 raft_consensus.cc:2749] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:56.650931 21311 leader_election.cc:290] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:56.652946 21319 leader_election.cc:290] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:56.654430 21240 consensus_meta.cc:287] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.728s	user 0.007s	sys 0.002s
I20260709 12:10:56.655350 21346 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:56.635658 21388 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.656566 18096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53954 (request call id 2184) took 1459 ms. Trace:
I20260709 12:10:56.660084 18096 rpcz_store.cc:276] 0709 12:10:55.197680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.304660 (+106980us) service_pool.cc:224] Handling call
0709 12:10:55.304955 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:56.378320 (+1073365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.656338 (+278018us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54002fa3d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:56.656515 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2451950976}
I20260709 12:10:56.662689 21388 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.659147 21398 consensus_queue.cc:1048] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:10:56.657318 21222 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:56.670608 18098 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 11.
I20260709 12:10:56.667829 21401 raft_consensus.cc:2804] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:56.672356 21222 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:56.673177 20986 leader_election.cc:290] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:56.673187 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:56.675617 21388 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:56.675761 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:56.642470 21243 raft_consensus.cc:493] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:56.685527 21401 raft_consensus.cc:697] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:56.686877 21243 raft_consensus.cc:3060] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:56.686529 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 52351.8us
I20260709 12:10:56.688429 18061 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:56.688150 21401 consensus_queue.cc:237] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:56.642872 21324 consensus_queue.cc:1048] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:10:56.694904 21303 raft_consensus.cc:2804] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:56.695264 21303 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.695574 21303 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:56.700104 18095 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41818 (request call id 870) took 1581 ms (client timeout 1915 ms). Trace:
W20260709 12:10:56.700505 18095 rpcz_store.cc:269] 0709 12:10:55.118894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.178382 (+ 59488us) service_pool.cc:224] Handling call
0709 12:10:56.699949 (+1521567us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54002ef254. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:56.700049 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3019147008}
I20260709 12:10:56.702595 21303 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:56.704665 21303 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:56.705514 17914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.706943 18608 leader_election.cc:304] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:56.708201 18608 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:56.709115 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:56.709261 18608 leader_election.cc:304] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:56.709388 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:56.720290 17944 pending_rounds.cc:85] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1: Aborting all ops after (but not including) 8
I20260709 12:10:56.720039 18608 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:56.720661 17944 pending_rounds.cc:107] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 12:10:56.720980 17944 raft_consensus.cc:2889] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:56.720669 18609 leader_election.cc:304] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
W20260709 12:10:56.728873 18608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.753800 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:56.754963 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:56.755642 18641 raft_consensus.cc:2468] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 8.
W20260709 12:10:56.756098 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.727521 18638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:52812
I20260709 12:10:56.758944 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:56.759222 18061 leader_election.cc:304] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:56.760515 18641 raft_consensus.cc:2393] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 9: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:56.725561 21398 raft_consensus.cc:2749] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:56.726879 21376 raft_consensus.cc:2749] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:56.725987 21373 raft_consensus.cc:2804] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:56.727229 20940 raft_consensus.cc:2749] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:10:56.766929 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 197946us
I20260709 12:10:56.749125 21085 raft_consensus.cc:2764] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:10:56.750770 21374 raft_consensus.cc:2804] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:56.768390 21373 raft_consensus.cc:493] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:56.770817 17988 leader_election.cc:304] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:56.765717 21370 raft_consensus.cc:493] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:56.766278 21349 raft_consensus.cc:2804] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:56.778275 18635 raft_consensus.cc:2468] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 7.
I20260709 12:10:56.747537 21291 consensus_queue.cc:1048] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:10:56.779925 17988 leader_election.cc:304] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:56.766525 21303 raft_consensus.cc:2804] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:56.777292 21373 raft_consensus.cc:3060] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:56.806303 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:56.807813 20698 raft_consensus.cc:3060] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:56.809755 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:56.812368 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:56.813506 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:56.814498 18020 raft_consensus.cc:2393] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 10: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:56.816481 18021 raft_consensus.cc:1240] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:56.822708 18018 raft_consensus.cc:2468] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
I20260709 12:10:56.825269 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:56.832255 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:56.833221 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.833304 18016 raft_consensus.cc:2410] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:10:56.842454 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:56.843324 18018 raft_consensus.cc:2468] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
W20260709 12:10:56.844151 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:56.803815 21303 raft_consensus.cc:493] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:56.782425 20940 raft_consensus.cc:2749] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:56.861428 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:56.868163 18022 raft_consensus.cc:2393] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 8: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:56.864044 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:56.869366 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:56.870157 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:56.850978 21393 log.cc:927] Time spent T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:10:56.771652 21083 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:56.878443 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:56.878674 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:56.877031 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:56.884884 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:56.886291 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:56.887053 18022 raft_consensus.cc:2468] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 7.
I20260709 12:10:56.870705 18016 raft_consensus.cc:2468] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 5.
I20260709 12:10:56.825069 21374 raft_consensus.cc:697] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:56.864437 21303 raft_consensus.cc:3060] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:56.801952 21370 raft_consensus.cc:515] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:56.882100 21397 log.cc:927] Time spent T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:10:56.900866 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:56.906045 18018 raft_consensus.cc:2468] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 7.
I20260709 12:10:56.902036 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:56.893026 21354 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:56.907507 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:56.908831 18018 raft_consensus.cc:2393] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 9: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:56.875183 21319 raft_consensus.cc:493] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:56.924196 18020 raft_consensus.cc:2368] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 8. Current term is 9.
W20260709 12:10:56.931774 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 173451us
I20260709 12:10:56.959079 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:56.934600 21389 raft_consensus.cc:493] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:56.960242 21380 raft_consensus.cc:493] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:56.908423 21398 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:56.919119 21319 raft_consensus.cc:515] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:56.988955 21380 raft_consensus.cc:515] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:57.009584 21380 leader_election.cc:290] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:56.980211 21357 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.010965 21357 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:56.987967 21374 consensus_queue.cc:237] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:56.997471 21326 raft_consensus.cc:2749] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:57.015707 18019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 2093) took 1321 ms. Trace:
I20260709 12:10:57.023854 21370 leader_election.cc:290] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:57.027016 21415 log.cc:927] Time spent T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:10:57.030925 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:57.032400 21388 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:57.033913 17943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2171) took 1210 ms. Trace:
I20260709 12:10:57.038177 18017 raft_consensus.cc:2468] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
I20260709 12:10:57.040733 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:57.041572 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:57.050354 18098 raft_consensus.cc:2393] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 9: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:57.034034 18019 rpcz_store.cc:276] 0709 12:10:55.694438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.695417 (+   979us) service_pool.cc:224] Handling call
0709 12:10:55.695721 (+   304us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:56.653344 (+957623us) spinlock_profiling.cc:243] Waited 3.54 ms on lock 0x7b1800480760. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f4c55a4bc 00007f7f498a848b 00007f7f527029a9 00007f7f498c469b 00007f7f498c293f 00007f7f498c2455 00007f7f4c9aa060 00007f7f4c9aabfb 00007f7f4c9b564b
0709 12:10:56.653481 (+   137us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:56.653509 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:56.654122 (+   613us) log.cc:844] Serialized 52 byte log entry
0709 12:10:56.762939 (+108817us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:10:56.762981 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.763046 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:57.015294 (+252248us) raft_consensus.cc:1685] finished
0709 12:10:57.015322 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:57.015631 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":160161,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":11703,"spinlock_wait_cycles":8148736,"thread_start_us":288812,"threads_started":2,"wal-append.queue_time_us":310038}
I20260709 12:10:57.045077 18020 raft_consensus.cc:2376] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8. Re-sending same reply.
I20260709 12:10:57.042857 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:57.051517 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:57.052467 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:57.052629 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:57.053134 18017 raft_consensus.cc:2376] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8. Re-sending same reply.
I20260709 12:10:57.053437 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:57.053941 18019 raft_consensus.cc:3060] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.054142 18017 raft_consensus.cc:1240] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:10:57.054914 18022 raft_consensus.cc:1275] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:10:57.049150 17943 rpcz_store.cc:276] 0709 12:10:55.823102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:56.438773 (+615671us) service_pool.cc:224] Handling call
0709 12:10:56.439021 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:56.659476 (+220455us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:10:56.659508 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:56.659549 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:56.659582 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.033707 (+374125us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b54000a0d54. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:57.033752 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:57.033864 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2327,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":2563,"spinlock_wait_cycles":506279296}
I20260709 12:10:57.070013 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:56.979779 21389 raft_consensus.cc:515] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:57.071293 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:56.987401 21398 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:57.073884 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:57.076017 18017 raft_consensus.cc:2468] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
I20260709 12:10:57.077572 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:57.081543 18638 raft_consensus.cc:606] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:57.092433 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:57.135589 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:57.075662 21020 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.068171 21243 raft_consensus.cc:515] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:57.149992 21419 log.cc:927] Time spent T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:10:57.152287 21083 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:57.172622 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:57.176368 18018 raft_consensus.cc:2468] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
I20260709 12:10:57.088201 21154 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:57.179478 18608 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
W20260709 12:10:57.171617 20882 consensus_meta.cc:287] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.589s	user 0.014s	sys 0.000s
I20260709 12:10:57.159694 21020 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:57.189486 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:57.190528 21020 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:57.190841 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:57.191740 18021 raft_consensus.cc:2368] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 10. Current term is 11.
I20260709 12:10:57.192556 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:57.193639 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:57.193981 18608 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:57.194250 18021 raft_consensus.cc:2368] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 10. Current term is 11.
I20260709 12:10:57.195686 20466 leader_election.cc:290] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:57.198060 21154 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:57.195183 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:57.198680 18021 raft_consensus.cc:2376] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7. Re-sending same reply.
I20260709 12:10:57.199466 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:57.199905 21303 raft_consensus.cc:515] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:57.200523 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:57.201146 18021 raft_consensus.cc:2368] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 7. Current term is 8.
I20260709 12:10:57.201944 21303 leader_election.cc:290] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:57.201964 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:57.202843 18021 raft_consensus.cc:2393] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 6: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:57.202782 21085 raft_consensus.cc:2804] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:57.203527 21380 raft_consensus.cc:2749] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:57.204527 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:57.204829 17946 raft_consensus.cc:1275] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:57.203903 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:57.206260 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:57.207242 21425 log.cc:927] Time spent T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:10:57.213553 18023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 2097) took 1346 ms. Trace:
I20260709 12:10:57.214010 18023 rpcz_store.cc:276] 0709 12:10:55.866661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.868095 (+  1434us) service_pool.cc:224] Handling call
0709 12:10:55.872308 (+  4213us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:56.612754 (+740446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.213260 (+600506us) spinlock_profiling.cc:243] Waited 740 ms on lock 0x7b540027a1d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:57.213481 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1701037952}
I20260709 12:10:57.220645 21344 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:10:57.222222 17912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.227502 18062 leader_election.cc:304] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:57.230486 21303 raft_consensus.cc:2804] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:57.231011 21303 raft_consensus.cc:493] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:57.231500 21303 raft_consensus.cc:3060] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:57.235996 21219 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:57.257287 18023 raft_consensus.cc:1275] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:10:57.265038 18062 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:57.268293 18062 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:57.269495 18062 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:57.273154 18020 raft_consensus.cc:2468] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
W20260709 12:10:57.283511 21424 log.cc:927] Time spent T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:10:57.243904 21085 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:57.285534 21334 raft_consensus.cc:2749] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:57.285938 21085 raft_consensus.cc:3060] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:57.289063 21303 raft_consensus.cc:515] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:57.290055 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.290287 21154 raft_consensus.cc:2749] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:10:57.298758 17914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.297789 18062 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:57.312008 18062 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:57.263998 21020 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:57.315429 18062 leader_election.cc:304] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:57.328469 18062 leader_election.cc:304] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:57.311236 21334 raft_consensus.cc:2804] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:10:57.310927 21319 leader_election.cc:290] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:10:57.330098 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 136187us
I20260709 12:10:57.320124 21219 raft_consensus.cc:2804] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:57.319113 21324 raft_consensus.cc:2749] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:57.339167 18098 raft_consensus.cc:1240] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:57.336570 18608 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:57.336252 21303 leader_election.cc:290] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:57.308732 20986 consensus_queue.cc:1048] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:10:57.322711 21357 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:57.324071 21354 raft_consensus.cc:2804] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:10:57.348805 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.329658 21154 raft_consensus.cc:493] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:57.366683 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:57.335348 21310 raft_consensus.cc:2804] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:57.322037 21326 consensus_queue.cc:1059] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:10:57.334272 21334 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:57.370518 18098 raft_consensus.cc:2468] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 6.
I20260709 12:10:57.327518 21020 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:57.349375 21354 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.375859 18609 leader_election.cc:304] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:57.336488 21219 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:57.347916 21398 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:57.365954 21389 leader_election.cc:290] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:57.372833 21310 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:57.375917 21334 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:57.376209 21388 raft_consensus.cc:2749] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:57.389851 21398 raft_consensus.cc:2804] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:10:57.390795 21428 log.cc:927] Time spent T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:10:57.392959 21020 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:57.372246 21435 consensus_queue.cc:1059] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:10:57.379057 21354 raft_consensus.cc:3060] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.395884 18608 leader_election.cc:304] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:57.395063 18019 raft_consensus.cc:2468] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 7.
W20260709 12:10:57.395754 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 63905.8us
I20260709 12:10:57.380489 21219 raft_consensus.cc:3060] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.378636 21243 leader_election.cc:290] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:57.373566 21154 raft_consensus.cc:515] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:57.394074 21310 raft_consensus.cc:3060] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:10:57.399271 20698 consensus_meta.cc:287] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.591s	user 0.010s	sys 0.002s
I20260709 12:10:57.402369 20698 raft_consensus.cc:2749] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:57.406630 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:10:57.400701 18062 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:57.409621 18062 leader_election.cc:304] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:57.410151 21243 raft_consensus.cc:2804] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:57.411052 21326 raft_consensus.cc:2764] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:10:57.412011 21243 raft_consensus.cc:697] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 11 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:57.412983 21243 consensus_queue.cc:237] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:57.416477 21326 consensus_queue.cc:1048] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:57.395735 21398 raft_consensus.cc:493] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:57.418869 21398 raft_consensus.cc:3060] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.420663 18023 raft_consensus.cc:1275] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:10:57.421048 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:57.421670 18020 raft_consensus.cc:2468] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 7.
I20260709 12:10:57.421710 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:57.422335 18023 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:57.400532 21388 raft_consensus.cc:2749] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:57.422834 18020 raft_consensus.cc:1240] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:10:57.424356 18020 raft_consensus.cc:1275] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:10:57.424748 18020 pending_rounds.cc:85] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb: Aborting all ops after (but not including) 5
I20260709 12:10:57.425036 18020 pending_rounds.cc:107] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:10:57.425335 18020 raft_consensus.cc:2889] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:57.429234 21303 raft_consensus.cc:3055] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:57.429644 21303 raft_consensus.cc:740] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:57.429740 18023 raft_consensus.cc:2468] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 11.
W20260709 12:10:57.399464 21373 consensus_meta.cc:287] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.592s	user 0.012s	sys 0.000s
I20260709 12:10:57.400290 21371 consensus_queue.cc:1048] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:10:57.438174 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:57.443100 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:57.444141 18098 raft_consensus.cc:1275] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:10:57.444571 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:57.449061 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:57.449626 18023 raft_consensus.cc:3060] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.451256 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:57.439644 21368 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:57.436123 21373 raft_consensus.cc:515] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:57.452195 21368 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:57.452564 18021 raft_consensus.cc:1275] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:10:57.435724 21366 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.450794 21398 raft_consensus.cc:515] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:57.453780 21373 leader_election.cc:290] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:57.453996 21366 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:57.454819 21349 raft_consensus.cc:493] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:57.455271 21349 raft_consensus.cc:3060] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.459198 18024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 2095) took 1764 ms. Trace:
I20260709 12:10:57.461506 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:57.462155 18062 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.459564 18024 rpcz_store.cc:276] 0709 12:10:55.695186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:55.696208 (+  1022us) service_pool.cc:224] Handling call
0709 12:10:55.696461 (+   253us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:55.856387 (+159926us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:55.856434 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:55.857006 (+   572us) log.cc:844] Serialized 26 byte log entry
0709 12:10:55.919383 (+ 62377us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:10:55.919441 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:56.591316 (+671875us) spinlock_profiling.cc:243] Waited 3.35 ms on lock 0x7b4400022b4c. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f497ebc85 00007f7f497ec6a2 00007f7f4c55e1db 00007f7f4c559aaf 00007f7f4c54d86e 00007f7f4c54cbb6 00007f7f4c54c7d8 00007f7f4c556221 00007f7f4c5561d9 00007f7f4c556169
0709 12:10:57.458920 (+867604us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54000b2a54. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:57.458972 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:57.459012 (+    40us) raft_consensus.cc:1685] finished
0709 12:10:57.459025 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:57.459135 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27411,"raft.queue_time_us":73036,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"spinlock_wait_cycles":311327872,"thread_start_us":61868,"threads_started":1,"wal-append.queue_time_us":382508}
I20260709 12:10:57.463876 18638 raft_consensus.cc:1275] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:57.468770 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:57.470104 21344 raft_consensus.cc:3055] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:10:57.470430 18017 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 11.
I20260709 12:10:57.471589 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:57.471796 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:57.472734 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:57.473163 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:57.473862 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:57.439500 21154 leader_election.cc:290] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:57.474833 18644 raft_consensus.cc:1240] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:57.476840 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:57.477370 18639 raft_consensus.cc:1275] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:10:57.478457 18023 raft_consensus.cc:2468] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 8.
I20260709 12:10:57.478621 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:57.478838 18015 raft_consensus.cc:2468] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
I20260709 12:10:57.481788 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:57.482306 18092 raft_consensus.cc:3060] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.430500 21303 consensus_queue.cc:260] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:57.435174 21085 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:57.487630 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:57.489286 18098 raft_consensus.cc:3060] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.470551 21344 raft_consensus.cc:740] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:57.487757 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:57.491003 18638 raft_consensus.cc:1813] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Handling vote request from an unknown peer 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:57.492712 18638 raft_consensus.cc:2410] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:10:57.430617 21310 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:57.480998 21431 log.cc:927] Time spent T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.110s	user 0.003s	sys 0.000s
I20260709 12:10:57.497246 18635 raft_consensus.cc:1240] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:57.500957 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:57.504981 18098 raft_consensus.cc:2468] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 7.
I20260709 12:10:57.475885 21371 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:57.510995 18092 raft_consensus.cc:2468] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
I20260709 12:10:57.515413 21085 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:57.480923 21236 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
W20260709 12:10:57.522491 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 122106us
I20260709 12:10:57.524552 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:57.522476 21303 raft_consensus.cc:3060] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.522459 20882 consensus_queue.cc:1048] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:10:57.529301 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:57.476398 21435 consensus_queue.cc:1048] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:10:57.531694 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:57.535737 17913 leader_election.cc:336] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 1.542s (SENT)
I20260709 12:10:57.529858 18638 raft_consensus.cc:2376] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8. Re-sending same reply.
I20260709 12:10:57.416436 21354 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:57.534443 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:57.539040 18091 raft_consensus.cc:2393] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 5: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:57.539093 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:57.541916 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:57.540668 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:57.540650 21344 consensus_queue.cc:260] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:57.528939 21236 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:57.538375 21020 raft_consensus.cc:493] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:57.547149 21020 raft_consensus.cc:515] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:57.549093 21020 leader_election.cc:290] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:57.549860 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:57.550223 18094 raft_consensus.cc:2410] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:10:57.550447 17948 raft_consensus.cc:2468] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
I20260709 12:10:57.531412 21389 consensus_queue.cc:1048] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:10:57.550587 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:57.552328 17947 raft_consensus.cc:1275] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:10:57.528517 20986 consensus_queue.cc:1048] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:10:57.552812 21219 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:10:57.553342 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:57.553853 17946 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:57.542974 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:57.558226 21366 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:57.558701 21368 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:57.563426 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:57.578940 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:57.585314 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:57.585860 18643 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:10:57.589804 18092 raft_consensus.cc:2368] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 7. Current term is 8.
I20260709 12:10:57.592092 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:57.570065 17946 raft_consensus.cc:2468] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 11.
I20260709 12:10:57.598464 17913 leader_election.cc:304] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:57.603097 17913 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:57.605944 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:57.606256 17913 leader_election.cc:304] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:57.609634 18091 raft_consensus.cc:1240] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:57.609488 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:57.611318 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.611553 17913 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:57.525379 21371 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:10:57.595280 21244 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.619999 21363 raft_consensus.cc:2749] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:57.594805 21219 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123)
I20260709 12:10:57.622804 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:57.624924 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:57.610189 20466 raft_consensus.cc:3060] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.625558 18640 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 11.
I20260709 12:10:57.615217 20986 raft_consensus.cc:2749] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:57.618324 21039 raft_consensus.cc:2749] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:57.628479 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:57.629544 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:57.630991 17913 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:57.631229 18642 raft_consensus.cc:3060] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:57.633368 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:57.640010 18062 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:57.641631 18642 raft_consensus.cc:2468] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 8.
I20260709 12:10:57.641631 17913 leader_election.cc:304] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:57.629768 21398 leader_election.cc:290] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:57.652021 18062 leader_election.cc:304] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:57.657946 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:57.657224 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:57.662003 17913 leader_election.cc:304] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:57.656569 21219 raft_consensus.cc:2749] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:57.656200 18643 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 11.
I20260709 12:10:57.626508 21244 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:57.662946 18062 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:57.666947 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:57.668447 21363 raft_consensus.cc:2804] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:10:57.670727 18016 raft_consensus.cc:1275] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:10:57.668859 21363 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:57.671759 21363 raft_consensus.cc:3060] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.672425 21310 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:57.662835 21378 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.673209 21378 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:57.675334 21378 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:57.661513 20986 raft_consensus.cc:2804] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:57.661816 21389 raft_consensus.cc:493] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:57.683051 21290 raft_consensus.cc:3055] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:57.681663 18062 leader_election.cc:304] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:57.668319 17913 leader_election.cc:400] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Vote denied by peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297) with higher term. Message: Invalid argument: T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 8. Current term is 9.
I20260709 12:10:57.663807 21357 raft_consensus.cc:2804] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:10:57.686892 21357 raft_consensus.cc:493] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:57.687095 21354 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:57.687386 21357 raft_consensus.cc:3060] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:57.687628 21290 raft_consensus.cc:740] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:57.688503 21290 consensus_queue.cc:260] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:57.689483 17989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.679320 21243 raft_consensus.cc:2764] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:10:57.689610 21290 raft_consensus.cc:3060] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:57.697993 18095 raft_consensus.cc:1275] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:10:57.700884 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:57.701506 18018 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 11.
I20260709 12:10:57.693239 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:10:57.702147 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.696219 18096 raft_consensus.cc:1240] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:57.696156 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:57.697075 18097 raft_consensus.cc:1240] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:57.703244 17913 leader_election.cc:403] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:57.703404 17989 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:57.708743 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:57.702320 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:57.710390 18020 raft_consensus.cc:2410] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:10:57.718683 18638 raft_consensus.cc:1240] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:57.720139 18097 raft_consensus.cc:1240] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 6. Current term is 7. Ops: []
I20260709 12:10:57.712894 21310 raft_consensus.cc:3060] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:57.723775 18608 leader_election.cc:400] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Vote denied by peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297) with higher term. Message: Invalid argument: T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 10. Current term is 11.
I20260709 12:10:57.724108 18608 leader_election.cc:403] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:57.713810 21039 consensus_queue.cc:1059] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:10:57.725626 21039 raft_consensus.cc:2749] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297) with higher term. Message: Invalid argument: T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 8. Current term is 9.
I20260709 12:10:57.726284 21039 raft_consensus.cc:3055] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:57.713097 21368 raft_consensus.cc:2804] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:57.726765 21039 raft_consensus.cc:740] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:57.727267 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:57.727860 18096 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 11.
I20260709 12:10:57.727581 21039 consensus_queue.cc:260] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:57.728720 21039 raft_consensus.cc:3060] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:57.711254 21389 raft_consensus.cc:515] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:57.731199 21349 raft_consensus.cc:515] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:57.731683 21389 leader_election.cc:290] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:57.732200 21389 raft_consensus.cc:2749] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297) with higher term. Message: Invalid argument: T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 10. Current term is 11.
I20260709 12:10:57.733331 21349 leader_election.cc:290] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:57.734805 21219 consensus_queue.cc:1048] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:10:57.737157 21244 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:57.738564 21357 raft_consensus.cc:515] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:57.739406 18090 raft_consensus.cc:1275] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:57.740619 21357 leader_election.cc:290] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:57.741505 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:57.741797 21378 consensus_queue.cc:1048] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:57.746281 21359 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:57.746506 21271 consensus_queue.cc:1059] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:10:57.746825 21359 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:57.747534 21271 raft_consensus.cc:3055] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:57.747875 21271 raft_consensus.cc:740] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:57.748921 21359 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:57.748672 21271 consensus_queue.cc:260] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:57.749909 21271 raft_consensus.cc:3060] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:57.750033 21368 raft_consensus.cc:697] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:57.751036 21194 consensus_queue.cc:1059] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:57.750980 21368 consensus_queue.cc:237] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:57.752081 21370 raft_consensus.cc:3055] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:57.752424 21370 raft_consensus.cc:740] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:57.753129 21370 consensus_queue.cc:260] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:57.755298 17989 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:57.756047 21392 raft_consensus.cc:2804] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:10:57.756147 18608 leader_election.cc:304] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:57.756495 21392 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:57.756876 21392 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:57.756922 21398 raft_consensus.cc:2764] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 12:10:57.757252 20698 consensus_queue.cc:1048] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:57.758244 18608 leader_election.cc:400] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Vote denied by peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297) with higher term. Message: Invalid argument: T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 7. Current term is 8.
I20260709 12:10:57.758529 18608 leader_election.cc:403] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:57.758862 20698 consensus_queue.cc:1059] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:10:57.759054 21398 raft_consensus.cc:2749] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297) with higher term. Message: Invalid argument: T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 7. Current term is 8.
I20260709 12:10:57.759959 21378 raft_consensus.cc:3055] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:10:57.760310 21378 raft_consensus.cc:740] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:57.760404 18608 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:57.761200 21398 raft_consensus.cc:3060] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:57.761108 21378 consensus_queue.cc:260] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
W20260709 12:10:57.762619 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.764400 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:57.726330 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:57.763118 18608 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:57.766326 18608 leader_election.cc:304] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:57.779565 21435 raft_consensus.cc:2749] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:10:57.781975 18090 raft_consensus.cc:1240] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 7. Current term is 8. Ops: [6.8-7.9]
I20260709 12:10:57.787216 21371 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:57.795478 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:57.779978 21243 consensus_queue.cc:1048] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:10:57.797468 21290 raft_consensus.cc:2749] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:57.798131 21290 consensus_queue.cc:1059] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:57.798846 20977 raft_consensus.cc:3055] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:57.799217 20977 raft_consensus.cc:740] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:57.800107 21219 consensus_queue.cc:1059] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:10:57.800987 21219 raft_consensus.cc:3055] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:57.801322 21219 raft_consensus.cc:740] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:57.790702 21354 consensus_queue.cc:1059] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:10:57.802452 21243 raft_consensus.cc:3055] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:57.799989 20977 consensus_queue.cc:260] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:57.803551 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:57.807540 18061 leader_election.cc:304] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:57.807833 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:57.808653 18020 raft_consensus.cc:2468] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 8.
I20260709 12:10:57.809913 18092 raft_consensus.cc:2468] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 7.
I20260709 12:10:57.809937 18016 raft_consensus.cc:1275] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:10:57.803622 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:57.793433 18062 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:57.810892 17987 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:57.810959 17989 leader_election.cc:304] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:57.812235 18022 raft_consensus.cc:1240] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:57.813200 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:57.814467 17987 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:57.814954 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:57.816505 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:57.786507 21310 raft_consensus.cc:2749] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:57.818383 17987 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:57.818912 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:57.819986 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:57.823530 18061 leader_election.cc:304] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:57.824384 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:57.802919 21243 raft_consensus.cc:740] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:57.802153 21219 consensus_queue.cc:260] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:57.826727 20977 raft_consensus.cc:3060] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:57.827064 21311 consensus_queue.cc:1048] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:10:57.821889 21401 raft_consensus.cc:2749] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:57.830950 17947 raft_consensus.cc:1240] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:57.831228 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:57.830001 21442 raft_consensus.cc:2749] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:57.835170 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:57.794018 21334 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:57.803267 21319 consensus_queue.cc:1048] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:10:57.822301 21360 raft_consensus.cc:2749] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:57.827847 21363 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:57.816110 21359 raft_consensus.cc:2749] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:57.828056 21342 consensus_queue.cc:1048] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:10:57.825671 21154 raft_consensus.cc:2804] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:57.838303 20466 raft_consensus.cc:2749] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:57.907986 21363 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:57.818446 21349 raft_consensus.cc:2804] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:57.908767 21349 raft_consensus.cc:697] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:57.909770 21349 consensus_queue.cc:237] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:57.818272 21389 consensus_queue.cc:1059] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:10:57.913899 21389 raft_consensus.cc:3055] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:10:57.849802 17912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.914844 17940 raft_consensus.cc:1240] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:57.916157 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:57.916899 17940 raft_consensus.cc:2468] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:10:57.918234 17940 raft_consensus.cc:1240] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:57.918830 21453 consensus_queue.cc:1059] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:10:57.919028 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:57.919881 21453 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:57.920379 21453 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:57.922389 21453 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:57.857450 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:57.863513 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:57.867877 18607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.816326 21085 consensus_queue.cc:1048] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:10:57.940897 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:57.941838 18642 raft_consensus.cc:2368] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 8. Current term is 9.
I20260709 12:10:57.903095 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:57.942720 17946 raft_consensus.cc:3060] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:57.905797 18608 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:57.906463 18637 raft_consensus.cc:1275] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:10:57.925665 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:57.926551 21154 raft_consensus.cc:697] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
W20260709 12:10:57.928203 17914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:57.952953 17914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:57.953186 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 47477.7us
I20260709 12:10:57.954140 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:57.925669 21398 raft_consensus.cc:2749] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:57.929486 21392 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:57.914357 21389 raft_consensus.cc:740] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:57.850062 17944 raft_consensus.cc:2468] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
I20260709 12:10:57.932667 18090 raft_consensus.cc:1240] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:57.930371 21360 raft_consensus.cc:493] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:57.928742 21244 raft_consensus.cc:3055] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:57.904963 21219 raft_consensus.cc:3060] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:57.963852 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 141807us
I20260709 12:10:57.972929 17946 raft_consensus.cc:2468] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 6.
W20260709 12:10:57.965488 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 137611us
I20260709 12:10:57.968437 18608 leader_election.cc:304] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
W20260709 12:10:57.974030 17988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:57.959563 21303 raft_consensus.cc:2804] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:10:57.970863 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 147401us
I20260709 12:10:57.971321 17912 leader_election.cc:400] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Vote denied by peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647) with higher term. Message: Invalid argument: T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 8. Current term is 9.
I20260709 12:10:57.980099 18608 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:57.980543 17912 leader_election.cc:403] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:10:57.974690 17987 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:57.970041 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 301812us
I20260709 12:10:57.984973 17913 leader_election.cc:304] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:57.972991 18062 leader_election.cc:304] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:57.960088 21290 raft_consensus.cc:2804] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:10:57.961867 21244 raft_consensus.cc:740] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:57.965255 21398 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:57.993266 17914 leader_election.cc:304] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:57.991139 17913 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:58.007972 17987 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:58.020794 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:58.022233 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:58.022979 18090 raft_consensus.cc:2368] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 7. Current term is 8.
I20260709 12:10:58.022806 17987 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:57.961834 21373 consensus_queue.cc:1048] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:10:57.979628 21354 raft_consensus.cc:2804] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:58.037918 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:57.980618 21370 raft_consensus.cc:3060] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:57.962915 21291 consensus_queue.cc:1059] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:10:58.024364 18092 raft_consensus.cc:1275] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:10:57.956490 21243 consensus_queue.cc:260] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:58.039790 18096 raft_consensus.cc:2368] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 8. Current term is 9.
I20260709 12:10:58.039697 21039 raft_consensus.cc:2749] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:10:57.979828 21162 consensus_queue.cc:1059] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 12:10:58.024047 20466 raft_consensus.cc:2804] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:58.024120 21154 consensus_queue.cc:237] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:58.024362 21349 raft_consensus.cc:2749] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:58.023800 21366 raft_consensus.cc:2749] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:57.963841 21360 raft_consensus.cc:515] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:58.000439 21311 raft_consensus.cc:2804] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:58.038249 20882 raft_consensus.cc:2749] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:10:58.080905 18017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53022 (request call id 557) took 1003 ms. Trace:
I20260709 12:10:57.999577 21020 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:10:57.977382 21388 consensus_queue.cc:1059] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:10:57.990808 21290 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
W20260709 12:10:58.021035 21445 log.cc:927] Time spent T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:10:58.050133 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.046051 18092 pending_rounds.cc:85] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110: Aborting all ops after (but not including) 6
I20260709 12:10:58.093890 18092 pending_rounds.cc:107] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:10:58.094162 18092 raft_consensus.cc:2889] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:57.999794 21441 raft_consensus.cc:2804] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:10:57.990312 21438 raft_consensus.cc:2749] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:10:58.052234 21243 raft_consensus.cc:3060] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:58.081327 18017 rpcz_store.cc:276] 0709 12:10:57.077201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.077362 (+   161us) service_pool.cc:224] Handling call
0709 12:10:58.080730 (+1003368us) spinlock_profiling.cc:243] Waited 377 ms on lock 0x7b5400364054. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:10:58.080847 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":867234560}
I20260709 12:10:58.099454 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:58.048542 21359 raft_consensus.cc:2749] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:58.047709 20986 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:58.096654 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:58.097002 18015 raft_consensus.cc:1240] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:58.100064 18022 raft_consensus.cc:3060] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.101151 18023 raft_consensus.cc:1240] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:58.031450 21398 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:58.110776 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:58.111979 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:58.112540 18092 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:58.085521 20466 raft_consensus.cc:697] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:58.085886 21162 raft_consensus.cc:3055] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:10:58.102284 21290 raft_consensus.cc:3060] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:10:58.118847 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 137675us
I20260709 12:10:58.033452 21389 consensus_queue.cc:260] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:58.132217 18608 leader_election.cc:304] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:58.129577 18023 raft_consensus.cc:1240] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:10:58.098415 21311 raft_consensus.cc:697] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:58.136955 18092 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 12.
W20260709 12:10:58.137892 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 144728us
I20260709 12:10:58.107306 20986 raft_consensus.cc:3060] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.052192 21462 consensus_queue.cc:1048] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 12:10:58.160143 18608 leader_election.cc:304] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:58.099290 21441 raft_consensus.cc:493] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
W20260709 12:10:58.153316 17989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.085922 21437 consensus_queue.cc:1059] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
W20260709 12:10:58.174930 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 183845us
I20260709 12:10:58.130817 21162 raft_consensus.cc:740] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
W20260709 12:10:58.190418 17989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.191010 18022 raft_consensus.cc:2468] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 8.
I20260709 12:10:58.079820 21244 consensus_queue.cc:260] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:58.175719 21438 raft_consensus.cc:2804] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:10:58.173319 21373 raft_consensus.cc:2749] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:58.163800 21441 raft_consensus.cc:3060] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:10:58.224649 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 76491.7us
I20260709 12:10:58.208249 21392 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:58.173843 21435 consensus_queue.cc:1059] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
W20260709 12:10:58.255314 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:58.365212 18062 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.207080 21319 consensus_queue.cc:1059] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:10:58.231982 21460 consensus_queue.cc:1059] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.160s
I20260709 12:10:58.384634 21244 raft_consensus.cc:3060] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:58.385054 21236 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:58.399109 21442 raft_consensus.cc:3055] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:58.377027 20466 consensus_queue.cc:237] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:58.231621 21311 consensus_queue.cc:237] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:58.441494 18092 raft_consensus.cc:1240] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 10. Current term is 11. Ops: []
W20260709 12:10:58.422987 21455 log.cc:927] Time spent T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.322s	user 0.001s	sys 0.000s
W20260709 12:10:58.427044 21456 log.cc:927] Time spent T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.320s	user 0.000s	sys 0.000s
I20260709 12:10:58.415114 21360 leader_election.cc:290] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:58.443001 21438 raft_consensus.cc:697] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:58.423225 21442 raft_consensus.cc:740] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
W20260709 12:10:58.447422 21457 log.cc:927] Time spent T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.362s	user 0.001s	sys 0.000s
I20260709 12:10:58.456099 21373 consensus_queue.cc:1059] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
W20260709 12:10:58.465945 21474 log.cc:927] Time spent T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:10:58.467993 21378 raft_consensus.cc:3060] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:10:58.469774 21303 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
W20260709 12:10:58.471979 21452 log.cc:927] Time spent T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.305s	user 0.000s	sys 0.001s
I20260709 12:10:58.473348 20977 raft_consensus.cc:3055] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:10:58.474172 21354 raft_consensus.cc:493] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
W20260709 12:10:58.476912 21451 log.cc:927] Time spent T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.247s	user 0.001s	sys 0.000s
I20260709 12:10:58.483053 21398 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:58.482287 21219 consensus_meta.cc:287] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.515s	user 0.007s	sys 0.000s
I20260709 12:10:58.472011 21401 raft_consensus.cc:1064] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:10:58.493139 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:58.562285 21354 raft_consensus.cc:3060] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.563738 21436 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
W20260709 12:10:58.562178 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 391834us
I20260709 12:10:58.556450 21303 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:58.558566 20977 raft_consensus.cc:740] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
W20260709 12:10:58.560115 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 416216us
W20260709 12:10:58.586433 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:58.588251 17943 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.020s	sys 0.024s
W20260709 12:10:58.588762 17943 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.020s	sys 0.024s
I20260709 12:10:58.590535 18636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60430 (request call id 787) took 1027 ms. Trace:
I20260709 12:10:58.592767 18636 rpcz_store.cc:276] 0709 12:10:57.563404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.564045 (+   641us) service_pool.cc:224] Handling call
0709 12:10:57.578992 (+ 14947us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:57.586529 (+  7537us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:57.586557 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:57.594433 (+  7876us) log.cc:844] Serialized 26 byte log entry
0709 12:10:57.833946 (+239513us) spinlock_profiling.cc:243] Waited 3.54 ms on lock 0x7b4800270258. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f518dbaa1 00007f7f518d2b37 00007f7f518d29ca 00007f7f519ca26f 00007f7f519c9f37 00007f7f519de55c 00007f7f519de508 00007f7f519de488 00007f7f519de443 00007f7f519dd6ec 00007f7f50907a96
0709 12:10:57.959652 (+125706us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:57.959708 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.960529 (+   821us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:58.585555 (+625026us) raft_consensus.cc:1685] finished
0709 12:10:58.585581 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.590464 (+  4883us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54335,"raft.queue_time_us":8509,"raft.run_cpu_time_us":2933,"raft.run_wall_time_us":258511,"spinlock_wait_cycles":8134400,"thread_start_us":301236,"threads_started":1,"wal-append.queue_time_us":448870}
I20260709 12:10:58.585342 21360 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:58.587805 21333 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.588392 21366 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:58.568300 21442 consensus_queue.cc:260] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:58.581501 21436 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:58.572930 21162 consensus_queue.cc:260] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:58.602533 21481 log.cc:927] Time spent T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:10:58.601378 20977 consensus_queue.cc:260] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:58.631378 20977 raft_consensus.cc:3060] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:58.617352 21333 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:58.639082 21290 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:58.647807 21290 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:58.647848 21401 consensus_queue.cc:237] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:58.648927 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:58.649636 21291 raft_consensus.cc:3055] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:58.666113 21291 raft_consensus.cc:740] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:58.623448 21398 raft_consensus.cc:493] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.666860 21398 raft_consensus.cc:515] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:58.667047 21291 consensus_queue.cc:260] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:58.668006 21291 raft_consensus.cc:3060] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:58.669014 21398 leader_election.cc:290] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:58.671924 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:58.618119 21366 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:58.617889 21360 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:58.655488 21442 raft_consensus.cc:3060] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:58.673718 17989 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:58.673259 21334 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:58.683974 21319 raft_consensus.cc:3055] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:10:58.684417 21360 leader_election.cc:290] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:58.684417 21319 raft_consensus.cc:740] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:58.685472 21319 consensus_queue.cc:260] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:58.686589 21319 raft_consensus.cc:3060] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:58.687093 21333 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:58.688777 21436 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:58.689880 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:58.699615 21344 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:58.700814 21354 raft_consensus.cc:515] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:58.706533 21303 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:58.708644 21303 leader_election.cc:290] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:58.580674 21438 consensus_queue.cc:237] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:58.672900 21243 consensus_meta.cc:287] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.566s	user 0.004s	sys 0.004s
W20260709 12:10:58.677068 21020 consensus_meta.cc:287] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.584s	user 0.004s	sys 0.004s
W20260709 12:10:58.763387 21370 consensus_meta.cc:287] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.715s	user 0.010s	sys 0.001s
I20260709 12:10:58.764957 21441 raft_consensus.cc:515] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:58.782915 18018 raft_consensus.cc:2468] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 7.
W20260709 12:10:58.773330 20986 consensus_meta.cc:287] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.600s	user 0.007s	sys 0.003s
I20260709 12:10:58.748668 21020 raft_consensus.cc:2749] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647) with higher term. Message: Invalid argument: T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 8. Current term is 9.
I20260709 12:10:58.785025 21354 leader_election.cc:290] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:58.808025 21458 log.cc:927] Time spent T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.640s	user 0.003s	sys 0.000s
I20260709 12:10:58.819129 21162 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:58.826432 21389 raft_consensus.cc:3060] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:10:58.836576 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 162972us
I20260709 12:10:58.838336 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:58.838920 18636 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:10:58.839339 21360 raft_consensus.cc:2804] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:10:58.839846 21360 raft_consensus.cc:697] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:10:58.840924 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:58.840637 21360 consensus_queue.cc:237] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:58.842110 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:58.843149 18017 raft_consensus.cc:1240] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 7. Current term is 8. Ops: []
I20260709 12:10:58.844108 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:58.844182 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:10:58.845098 18610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.845750 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:58.846290 18022 raft_consensus.cc:3060] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:58.847911 18015 raft_consensus.cc:2393] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 9: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:10:58.848740 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:10:58.851275 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 864202us
I20260709 12:10:58.852093 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:58.852228 18061 leader_election.cc:304] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:58.853566 18636 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 12.
I20260709 12:10:58.854533 18639 raft_consensus.cc:1275] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:10:58.855106 18607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.855976 21492 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.856262 21291 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:58.856658 21390 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.856793 21291 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:58.857126 21390 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:58.859064 21390 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:58.856613 21492 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:58.860577 21243 raft_consensus.cc:2749] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:10:58.861292 21243 consensus_queue.cc:1059] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:10:58.861752 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 683967us
I20260709 12:10:58.862370 21354 raft_consensus.cc:3055] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:10:58.865316 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:58.865775 18090 raft_consensus.cc:1275] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:10:58.865983 18022 raft_consensus.cc:2468] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 9.
I20260709 12:10:58.867823 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:58.872052 18094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53954 (request call id 2216) took 1108 ms. Trace:
I20260709 12:10:58.862764 21354 raft_consensus.cc:740] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:58.877507 18018 raft_consensus.cc:1240] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 8. Current term is 9. Ops: []
W20260709 12:10:58.878717 18062 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.879666 18062 leader_election.cc:304] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:58.883069 18608 leader_election.cc:304] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:58.884521 18608 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:58.875211 17989 leader_election.cc:304] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:58.889634 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:10:58.797652 20986 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:58.894078 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
W20260709 12:10:58.868866 21357 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.893s	user 0.023s	sys 0.022s
I20260709 12:10:58.894662 18015 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:10:58.872442 18094 rpcz_store.cc:276] 0709 12:10:57.764088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.765244 (+  1156us) service_pool.cc:224] Handling call
0709 12:10:57.765537 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:57.791099 (+ 25562us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:57.791141 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:57.791607 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 12:10:57.974398 (+182791us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:57.974436 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:57.974526 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:58.807296 (+832770us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b4400022b4c. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f497ebc85 00007f7f497ec6a2 00007f7f4c55e1db 00007f7f4c559aaf 00007f7f4c54d86e 00007f7f4c54cbb6 00007f7f4c54c7d8 00007f7f4c556221 00007f7f4c5561d9 00007f7f4c556169
0709 12:10:58.866406 (+ 59110us) raft_consensus.cc:1685] finished
0709 12:10:58.866428 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:58.872001 (+  5573us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25210,"raft.queue_time_us":28122,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":7647,"spinlock_wait_cycles":25307392,"thread_start_us":174394,"threads_started":1,"wal-append.queue_time_us":298947}
I20260709 12:10:58.896324 18062 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:10:58.894497 18608 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:58.904309 18608 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:58.905756 18608 leader_election.cc:304] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:58.909958 18015 raft_consensus.cc:2468] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 11.
I20260709 12:10:58.868521 21492 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:58.916106 18608 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:58.924072 18062 leader_election.cc:304] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:10:58.899130 21357 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.929s	user 0.024s	sys 0.022s
W20260709 12:10:58.975328 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 59288.8us
I20260709 12:10:58.974335 20466 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.923266 21085 raft_consensus.cc:2749] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:10:58.978681 21498 log.cc:927] Time spent T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 12:10:58.979655 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:59.083838 17914 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:58.980237 21441 leader_election.cc:290] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:58.981351 21354 consensus_queue.cc:260] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:59.086658 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:10:59.001998 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:58.924320 21461 consensus_queue.cc:1048] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.136s
I20260709 12:10:59.002022 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:10:59.089095 17914 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:59.006047 21398 raft_consensus.cc:2804] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:10:58.895170 21462 raft_consensus.cc:2749] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:10:59.009250 18094 raft_consensus.cc:1240] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 7. Current term is 8. Ops: []
W20260709 12:10:59.009938 21496 log.cc:927] Time spent T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:10:59.013289 20986 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:59.018695 21271 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:59.019990 21366 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:58.898667 21290 raft_consensus.cc:2749] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:10:58.923417 21490 consensus_queue.cc:1048] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.104s
W20260709 12:10:59.032023 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:58.915103 20977 raft_consensus.cc:2749] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:10:58.893980 21154 raft_consensus.cc:2804] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:58.889645 21371 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:58.924654 21442 raft_consensus.cc:2804] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:59.036347 17943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44668 (request call id 547) took 1125 ms. Trace:
I20260709 12:10:59.098788 21085 raft_consensus.cc:493] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:58.974380 21471 raft_consensus.cc:493] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.058085 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:59.058758 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:10:59.059548 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:59.060204 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:59.028326 21303 raft_consensus.cc:2804] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:59.032879 21435 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:58.983942 20698 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:59.033713 21349 raft_consensus.cc:493] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.003269 17845 catalog_manager.cc:5697] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } }
I20260709 12:10:59.032496 21291 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:59.037489 21311 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.104974 18091 raft_consensus.cc:2468] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 9.
I20260709 12:10:59.105736 18639 raft_consensus.cc:1275] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:10:59.182034 18639 pending_rounds.cc:85] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db: Aborting all ops after (but not including) 8
I20260709 12:10:59.036832 21453 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:59.160962 20986 raft_consensus.cc:2804] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:10:59.180233 21435 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:59.145143 21271 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:59.186146 21453 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:59.187690 21435 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:59.187813 21271 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:59.180379 21154 raft_consensus.cc:697] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:59.165014 21085 raft_consensus.cc:515] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:59.172163 21471 raft_consensus.cc:515] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:59.189033 21154 consensus_queue.cc:237] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:59.189960 21085 leader_election.cc:290] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:10:59.145175 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 56183.7us
I20260709 12:10:59.190599 21471 leader_election.cc:290] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:59.190938 21303 raft_consensus.cc:697] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 11 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:59.191102 17914 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:59.191990 21303 consensus_queue.cc:237] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:59.192432 17914 leader_election.cc:304] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:59.192711 21311 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:58.890998 21437 raft_consensus.cc:2749] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:59.194072 18021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53022 (request call id 582) took 1026 ms. Trace:
I20260709 12:10:59.194744 21311 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:59.194928 18024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 2125) took 1047 ms. Trace:
I20260709 12:10:59.195106 21244 raft_consensus.cc:3060] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:59.184208 21349 raft_consensus.cc:515] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:59.195897 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:59.196523 18097 raft_consensus.cc:2468] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 9.
I20260709 12:10:59.161079 21366 consensus_queue.cc:1059] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:10:59.197506 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:59.184396 20698 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:59.194685 21020 raft_consensus.cc:2804] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:10:59.194416 18021 rpcz_store.cc:276] 0709 12:10:58.167864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.637248 (+469384us) service_pool.cc:224] Handling call
0709 12:10:58.637652 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:58.835363 (+197711us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:58.835392 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:58.835803 (+   411us) log.cc:844] Serialized 26 byte log entry
0709 12:10:59.083471 (+247668us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:59.083505 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.083564 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:59.193884 (+110320us) raft_consensus.cc:1685] finished
0709 12:10:59.193903 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.194020 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":197284,"raft.queue_time_us":198226,"raft.run_cpu_time_us":65,"raft.run_wall_time_us":65,"thread_start_us":247405,"threads_started":1,"wal-append.queue_time_us":336574}
I20260709 12:10:59.199836 20698 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:59.159190 17943 rpcz_store.cc:276] 0709 12:10:57.911363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.920187 (+  8824us) service_pool.cc:224] Handling call
0709 12:10:57.920502 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:57.920748 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:10:58.591268 (+670520us) log.cc:844] Serialized 14 byte log entry
0709 12:10:59.035753 (+444485us) log.cc:844] Serialized 14 byte log entry
0709 12:10:59.035924 (+   171us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:10:59.035979 (+    55us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:10:59.036044 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.036129 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.036280 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":321322,"prepare.queue_time_us":460787,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":76,"raft.queue_time_us":287076,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":10983,"spinlock_wait_cycles":36537728,"thread_start_us":842208,"threads_started":2,"wal-append.queue_time_us":282691}
I20260709 12:10:59.144090 21398 raft_consensus.cc:697] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 9 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:10:59.201284 21398 consensus_queue.cc:237] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:59.085223 20466 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:59.159724 21498 log.cc:927] Time spent T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:10:59.176663 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.214448 17914 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:59.151268 21450 raft_consensus.cc:3060] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:10:59.151578 21354 raft_consensus.cc:3060] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:10:59.082911 21436 raft_consensus.cc:2749] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:59.161671 21290 raft_consensus.cc:493] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.177297 21442 raft_consensus.cc:697] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:59.185856 20986 raft_consensus.cc:697] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:59.188315 21453 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:59.199486 21020 raft_consensus.cc:697] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:10:59.143550 21370 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.121312 21441 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
W20260709 12:10:59.153311 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 290423us
W20260709 12:10:59.153959 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 229956us
I20260709 12:10:59.204209 18609 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:59.195389 18024 rpcz_store.cc:276] 0709 12:10:58.147378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.147500 (+   122us) service_pool.cc:224] Handling call
0709 12:10:58.147790 (+   290us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:10:58.709037 (+561247us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b1800051640. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f4c55a4bc 00007f7f498a848b 00007f7f527029a9 00007f7f498c469b 00007f7f498c293f 00007f7f498c2455 00007f7f4c9aa060 00007f7f4c9aabfb 00007f7f4c9b564b
0709 12:10:58.709166 (+   129us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:58.709189 (+    23us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:10:58.709787 (+   598us) log.cc:844] Serialized 52 byte log entry
0709 12:10:58.874982 (+165195us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:10:58.875017 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.875089 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:59.194623 (+319534us) raft_consensus.cc:1685] finished
0709 12:10:59.194656 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.194873 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31848,"raft.queue_time_us":84764,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":130807,"spinlock_wait_cycles":37243776,"thread_start_us":224888,"threads_started":2,"wal-append.queue_time_us":433163}
I20260709 12:10:59.175345 21460 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.213831 18023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 2124) took 1071 ms. Trace:
I20260709 12:10:59.226305 18023 rpcz_store.cc:276] 0709 12:10:58.142473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.143615 (+  1142us) service_pool.cc:224] Handling call
0709 12:10:58.143904 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:58.591020 (+447116us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:58.591042 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:58.811677 (+220635us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b2c0005beb8. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4b2aba11 00007f7f4b2bb372 00007f7f4c9eda01 00007f7f4c9b243a 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2
0709 12:10:58.812206 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 12:10:59.097672 (+285466us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:10:59.097722 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.097810 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:59.202834 (+105024us) raft_consensus.cc:1685] finished
0709 12:10:59.202853 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.213765 (+ 10912us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33929,"raft.queue_time_us":81232,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":21460,"spinlock_wait_cycles":9537408,"thread_start_us":717109,"threads_started":2,"wal-append.queue_time_us":369284}
I20260709 12:10:59.182376 18639 pending_rounds.cc:107] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 8.9
I20260709 12:10:59.217458 17914 leader_election.cc:304] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:10:59.222504 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 359636us
I20260709 12:10:59.163319 21371 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:59.229534 17914 leader_election.cc:304] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:59.229346 18024 raft_consensus.cc:1240] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 8. Current term is 9. Ops: []
W20260709 12:10:59.222182 21344 consensus_meta.cc:287] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.522s	user 0.005s	sys 0.004s
I20260709 12:10:59.235131 18639 raft_consensus.cc:2917] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Aborting config change with OpId 8.9: Aborted: Op aborted by new leader
I20260709 12:10:59.218322 21462 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:59.237200 18636 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 11.
I20260709 12:10:59.237697 18639 raft_consensus.cc:2889] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:10:59.238750 17914 leader_election.cc:400] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931) with higher term. Message: Invalid argument: T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 7. Current term is 8.
I20260709 12:10:59.247457 17914 leader_election.cc:400] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 election: Vote denied by peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931) with higher term. Message: Invalid argument: T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 7. Current term is 8.
I20260709 12:10:59.247754 17914 leader_election.cc:403] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 12:10:59.250149 18062 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.245870 17948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44668 (request call id 549) took 1333 ms. Trace:
I20260709 12:10:59.235754 17913 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:59.229934 21162 raft_consensus.cc:2804] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:59.229789 21039 raft_consensus.cc:2749] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:10:59.251021 17948 rpcz_store.cc:276] 0709 12:10:57.912001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:57.922191 (+ 10190us) service_pool.cc:224] Handling call
0709 12:10:57.922625 (+   434us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:10:57.923107 (+   482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:10:57.923151 (+    44us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:10:57.924025 (+   874us) log.cc:844] Serialized 78 byte log entry
0709 12:10:58.066309 (+142284us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:10:58.228847 (+162538us) log.cc:844] Serialized 14 byte log entry
0709 12:10:59.245477 (+1016630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:59.245576 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:59.245630 (+    54us) raft_consensus.cc:1685] finished
0709 12:10:59.245649 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.245803 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":666083,"prepare.queue_time_us":394924,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":816590,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":32593,"spinlock_wait_cycles":1280,"thread_start_us":577046,"threads_started":3,"wal-append.queue_time_us":499068}
I20260709 12:10:59.257139 21303 consensus_queue.cc:1059] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:10:59.234453 21437 raft_consensus.cc:493] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:59.244241 21476 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.224056 21290 raft_consensus.cc:515] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:59.226045 21370 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:59.246717 21459 raft_consensus.cc:493] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:59.254364 21438 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:10:59.240450 20466 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:59.230446 21441 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:59.235996 21460 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:59.311532 18639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:44988 (request call id 7) took 14660 ms. Trace:
I20260709 12:10:59.254164 21462 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:59.282202 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.260123 21162 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.262802 21471 raft_consensus.cc:2749] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:59.320883 18607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:10:59.301374 21401 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.004s	sys 0.012s
W20260709 12:10:59.285205 18610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.300515 21085 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.316493 18639 rpcz_store.cc:276] 0709 12:10:44.615926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:44.617970 (+  2044us) service_pool.cc:224] Handling call
0709 12:10:45.339966 (+721996us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b180010a820. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9ed73d 00007f7f4c9b8f3f 00007f7f4c9b86b3 00007f7f4c9b09fa 00007f7f519784c9 00007f7f4aef4c54 00007f7f4aef4be2 00007f7f4aef4b11 00007f7f4aef4a8c 00007f7f4aef3d42
0709 12:10:45.411004 (+ 71038us) log.cc:844] Serialized 501 byte log entry
0709 12:10:48.002414 (+2591410us) spinlock_profiling.cc:243] Waited 533 ms on lock 0x7b5400760f54. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b8735 00007f7f4c9b09fa 00007f7f519784c9 00007f7f4aef4c54 00007f7f4aef4be2 00007f7f4aef4b11 00007f7f4aef4a8c 00007f7f4aef3d42 00007f7f4aced48c 00007f7f4acec8c6
0709 12:10:59.267756 (+11265342us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":99580,"raft.run_cpu_time_us":580,"raft.run_wall_time_us":580,"spinlock_wait_cycles":1648954752,"thread_start_us":165053,"threads_started":2}
I20260709 12:10:59.353386 18639 pending_rounds.cc:107] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:10:59.353818 18639 raft_consensus.cc:2889] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:10:59.355023 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 105333us
W20260709 12:10:59.340126 21495 log.cc:927] Time spent T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:10:59.276647 21453 consensus_queue.cc:1048] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 12:10:59.357458 18024 raft_consensus.cc:1275] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:10:59.320811 20466 raft_consensus.cc:2749] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:10:59.342106 21162 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:10:59.349905 21401 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.004s	sys 0.012s
I20260709 12:10:59.370682 18608 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:10:59.376858 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:59.272094 21437 raft_consensus.cc:515] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:59.377406 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:59.277228 21476 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:59.266009 21020 consensus_queue.cc:237] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:59.314513 21438 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:59.304096 21442 consensus_queue.cc:237] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:10:59.359146 21311 raft_consensus.cc:493] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.300833 20986 consensus_queue.cc:237] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:59.386423 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:59.309719 21459 raft_consensus.cc:515] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:59.386441 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 150770us
W20260709 12:10:59.407766 18062 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.98.193:39123 timed out after 1.818s (SENT) [suppressed 41 similar messages]
I20260709 12:10:59.355408 21085 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:59.378000 20977 raft_consensus.cc:2749] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:10:59.428833 17913 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:59.374727 21435 raft_consensus.cc:493] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:10:59.374446 21291 raft_consensus.cc:493] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
W20260709 12:10:59.430318 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 182975us
I20260709 12:10:59.431116 18016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53022 (request call id 581) took 1264 ms. Trace:
I20260709 12:10:59.388461 21039 raft_consensus.cc:3060] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.434252 18018 raft_consensus.cc:1275] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:10:59.384990 21507 raft_consensus.cc:2749] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:59.429443 21303 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.452430 21303 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:59.459928 21085 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:59.460515 21085 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:59.460994 21085 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:59.463560 21290 leader_election.cc:290] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:59.467046 21371 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:10:59.467567 21505 log.cc:927] Time spent T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.128s	user 0.003s	sys 0.000s
W20260709 12:10:59.468225 21514 log.cc:927] Time spent T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:10:59.468365 21370 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:59.427870 21319 raft_consensus.cc:493] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:59.469305 21319 raft_consensus.cc:515] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:59.471709 21319 leader_election.cc:290] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:10:59.472474 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 86518.2us
I20260709 12:10:59.474970 20882 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:10:59.475518 20882 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:59.476032 21441 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:59.476243 21349 leader_election.cc:290] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:59.411792 21515 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:59.476873 21515 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:59.454370 21303 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:59.477500 20882 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:59.436242 18016 rpcz_store.cc:276] 0709 12:10:58.167181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.167301 (+   120us) service_pool.cc:224] Handling call
0709 12:10:58.167616 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:10:58.581293 (+413677us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:58.592887 (+ 11594us) log.cc:844] Serialized 14 byte log entry
0709 12:10:58.618185 (+ 25298us) log.cc:844] Serialized 14 byte log entry
0709 12:10:58.832809 (+214624us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b1800252c40. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f4983fc0a 00007f7f52f7f219 00007f7f498c7a40 00007f7f498c24e4 00007f7f498c2455 00007f7f4c9aa060 00007f7f4c9bc716 00007f7f4c9cd287 00007f7f4c9cd208
0709 12:10:58.833237 (+   428us) log.cc:844] Serialized 14 byte log entry
0709 12:10:58.833404 (+   167us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:10:58.833985 (+   581us) log.cc:844] Serialized 26 byte log entry
0709 12:10:58.834145 (+   160us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:10:58.861432 (+ 27287us) spinlock_profiling.cc:243] Waited 2.68 ms on lock 0x7b1800252c40. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f498c53f3 00007f7f498c77c1 00007f7f498c7779 00007f7f498c7709 00007f7f498c76d1 00007f7f498c69cd 0000000000388634 0000000000388479 00007f7f498a883a
0709 12:10:58.866059 (+  4627us) log.cc:844] Serialized 14 byte log entry
0709 12:10:58.866238 (+   179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:10:58.866297 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:10:59.430864 (+564567us) raft_consensus.cc:1685] finished
0709 12:10:59.430891 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:10:59.431052 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8937,"prepare.queue_time_us":16031,"prepare.run_cpu_time_us":135,"prepare.run_wall_time_us":1900,"raft.queue_time_us":439091,"raft.run_cpu_time_us":473,"raft.run_wall_time_us":28956,"spinlock_wait_cycles":12923776,"thread_start_us":416989,"threads_started":2,"wal-append.queue_time_us":110234}
I20260709 12:10:59.377476 21510 consensus_queue.cc:1048] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 12:10:59.494807 18061 leader_election.cc:304] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:10:59.454489 21244 raft_consensus.cc:2749] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:10:59.500380 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 92642.2us
I20260709 12:10:59.411610 21311 raft_consensus.cc:515] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:10:59.502576 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 59028.6us
I20260709 12:10:59.503571 17914 leader_election.cc:400] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931) with higher term. Message: Invalid argument: T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 8. Current term is 9.
W20260709 12:10:59.502085 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 73392.1us
W20260709 12:10:59.495445 21506 log.cc:927] Time spent T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.230s	user 0.000s	sys 0.000s
I20260709 12:10:59.447557 21435 raft_consensus.cc:515] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:59.447103 21291 raft_consensus.cc:515] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:59.500993 21319 raft_consensus.cc:2749] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:10:59.520237 18642 raft_consensus.cc:1240] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 4. Current term is 5. Ops: []
I20260709 12:10:59.527204 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:59.528059 18637 raft_consensus.cc:2468] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 8.
I20260709 12:10:59.530264 21085 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:59.534389 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:59.507928 21526 raft_consensus.cc:2749] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:10:59.535172 17948 raft_consensus.cc:2393] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 8: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:59.538180 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:59.539803 17944 raft_consensus.cc:2468] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:10:59.540493 18061 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:59.540700 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:59.542519 17943 raft_consensus.cc:1275] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:10:59.542616 18637 raft_consensus.cc:2468] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 7.
I20260709 12:10:59.544308 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:59.544571 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:59.544801 18061 leader_election.cc:304] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:59.545317 17946 raft_consensus.cc:2393] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 11: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:59.546525 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:59.547695 17949 raft_consensus.cc:2410] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:10:59.547847 17943 raft_consensus.cc:1240] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 5. Current term is 6. Ops: []
I20260709 12:10:59.549942 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:59.550243 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:59.550866 17946 raft_consensus.cc:2468] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 9.
I20260709 12:10:59.554597 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:59.549178 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:59.555565 18641 raft_consensus.cc:2393] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 7: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:10:59.555776 17943 raft_consensus.cc:3060] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:59.591316 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:59.541613 21319 consensus_queue.cc:1059] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:10:59.594334 21319 raft_consensus.cc:3055] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:10:59.549692 21454 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
W20260709 12:10:59.560113 21512 log.cc:927] Time spent T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.117s	user 0.001s	sys 0.001s
I20260709 12:10:59.595281 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:59.606339 17949 raft_consensus.cc:2468] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
I20260709 12:10:59.599018 21319 raft_consensus.cc:740] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:59.601516 18641 raft_consensus.cc:1240] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 9 LEADER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:59.595494 21515 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:59.619474 17945 raft_consensus.cc:1240] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 8. Current term is 9. Ops: []
I20260709 12:10:59.622915 17942 raft_consensus.cc:2468] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 5.
I20260709 12:10:59.623836 17940 raft_consensus.cc:1275] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:10:59.610260 17948 raft_consensus.cc:2468] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:10:59.549683 21303 raft_consensus.cc:2804] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:10:59.612262 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:59.613132 21535 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.613369 21437 leader_election.cc:290] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:59.631824 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:59.560431 21085 raft_consensus.cc:493] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:59.541849 21334 raft_consensus.cc:2804] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:59.635068 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:10:59.555019 21459 leader_election.cc:290] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:59.636677 17943 raft_consensus.cc:2468] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
I20260709 12:10:59.645915 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:59.646776 17946 raft_consensus.cc:2393] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 7: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:10:59.541771 21525 consensus_queue.cc:1048] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 12:10:59.645591 21334 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.613754 21243 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.669763 21243 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:10:59.646585 17941 raft_consensus.cc:2468] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 8.
I20260709 12:10:59.652976 18061 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:59.647176 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:59.649117 21039 raft_consensus.cc:2749] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931) with higher term. Message: Invalid argument: T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 7. Current term is 8.
I20260709 12:10:59.535100 21529 consensus_queue.cc:1048] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 12:10:59.671247 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:59.673043 21243 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:59.673684 21334 raft_consensus.cc:3060] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:59.636242 18637 raft_consensus.cc:2468] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 9.
I20260709 12:10:59.633544 21303 raft_consensus.cc:493] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:10:59.661856 21435 leader_election.cc:290] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:59.662688 21311 leader_election.cc:290] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:10:59.665521 21389 consensus_meta.cc:287] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.838s	user 0.004s	sys 0.008s
I20260709 12:10:59.668179 21291 leader_election.cc:290] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:59.669221 21450 raft_consensus.cc:2749] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:59.659003 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:59.675799 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:10:59.680397 21539 log.cc:927] Time spent T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:10:59.677956 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:59.678081 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:59.678912 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:59.679144 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:59.633476 21438 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:10:59.611296 21454 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:59.691218 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:10:59.693636 17943 raft_consensus.cc:2410] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:10:59.677435 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:10:59.689345 18061 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:59.680528 21303 raft_consensus.cc:3060] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.697150 18098 raft_consensus.cc:2393] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 6: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:10:59.697691 17944 raft_consensus.cc:2410] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:10:59.680753 21533 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.716500 21533 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:59.645345 21085 raft_consensus.cc:515] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:59.658072 21537 consensus_queue.cc:1059] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:10:59.702466 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:10:59.791239 17943 raft_consensus.cc:2468] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:10:59.709216 18608 leader_election.cc:304] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:10:59.690951 21243 raft_consensus.cc:2804] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:10:59.646678 21535 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:59.831229 17914 leader_election.cc:304] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:10:59.873932 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.876116 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:10:59.876416 18062 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:10:59.876772 17941 raft_consensus.cc:2410] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 12:10:59.882699 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 51555.7us
I20260709 12:10:59.719022 21311 raft_consensus.cc:2804] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:59.965337 18092 raft_consensus.cc:1240] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 11 LEADER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:10:59.972010 21533 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:10:59.972318 21085 leader_election.cc:290] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:10:59.679600 21319 consensus_queue.cc:260] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:59.973471 21319 raft_consensus.cc:3060] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:10:59.976352 21243 raft_consensus.cc:697] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 11 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:10:59.977378 21243 consensus_queue.cc:237] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:10:59.961983 21162 consensus_meta.cc:287] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.587s	user 0.010s	sys 0.000s
I20260709 12:10:59.979241 21162 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:10:59.790494 21529 raft_consensus.cc:493] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:10:59.873042 21438 raft_consensus.cc:2749] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:10:59.982623 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 273494us
I20260709 12:10:59.988688 18608 leader_election.cc:304] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:10:59.961624 21537 consensus_queue.cc:1243] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer e28f77912a9c4ba2b9841f6fedddc2db log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:10:59.990523 18608 leader_election.cc:304] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:10:59.964835 20466 raft_consensus.cc:2749] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:10:59.996667 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:10:59.996920 18092 raft_consensus.cc:3060] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:10:59.997794 18639 raft_consensus.cc:2410] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:10:59.964761 21311 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:00.000602 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:00.002154 17943 raft_consensus.cc:2393] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 11: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:00.007160 18092 raft_consensus.cc:1275] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:10:59.994334 21085 raft_consensus.cc:2804] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:10:59.999756 21389 raft_consensus.cc:2804] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:10:59.996763 21162 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:00.003213 21311 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:10:59.995455 21450 consensus_queue.cc:1059] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:11:00.010098 21342 consensus_queue.cc:1048] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:11:00.015895 21085 raft_consensus.cc:697] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:00.014055 21389 raft_consensus.cc:493] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:10:59.990084 21529 raft_consensus.cc:515] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:00.023418 21454 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:00.024796 21450 consensus_queue.cc:1243] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer 4813437da0a74e65b61eb7bd1d18f110 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:11:00.033051 21460 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:11:00.033196 21516 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.010s	sys 0.024s
W20260709 12:11:00.033625 21516 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.010s	sys 0.025s
I20260709 12:11:00.026163 21389 raft_consensus.cc:3060] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:00.029846 21535 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:00.038851 21529 leader_election.cc:290] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:00.115634 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:00.117245 18089 raft_consensus.cc:2468] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
I20260709 12:11:00.122071 21529 consensus_queue.cc:1048] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:00.118036 21334 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:00.116628 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:00.112691 21085 consensus_queue.cc:237] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:00.131350 17943 raft_consensus.cc:2393] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 7: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:00.132606 21460 consensus_queue.cc:1048] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:00.142917 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:00.143885 18637 raft_consensus.cc:3060] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:11:00.144124 21454 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.144879 21454 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:00.128741 21334 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:00.150280 18636 raft_consensus.cc:1240] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 9 LEADER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:00.152499 21454 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:00.155586 21154 consensus_queue.cc:1059] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:00.156435 21154 consensus_queue.cc:1243] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer e28f77912a9c4ba2b9841f6fedddc2db log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:11:00.162097 17914 leader_election.cc:304] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:10:59.473202 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:00.165716 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:00.167498 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:00.167236 17845 catalog_manager.cc:5697] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 5 to 8, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 8 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:00.168937 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:00.169914 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:00.171383 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:00.172358 17948 raft_consensus.cc:2468] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
I20260709 12:11:00.173585 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:11:00.175794 18091 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41818 (request call id 900) took 1486 ms (client timeout 1945 ms). Trace:
W20260709 12:11:00.176271 18091 rpcz_store.cc:269] 0709 12:10:58.689477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.689624 (+   147us) service_pool.cc:224] Handling call
0709 12:11:00.175421 (+1485797us) spinlock_profiling.cc:243] Waited 414 ms on lock 0x7b54000ab754. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:00.175631 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":953001856}
I20260709 12:11:00.180508 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:00.181943 17944 raft_consensus.cc:2393] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 8: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:00.183247 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:00.184221 17944 raft_consensus.cc:2376] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 5. Re-sending same reply.
I20260709 12:11:00.186636 21516 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.187444 21516 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:00.188282 18609 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:00.189844 21438 raft_consensus.cc:2804] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:00.191144 21435 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.199846 21435 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:00.202446 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:00.190238 21516 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:00.203686 18095 raft_consensus.cc:2393] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 5: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:00.203612 21219 raft_consensus.cc:3055] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:00.204217 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:00.204936 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:00.190287 21438 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:00.190814 21544 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.170420 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:00.182037 20882 raft_consensus.cc:2804] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:00.211541 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:00.212427 21321 raft_consensus.cc:3055] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:00.170601 17845 catalog_manager.cc:5697] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 2 to 6, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 6 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:00.218746 18092 raft_consensus.cc:2368] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 9. Current term is 10.
I20260709 12:11:00.173614 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:00.198030 18637 raft_consensus.cc:2468] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 10.
I20260709 12:11:00.250763 21039 raft_consensus.cc:493] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.251726 21039 raft_consensus.cc:515] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:00.253624 17943 raft_consensus.cc:2410] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:11:00.254247 21039 leader_election.cc:290] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:00.247936 20882 raft_consensus.cc:493] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.255144 20882 raft_consensus.cc:3060] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.258074 21544 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:00.222527 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:00.222762 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:00.256480 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:00.223709 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:00.218992 21219 raft_consensus.cc:740] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
W20260709 12:11:00.282523 21521 log.cc:927] Time spent T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.828s	user 0.013s	sys 0.018s
I20260709 12:11:00.282583 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:00.279732 21544 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:00.283445 18095 raft_consensus.cc:2468] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
I20260709 12:11:00.283836 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:00.263723 21516 raft_consensus.cc:493] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.282603 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:00.234970 21438 raft_consensus.cc:3060] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.287865 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:00.287521 17914 leader_election.cc:304] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:11:00.295172 17944 raft_consensus.cc:3060] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:00.295581 17943 raft_consensus.cc:2393] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 9: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:00.296474 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:00.297643 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:00.297964 20882 raft_consensus.cc:515] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:00.299331 18096 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:00.248118 21321 raft_consensus.cc:740] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:00.301469 21516 raft_consensus.cc:515] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:00.303086 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:00.304905 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:00.306319 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:00.298852 18094 raft_consensus.cc:2468] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 9.
I20260709 12:11:00.306932 17944 raft_consensus.cc:2468] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
I20260709 12:11:00.279264 21435 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:00.319227 17943 raft_consensus.cc:2468] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 5.
I20260709 12:11:00.319480 17940 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:00.320300 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:00.322798 21471 raft_consensus.cc:2804] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:00.323244 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:00.324198 18095 raft_consensus.cc:2468] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 6.
I20260709 12:11:00.316000 17948 raft_consensus.cc:2376] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8. Re-sending same reply.
I20260709 12:11:00.339097 17949 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:00.339653 21321 consensus_queue.cc:260] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:00.342310 21219 consensus_queue.cc:260] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:00.342818 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:00.342943 18098 raft_consensus.cc:1275] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:11:00.343577 18095 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 11.
I20260709 12:11:00.366443 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:00.378522 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:00.379242 18609 leader_election.cc:400] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Vote denied by peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931) with higher term. Message: Invalid argument: T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 9. Current term is 10.
I20260709 12:11:00.379683 18609 leader_election.cc:403] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:00.379573 18097 raft_consensus.cc:2468] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 8.
I20260709 12:11:00.380388 21435 raft_consensus.cc:2749] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931) with higher term. Message: Invalid argument: T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 9. Current term is 10.
I20260709 12:11:00.380637 18609 leader_election.cc:304] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:00.380301 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:00.381486 17941 raft_consensus.cc:2468] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 6.
W20260709 12:11:00.382076 20977 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.864s	user 0.010s	sys 0.018s
W20260709 12:11:00.382457 20977 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.930s	user 0.010s	sys 0.018s
I20260709 12:11:00.383212 21435 raft_consensus.cc:2749] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:00.384332 17941 raft_consensus.cc:1275] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:00.395421 21310 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:00.400310 21310 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:00.385459 18062 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.323268 21471 raft_consensus.cc:493] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.413266 17949 raft_consensus.cc:2468] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 10.
I20260709 12:11:00.431334 17940 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 11.
W20260709 12:11:00.432734 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.432904 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:00.433643 21243 raft_consensus.cc:493] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:00.409238 21219 raft_consensus.cc:3060] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.434439 21243 raft_consensus.cc:515] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:00.435051 21310 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:00.436954 21243 leader_election.cc:290] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:11:00.433235 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.408313 20882 leader_election.cc:290] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:00.433704 18097 raft_consensus.cc:3060] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.339097 21462 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:00.442507 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:11:00.443154 21303 consensus_meta.cc:287] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.652s	user 0.006s	sys 0.014s
I20260709 12:11:00.449749 21303 raft_consensus.cc:515] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:00.409057 21321 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:00.452769 21303 leader_election.cc:290] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:00.443185 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:00.446373 21438 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:00.409940 21471 raft_consensus.cc:3060] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:00.397078 21516 leader_election.cc:290] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:11:00.468647 17831 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 4ccf0bcc20ae40e79c32530091613e1e with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647) due to error UNKNOWN_ERROR; will retry: Aborted: Op aborted by new leader
I20260709 12:11:00.459709 21243 raft_consensus.cc:493] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
W20260709 12:11:00.472954 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 70574.9us
I20260709 12:11:00.473187 21243 raft_consensus.cc:515] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:11:00.474525 21513 log.cc:927] Time spent T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 1.097s	user 0.005s	sys 0.005s
I20260709 12:11:00.474365 18609 leader_election.cc:304] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:00.480199 18090 raft_consensus.cc:1240] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:00.484440 21522 log.cc:927] Time spent T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 1.104s	user 0.002s	sys 0.002s
I20260709 12:11:00.486682 18061 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:00.487936 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:00.488246 21528 raft_consensus.cc:2804] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:00.488760 21528 raft_consensus.cc:697] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 10 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:00.489220 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:00.489924 17942 raft_consensus.cc:2376] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 11. Re-sending same reply.
I20260709 12:11:00.489842 21528 consensus_queue.cc:237] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:00.491930 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:00.492605 17945 raft_consensus.cc:2368] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for earlier term 7. Current term is 8.
I20260709 12:11:00.493436 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:00.494092 17945 raft_consensus.cc:2368] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for earlier term 9. Current term is 10.
I20260709 12:11:00.460724 21310 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.496099 17946 raft_consensus.cc:1240] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 4. Current term is 5. Ops: []
I20260709 12:11:00.497679 17946 raft_consensus.cc:1275] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:00.501014 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:00.502409 17947 raft_consensus.cc:1275] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:00.503511 18018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 2131) took 1603 ms. Trace:
I20260709 12:11:00.505738 18018 rpcz_store.cc:276] 0709 12:10:58.900028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.901052 (+  1024us) service_pool.cc:224] Handling call
0709 12:10:58.976487 (+ 75435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.445198 (+468711us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.502989 (+1057791us) spinlock_profiling.cc:243] Waited 457 ms on lock 0x7b54001e5354. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:11:00.503254 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1051761024}
I20260709 12:11:00.508926 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:00.510144 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
W20260709 12:11:00.510924 21523 log.cc:927] Time spent T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 1.130s	user 0.006s	sys 0.004s
I20260709 12:11:00.511559 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:00.512276 17945 raft_consensus.cc:2468] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 9.
I20260709 12:11:00.494566 21310 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:00.514611 21310 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:00.515793 17946 pending_rounds.cc:85] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1: Aborting all ops after (but not including) 5
I20260709 12:11:00.516129 17946 pending_rounds.cc:107] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:11:00.516407 17946 raft_consensus.cc:2889] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:00.510893 17942 raft_consensus.cc:2376] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6. Re-sending same reply.
W20260709 12:11:00.503764 21319 consensus_meta.cc:287] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.530s	user 0.004s	sys 0.013s
I20260709 12:11:00.525839 18096 raft_consensus.cc:2468] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 10.
I20260709 12:11:00.525982 18097 raft_consensus.cc:2468] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
I20260709 12:11:00.545506 17944 raft_consensus.cc:2468] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 8.
I20260709 12:11:00.548591 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:11:00.549474 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 75250.3us
I20260709 12:11:00.552556 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:00.550729 18609 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:00.508160 21389 raft_consensus.cc:515] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:00.562228 17944 raft_consensus.cc:2468] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 7.
I20260709 12:11:00.569978 18609 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:00.572650 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:00.574311 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:00.580981 18609 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:00.582913 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:00.583504 17948 raft_consensus.cc:2376] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 11. Re-sending same reply.
I20260709 12:11:00.585352 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:00.569167 21435 raft_consensus.cc:493] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.576872 21085 raft_consensus.cc:2804] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:00.587024 17947 raft_consensus.cc:3060] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.567389 21516 raft_consensus.cc:493] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:00.589131 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:00.589650 21162 consensus_queue.cc:1048] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:11:00.592293 18608 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:00.592864 21535 raft_consensus.cc:2804] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:00.593052 21524 log.cc:927] Time spent T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 1.210s	user 0.005s	sys 0.005s
I20260709 12:11:00.593258 17914 leader_election.cc:304] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:11:00.594256 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:00.595389 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:00.595705 21544 raft_consensus.cc:2804] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:11:00.597299 21311 consensus_meta.cc:287] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.579s	user 0.010s	sys 0.003s
I20260709 12:11:00.606917 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:00.597929 17845 catalog_manager.cc:5697] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:00.622044 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:00.621498 18636 raft_consensus.cc:1275] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:00.638399 18639 raft_consensus.cc:3060] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.640754 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:00.608745 21085 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.645397 17942 raft_consensus.cc:2393] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 9: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:00.636175 21535 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.610846 21243 leader_election.cc:290] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:00.654471 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:00.658216 17944 raft_consensus.cc:2368] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for earlier term 9. Current term is 10.
I20260709 12:11:00.620900 21476 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:00.637450 21544 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.644507 21162 raft_consensus.cc:2804] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:00.653942 21085 raft_consensus.cc:3060] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:00.666615 21511 raft_consensus.cc:2804] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:00.669435 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:00.671164 21363 consensus_queue.cc:1059] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 7.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:11:00.661114 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:00.654999 21516 raft_consensus.cc:515] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:00.673259 21442 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:00.663043 21162 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.675115 21319 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.675380 21483 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.675853 20977 raft_consensus.cc:2804] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:00.680238 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:00.680217 21511 raft_consensus.cc:697] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:00.681540 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:00.672708 21389 leader_election.cc:290] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:00.689085 17940 raft_consensus.cc:1275] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:00.663708 21544 raft_consensus.cc:3060] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:00.691445 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:00.657670 21535 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:00.643244 21311 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:00.693951 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:00.659655 21435 raft_consensus.cc:515] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:00.678056 21438 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:00.698834 21483 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:00.702865 21319 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:00.689890 21162 raft_consensus.cc:3060] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:00.704828 20977 raft_consensus.cc:697] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
W20260709 12:11:00.706620 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 135824us
I20260709 12:11:00.709018 18097 raft_consensus.cc:2468] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 5.
I20260709 12:11:00.711577 17944 raft_consensus.cc:2468] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:11:00.712832 18089 raft_consensus.cc:1275] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:00.712927 17940 raft_consensus.cc:1240] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:00.704897 21471 raft_consensus.cc:515] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:00.728117 17943 raft_consensus.cc:1240] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:00.719249 21435 leader_election.cc:290] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:00.720016 21311 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:00.722745 18091 raft_consensus.cc:2393] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 10: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:00.729266 21471 leader_election.cc:290] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:00.741909 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:00.692939 21442 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:00.745612 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:00.745959 18098 raft_consensus.cc:2393] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 8: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:00.745141 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:00.747509 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:00.747602 18090 raft_consensus.cc:3060] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:00.747294 18642 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 12.
I20260709 12:11:00.750478 21438 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:00.750943 21363 consensus_queue.cc:1048] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:00.751097 21438 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:00.753175 21438 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:00.750500 20977 consensus_queue.cc:237] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:00.756043 18062 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:00.756567 21244 raft_consensus.cc:3055] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:00.756973 21244 raft_consensus.cc:740] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:00.758858 17948 raft_consensus.cc:2468] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 6.
I20260709 12:11:00.759799 18022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 2126) took 1883 ms. Trace:
I20260709 12:11:00.761291 18089 raft_consensus.cc:1275] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:00.766345 18095 raft_consensus.cc:2468] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 9.
I20260709 12:11:00.768313 17947 raft_consensus.cc:2468] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 9.
I20260709 12:11:00.758049 21244 consensus_queue.cc:260] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 7.10, Last appended by leader: 10, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:00.773739 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 181634us
I20260709 12:11:00.771040 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:00.776675 17945 raft_consensus.cc:1275] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:00.769438 21389 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:00.778561 21560 log.cc:927] Time spent T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
W20260709 12:11:00.779170 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 1.39946e+06us
I20260709 12:11:00.780987 21442 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:00.782008 21516 leader_election.cc:290] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:11:00.782194 17988 connection.cc:256] RPC call timeout handler was delayed by -1.1106032180000511s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2931s for a response
I20260709 12:11:00.783681 21483 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:00.814260 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.785810 21333 raft_consensus.cc:493] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.785050 21319 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:00.758858 21565 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:00.779170 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:00.827816 18090 raft_consensus.cc:2468] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 10.
I20260709 12:11:00.767688 21435 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:00.773382 21438 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:00.767668 21219 raft_consensus.cc:2749] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:00.842962 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 66129.3us
I20260709 12:11:00.844700 18609 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:00.845156 18639 raft_consensus.cc:2468] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 8.
I20260709 12:11:00.760160 18022 rpcz_store.cc:276] 0709 12:10:58.876454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:58.876653 (+   199us) service_pool.cc:224] Handling call
0709 12:10:58.887506 (+ 10853us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:58.887694 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:10:58.887935 (+   241us) log.cc:844] Serialized 14 byte log entry
0709 12:10:59.093292 (+205357us) spinlock_profiling.cc:243] Waited 3.2 ms on lock 0x7b18002a6880. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f498a7e07 00007f7f527029a9 00007f7f498c469b 00007f7f498c293f 00007f7f498c4c02 00007f7f4c54c20b 00007f7f4c551d23 00007f7f4c55223a 00007f7f4c9bca2a
0709 12:11:00.483567 (+1390275us) spinlock_profiling.cc:243] Waited 84.2 ms on lock 0x7b4400022b4c. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f497ebc85 00007f7f497ec6a2 00007f7f4c55e1db 00007f7f4c559aaf 00007f7f4c54d86e 00007f7f4c54cbb6 00007f7f4c54c7d8 00007f7f4c556221 00007f7f4c5561d9 00007f7f4c556169
0709 12:11:00.759149 (+275582us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:00.759253 (+   104us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:00.759361 (+   108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.759473 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.759643 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1379343,"prepare.queue_time_us":101,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":2697,"spinlock_wait_cycles":201023744,"thread_start_us":285946,"threads_started":1,"wal-append.queue_time_us":491546}
I20260709 12:11:00.850152 18062 leader_election.cc:400] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123) with higher term. Message: Invalid argument: T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for earlier term 7. Current term is 8.
I20260709 12:11:00.854008 18062 leader_election.cc:403] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:00.854578 18609 leader_election.cc:304] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:00.840199 21389 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:00.769258 21511 consensus_queue.cc:237] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:00.882028 18608 leader_election.cc:304] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:00.883481 21359 raft_consensus.cc:493] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:00.884128 21359 raft_consensus.cc:515] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:00.849001 21162 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:00.871658 21333 raft_consensus.cc:515] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:00.892840 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:00.848948 21565 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:00.855530 21435 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:00.893396 17947 raft_consensus.cc:3060] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:00.897034 17913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.875876 21219 raft_consensus.cc:2749] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123) with higher term. Message: Invalid argument: T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for earlier term 7. Current term is 8.
I20260709 12:11:00.899860 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:00.874879 21564 consensus_queue.cc:1048] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:11:00.879433 20977 raft_consensus.cc:2804] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:00.907090 17940 raft_consensus.cc:1275] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:11:00.871909 21438 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:00.913089 21564 raft_consensus.cc:2804] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:00.913533 21564 raft_consensus.cc:493] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:00.913906 21564 raft_consensus.cc:3060] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:00.914767 21569 raft_consensus.cc:2804] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:00.915336 21569 raft_consensus.cc:697] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:00.916287 21569 consensus_queue.cc:237] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:00.917148 21333 leader_election.cc:290] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:00.908092 21483 raft_consensus.cc:493] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.918092 21483 raft_consensus.cc:515] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:00.918816 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.919407 21244 raft_consensus.cc:3060] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:00.919530 21563 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.920209 21483 leader_election.cc:290] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:00.920152 21563 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:00.922801 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 92397.3us
I20260709 12:11:00.918692 21360 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:00.924099 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:00.926458 18061 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:00.927510 21359 leader_election.cc:290] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:00.910763 21334 consensus_queue.cc:1048] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:11:00.931416 21271 raft_consensus.cc:3055] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:00.931856 21271 raft_consensus.cc:740] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:00.932832 21271 consensus_queue.cc:260] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:00.937546 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:00.952641 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.939889 21162 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:00.941011 21565 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:00.917157 21085 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:00.943089 21516 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:00.946033 21435 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:00.971562 17988 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
W20260709 12:11:00.948679 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:00.950145 21438 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:00.952083 17943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44668 (request call id 561) took 1257 ms. Trace:
I20260709 12:11:00.952185 17949 raft_consensus.cc:1240] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 5. Current term is 7. Ops: []
I20260709 12:11:00.957082 21544 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:00.957983 21564 raft_consensus.cc:515] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:01.001263 21564 leader_election.cc:290] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:00.958998 18061 leader_election.cc:304] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:01.002590 21544 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:00.959229 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:11:01.003094 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 44153.5us
I20260709 12:11:00.960566 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:00.961711 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:01.004398 21461 consensus_queue.cc:1048] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:11:00.963133 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:01.005060 21442 raft_consensus.cc:2804] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:01.005584 18635 raft_consensus.cc:2393] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 7: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:11:01.005604 21442 raft_consensus.cc:697] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:01.007033 21570 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.007593 21442 consensus_queue.cc:237] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 7.10, Last appended by leader: 10, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:01.010936 21490 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.011374 18092 raft_consensus.cc:1240] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:01.011498 21490 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:01.013847 21490 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:01.014384 21490 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.964515 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:01.030022 18636 raft_consensus.cc:2468] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 7.
I20260709 12:11:00.967550 18021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 2136) took 1706 ms. Trace:
I20260709 12:11:00.968623 21535 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:01.033725 21490 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:00.969444 21360 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:00.970000 21194 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.036049 21194 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:00.980085 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:00.980463 21344 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.980686 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:00.980767 21366 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.981115 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:00.981506 18062 leader_election.cc:400] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 election: Vote denied by peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123) with higher term. Message: Invalid argument: T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for earlier term 9. Current term is 10.
I20260709 12:11:00.981829 18095 raft_consensus.cc:1275] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:00.981985 21319 raft_consensus.cc:2804] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:00.973002 21476 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.970559 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:00.983642 21085 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:00.983983 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:00.980103 21492 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:00.970813 21571 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:00.947751 21389 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:00.981936 17940 raft_consensus.cc:1240] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:00.994225 21563 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:00.996505 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:00.963963 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:01.015213 21516 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:01.027796 21349 raft_consensus.cc:2749] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:01.027858 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 56483.1us
I20260709 12:11:01.014748 18641 raft_consensus.cc:2368] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 6. Current term is 7.
I20260709 12:11:01.007807 21570 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:01.030946 18021 rpcz_store.cc:276] 0709 12:10:59.260757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:59.261211 (+   454us) service_pool.cc:224] Handling call
0709 12:10:59.261477 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:10:59.261666 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:10:59.387491 (+125825us) log.cc:844] Serialized 14 byte log entry
0709 12:11:00.881035 (+1493544us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:00.909454 (+ 28419us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:00.929995 (+ 20541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.967288 (+ 37293us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:00.967406 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1398694,"prepare.queue_time_us":55568,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":1512101,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"thread_start_us":209752,"threads_started":2}
I20260709 12:11:00.972512 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:00.997324 17943 rpcz_store.cc:276] 0709 12:10:59.694326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:00.321250 (+626924us) service_pool.cc:224] Handling call
0709 12:11:00.321712 (+   462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:00.728477 (+406765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:00.951857 (+223380us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b54001fd454. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:11:00.952026 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":934187776}
I20260709 12:11:01.111554 21344 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:01.111869 17945 raft_consensus.cc:2468] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
I20260709 12:11:01.062160 21507 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:01.100769 18062 leader_election.cc:403] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:11:01.111045 17948 raft_consensus.cc:2376] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 8. Re-sending same reply.
I20260709 12:11:01.110483 18098 raft_consensus.cc:2468] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
I20260709 12:11:01.109658 21366 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:11:01.044857 21194 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:01.112380 21492 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:01.109962 18090 raft_consensus.cc:1275] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:01.110538 17946 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 11.
I20260709 12:11:01.107503 18638 raft_consensus.cc:3060] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:01.108867 21476 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:01.115006 21360 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:01.108916 21571 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:01.117995 21490 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:01.098532 21271 raft_consensus.cc:3060] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:01.145627 20977 raft_consensus.cc:697] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:01.111081 21516 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:01.053285 17947 raft_consensus.cc:2468] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 10.
I20260709 12:11:01.224644 21334 raft_consensus.cc:493] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.225227 21401 raft_consensus.cc:493] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.225939 21368 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:01.224670 18643 raft_consensus.cc:1240] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:01.226914 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:01.227869 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:01.225224 21461 raft_consensus.cc:493] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:01.280869 21461 raft_consensus.cc:515] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:01.255719 21219 raft_consensus.cc:2749] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123) with higher term. Message: Invalid argument: T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for earlier term 9. Current term is 10.
I20260709 12:11:01.283104 21461 leader_election.cc:290] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:01.283262 20977 consensus_queue.cc:237] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:01.284067 21570 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:01.228381 18016 raft_consensus.cc:1275] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:01.229489 18024 raft_consensus.cc:1240] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:01.163393 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 315029us
I20260709 12:11:01.242417 17845 catalog_manager.cc:5697] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 5 to 6, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 6 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
W20260709 12:11:01.256448 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.258749 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:01.258876 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
W20260709 12:11:01.259114 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 277736us
I20260709 12:11:01.260560 21344 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:01.261405 18635 raft_consensus.cc:1275] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:01.263057 21492 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:01.222180 21535 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:01.273399 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:01.300442 18637 raft_consensus.cc:2410] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:11:01.300886 20698 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:01.277200 21334 raft_consensus.cc:515] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:01.277396 21401 raft_consensus.cc:515] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:01.278431 21368 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:01.274849 18022 raft_consensus.cc:2468] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 9.
I20260709 12:11:01.280287 18018 raft_consensus.cc:2393] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 8: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:01.280203 21476 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:01.252595 21319 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.286515 18640 raft_consensus.cc:2468] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:11:01.301715 18021 raft_consensus.cc:1275] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:01.301632 21244 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:01.322180 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 56099.5us
I20260709 12:11:01.330255 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:01.328451 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:01.332351 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:01.332995 18091 raft_consensus.cc:3060] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:01.301532 20698 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:01.334791 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:01.335000 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:01.336385 18092 raft_consensus.cc:3060] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:01.336658 18090 raft_consensus.cc:2393] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 9: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:01.319336 21319 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:01.331032 18089 raft_consensus.cc:2468] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 6.
I20260709 12:11:01.339777 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:01.341988 18089 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:01.321600 21471 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:01.326072 21366 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123)
I20260709 12:11:01.331202 21039 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.298357 21507 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:01.350696 18098 raft_consensus.cc:1275] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:11:01.353642 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:01.357585 21578 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.357717 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:01.358120 21578 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:01.360267 21578 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:01.368155 21334 leader_election.cc:290] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:01.370685 18092 raft_consensus.cc:2468] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 9.
I20260709 12:11:01.366556 18638 raft_consensus.cc:2468] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
I20260709 12:11:01.377315 17945 raft_consensus.cc:2468] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 6.
I20260709 12:11:01.379580 18091 raft_consensus.cc:2468] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
I20260709 12:11:01.380679 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:01.381283 17947 raft_consensus.cc:3060] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:01.383771 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:01.385151 18640 raft_consensus.cc:1275] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:01.350396 21476 raft_consensus.cc:493] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:01.387872 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:01.382337 18609 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:01.397650 17845 catalog_manager.cc:5697] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:01.388507 17945 raft_consensus.cc:2468] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 8.
I20260709 12:11:01.402837 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:01.347649 21244 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:01.406700 18062 leader_election.cc:304] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:01.370802 21039 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:11:01.410524 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:01.353799 21471 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:11:01.400313 17845 catalog_manager.cc:5697] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:01.424409 17988 leader_election.cc:304] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:01.427450 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:01.428231 17945 raft_consensus.cc:3060] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:01.447300 17947 raft_consensus.cc:2468] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
I20260709 12:11:01.451468 17845 catalog_manager.cc:5697] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:01.439201 21219 raft_consensus.cc:2749] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:01.452955 17989 leader_election.cc:304] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:01.453306 17845 catalog_manager.cc:5697] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 5 to 7, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 7 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
W20260709 12:11:01.454766 17913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.455030 21579 raft_consensus.cc:2804] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:01.455426 21579 raft_consensus.cc:493] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.455901 21579 raft_consensus.cc:3060] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:01.455937 21085 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:01.457758 21368 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:01.423796 21442 consensus_queue.cc:1048] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.040s
W20260709 12:11:01.461042 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 84870.5us
I20260709 12:11:01.455348 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:01.461972 17943 raft_consensus.cc:3060] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:01.462205 18609 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:01.463264 18609 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:01.463321 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:01.464128 18640 raft_consensus.cc:2393] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 6: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:11:01.464450 18641 raft_consensus.cc:1275] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:01.465161 21039 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:01.465397 18638 raft_consensus.cc:1240] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:11:01.465893 21569 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:01.466290 21535 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:01.466427 21569 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:01.466907 21535 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:01.467657 21389 raft_consensus.cc:2804] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:01.468036 21389 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:01.468433 21389 raft_consensus.cc:3060] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:01.468494 21569 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:01.468794 21535 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:01.469333 21535 raft_consensus.cc:2804] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:11:01.470377 21582 log.cc:927] Time spent T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:11:01.470304 21535 raft_consensus.cc:697] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:01.470992 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:01.484407 18642 raft_consensus.cc:2468] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:11:01.471153 17989 leader_election.cc:304] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:01.471812 21490 raft_consensus.cc:2749] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:01.461990 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 60794.8us
I20260709 12:11:01.469132 21569 consensus_queue.cc:1048] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:01.475008 18609 leader_election.cc:304] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:01.383097 21483 consensus_queue.cc:1048] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:11:01.514252 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:01.515107 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:11:01.506889 21574 log.cc:927] Time spent T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:11:01.507016 18608 leader_election.cc:304] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:01.515822 18644 raft_consensus.cc:2468] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
W20260709 12:11:01.513988 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 55580.2us
I20260709 12:11:01.520249 17943 raft_consensus.cc:2468] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
I20260709 12:11:01.523533 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:01.524291 18638 raft_consensus.cc:2368] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 6. Current term is 7.
I20260709 12:11:01.524061 17845 catalog_manager.cc:5697] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } }
I20260709 12:11:01.525041 17912 leader_election.cc:400] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Vote denied by peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647) with higher term. Message: Invalid argument: T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 6. Current term is 7.
I20260709 12:11:01.525367 17912 leader_election.cc:403] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:01.527869 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:01.528920 18092 raft_consensus.cc:1275] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:01.531241 18608 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:01.532701 18608 leader_election.cc:304] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:01.534444 18090 raft_consensus.cc:1275] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:01.533169 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:01.539382 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:01.539958 18097 raft_consensus.cc:2468] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
I20260709 12:11:01.537334 18098 raft_consensus.cc:2468] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 6.
I20260709 12:11:01.542868 18608 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:01.536123 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:11:01.545193 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 138599us
I20260709 12:11:01.424144 21476 raft_consensus.cc:515] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:01.544989 18024 raft_consensus.cc:2468] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 7.
I20260709 12:11:01.546545 17845 catalog_manager.cc:5697] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 6 to 10, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 10 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:01.518770 21085 raft_consensus.cc:2749] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:01.520602 21368 raft_consensus.cc:2804] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:01.523367 21516 raft_consensus.cc:2804] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:01.551646 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:01.554193 18608 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:01.567010 21516 raft_consensus.cc:697] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:01.567224 18091 raft_consensus.cc:2468] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 7.
I20260709 12:11:01.568081 21516 consensus_queue.cc:237] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:01.568593 21564 raft_consensus.cc:2804] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:01.569326 21564 raft_consensus.cc:697] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:01.523728 21162 raft_consensus.cc:2749] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:01.558797 18062 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:11:01.518811 21039 consensus_queue.cc:1059] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:11:01.533288 21544 consensus_queue.cc:1048] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:11:01.519078 21271 consensus_queue.cc:1048] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:11:01.540932 21438 raft_consensus.cc:2804] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:01.608183 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:01.609366 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:11:01.609974 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 64171.5us
I20260709 12:11:01.609196 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:01.555753 21368 raft_consensus.cc:493] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.613652 21368 raft_consensus.cc:3060] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:01.614184 17846 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40276 (request call id 254) took 18780 ms (client timeout 15000 ms). Trace:
I20260709 12:11:01.624753 21571 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:01.618904 17846 rpcz_store.cc:269] 0709 12:10:42.736552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:42.736802 (+   250us) service_pool.cc:224] Handling call
0709 12:11:01.510702 (+18773900us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:10:55.278966 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:10:55.279562 (+   596us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:10:55.279614 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:10:55.279635 (+    21us) tablet.cc:662] Decoding operations
0709 12:10:55.429039 (+149404us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:10:55.432593 (+  3554us) write_op.cc:641] Partition lock acquired for write op
0709 12:10:55.434358 (+  1765us) tablet.cc:685] Acquiring locks for 20 operations
0709 12:10:55.875106 (+440748us) tablet.cc:701] Row locks acquired
0709 12:10:55.876044 (+   938us) write_op.cc:260] PREPARE: finished
0709 12:10:55.899467 (+ 23423us) write_op.cc:270] Start()
0709 12:10:55.923746 (+ 24279us) write_op.cc:276] Timestamp: P: 1783599055892459 usec, L: 0
0709 12:10:55.926771 (+  3025us) op_driver.cc:348] REPLICATION: starting
0709 12:10:56.238874 (+312103us) log.cc:844] Serialized 7877 byte log entry
0709 12:10:56.645883 (+407009us) op_driver.cc:464] REPLICATION: finished
0709 12:10:56.890957 (+245074us) write_op.cc:301] APPLY: starting
0709 12:10:56.896906 (+  5949us) tablet.cc:1367] starting BulkCheckPresence
0709 12:10:56.963849 (+ 66943us) tablet.cc:1370] finished BulkCheckPresence
0709 12:10:56.963981 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:10:57.008459 (+ 44478us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:10:57.008930 (+   471us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=20
0709 12:10:57.008998 (+    68us) write_op.cc:312] APPLY: finished
0709 12:10:57.009533 (+   535us) log.cc:844] Serialized 139 byte log entry
0709 12:10:57.009742 (+   209us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:57.009969 (+   227us) write_op.cc:454] Released schema lock
0709 12:10:57.010043 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 12:10:57.010614 (+   571us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:10:57.038468 (+ 27854us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5040937,"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":204896,"apply.run_cpu_time_us":6110,"apply.run_wall_time_us":130088,"num_ops":20,"prepare.queue_time_us":273582,"prepare.run_cpu_time_us":37108,"prepare.run_wall_time_us":1084513,"raft.queue_time_us":125231,"raft.run_cpu_time_us":12793,"raft.run_wall_time_us":118606,"replication_time_us":718962,"thread_start_us":546738,"threads_started":4,"wal-append.queue_time_us":167345,"wal-append.run_cpu_time_us":15656,"wal-append.run_wall_time_us":1599477}]]}
I20260709 12:11:01.625705 20698 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:01.629673 18024 raft_consensus.cc:1275] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:01.527210 21366 consensus_queue.cc:1048] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 12:11:01.632118 21507 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:01.632740 21401 leader_election.cc:290] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:01.632855 21368 raft_consensus.cc:515] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:01.638654 21476 leader_election.cc:290] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:01.643474 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:01.644568 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:01.646023 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:01.659198 18016 raft_consensus.cc:3060] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:01.659909 18609 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:01.660924 21569 raft_consensus.cc:2804] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:01.661305 21569 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:01.661701 21569 raft_consensus.cc:3060] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:01.661912 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:01.646054 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:01.662808 21575 consensus_queue.cc:1048] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:01.551216 21563 raft_consensus.cc:2749] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:01.663384 21162 consensus_queue.cc:1048] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:01.646939 21442 raft_consensus.cc:2804] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:01.664350 21442 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.664822 21442 raft_consensus.cc:3060] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:01.610714 21438 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.650995 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:01.652959 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:01.571755 21321 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.528607 21535 consensus_queue.cc:237] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:01.668120 17845 catalog_manager.cc:5697] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:01.662533 18021 raft_consensus.cc:2468] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 9.
I20260709 12:11:01.608928 18093 raft_consensus.cc:2468] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
I20260709 12:11:01.544535 21435 raft_consensus.cc:2804] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:01.558538 21508 raft_consensus.cc:2749] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647) with higher term. Message: Invalid argument: T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 6. Current term is 7.
I20260709 12:11:01.689932 17988 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:01.695660 18062 leader_election.cc:304] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:01.705323 17945 raft_consensus.cc:2468] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
I20260709 12:11:01.702937 17845 catalog_manager.cc:5697] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } }
I20260709 12:11:01.673655 18089 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 12.
I20260709 12:11:01.540529 21565 consensus_queue.cc:1059] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.138s
W20260709 12:11:01.708451 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 61808.7us
I20260709 12:11:01.743640 18609 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:01.709591 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:11:01.744243 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 225711us
I20260709 12:11:01.667014 21039 consensus_queue.cc:1243] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer e28f77912a9c4ba2b9841f6fedddc2db log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:01.716987 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:01.731034 21368 leader_election.cc:290] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:01.689141 21438 raft_consensus.cc:3060] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:01.737242 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:01.739918 18016 raft_consensus.cc:2468] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 10.
I20260709 12:11:01.704295 21435 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.745945 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:11:01.756631 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:01.701059 21321 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:01.776683 18642 raft_consensus.cc:1240] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:01.711319 21389 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:01.773835 17845 catalog_manager.cc:5697] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:01.775514 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:01.789847 18641 raft_consensus.cc:1275] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:01.758937 21085 raft_consensus.cc:2804] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:01.791234 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:01.749672 21483 raft_consensus.cc:2764] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 12:11:01.795143 18643 raft_consensus.cc:2468] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 7.
I20260709 12:11:01.758136 21039 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.758596 21435 raft_consensus.cc:3060] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:01.803387 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:01.807299 18089 raft_consensus.cc:1240] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 11. Current term is 12. Ops: [9.9-11.10]
I20260709 12:11:01.811544 17845 catalog_manager.cc:5697] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 4 to 6, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 6 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } }
I20260709 12:11:01.780380 21349 raft_consensus.cc:2749] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:01.814672 21039 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:11:01.831717 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 221599us
I20260709 12:11:01.857950 21039 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:11:01.860028 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 249417us
I20260709 12:11:01.570505 21564 consensus_queue.cc:237] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:01.813472 21085 raft_consensus.cc:697] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 12 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:01.878788 18062 leader_election.cc:304] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:11:01.885721 17845 catalog_manager.cc:5697] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:01.858038 21511 raft_consensus.cc:3055] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:01.905552 17845 catalog_manager.cc:5697] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:01.910821 17988 leader_election.cc:304] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:01.919857 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:01.901377 21511 raft_consensus.cc:740] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:01.902598 21334 raft_consensus.cc:2804] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:01.928781 17845 catalog_manager.cc:5697] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 2 to 5, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 5 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:01.939652 17989 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:01.948834 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:01.949647 18091 raft_consensus.cc:3060] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:01.953986 17989 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:11:01.957029 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 48886.1us
I20260709 12:11:01.944896 21334 raft_consensus.cc:493] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:01.961939 17845 catalog_manager.cc:5697] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 3 to 4, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 4 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:01.970160 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 416052us
I20260709 12:11:01.953881 21366 raft_consensus.cc:2804] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:01.955411 21349 raft_consensus.cc:2804] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:11:01.981400 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 77992.5us
I20260709 12:11:02.004648 18089 raft_consensus.cc:1275] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:11:01.923921 21085 consensus_queue.cc:237] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:01.973660 21334 raft_consensus.cc:3060] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:02.012208 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 54262.3us
I20260709 12:11:02.011739 17845 catalog_manager.cc:5697] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 5 to 6, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 6 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } }
I20260709 12:11:01.980293 21366 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:01.980577 20698 raft_consensus.cc:2804] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:01.983843 20882 raft_consensus.cc:493] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:01.985530 21349 raft_consensus.cc:493] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:02.010444 21544 raft_consensus.cc:493] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:02.053449 18091 raft_consensus.cc:2468] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 10.
W20260709 12:11:02.060240 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 53588.5us
I20260709 12:11:02.061601 17987 leader_election.cc:400] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Vote denied by peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647) with higher term. Message: Invalid argument: T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 6. Current term is 7.
I20260709 12:11:02.061902 17987 leader_election.cc:403] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:02.013921 21321 leader_election.cc:290] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:01.985795 21571 consensus_queue.cc:1048] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:11:02.065431 17845 catalog_manager.cc:5697] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 3 to 6, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 6 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } }
I20260709 12:11:02.025876 20698 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.030687 21366 raft_consensus.cc:3060] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:02.014016 21507 raft_consensus.cc:493] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
W20260709 12:11:02.072494 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 60526.4us
I20260709 12:11:02.054003 21349 raft_consensus.cc:3060] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.006413 21476 consensus_queue.cc:1059] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 12:11:02.080848 18062 leader_election.cc:304] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:02.028618 21575 consensus_queue.cc:1048] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 12:11:01.985157 21511 consensus_queue.cc:260] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:02.076831 20698 raft_consensus.cc:3060] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:02.078564 21244 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:02.109283 17988 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:02.071223 21596 raft_consensus.cc:493] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:02.064630 20882 raft_consensus.cc:515] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:02.088610 21599 raft_consensus.cc:493] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
W20260709 12:11:02.108775 21584 log.cc:927] Time spent T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
I20260709 12:11:02.068650 21544 raft_consensus.cc:515] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:02.130103 21599 raft_consensus.cc:515] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:11:02.132805 18061 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.046s	sys 0.076s
W20260709 12:11:02.139734 18061 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.048s	sys 0.077s
W20260709 12:11:02.140152 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 691779us
W20260709 12:11:02.140509 21587 log.cc:927] Time spent T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
W20260709 12:11:02.148439 21588 log.cc:927] Time spent T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:11:02.148976 21596 raft_consensus.cc:515] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:02.116791 21244 raft_consensus.cc:493] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:02.151311 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.151608 21596 leader_election.cc:290] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:02.151250 21244 raft_consensus.cc:515] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:02.152702 21589 log.cc:927] Time spent T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 12:11:02.153962 21244 leader_election.cc:290] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:02.111593 21507 raft_consensus.cc:515] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:02.163292 21507 leader_election.cc:290] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:11:02.115188 21319 consensus_meta.cc:287] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.756s	user 0.010s	sys 0.002s
I20260709 12:11:02.105082 21581 raft_consensus.cc:3055] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:02.171557 21581 raft_consensus.cc:740] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:02.172622 21581 consensus_queue.cc:260] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:02.173957 21571 raft_consensus.cc:2749] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:02.128494 21476 raft_consensus.cc:3060] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 7
W20260709 12:11:02.138728 21586 log.cc:927] Time spent T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
W20260709 12:11:02.217585 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 275954us
I20260709 12:11:02.139268 21511 raft_consensus.cc:3060] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:02.220793 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 204809us
I20260709 12:11:02.242080 17912 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
W20260709 12:11:02.247324 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 233631us
I20260709 12:11:02.205116 21368 raft_consensus.cc:3055] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:11:02.255321 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 113087us
I20260709 12:11:02.167798 21442 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:02.180735 21319 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:02.308707 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:02.309484 18641 raft_consensus.cc:2468] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
I20260709 12:11:02.253225 21596 raft_consensus.cc:2804] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:02.319702 18093 raft_consensus.cc:1240] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:11:02.320652 18061 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
W20260709 12:11:02.322237 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 260764us
W20260709 12:11:02.322515 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 63084.4us
I20260709 12:11:02.224623 21435 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:02.256083 21368 raft_consensus.cc:740] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
W20260709 12:11:02.328202 17913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.249222 21244 consensus_queue.cc:1048] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 12:11:02.327765 21039 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.324101 21596 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:02.253918 21592 consensus_queue.cc:1059] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.093s
I20260709 12:11:02.334295 21571 raft_consensus.cc:493] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.353916 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:11:02.343051 21579 consensus_meta.cc:287] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.887s	user 0.012s	sys 0.000s
I20260709 12:11:02.357443 21368 consensus_queue.cc:260] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:02.359532 21594 log.cc:927] Time spent T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:11:02.360442 21544 leader_election.cc:290] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:02.363376 21590 raft_consensus.cc:2749] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:02.363736 21039 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:02.364454 21596 raft_consensus.cc:3060] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:02.344089 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 307398us
I20260709 12:11:02.357458 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:02.394091 18641 raft_consensus.cc:1275] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 7 index: 10. Preceding OpId from leader: term: 8 index: 11. (index mismatch)
W20260709 12:11:02.350011 21569 consensus_meta.cc:287] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.686s	user 0.004s	sys 0.008s
I20260709 12:11:02.396979 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:02.343386 20977 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:02.341717 21507 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:02.394605 17989 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:11:02.400915 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 320126us
I20260709 12:11:02.382311 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:11:02.395895 21438 consensus_meta.cc:287] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.614s	user 0.010s	sys 0.002s
I20260709 12:11:02.403327 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:11:02.405779 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 85205.1us
I20260709 12:11:02.419797 17989 leader_election.cc:304] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:02.402295 18637 raft_consensus.cc:2468] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 7.
I20260709 12:11:02.419112 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:02.422988 18641 raft_consensus.cc:2468] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
I20260709 12:11:02.381199 21571 raft_consensus.cc:515] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:02.417191 21368 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:02.403339 20977 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:02.381631 21579 raft_consensus.cc:515] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:02.444401 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:02.437248 18023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 2142) took 1143 ms. Trace:
W20260709 12:11:02.445376 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 342552us
I20260709 12:11:02.400131 21569 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:02.444263 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:02.431896 21618 raft_consensus.cc:2804] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:02.407012 21590 consensus_queue.cc:1048] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:11:02.430729 21490 raft_consensus.cc:2804] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:02.444196 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:02.411230 21438 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:02.453495 18062 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:02.454231 18094 raft_consensus.cc:2393] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 8: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:02.455029 18641 raft_consensus.cc:2393] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 10: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:02.457011 21435 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:02.458550 20977 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:02.458724 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:02.437417 20882 leader_election.cc:290] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:02.444123 21615 raft_consensus.cc:493] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:02.417263 21507 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:02.445354 18023 rpcz_store.cc:276] 0709 12:11:01.228469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.228675 (+   206us) service_pool.cc:224] Handling call
0709 12:11:01.229177 (+   502us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:01.281027 (+ 51850us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:01.281054 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:01.281741 (+   687us) log.cc:844] Serialized 52 byte log entry
0709 12:11:01.517432 (+235691us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:01.517471 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:01.616537 (+ 99066us) spinlock_profiling.cc:243] Waited 44.4 ms on lock 0x7b54000b3954. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:11:01.616589 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:02.349178 (+732589us) raft_consensus.cc:1685] finished
0709 12:11:02.349197 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:02.371376 (+ 22179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2733,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":114,"spinlock_wait_cycles":102119936,"thread_start_us":235279,"threads_started":1,"wal-append.queue_time_us":518096}
I20260709 12:11:02.453966 21617 raft_consensus.cc:2804] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:02.451785 21618 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.472177 18638 raft_consensus.cc:1240] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:02.451355 21599 leader_election.cc:290] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:02.474327 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:02.478454 17988 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:02.485291 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:02.485994 18637 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 11.
I20260709 12:11:02.489763 17912 leader_election.cc:304] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:02.475060 21617 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.505682 21571 leader_election.cc:290] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:02.506120 21626 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:02.515425 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 70662.2us
I20260709 12:11:02.477974 21442 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:02.516547 18062 leader_election.cc:400] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123) with higher term. Message: Invalid argument: T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for earlier term 9. Current term is 10.
I20260709 12:11:02.507694 21438 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:02.518267 18091 raft_consensus.cc:1275] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:02.527551 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:02.499293 21623 consensus_queue.cc:1048] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
W20260709 12:11:02.519183 21614 log.cc:927] Time spent T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:11:02.478785 21615 raft_consensus.cc:515] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:02.525280 21606 raft_consensus.cc:493] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:02.481274 21618 raft_consensus.cc:3060] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:02.502163 21592 raft_consensus.cc:2804] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:02.515153 21617 raft_consensus.cc:3060] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:02.542805 21039 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:02.564508 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:02.551426 21592 raft_consensus.cc:493] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.549132 21471 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:02.535132 21334 raft_consensus.cc:515] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:02.588534 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:02.589421 17945 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 11.
I20260709 12:11:02.580343 21592 raft_consensus.cc:3060] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.592001 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:02.596619 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:02.550280 21606 raft_consensus.cc:515] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:02.570020 21490 raft_consensus.cc:697] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:02.635046 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:02.635643 18640 raft_consensus.cc:3060] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:11:02.584378 21610 raft_consensus.cc:2749] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:02.634747 21349 consensus_meta.cc:287] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.544s	user 0.010s	sys 0.001s
I20260709 12:11:02.643833 17943 raft_consensus.cc:1275] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 12:11:02.641999 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 175940us
I20260709 12:11:02.645323 21349 raft_consensus.cc:515] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:11:02.647174 21602 log.cc:927] Time spent T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:11:02.641506 18062 leader_election.cc:304] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:11:02.592658 21366 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:02.663909 21490 consensus_queue.cc:237] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:02.661695 21483 consensus_queue.cc:1059] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.006s
W20260709 12:11:02.661142 20698 consensus_meta.cc:287] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.541s	user 0.008s	sys 0.003s
I20260709 12:11:02.668514 21483 raft_consensus.cc:3055] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:02.668905 21483 raft_consensus.cc:740] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:02.668699 20698 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:02.669759 21483 consensus_queue.cc:260] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:02.661810 21442 raft_consensus.cc:2804] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:02.671144 21442 raft_consensus.cc:493] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:02.671276 21334 leader_election.cc:290] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:02.671530 21442 raft_consensus.cc:3060] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:02.672190 18062 leader_election.cc:304] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:02.673790 21622 raft_consensus.cc:2764] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 12:11:02.677804 21596 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:02.678665 21622 consensus_queue.cc:1048] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:11:02.679394 21631 log.cc:927] Time spent T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:11:02.681928 18062 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:02.683645 21622 raft_consensus.cc:2749] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:02.633868 21623 consensus_queue.cc:1048] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:11:02.688081 17988 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:02.692595 17943 raft_consensus.cc:1275] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:02.693645 17941 raft_consensus.cc:3060] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:02.697741 17945 raft_consensus.cc:2393] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 8: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:02.666500 21476 raft_consensus.cc:2749] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647) with higher term. Message: Invalid argument: T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 6. Current term is 7.
I20260709 12:11:02.701611 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:02.718905 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:02.719513 17946 raft_consensus.cc:2468] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:11:02.724115 17947 raft_consensus.cc:2468] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 8.
I20260709 12:11:02.701501 21483 raft_consensus.cc:3060] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:02.730621 17988 leader_election.cc:304] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:02.734942 21368 raft_consensus.cc:2804] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:02.735497 21368 raft_consensus.cc:493] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:02.735961 21368 raft_consensus.cc:3060] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:02.737560 21442 raft_consensus.cc:515] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:02.742621 17988 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:02.744158 21641 raft_consensus.cc:2749] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:02.744719 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:02.748381 21622 consensus_queue.cc:1048] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:02.745388 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:02.746028 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:02.749948 18020 raft_consensus.cc:2468] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 8.
I20260709 12:11:02.746903 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:02.747633 21389 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:02.747872 17988 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:02.748148 18061 leader_election.cc:304] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:02.700717 20698 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:02.751611 18017 raft_consensus.cc:1275] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:11:02.754246 18062 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.751966 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
W20260709 12:11:02.756847 18062 connection.cc:256] RPC call timeout handler was delayed by -1.7322680169997966s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16110000000000002s for a response
I20260709 12:11:02.757104 18021 raft_consensus.cc:3060] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:02.703337 17940 raft_consensus.cc:1275] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:11:02.757707 18062 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:02.754196 17988 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
W20260709 12:11:02.758271 18062 connection.cc:256] RPC call timeout handler was delayed by -1.3893680169999243s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19920000000000002s for a response
I20260709 12:11:02.750969 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:11:02.758772 18062 connection.cc:256] RPC call timeout handler was delayed by -1.3105515679999371s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 12:11:02.759739 18062 connection.cc:256] RPC call timeout handler was delayed by -1.211021626000047s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1995s for a response
W20260709 12:11:02.760066 18062 connection.cc:256] RPC call timeout handler was delayed by -1.151621625999951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2061s for a response
I20260709 12:11:02.717093 21612 raft_consensus.cc:2749] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:02.769163 21511 consensus_meta.cc:287] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.522s	user 0.005s	sys 0.005s
I20260709 12:11:02.772962 17945 raft_consensus.cc:1240] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:11:02.773818 18018 raft_consensus.cc:2468] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:11:02.774039 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:02.754084 21641 raft_consensus.cc:3060] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:02.775063 21616 consensus_queue.cc:1048] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:02.776496 21596 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:02.777428 17988 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:02.778266 17987 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:02.778774 18608 leader_election.cc:304] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:02.780133 18608 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:02.780146 17987 leader_election.cc:304] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:11:02.770116 17831 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 4ccf0bcc20ae40e79c32530091613e1e with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e28f77912a9c4ba2b9841f6fedddc2db is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:02.754351 21622 raft_consensus.cc:2804] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:02.782706 21389 raft_consensus.cc:2804] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:02.787230 21319 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:02.750666 21442 leader_election.cc:290] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:02.788955 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:02.811187 17945 raft_consensus.cc:3060] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.701182 21617 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:02.813946 17987 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:02.818413 21349 leader_election.cc:290] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:02.789608 21476 raft_consensus.cc:2749] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:02.820365 17949 raft_consensus.cc:1275] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:02.820698 17987 leader_election.cc:304] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:02.821127 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:02.824220 17942 raft_consensus.cc:3060] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:02.793238 21622 raft_consensus.cc:493] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.795262 21535 raft_consensus.cc:2804] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:02.834564 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 57243.8us
I20260709 12:11:02.816826 21612 raft_consensus.cc:2749] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:02.812438 21389 raft_consensus.cc:697] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:02.839746 18640 raft_consensus.cc:2468] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 10.
I20260709 12:11:02.844623 21629 consensus_queue.cc:1048] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:11:02.848296 21579 leader_election.cc:290] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:02.811928 21638 consensus_queue.cc:1059] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:11:02.853515 17945 raft_consensus.cc:2468] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 9.
I20260709 12:11:02.834571 21490 raft_consensus.cc:2749] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:02.817636 21615 leader_election.cc:290] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:02.858903 18094 raft_consensus.cc:1275] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:02.860234 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:02.860908 18608 leader_election.cc:304] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:02.810334 21544 consensus_queue.cc:1048] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:11:02.823328 20698 raft_consensus.cc:2749] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:02.790356 21592 raft_consensus.cc:515] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:02.868405 17941 raft_consensus.cc:1275] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:11:02.795609 21575 consensus_queue.cc:1048] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:11:02.831969 21622 raft_consensus.cc:3060] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:02.830600 21349 raft_consensus.cc:2749] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:02.868312 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:03.011981 17945 raft_consensus.cc:3060] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:02.873091 21643 log.cc:927] Time spent T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:11:02.876327 21569 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:11:03.023494 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 162652us
I20260709 12:11:02.882123 21507 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:02.885829 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 46712.5us
I20260709 12:11:02.893429 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:03.039472 18090 raft_consensus.cc:2368] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 6. Current term is 7.
I20260709 12:11:02.908591 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:02.836220 21535 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:02.816542 21635 consensus_queue.cc:1059] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.093s
I20260709 12:11:02.825256 21319 consensus_queue.cc:1048] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:11:02.873812 21579 consensus_queue.cc:1048] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:11:03.003618 17913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.003712 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:02.888733 21389 consensus_queue.cc:237] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:03.042537 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:03.014744 17942 raft_consensus.cc:2468] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
I20260709 12:11:03.015255 18021 raft_consensus.cc:2468] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 10.
W20260709 12:11:03.046037 17912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.016546 17988 leader_election.cc:304] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:03.029814 17987 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:03.040129 17941 raft_consensus.cc:3060] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:03.007313 21321 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.060814 18093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53954 (request call id 2256) took 1174 ms. Trace:
I20260709 12:11:03.057850 18643 raft_consensus.cc:2468] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 7.
W20260709 12:11:03.062018 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:03.061242 18093 rpcz_store.cc:276] 0709 12:11:01.872475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:01.872655 (+   180us) service_pool.cc:224] Handling call
0709 12:11:01.873024 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:02.324796 (+451772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.046279 (+721483us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b5400337a54. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:11:03.046447 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1006435712}
I20260709 12:11:03.019111 21244 raft_consensus.cc:3055] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:03.071692 18608 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:03.072100 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:03.079315 21321 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:03.055033 21626 raft_consensus.cc:2749] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:03.112967 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 44357.1us
I20260709 12:11:03.113029 18641 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 11.
W20260709 12:11:03.114114 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 47403.8us
I20260709 12:11:03.116241 18091 raft_consensus.cc:1240] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:03.082906 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:03.119978 18091 raft_consensus.cc:1240] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:03.120251 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:03.120420 17945 raft_consensus.cc:2468] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 10.
I20260709 12:11:03.121029 18098 raft_consensus.cc:3060] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:03.123503 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:03.124244 18094 raft_consensus.cc:3060] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:03.057260 21535 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:03.126076 17942 raft_consensus.cc:1275] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:03.128739 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:03.130235 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
W20260709 12:11:03.130697 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 59090.1us
I20260709 12:11:03.135947 17941 raft_consensus.cc:2468] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 8.
I20260709 12:11:03.137482 17941 raft_consensus.cc:1275] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:03.061224 21271 raft_consensus.cc:2749] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:11:03.146140 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 138533us
I20260709 12:11:03.042716 20698 consensus_queue.cc:1059] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 12:11:03.152997 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:03.153653 18643 raft_consensus.cc:3060] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:11:03.072990 21591 raft_consensus.cc:2804] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:03.079558 21590 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:03.080330 21244 raft_consensus.cc:740] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
W20260709 12:11:03.174782 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 47174.5us
I20260709 12:11:03.176432 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:03.126710 21366 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:03.083542 21349 raft_consensus.cc:2749] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:03.043066 21368 raft_consensus.cc:515] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:03.129113 21606 leader_election.cc:290] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:03.055190 21618 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:03.185537 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:03.115090 21638 consensus_queue.cc:1048] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:11:03.154258 21516 raft_consensus.cc:2804] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:03.171057 17988 leader_election.cc:304] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:03.209192 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:03.131147 21626 consensus_queue.cc:1048] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:11:03.219177 18062 leader_election.cc:304] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:11:03.238003 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 78257.5us
I20260709 12:11:03.154000 21162 consensus_queue.cc:1048] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 12:11:03.241940 18024 raft_consensus.cc:2393] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 7: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
W20260709 12:11:03.248458 21644 log.cc:927] Time spent T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:11:03.249395 21628 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:03.249958 21628 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:03.250741 21620 raft_consensus.cc:2804] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:03.251188 21620 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:03.251552 21620 raft_consensus.cc:3060] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:03.252063 21618 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:03.255236 21645 log.cc:927] Time spent T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.217s	user 0.000s	sys 0.000s
W20260709 12:11:03.255875 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 84933.1us
I20260709 12:11:03.257365 17988 leader_election.cc:304] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:11:03.259163 21646 log.cc:927] Time spent T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 12:11:03.260757 18062 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:03.262722 21621 raft_consensus.cc:2749] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:03.263862 20698 consensus_queue.cc:1048] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:11:03.264261 21321 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:11:03.264842 21608 log.cc:927] Time spent T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:11:03.266007 20698 raft_consensus.cc:2749] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:03.267464 21442 consensus_queue.cc:1048] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:03.237746 21516 raft_consensus.cc:697] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:03.221987 21616 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:03.271698 17988 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:03.276006 18098 raft_consensus.cc:2468] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
I20260709 12:11:03.262734 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:03.221786 21591 raft_consensus.cc:697] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 9 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:03.236349 21617 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:03.322422 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 50813.9us
I20260709 12:11:03.323259 17988 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:03.214422 21565 consensus_queue.cc:1048] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:11:03.331667 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:03.332547 18638 raft_consensus.cc:3060] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:03.237988 21590 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:03.341807 21271 raft_consensus.cc:2804] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:03.373975 17988 leader_election.cc:304] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:03.364756 21516 consensus_queue.cc:237] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:03.282553 21610 raft_consensus.cc:2804] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:03.309594 21618 consensus_queue.cc:1059] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
W20260709 12:11:03.382369 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 191453us
I20260709 12:11:03.304620 21564 consensus_queue.cc:1048] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.092s
W20260709 12:11:03.413802 21641 consensus_meta.cc:287] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.639s	user 0.015s	sys 0.000s
I20260709 12:11:03.322901 21616 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:03.505833 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 243528us
I20260709 12:11:03.430016 18638 raft_consensus.cc:2468] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 7.
W20260709 12:11:03.430351 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 89867.1us
I20260709 12:11:03.518324 18061 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:03.522459 18643 raft_consensus.cc:2468] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
I20260709 12:11:03.417634 21271 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:03.419034 21579 raft_consensus.cc:2804] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:03.428658 21592 leader_election.cc:290] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:03.431360 21648 log.cc:927] Time spent T 00000000000000000000000000000000 P b852ae4791e4401b8356c71ae33bbc7d: Append to log took a long time: real 0.210s	user 0.001s	sys 0.003s
W20260709 12:11:03.529580 21650 log.cc:927] Time spent T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:11:03.528522 21271 raft_consensus.cc:3060] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:03.502249 21618 consensus_queue.cc:1059] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:11:03.467571 21610 raft_consensus.cc:697] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:03.428951 21564 consensus_queue.cc:1243] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer 63f5bddeebd84e5788d671a176cfa8e1 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:03.450765 20698 raft_consensus.cc:2749] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:03.525507 21641 raft_consensus.cc:2749] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:03.481983 21578 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:03.541142 18637 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.009s	sys 0.005s
I20260709 12:11:03.528647 21368 leader_election.cc:290] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:03.536939 21579 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:03.549321 18637 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.009s	sys 0.005s
I20260709 12:11:03.564210 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:11:03.539048 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 369083us
I20260709 12:11:03.544015 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:03.531071 21616 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:03.568022 18094 raft_consensus.cc:2468] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:11:03.587088 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:03.587745 18609 leader_election.cc:400] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 election: Vote denied by peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931) with higher term. Message: Invalid argument: T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 6. Current term is 7.
I20260709 12:11:03.596515 18609 leader_election.cc:403] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:11:03.591123 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:03.590273 18017 raft_consensus.cc:1275] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:11:03.551334 21579 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:03.611584 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:03.610987 18020 raft_consensus.cc:2368] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 7. Current term is 8.
I20260709 12:11:03.542215 21591 consensus_queue.cc:237] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:03.562373 21617 raft_consensus.cc:2804] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:11:03.822191 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 301462us
I20260709 12:11:03.649782 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:03.652653 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:03.617944 18018 raft_consensus.cc:2368] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 6. Current term is 7.
W20260709 12:11:03.710855 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 287668us
I20260709 12:11:03.661603 18639 raft_consensus.cc:1275] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:03.621819 17987 leader_election.cc:304] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:03.903960 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
W20260709 12:11:03.663569 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 57876.1us
I20260709 12:11:03.827080 18637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60424 (request call id 987) took 1127 ms. Trace:
I20260709 12:11:03.912451 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:03.892345 18023 raft_consensus.cc:2468] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
I20260709 12:11:03.916745 18015 raft_consensus.cc:2410] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:03.909749 18017 raft_consensus.cc:2468] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
W20260709 12:11:03.917493 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 295741us
W20260709 12:11:03.623297 21662 log.cc:927] Time spent T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 12:11:03.618606 21657 log.cc:927] Time spent T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:11:03.604269 21483 raft_consensus.cc:2764] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:11:03.624464 21590 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:03.997992 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:11:03.903326 21535 consensus_meta.cc:287] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.755s	user 0.007s	sys 0.007s
W20260709 12:11:03.888494 21599 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.003s	sys 0.017s
W20260709 12:11:03.863535 21622 consensus_meta.cc:287] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.809s	user 0.008s	sys 0.003s
I20260709 12:11:03.998759 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:03.617923 21661 raft_consensus.cc:3055] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:03.560740 21578 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:03.697551 21620 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:04.040328 21671 consensus_queue.cc:1059] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:04.041406 18016 raft_consensus.cc:2393] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 6: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:04.041504 21578 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:11:03.914830 21649 log.cc:927] Time spent T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.573s	user 0.003s	sys 0.000s
I20260709 12:11:04.042750 21366 raft_consensus.cc:3055] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:04.043160 21366 raft_consensus.cc:740] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:04.044390 17943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44668 (request call id 589) took 1326 ms. Trace:
I20260709 12:11:03.998852 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:03.999516 21617 raft_consensus.cc:697] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:03.915956 18643 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "158a286025af4eddba6fb641c128cd25"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
mode: GRACEFUL
new_leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:52812
I20260709 12:11:04.001055 21581 raft_consensus.cc:3060] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:04.044023 21366 consensus_queue.cc:260] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:04.003887 20698 raft_consensus.cc:2804] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:04.023300 17987 leader_election.cc:304] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:03.801914 21244 consensus_queue.cc:260] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:04.026863 18640 raft_consensus.cc:1240] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:04.025803 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:04.026487 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:04.035202 18062 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:04.037371 18023 raft_consensus.cc:2393] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 7: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:04.032691 18015 raft_consensus.cc:2468] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 11.
I20260709 12:11:03.611840 21660 raft_consensus.cc:2749] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931) with higher term. Message: Invalid argument: T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 6. Current term is 7.
I20260709 12:11:03.911966 18637 rpcz_store.cc:276] 0709 12:11:02.699740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.699871 (+   131us) service_pool.cc:224] Handling call
0709 12:11:02.718951 (+ 19080us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:02.719305 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:02.719329 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:02.778254 (+ 58925us) log.cc:844] Serialized 564 byte log entry
0709 12:11:03.551316 (+773062us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:03.551377 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.567138 (+ 15761us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:03.826829 (+259691us) raft_consensus.cc:1685] finished
0709 12:11:03.826849 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:03.826985 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":725485,"threads_started":1,"wal-append.queue_time_us":887271}
I20260709 12:11:04.001947 21368 consensus_queue.cc:1059] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.093s
I20260709 12:11:03.650959 21610 consensus_queue.cc:237] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:04.100977 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:04.132169 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:11:04.116819 17912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.155989 17942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44668 (request call id 599) took 1010 ms. Trace:
I20260709 12:11:04.094209 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:04.153306 18093 raft_consensus.cc:1275] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:04.564144 18016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45464 (request call id 1947) took 1014 ms. Trace:
I20260709 12:11:04.155565 17946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2232) took 1288 ms. Trace:
I20260709 12:11:04.526624 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:04.626137 18021 raft_consensus.cc:2468] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 9.
I20260709 12:11:04.626737 18021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45464 (request call id 1959) took 1036 ms. Trace:
I20260709 12:11:04.627099 18021 rpcz_store.cc:276] 0709 12:11:03.590491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.100734 (+510243us) service_pool.cc:224] Handling call
0709 12:11:04.626684 (+525950us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:04.044976 17947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2237) took 1176 ms. Trace:
I20260709 12:11:04.154551 17949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2234) took 1286 ms. Trace:
W20260709 12:11:04.473136 17988 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:53022 dropped due to backpressure: service queue is full with 50 items
I20260709 12:11:04.069618 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:04.634742 18091 raft_consensus.cc:2468] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 10.
I20260709 12:11:04.627964 17947 rpcz_store.cc:276] 0709 12:11:02.868820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.048231 (+179411us) service_pool.cc:224] Handling call
0709 12:11:03.071278 (+ 23047us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:03.071586 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:03.071612 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:03.082742 (+ 11130us) log.cc:844] Serialized 26 byte log entry
0709 12:11:03.287601 (+204859us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:03.287662 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.287757 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:04.044781 (+757024us) raft_consensus.cc:1685] finished
0709 12:11:04.044803 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:04.044926 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8215,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":30995,"thread_start_us":138395,"threads_started":1,"wal-append.queue_time_us":294782}
I20260709 12:11:04.157608 17940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2236) took 1289 ms. Trace:
I20260709 12:11:04.624646 18016 rpcz_store.cc:276] 0709 12:11:03.541432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.547195 (+  5763us) service_pool.cc:224] Handling call
0709 12:11:04.551165 (+1003970us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b540008d9d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:04.551350 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1095628672}
I20260709 12:11:04.155148 17948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2230) took 1459 ms. Trace:
I20260709 12:11:04.621621 17942 rpcz_store.cc:276] 0709 12:11:03.145676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.148448 (+  2772us) service_pool.cc:224] Handling call
0709 12:11:03.148781 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:03.176554 (+ 27773us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:03.176585 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:03.195340 (+ 18755us) log.cc:844] Serialized 26 byte log entry
0709 12:11:03.714344 (+519004us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:03.763638 (+ 49294us) log.cc:844] Serialized 14 byte log entry
0709 12:11:04.155706 (+392068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:04.155777 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:04.155815 (+    38us) raft_consensus.cc:1685] finished
0709 12:11:04.155829 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:04.155937 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1311576,"prepare.queue_time_us":85404,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":440215,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":6904,"thread_start_us":438507,"threads_started":1,"wal-append.queue_time_us":863538}
I20260709 12:11:04.627208 18020 raft_consensus.cc:2468] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 11.
I20260709 12:11:04.617877 17943 rpcz_store.cc:276] 0709 12:11:02.718020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.730151 (+ 12131us) service_pool.cc:224] Handling call
0709 12:11:02.768380 (+ 38229us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:02.768686 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:02.768713 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:02.790291 (+ 21578us) log.cc:844] Serialized 26 byte log entry
0709 12:11:03.017936 (+227645us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:03.017977 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.018066 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:03.903355 (+885289us) spinlock_profiling.cc:243] Waited 24.8 ms on lock 0x7b4400022b4c. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f497ebc85 00007f7f497ec6a2 00007f7f4c55e1db 00007f7f4c559aaf 00007f7f4c54d86e 00007f7f4c54cbb6 00007f7f4c54c7d8 00007f7f4c556221 00007f7f4c5561d9 00007f7f4c556169
0709 12:11:04.044101 (+140746us) raft_consensus.cc:1685] finished
0709 12:11:04.044121 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:04.044316 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":152,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":7150,"spinlock_wait_cycles":56925440,"thread_start_us":182710,"threads_started":1,"wal-append.queue_time_us":388716}
I20260709 12:11:04.641990 18019 raft_consensus.cc:2410] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:11:04.649395 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:04.628075 17949 rpcz_store.cc:276] 0709 12:11:02.868140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.042065 (+173925us) service_pool.cc:224] Handling call
0709 12:11:03.079784 (+ 37719us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:03.080009 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:03.476445 (+396436us) log.cc:844] Serialized 14 byte log entry
0709 12:11:04.043517 (+567072us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b4400022b4c. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f497ebc85 00007f7f497ec6a2 00007f7f4c55e1db 00007f7f4c559aaf 00007f7f4c54d86e 00007f7f4c54cbb6 00007f7f4c54c7d8 00007f7f4c556221 00007f7f4c5561d9 00007f7f4c556169
0709 12:11:04.154226 (+110709us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:04.154285 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:04.154330 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:04.154396 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:04.154497 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":647378,"prepare.queue_time_us":268517,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":616674,"raft.run_cpu_time_us":53,"raft.run_wall_time_us":53,"spinlock_wait_cycles":6114688,"thread_start_us":393789,"threads_started":2,"wal-append.queue_time_us":345006}
W20260709 12:11:04.036872 21599 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.003s	sys 0.018s
I20260709 12:11:04.624857 17946 rpcz_store.cc:276] 0709 12:11:02.867474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.867671 (+   197us) service_pool.cc:224] Handling call
0709 12:11:03.002713 (+135042us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:03.002940 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:03.280433 (+277493us) log.cc:844] Serialized 14 byte log entry
0709 12:11:04.155131 (+874698us) log.cc:844] Serialized 14 byte log entry
0709 12:11:04.155268 (+   137us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:04.155307 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:04.155354 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:04.155418 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:04.155518 (+   100us) inbound_call.cc:177] Queueing success response
0709 12:11:04.517038 (+361520us) spinlock_profiling.cc:243] Waited 4 ms on lock 0x7b4400022b4c. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f497ebc85 00007f7f497ec6a2 00007f7f4c55e1db 00007f7f4c559aaf 00007f7f4c54d86e 00007f7f4c54cbb6 00007f7f4c54c7d8 00007f7f4c556221 00007f7f4c5561d9 00007f7f4c556169
Metrics: {"mutex_wait_us":416091,"prepare.queue_time_us":235430,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":7131,"raft.queue_time_us":418244,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":92,"spinlock_wait_cycles":9202432,"thread_start_us":700538,"threads_started":2,"wal-append.queue_time_us":632553}
W20260709 12:11:04.517680 21667 log.cc:927] Time spent T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.604s	user 0.001s	sys 0.001s
W20260709 12:11:04.044049 21672 log.cc:927] Time spent T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
W20260709 12:11:04.137884 21669 log.cc:927] Time spent T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.312s	user 0.001s	sys 0.000s
W20260709 12:11:04.099634 21271 consensus_meta.cc:287] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.565s	user 0.010s	sys 0.000s
I20260709 12:11:04.663694 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:04.041425 21620 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:04.119280 21544 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:04.672863 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:04.673350 18019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45464 (request call id 1953) took 1084 ms. Trace:
W20260709 12:11:04.675173 18094 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.000s	sys 0.009s
W20260709 12:11:04.153106 17913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:04.712920 18094 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.001s	sys 0.010s
W20260709 12:11:04.676050 17944 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.008s	sys 0.002s
W20260709 12:11:04.714494 17944 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.008s	sys 0.002s
W20260709 12:11:04.683538 21435 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.363s	user 0.007s	sys 0.010s
W20260709 12:11:04.683622 18090 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.010s	sys 0.000s
I20260709 12:11:04.133380 21401 raft_consensus.cc:3055] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:04.637181 17940 rpcz_store.cc:276] 0709 12:11:02.868606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.039860 (+171254us) service_pool.cc:224] Handling call
0709 12:11:03.066473 (+ 26613us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:03.067355 (+   882us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:03.176555 (+109200us) log.cc:844] Serialized 14 byte log entry
0709 12:11:04.154827 (+978272us) log.cc:844] Serialized 14 byte log entry
0709 12:11:04.157299 (+  2472us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:04.157360 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:04.157411 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:04.157469 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:04.157562 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":702463,"prepare.queue_time_us":172350,"prepare.run_cpu_time_us":5142,"prepare.run_wall_time_us":109044,"raft.queue_time_us":687435,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":6189,"thread_start_us":357289,"threads_started":2,"wal-append.queue_time_us":382869}
I20260709 12:11:04.686308 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:04.712809 18019 rpcz_store.cc:276] 0709 12:11:03.588712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.613711 (+ 24999us) service_pool.cc:224] Handling call
0709 12:11:04.526421 (+912710us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b5800055898. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4988db71 00007f7f4988da22 00007f7f527a68d9 00007f7f51900ee0 00007f7f519ca0ab 00007f7f519ca131 00007f7f519780a0 00007f7f51977984 00007f7f4aef26d4 00007f7f4aef2662
0709 12:11:04.673231 (+146810us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26669312}
I20260709 12:11:04.686678 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:04.446750 21621 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.693833 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:04.716960 18017 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 11.
I20260709 12:11:04.723815 18016 raft_consensus.cc:2368] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 9. Current term is 10.
I20260709 12:11:04.697944 18643 raft_consensus.cc:606] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Received request to transfer leadership to TS 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:04.106778 18024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45472 (request call id 2162) took 1362 ms. Trace:
I20260709 12:11:04.698937 18023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45464 (request call id 1968) took 1036 ms. Trace:
I20260709 12:11:04.725248 18023 rpcz_store.cc:276] 0709 12:11:03.662662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.998508 (+335846us) service_pool.cc:224] Handling call
0709 12:11:04.698891 (+700383us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:04.685292 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 662048us
I20260709 12:11:04.350581 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:04.156911 21039 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.729525 21039 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:04.417191 18608 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 1.600s (SENT) [suppressed 43 similar messages]
W20260709 12:11:04.731009 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 313861us
I20260709 12:11:04.265978 21629 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:04.731791 21629 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:04.700784 17942 raft_consensus.cc:1275] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:04.131057 21628 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:04.121207 21578 raft_consensus.cc:493] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:04.638744 17948 rpcz_store.cc:276] 0709 12:11:02.695323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.695467 (+   144us) service_pool.cc:224] Handling call
0709 12:11:02.695856 (+   389us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:02.701265 (+  5409us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:11:02.993540 (+292275us) log.cc:844] Serialized 14 byte log entry
0709 12:11:04.149023 (+1155483us) spinlock_profiling.cc:243] Waited 5.35 ms on lock 0x7b18003ebcc0. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f4983fc0a 00007f7f52f7f219 00007f7f498c7a40 00007f7f498c24e4 00007f7f498c2455 00007f7f4c9aa060 00007f7f4c9bc716 00007f7f4c9cd287 00007f7f4c9cd208
0709 12:11:04.149198 (+   175us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:04.149993 (+   795us) log.cc:844] Serialized 52 byte log entry
0709 12:11:04.150147 (+   154us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:04.150192 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:04.150256 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:04.154853 (+  4597us) raft_consensus.cc:1685] finished
0709 12:11:04.154953 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:04.155086 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45845,"prepare.queue_time_us":472716,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":964731,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":27435,"spinlock_wait_cycles":12306176,"thread_start_us":382305,"threads_started":2,"wal-append.queue_time_us":207652}
I20260709 12:11:04.448659 21673 raft_consensus.cc:493] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:04.703118 18015 raft_consensus.cc:2410] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:04.503230 21219 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:04.632349 21626 raft_consensus.cc:493] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
W20260709 12:11:04.715791 18090 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.010s	sys 0.000s
I20260709 12:11:04.039105 21661 raft_consensus.cc:740] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:04.749377 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:04.036422 21516 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:04.717559 18020 raft_consensus.cc:2368] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 5. Current term is 6.
I20260709 12:11:04.718880 21607 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
W20260709 12:11:04.718251 21678 log.cc:927] Time spent T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.711s	user 0.001s	sys 0.000s
I20260709 12:11:04.686303 20698 raft_consensus.cc:493] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:04.699779 21366 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:04.725147 18024 rpcz_store.cc:276] 0709 12:11:02.744574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.745180 (+   606us) service_pool.cc:224] Handling call
0709 12:11:04.106542 (+1361362us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b540038d454. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:04.106695 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1131670272}
I20260709 12:11:04.039304 21535 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:04.121150 21659 raft_consensus.cc:493] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
W20260709 12:11:04.698619 21671 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.009s	sys 0.002s
I20260709 12:11:04.734997 18643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:52812 (request call id 22) took 1145 ms. Trace:
I20260709 12:11:04.735050 17945 pending_rounds.cc:85] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1: Aborting all ops after (but not including) 8
I20260709 12:11:04.813988 17945 pending_rounds.cc:107] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:11:04.814253 17945 raft_consensus.cc:2889] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:04.813769 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:04.702605 21271 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:04.630129 17988 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:53022 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53022 (request call id 594)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53022 (request call id 592)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53022 (request call id 601)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53022 (request call id 597)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45464 (request call id 1974)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53022 (request call id 589)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53022 (request call id 591)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53022 (request call id 608)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45464 (request call id 1976)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45464 (request call id 1984)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45464 (request call id 1975)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53022 (request call id 590)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45464 (request call id 1982)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45464 (request call id 1965)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53022 (request call id 599)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45464 (request call id 1977)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53022 (request call id 613)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53022 (request call id 605)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45464 (request call id 1978)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53022 (request call id 614)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53022 (request call id 615)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45464 (request call id 1979)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53022 (request call id 610)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53022 (request call id 598)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45464 (request call id 1983)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45464 (request call id 1967)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53022 (request call id 603)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53022 (request call id 602)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53022 (request call id 604)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53022 (request call id 612)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53022 (request call id 606)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53022 (request call id 609)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45464 (request call id 1981)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45464 (request call id 1985)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53022 (request call id 607)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45464 (request call id 1956)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45464 (request call id 1957)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45464 (request call id 1958)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45464 (request call id 1961)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45464 (request call id 1962)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45464 (request call id 1963)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45464 (request call id 1964)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53022 (request call id 595)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53022 (request call id 596)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53022 (request call id 611)
I20260709 12:11:04.737432 18642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60412 (request call id 1027) took 1943 ms. Trace:
I20260709 12:11:04.815495 18643 rpcz_store.cc:276] 0709 12:11:03.579908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.580052 (+   144us) service_pool.cc:224] Handling call
0709 12:11:04.724985 (+1144933us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:04.799367 21667 log.cc:927] Time spent T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:11:04.716969 21544 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:04.717770 21435 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.435s	user 0.008s	sys 0.010s
W20260709 12:11:04.744541 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 742862us
I20260709 12:11:04.714533 21665 raft_consensus.cc:2749] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:04.716387 21401 raft_consensus.cc:740] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:04.753131 18015 raft_consensus.cc:2368] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 9. Current term is 10.
I20260709 12:11:04.055771 21622 raft_consensus.cc:515] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:04.808315 21680 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:04.808506 21039 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:04.809165 21661 consensus_queue.cc:260] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:04.744462 21621 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:04.815701 18024 raft_consensus.cc:2393] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 9: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:04.737954 21244 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:04.819391 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:04.756604 21620 raft_consensus.cc:2804] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:04.846670 21620 raft_consensus.cc:697] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
W20260709 12:11:04.847608 18608 leader_election.cc:336] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 1.752s (SENT)
I20260709 12:11:04.847528 21620 consensus_queue.cc:237] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:04.822731 18636 raft_consensus.cc:1240] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:11:04.848251 18608 leader_election.cc:304] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:04.800737 20698 raft_consensus.cc:3060] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:04.813692 21671 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.009s	sys 0.002s
I20260709 12:11:04.810009 21629 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:04.836798 18062 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:04.801087 21607 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:04.818133 18642 rpcz_store.cc:276] 0709 12:11:02.794162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.794287 (+   125us) service_pool.cc:224] Handling call
0709 12:11:02.820070 (+ 25783us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:02.822745 (+  2675us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:02.822773 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:02.844164 (+ 21391us) log.cc:844] Serialized 26 byte log entry
0709 12:11:03.366601 (+522437us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b180048a360. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f498a7e07 00007f7f527029a9 00007f7f498c469b 00007f7f498c293f 00007f7f498c4c02 00007f7f4c54c20b 00007f7f4c551d23 00007f7f4c5520d1 00007f7f4c96da0f
0709 12:11:03.552719 (+186118us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:03.552755 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:03.552812 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:04.137246 (+584434us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b4400022b4c. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f497ebc85 00007f7f497ec6a2 00007f7f4c55e1db 00007f7f4c559aaf 00007f7f4c54d86e 00007f7f4c54cbb6 00007f7f4c54c7d8 00007f7f4c556221 00007f7f4c5561d9 00007f7f4c556169
0709 12:11:04.737232 (+599986us) raft_consensus.cc:1685] finished
0709 12:11:04.737250 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:04.737376 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1643,"raft.queue_time_us":117,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":8822,"spinlock_wait_cycles":77562880,"thread_start_us":185927,"threads_started":1,"wal-append.queue_time_us":908271}
I20260709 12:11:04.853899 18089 raft_consensus.cc:2393] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 9: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:04.760078 21219 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:04.805227 21516 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:04.759057 21626 raft_consensus.cc:515] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:04.841296 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:04.818331 21659 raft_consensus.cc:515] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:04.877823 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:04.752530 21673 raft_consensus.cc:515] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:04.855254 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:04.892658 18024 raft_consensus.cc:2468] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 9.
I20260709 12:11:04.893802 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:04.894392 18024 raft_consensus.cc:2468] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 8.
I20260709 12:11:04.865338 18062 leader_election.cc:304] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:04.866438 18015 raft_consensus.cc:2393] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 10: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:04.854312 18020 raft_consensus.cc:2468] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
W20260709 12:11:04.901222 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.854573 21661 raft_consensus.cc:3060] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:04.748160 21578 raft_consensus.cc:515] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:04.907987 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:04.816900 21617 consensus_queue.cc:237] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:04.859694 21665 raft_consensus.cc:2749] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:04.912755 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:04.918943 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:04.919072 18015 raft_consensus.cc:2468] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
I20260709 12:11:04.919539 18020 raft_consensus.cc:2376] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7. Re-sending same reply.
W20260709 12:11:04.919826 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 54556.1us
W20260709 12:11:04.873950 18608 leader_election.cc:336] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 1.792s (SENT)
I20260709 12:11:04.923321 18608 leader_election.cc:304] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:04.926162 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:04.927536 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:04.913663 18018 raft_consensus.cc:2468] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 8.
I20260709 12:11:04.929118 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:04.930141 18015 raft_consensus.cc:2393] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 6: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:04.925271 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:04.934959 18017 raft_consensus.cc:2368] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 7. Current term is 8.
I20260709 12:11:04.939232 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:04.939126 21628 raft_consensus.cc:2749] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:04.941709 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:04.833216 21680 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:04.910390 21629 raft_consensus.cc:2749] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:04.942296 18015 raft_consensus.cc:2468] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:11:04.947085 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:04.918588 21435 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
W20260709 12:11:04.950917 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 76993.1us
I20260709 12:11:04.950703 18015 raft_consensus.cc:2368] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 6. Current term is 7.
I20260709 12:11:04.951251 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:11:04.952929 18608 leader_election.cc:336] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 1.786s (SENT)
I20260709 12:11:04.923699 21334 raft_consensus.cc:2749] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:04.953234 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:04.954005 18642 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
mode: GRACEFUL
new_leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:52812
I20260709 12:11:04.953321 18608 leader_election.cc:304] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:04.954804 18642 raft_consensus.cc:606] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 LEADER]: Received request to transfer leadership to TS 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:04.955690 18015 raft_consensus.cc:2368] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 6. Current term is 7.
I20260709 12:11:04.956441 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:04.957458 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:04.958134 18015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45464 (request call id 1967) took 1295 ms. Trace:
I20260709 12:11:04.958498 18015 rpcz_store.cc:276] 0709 12:11:03.662418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.957275 (+1294857us) service_pool.cc:224] Handling call
0709 12:11:04.958088 (+   813us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:04.958937 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:04.959409 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:04.959717 18017 raft_consensus.cc:2376] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8. Re-sending same reply.
I20260709 12:11:04.959954 18015 raft_consensus.cc:3060] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:04.960569 17914 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.025s	sys 0.049s
W20260709 12:11:04.957773 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 242279us
W20260709 12:11:04.962361 17914 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.025s	sys 0.049s
I20260709 12:11:04.964818 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:04.965096 18643 raft_consensus.cc:1240] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:04.962929 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 654740us
I20260709 12:11:04.968140 18023 raft_consensus.cc:2410] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:11:04.969409 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:04.966967 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:04.865716 21401 consensus_queue.cc:260] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:05.007582 17914 leader_election.cc:336] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Timed out: RequestConsensusVote RPC to 127.16.98.195:41931 timed out after 1.570s (SENT)
I20260709 12:11:05.011556 17914 leader_election.cc:304] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:05.011889 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:11:05.012305 17912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:05.023787 17913 leader_election.cc:336] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 1.868s (SENT)
I20260709 12:11:05.024343 17913 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:05.024809 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:05.025426 18020 raft_consensus.cc:2468] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 8.
I20260709 12:11:05.027421 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:11:05.028749 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 113426us
W20260709 12:11:05.026222 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 104426us
I20260709 12:11:05.041002 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:04.970463 21628 raft_consensus.cc:2749] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:05.047960 18062 leader_election.cc:304] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:05.051399 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:11:05.052407 17914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.054808 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
W20260709 12:11:05.065826 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:05.066283 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.066216 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:05.046672 21599 raft_consensus.cc:2749] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:05.067101 18020 raft_consensus.cc:2410] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 12:11:05.049492 21682 log.cc:927] Time spent T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
I20260709 12:11:04.963815 21435 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:05.075798 17987 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:05.084996 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:11:05.069530 18608 leader_election.cc:336] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 1.543s (SENT)
I20260709 12:11:05.049353 21693 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.049181 21535 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:11:05.082278 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 73611.6us
I20260709 12:11:05.052575 21663 raft_consensus.cc:493] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
W20260709 12:11:05.086784 18608 leader_election.cc:336] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 1.857s (SENT)
W20260709 12:11:05.087915 18608 leader_election.cc:336] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 1.892s (SENT)
I20260709 12:11:05.090822 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:05.059695 21271 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:05.091450 18017 raft_consensus.cc:2468] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 10.
I20260709 12:11:05.064471 21401 raft_consensus.cc:3060] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:05.089385 18608 leader_election.cc:336] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 1.900s (SENT)
I20260709 12:11:05.059178 21692 raft_consensus.cc:2749] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:05.087280 21681 log.cc:927] Time spent T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
W20260709 12:11:05.096273 17913 leader_election.cc:336] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 1.967s (SENT)
W20260709 12:11:05.086799 21685 log.cc:927] Time spent T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
I20260709 12:11:05.098085 18608 leader_election.cc:304] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:05.075838 21544 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:05.098636 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:05.088171 21607 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:05.104720 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:11:05.103403 18608 leader_election.cc:336] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 1.950s (SENT)
I20260709 12:11:05.105052 18020 raft_consensus.cc:2410] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:11:05.095197 21663 raft_consensus.cc:515] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:05.106921 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:05.114212 18094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41818 (request call id 950) took 1201 ms. Trace:
I20260709 12:11:05.109367 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:05.111601 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:05.113375 18608 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:05.105561 18017 raft_consensus.cc:2468] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 8.
I20260709 12:11:05.107661 21621 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:05.117132 18016 raft_consensus.cc:2468] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:11:05.120448 18016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53022 (request call id 592) took 1007 ms. Trace:
I20260709 12:11:05.120775 18016 rpcz_store.cc:276] 0709 12:11:04.112749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.111340 (+998591us) service_pool.cc:224] Handling call
0709 12:11:05.120397 (+  9057us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:05.081593 21671 consensus_queue.cc:1048] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:11:05.114701 18094 rpcz_store.cc:276] 0709 12:11:03.912598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.912784 (+   186us) service_pool.cc:224] Handling call
0709 12:11:03.913264 (+   480us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:11:03.913775 (+   511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:03.913809 (+    34us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:11:03.914671 (+   862us) log.cc:844] Serialized 78 byte log entry
0709 12:11:04.713360 (+798689us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:04.960749 (+247389us) log.cc:844] Serialized 14 byte log entry
0709 12:11:04.960939 (+   190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:04.961012 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:05.113924 (+152912us) raft_consensus.cc:1685] finished
0709 12:11:05.113953 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.114132 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":397531,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":26667,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":11295,"thread_start_us":899915,"threads_started":2,"wal-append.queue_time_us":782288}
I20260709 12:11:05.119990 18019 raft_consensus.cc:2410] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:11:05.130290 18019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53022 (request call id 589) took 1027 ms. Trace:
I20260709 12:11:05.130616 18019 rpcz_store.cc:276] 0709 12:11:04.102570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.109131 (+1006561us) service_pool.cc:224] Handling call
0709 12:11:05.130230 (+ 21099us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:05.128672 18020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45464 (request call id 1985) took 1026 ms. Trace:
I20260709 12:11:05.131501 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:05.131753 18020 rpcz_store.cc:276] 0709 12:11:04.102319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.106626 (+1004307us) service_pool.cc:224] Handling call
0709 12:11:05.128609 (+ 21983us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:05.135650 17947 raft_consensus.cc:2468] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 10.
I20260709 12:11:05.113052 21622 leader_election.cc:290] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:05.113123 21535 raft_consensus.cc:2749] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:05.118795 21271 raft_consensus.cc:2749] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:05.150789 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
W20260709 12:11:05.152812 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 1.12798e+06us
I20260709 12:11:05.153764 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:05.143149 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:05.159646 17940 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:05.133106 21621 raft_consensus.cc:2749] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:05.158146 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:05.159569 17989 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:05.117751 21626 leader_election.cc:290] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:05.093746 21693 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:05.157524 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:05.159526 18016 raft_consensus.cc:3060] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:05.162072 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:05.175040 18017 raft_consensus.cc:2368] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 6. Current term is 7.
W20260709 12:11:05.169606 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 83235.2us
I20260709 12:11:05.170035 21085 raft_consensus.cc:2749] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:05.170571 18089 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53954 (request call id 2261) took 2102 ms (client timeout 1834 ms). Trace:
I20260709 12:11:05.171023 18641 raft_consensus.cc:2393] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 7: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:05.179838 17940 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 12.
W20260709 12:11:05.180408 17913 leader_election.cc:336] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 1.984s (SENT)
I20260709 12:11:05.180974 17913 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:11:05.179064 18089 rpcz_store.cc:269] 0709 12:11:03.068385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.068880 (+   495us) service_pool.cc:224] Handling call
0709 12:11:05.170359 (+2101479us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b54002ef254. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:05.170493 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3988221312}
I20260709 12:11:05.142210 21244 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.186964 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:11:05.210522 17913 leader_election.cc:336] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 2.029s (SENT)
I20260709 12:11:05.211133 17913 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:11:05.212482 17913 leader_election.cc:336] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 2.094s (SENT)
I20260709 12:11:05.214246 17913 leader_election.cc:304] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:05.215575 21599 raft_consensus.cc:2749] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:11:05.217321 17913 leader_election.cc:336] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 2.095s (SENT)
I20260709 12:11:05.218091 17913 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:05.219372 21599 raft_consensus.cc:2749] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:11:05.220913 17913 leader_election.cc:336] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 2.167s (SENT)
I20260709 12:11:05.221946 17913 leader_election.cc:304] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:05.223378 21599 raft_consensus.cc:2749] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:11:05.212610 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 127401us
I20260709 12:11:05.213012 21692 raft_consensus.cc:2749] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:05.213500 21694 raft_consensus.cc:2749] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:05.171495 21673 leader_election.cc:290] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:05.227388 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 123998us
I20260709 12:11:05.160030 21659 leader_election.cc:290] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:05.230396 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:05.248993 17944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44668 (request call id 600) took 1967 ms. Trace:
I20260709 12:11:05.184231 21683 raft_consensus.cc:2804] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:05.255669 18016 raft_consensus.cc:2468] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
I20260709 12:11:05.249435 17944 rpcz_store.cc:276] 0709 12:11:03.281104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.533465 (+252361us) service_pool.cc:224] Handling call
0709 12:11:03.533805 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:04.156668 (+622863us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:04.156707 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:04.157131 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 12:11:04.715165 (+558034us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:05.050748 (+335583us) log.cc:844] Serialized 14 byte log entry
0709 12:11:05.051777 (+  1029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.051863 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:05.248793 (+196930us) raft_consensus.cc:1685] finished
0709 12:11:05.248813 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.248936 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":637328,"prepare.queue_time_us":412977,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":631288,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":3475,"thread_start_us":874192,"threads_started":2,"wal-append.queue_time_us":597574}
I20260709 12:11:05.232663 17942 raft_consensus.cc:1275] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:11:05.259697 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:11:05.260730 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 178365us
W20260709 12:11:05.258625 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 183015us
I20260709 12:11:05.262719 18062 leader_election.cc:304] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:05.270000 18062 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:05.225668 21244 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:05.288635 18019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45464 (request call id 1957) took 1675 ms. Trace:
I20260709 12:11:05.185338 21622 consensus_queue.cc:1048] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 12:11:05.290681 18019 rpcz_store.cc:276] 0709 12:11:03.589840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.257229 (+1667389us) service_pool.cc:224] Handling call
0709 12:11:05.264290 (+  7061us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.264499 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:05.264546 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:05.264599 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:05.264648 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.264714 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.264831 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:05.289623 18016 raft_consensus.cc:1240] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:11:05.292594 18016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45464 (request call id 1958) took 1702 ms. Trace:
I20260709 12:11:05.293009 18016 rpcz_store.cc:276] 0709 12:11:03.590156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.261691 (+1671535us) service_pool.cc:224] Handling call
0709 12:11:05.289421 (+ 27730us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:05.292337 (+  2916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.292528 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:05.300470 18090 raft_consensus.cc:1240] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:11:05.303795 18016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45464 (request call id 1962) took 1642 ms. Trace:
I20260709 12:11:05.305480 18016 rpcz_store.cc:276] 0709 12:11:03.661147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.293896 (+1632749us) service_pool.cc:224] Handling call
0709 12:11:05.303363 (+  9467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.303517 (+   154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:05.303540 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:05.303576 (+    36us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:05.303611 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.303661 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.303747 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:05.306672 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:05.307732 18094 raft_consensus.cc:2393] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 13: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:05.308619 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:05.288189 21673 raft_consensus.cc:2804] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:05.309473 18097 raft_consensus.cc:2410] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:05.311218 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:05.317006 18090 raft_consensus.cc:1240] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:05.328835 18015 raft_consensus.cc:2468] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
I20260709 12:11:05.329787 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:05.289955 21544 consensus_queue.cc:1048] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:11:05.330387 18015 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 9.
I20260709 12:11:05.343420 18015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45464 (request call id 1963) took 1682 ms. Trace:
I20260709 12:11:05.343943 18015 rpcz_store.cc:276] 0709 12:11:03.661396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.342418 (+1681022us) service_pool.cc:224] Handling call
0709 12:11:05.342788 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.343008 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:05.343047 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:05.343102 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:05.343157 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.343225 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.343354 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:05.313694 21673 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.339030 18608 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:05.345840 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:05.346428 18094 raft_consensus.cc:2468] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 8.
I20260709 12:11:05.315794 21271 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.318300 21713 raft_consensus.cc:2804] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:05.409184 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:05.410061 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:05.412587 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:05.412882 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:05.413376 18637 raft_consensus.cc:3060] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:11:05.350104 21673 raft_consensus.cc:3060] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:11:05.423615 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.415915 21659 raft_consensus.cc:2804] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:05.438594 21435 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:05.481555 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:05.407034 21271 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:05.489182 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:11:05.489606 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 141620us
I20260709 12:11:05.490111 18093 raft_consensus.cc:2410] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:11:05.469391 21713 raft_consensus.cc:697] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 10 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:05.507752 18637 raft_consensus.cc:2468] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 9.
I20260709 12:11:05.511970 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
W20260709 12:11:05.492411 21661 consensus_meta.cc:287] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.573s	user 0.008s	sys 0.002s
W20260709 12:11:05.514758 21711 log.cc:927] Time spent T 00000000000000000000000000000000 P b852ae4791e4401b8356c71ae33bbc7d: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:11:05.523978 18090 raft_consensus.cc:1275] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:11:05.525141 17989 connection.cc:256] RPC call timeout handler was delayed by -1.0162928290001219s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1834s for a response
W20260709 12:11:05.527753 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.517983 21219 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:05.521724 21708 log.cc:927] Time spent T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:11:05.522233 21707 log.cc:927] Time spent T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.222s	user 0.000s	sys 0.000s
I20260709 12:11:05.485107 21659 raft_consensus.cc:697] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 12 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
W20260709 12:11:05.512073 21581 consensus_meta.cc:287] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.878s	user 0.003s	sys 0.008s
W20260709 12:11:05.571810 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 168012us
I20260709 12:11:05.506342 21713 consensus_queue.cc:237] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:11:05.573921 21717 log.cc:927] Time spent T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 12:11:05.579797 18609 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:05.580914 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:05.581732 18090 raft_consensus.cc:2468] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
I20260709 12:11:05.578774 21162 raft_consensus.cc:493] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:05.591858 21579 consensus_meta.cc:287] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 1.590s	user 0.008s	sys 0.004s
W20260709 12:11:05.592489 21366 consensus_meta.cc:287] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.780s	user 0.008s	sys 0.004s
I20260709 12:11:05.592259 21579 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:05.594293 18024 raft_consensus.cc:2410] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:05.594923 18022 raft_consensus.cc:2393] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 12: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:05.598307 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:05.587800 21581 raft_consensus.cc:2804] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:05.599347 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:05.601176 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:05.601485 18016 raft_consensus.cc:2376] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7. Re-sending same reply.
I20260709 12:11:05.598558 18019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45464 (request call id 1961) took 1934 ms. Trace:
I20260709 12:11:05.603340 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:11:05.602880 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.606067 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:05.606083 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:05.606705 18635 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 8.
I20260709 12:11:05.606880 17941 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 11.
I20260709 12:11:05.607380 17947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44668 (request call id 604) took 1449 ms. Trace:
I20260709 12:11:05.607724 17947 rpcz_store.cc:276] 0709 12:11:04.157631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.636952 (+479321us) service_pool.cc:224] Handling call
0709 12:11:05.607253 (+970301us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b54003c0d54. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:05.607331 (+    78us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":972883328}
I20260709 12:11:05.608943 21368 raft_consensus.cc:3055] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:05.609453 21368 raft_consensus.cc:740] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:05.610495 21368 consensus_queue.cc:260] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:05.611752 21368 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:05.615345 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:05.604465 18019 rpcz_store.cc:276] 0709 12:11:03.660800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.292009 (+1631209us) service_pool.cc:224] Handling call
0709 12:11:05.304576 (+ 12567us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:05.306782 (+  2206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:05.306824 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:05.323740 (+ 16916us) log.cc:844] Serialized 26 byte log entry
0709 12:11:05.568799 (+245059us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:05.588291 (+ 19492us) log.cc:844] Serialized 14 byte log entry
0709 12:11:05.591729 (+  3438us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.594498 (+  2769us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:05.594538 (+    40us) raft_consensus.cc:1685] finished
0709 12:11:05.594549 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.594685 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2631,"raft.queue_time_us":26707,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":70485,"thread_start_us":175717,"threads_started":2,"wal-append.queue_time_us":218614}
I20260709 12:11:05.629186 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:05.629823 18090 raft_consensus.cc:2468] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
I20260709 12:11:05.631340 17943 raft_consensus.cc:1275] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:05.631503 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:05.629423 17948 raft_consensus.cc:2393] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 9: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:05.633795 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:05.634593 18016 raft_consensus.cc:2468] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 10.
I20260709 12:11:05.635906 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:05.637766 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:05.639300 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:05.599033 21661 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:05.588100 21718 consensus_queue.cc:1048] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:11:05.599844 21680 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:05.642257 18019 raft_consensus.cc:2368] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 9. Current term is 10.
I20260709 12:11:05.603721 21581 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:05.589887 21162 raft_consensus.cc:515] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:05.644330 17988 connection.cc:256] RPC call timeout handler was delayed by -1.7814176530000623s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:11:05.645082 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:05.643330 18609 leader_election.cc:304] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:05.648303 18609 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:05.638772 21659 consensus_queue.cc:237] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:05.650074 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:05.687800 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:05.688868 18644 raft_consensus.cc:2468] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 7.
I20260709 12:11:05.646227 21581 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:05.649487 21661 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:05.689400 21718 raft_consensus.cc:2804] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:05.698939 21721 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:05.734826 21730 raft_consensus.cc:2749] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:05.701910 20698 consensus_meta.cc:287] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.843s	user 0.006s	sys 0.005s
I20260709 12:11:05.735424 18640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60430 (request call id 849) took 1084 ms. Trace:
I20260709 12:11:05.736334 21579 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:05.702859 21476 raft_consensus.cc:3055] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:05.740222 18643 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4f794e5675049b284921052a24eea37"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
mode: GRACEFUL
new_leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
 from {username='slave'} at 127.0.0.1:52812
W20260709 12:11:05.741255 18641 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60424 (request call id 993) took 2057 ms (client timeout 1750 ms). Trace:
I20260709 12:11:05.708714 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:05.750332 18643 raft_consensus.cc:606] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Received request to transfer leadership to TS c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:05.712365 17945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44668 (request call id 603) took 1555 ms. Trace:
I20260709 12:11:05.750741 18643 raft_consensus.cc:614] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:05.714965 18636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60412 (request call id 1024) took 2922 ms. Trace:
W20260709 12:11:05.715670 18024 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45464 (request call id 1965) took 2053 ms (client timeout 2442 ms). Trace:
I20260709 12:11:05.720227 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:05.720799 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:05.745939 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:05.753925 18098 raft_consensus.cc:3060] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:05.721441 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:11:05.750747 18021 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53022 (request call id 594) took 1637 ms (client timeout 1786 ms). Trace:
W20260709 12:11:05.754895 18021 rpcz_store.cc:269] 0709 12:11:04.113218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.708478 (+1595260us) service_pool.cc:224] Handling call
0709 12:11:05.750695 (+ 42217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:05.722980 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:05.756235 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:05.756963 18091 raft_consensus.cc:2410] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:11:05.707901 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:05.723989 18016 raft_consensus.cc:2468] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 10.
I20260709 12:11:05.721704 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:05.721153 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:05.760764 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:05.760977 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:11:05.752883 18024 rpcz_store.cc:269] 0709 12:11:03.661887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.927264 (+1265377us) service_pool.cc:224] Handling call
0709 12:11:05.715500 (+788236us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b540030c5d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:05.715620 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1531249920}
I20260709 12:11:05.752198 18636 rpcz_store.cc:276] 0709 12:11:02.792803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:02.793284 (+   481us) service_pool.cc:224] Handling call
0709 12:11:02.793573 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:04.848720 (+2055147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.714727 (+866007us) spinlock_profiling.cc:243] Waited 2.03 s on lock 0x7b540072bd54. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:11:05.714891 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4665918208}
W20260709 12:11:05.750341 18641 rpcz_store.cc:269] 0709 12:11:03.683912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.684149 (+   237us) service_pool.cc:224] Handling call
0709 12:11:05.741031 (+2056882us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54005447d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:05.741162 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2896059776}
W20260709 12:11:05.719206 21724 log.cc:927] Time spent T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 12:11:05.702999 21720 log.cc:927] Time spent T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 12:11:05.750900 17945 rpcz_store.cc:276] 0709 12:11:04.157341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.157442 (+   101us) service_pool.cc:224] Handling call
0709 12:11:04.157779 (+   337us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:04.814989 (+657210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:04.815023 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:04.817825 (+  2802us) log.cc:844] Serialized 52 byte log entry
0709 12:11:05.030861 (+213036us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:05.030918 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.712004 (+681086us) spinlock_profiling.cc:243] Waited 577 ms on lock 0x7b540031c754. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:11:05.712050 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:05.712092 (+    42us) raft_consensus.cc:1685] finished
0709 12:11:05.712105 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.712309 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":706,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":3719,"spinlock_wait_cycles":1327087872,"thread_start_us":212648,"threads_started":1,"wal-append.queue_time_us":229296}
I20260709 12:11:05.765954 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:05.698346 21271 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:05.729429 21401 consensus_meta.cc:287] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.633s	user 0.003s	sys 0.005s
W20260709 12:11:05.714511 21715 log.cc:927] Time spent T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.419s	user 0.001s	sys 0.000s
W20260709 12:11:05.722836 21701 log.cc:927] Time spent T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.438s	user 0.002s	sys 0.000s
I20260709 12:11:05.771597 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:05.734241 21718 raft_consensus.cc:493] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:05.747080 18640 rpcz_store.cc:276] 0709 12:11:04.650623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.732584 (+ 81961us) service_pool.cc:224] Handling call
0709 12:11:04.732818 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:04.939809 (+206991us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:05.040965 (+101156us) log.cc:844] Serialized 14 byte log entry
0709 12:11:05.140719 (+ 99754us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:05.140784 (+    65us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:05.141854 (+  1070us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.704168 (+562314us) spinlock_profiling.cc:243] Waited 1.85 ms on lock 0x7b1800403b40. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f498c5522 00007f7f498c77c1 00007f7f498c7779 00007f7f498c7709 00007f7f498c76d1 00007f7f498c69cd 0000000000388634 0000000000388479 00007f7f498a883a
0709 12:11:05.722297 (+ 18129us) spinlock_profiling.cc:243] Waited 7.79 ms on lock 0x7b4400022b4c. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f497ebc85 00007f7f497ec6a2 00007f7f4c55e1db 00007f7f4c559aaf 00007f7f4c54d86e 00007f7f4c54cbb6 00007f7f4c54c7d8 00007f7f4c556221 00007f7f4c5561d9 00007f7f4c556169
0709 12:11:05.735209 (+ 12912us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b540041f854. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:11:05.735253 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:05.735372 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7118,"prepare.queue_time_us":181790,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":12076,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":1287,"spinlock_wait_cycles":497664128,"thread_start_us":176807,"threads_started":2,"wal-append.queue_time_us":191421}
I20260709 12:11:05.777755 18098 raft_consensus.cc:2410] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:11:05.799266 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:05.775130 18019 raft_consensus.cc:2468] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 11.
I20260709 12:11:05.800726 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:05.801250 18019 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 11.
I20260709 12:11:05.780862 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:05.771725 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:11:05.725095 21661 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:05.683004 21683 raft_consensus.cc:697] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:05.786365 18089 raft_consensus.cc:2468] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
I20260709 12:11:05.716675 21660 raft_consensus.cc:993] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db: : Instructing follower 63f5bddeebd84e5788d671a176cfa8e1 to start an election
I20260709 12:11:05.786827 18018 raft_consensus.cc:2468] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
I20260709 12:11:05.750211 21721 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:05.759325 20698 raft_consensus.cc:515] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:05.861690 21721 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:05.789811 21673 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:05.863603 21673 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:05.790952 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:05.759469 21476 raft_consensus.cc:740] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:05.865659 18020 raft_consensus.cc:2368] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 8. Current term is 9.
I20260709 12:11:05.794934 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:05.866472 18092 raft_consensus.cc:2468] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
I20260709 12:11:05.795023 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:05.795236 21581 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:05.795781 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:11:05.843617 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:05.799985 21718 raft_consensus.cc:3060] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:06.470359 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:06.483031 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:06.483706 20698 leader_election.cc:290] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:06.473012 21581 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:11:06.085515 21724 log.cc:927] Time spent T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:11:06.473434 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:06.348228 21683 consensus_queue.cc:237] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:06.488369 18017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45464 (request call id 1956) took 2898 ms. Trace:
I20260709 12:11:06.475270 21162 leader_election.cc:290] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:06.477505 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:06.490777 18097 raft_consensus.cc:2410] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:11:05.924630 21629 raft_consensus.cc:1081] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Signalling peer 63f5bddeebd84e5788d671a176cfa8e1 to start an election
I20260709 12:11:05.960356 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:06.003623 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:06.491503 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:06.492209 18019 raft_consensus.cc:2393] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 7: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:06.488765 18017 rpcz_store.cc:276] 0709 12:11:03.589555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.228069 (+1638514us) service_pool.cc:224] Handling call
0709 12:11:05.228392 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:05.411088 (+182696us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:05.411121 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:05.437517 (+ 26396us) log.cc:844] Serialized 26 byte log entry
0709 12:11:05.511601 (+ 74084us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:05.586164 (+ 74563us) log.cc:844] Serialized 14 byte log entry
0709 12:11:05.588008 (+  1844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:05.588087 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:06.488204 (+900117us) raft_consensus.cc:1685] finished
0709 12:11:06.488224 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.488322 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3428,"prepare.queue_time_us":117324,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":2543,"raft.queue_time_us":56141,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":13253,"thread_start_us":265809,"threads_started":3,"wal-append.queue_time_us":117188}
I20260709 12:11:06.493506 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:06.494122 18017 raft_consensus.cc:2368] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 6. Current term is 7.
I20260709 12:11:06.494792 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:11:06.495003 17912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.495293 18017 raft_consensus.cc:2468] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 11.
I20260709 12:11:06.496062 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
W20260709 12:11:06.474304 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:05.960755 21684 log.cc:927] Time spent T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 12:11:06.485626 21660 raft_consensus.cc:493] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
W20260709 12:11:05.913434 17989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.500599 20698 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.508211 20698 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:06.501492 18061 leader_election.cc:304] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
W20260709 12:11:06.501123 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.503382 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:06.511981 18017 raft_consensus.cc:2376] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7. Re-sending same reply.
I20260709 12:11:06.522111 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:06.522992 18017 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 11.
I20260709 12:11:06.524078 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:06.528062 18017 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 13.
I20260709 12:11:06.528875 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:06.529518 18017 raft_consensus.cc:2376] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7. Re-sending same reply.
I20260709 12:11:06.530821 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:06.531229 18017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53022 (request call id 635) took 1043 ms. Trace:
I20260709 12:11:06.531713 18017 rpcz_store.cc:276] 0709 12:11:05.487448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.528660 (+1041212us) service_pool.cc:224] Handling call
0709 12:11:06.531173 (+  2513us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:06.534090 18638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60430 (request call id 842) took 2423 ms. Trace:
I20260709 12:11:06.531603 18019 raft_consensus.cc:2376] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7. Re-sending same reply.
I20260709 12:11:06.535096 18019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53022 (request call id 634) took 1071 ms. Trace:
I20260709 12:11:06.534463 18638 rpcz_store.cc:276] 0709 12:11:04.110302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.130207 (+ 19905us) service_pool.cc:224] Handling call
0709 12:11:04.130515 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:04.838909 (+708394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:04.838957 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:04.839012 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:04.839062 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.533890 (+1694828us) spinlock_profiling.cc:243] Waited 708 ms on lock 0x7b54004628d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:11:06.533935 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.534040 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1628617600}
I20260709 12:11:06.532733 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:06.536931 18017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53022 (request call id 637) took 1012 ms. Trace:
I20260709 12:11:06.537310 18017 rpcz_store.cc:276] 0709 12:11:05.524549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.532540 (+1007991us) service_pool.cc:224] Handling call
0709 12:11:06.536885 (+  4345us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:06.538406 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:11:06.527669 21435 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.820s	user 0.027s	sys 0.057s
I20260709 12:11:06.535641 18019 rpcz_store.cc:276] 0709 12:11:05.463555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.497196 (+1033641us) service_pool.cc:224] Handling call
0709 12:11:06.535024 (+ 37828us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:06.540546 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:06.540930 20698 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:06.541525 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:06.541635 20698 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.542502 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:06.542228 20698 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:11:06.526810 21535 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.021s	sys 0.023s
I20260709 12:11:06.545382 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:06.548714 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:06.549322 18017 raft_consensus.cc:2468] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
I20260709 12:11:06.550431 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:11:06.543231 21435 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.028s	sys 0.057s
I20260709 12:11:06.551708 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
W20260709 12:11:06.543843 21535 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.022s	sys 0.023s
I20260709 12:11:06.552518 20698 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:06.556388 18016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53022 (request call id 638) took 1012 ms. Trace:
I20260709 12:11:06.556900 18016 rpcz_store.cc:276] 0709 12:11:05.544222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.635440 (+ 91218us) service_pool.cc:224] Handling call
0709 12:11:06.556183 (+920743us) spinlock_profiling.cc:243] Waited 87.5 ms on lock 0x7b54002788d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:06.556316 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201342336}
I20260709 12:11:06.558199 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:06.566311 18016 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 9.
I20260709 12:11:06.554382 18017 raft_consensus.cc:2410] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 12:11:06.559221 18023 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53022 (request call id 597) took 2445 ms (client timeout 1857 ms). Trace:
W20260709 12:11:06.566874 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 91238.8us
I20260709 12:11:06.561487 21244 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:06.562665 18020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53022 (request call id 619) took 1618 ms. Trace:
I20260709 12:11:06.568985 18020 rpcz_store.cc:276] 0709 12:11:04.943859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.133001 (+189142us) service_pool.cc:224] Handling call
0709 12:11:06.562413 (+1429412us) spinlock_profiling.cc:243] Waited 693 ms on lock 0x7b5400364554. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:06.562570 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1593678592}
I20260709 12:11:06.564858 21578 leader_election.cc:290] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:06.569403 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:06.525390 21660 raft_consensus.cc:515] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:06.567646 18023 rpcz_store.cc:269] 0709 12:11:04.113962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.877040 (+763078us) service_pool.cc:224] Handling call
0709 12:11:06.558980 (+1681940us) spinlock_profiling.cc:243] Waited 33.4 ms on lock 0x7b540038d954. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:06.559136 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76824320}
I20260709 12:11:06.568308 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:06.583457 18016 raft_consensus.cc:2376] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7. Re-sending same reply.
I20260709 12:11:06.553215 18019 raft_consensus.cc:2393] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 7: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:06.570367 18017 raft_consensus.cc:2393] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 9: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:06.579406 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:06.584987 17945 raft_consensus.cc:2468] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
I20260709 12:11:06.585873 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:06.586166 17948 raft_consensus.cc:1275] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:06.586408 17946 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:06.587972 18019 raft_consensus.cc:1240] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:06.588968 18019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53022 (request call id 620) took 1601 ms. Trace:
I20260709 12:11:06.589385 18019 rpcz_store.cc:276] 0709 12:11:04.987894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.587082 (+1599188us) service_pool.cc:224] Handling call
0709 12:11:06.587667 (+   585us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.588698 (+  1031us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.588899 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:06.590950 18016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53022 (request call id 611) took 2122 ms. Trace:
I20260709 12:11:06.591643 18019 raft_consensus.cc:1275] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:06.591284 18016 rpcz_store.cc:276] 0709 12:11:04.468944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.588616 (+2119672us) service_pool.cc:224] Handling call
0709 12:11:06.590495 (+  1879us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.590680 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:06.590705 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:06.590741 (+    36us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:06.590770 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.590819 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.590904 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:06.561532 21718 raft_consensus.cc:515] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:06.592799 18017 raft_consensus.cc:1275] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:11:06.595185 18023 raft_consensus.cc:1275] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:06.596737 18023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53022 (request call id 596) took 2483 ms. Trace:
I20260709 12:11:06.596700 18017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53022 (request call id 628) took 1312 ms. Trace:
I20260709 12:11:06.597175 18023 rpcz_store.cc:276] 0709 12:11:04.113714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.586199 (+2472485us) service_pool.cc:224] Handling call
0709 12:11:06.594987 (+  8788us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.596579 (+  1592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.596701 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:06.597224 18017 rpcz_store.cc:276] 0709 12:11:05.284226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.589478 (+1305252us) service_pool.cc:224] Handling call
0709 12:11:06.589704 (+   226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.596494 (+  6790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.596653 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:06.599332 18019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53022 (request call id 631) took 1244 ms. Trace:
I20260709 12:11:06.599722 18019 rpcz_store.cc:276] 0709 12:11:05.349522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.591151 (+1241629us) service_pool.cc:224] Handling call
0709 12:11:06.591386 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.593324 (+  1938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.594300 (+   976us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:06.601902 18016 raft_consensus.cc:1275] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:11:06.602300 18016 pending_rounds.cc:85] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb: Aborting all ops after (but not including) 9
I20260709 12:11:06.602540 18016 pending_rounds.cc:107] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:11:06.602859 18016 raft_consensus.cc:2889] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:06.607399 18023 raft_consensus.cc:1275] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:11:06.611557 18016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53022 (request call id 636) took 1098 ms. Trace:
I20260709 12:11:06.613343 21039 consensus_queue.cc:1059] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:06.613627 21660 leader_election.cc:290] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:06.617323 21718 leader_election.cc:290] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:06.619740 21516 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:11:06.620702 21739 log.cc:927] Time spent T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:11:06.623314 21718 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.623898 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:06.623766 21718 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:06.625161 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:11:06.620733 18644 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60412 (request call id 1029) took 3805 ms (client timeout 2099 ms). Trace:
I20260709 12:11:06.628288 21718 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:06.629303 21718 raft_consensus.cc:493] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:06.629755 21718 raft_consensus.cc:515] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:06.628381 18644 rpcz_store.cc:269] 0709 12:11:02.815460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.042288 (+226828us) service_pool.cc:224] Handling call
0709 12:11:06.620546 (+3578258us) spinlock_profiling.cc:243] Waited 2.63 s on lock 0x7b54006cf7d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:06.620638 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6051547520}
I20260709 12:11:06.631474 21660 raft_consensus.cc:493] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.631960 21660 raft_consensus.cc:515] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:06.632822 21733 log.cc:927] Time spent T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.531s	user 0.013s	sys 0.000s
I20260709 12:11:06.637530 21673 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:06.638018 21673 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:06.640340 21673 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:06.643306 18018 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53022 (request call id 612) took 2174 ms (client timeout 2134 ms). Trace:
W20260709 12:11:06.643812 18018 rpcz_store.cc:269] 0709 12:11:04.469266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.980312 (+511046us) service_pool.cc:224] Handling call
0709 12:11:06.643102 (+1662790us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b54003200d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:06.643226 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1712999168}
I20260709 12:11:06.644234 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:06.644977 18089 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:06.646751 21718 leader_election.cc:290] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:06.647744 21693 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:06.648422 21693 raft_consensus.cc:3055] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:06.648826 21693 raft_consensus.cc:740] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
W20260709 12:11:06.649758 18062 connection.cc:256] RPC call timeout handler was delayed by -1.5449353250000968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17370000000000002s for a response
I20260709 12:11:06.650060 18639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60430 (request call id 843) took 2539 ms. Trace:
W20260709 12:11:06.650127 18062 connection.cc:256] RPC call timeout handler was delayed by -1.4765353250002136s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18130000000000002s for a response
W20260709 12:11:06.650782 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 149412us
I20260709 12:11:06.649695 21334 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.651883 21334 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:06.654109 21334 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:11:06.650509 18062 connection.cc:256] RPC call timeout handler was delayed by -1.1381353250001212s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2189s for a response
I20260709 12:11:06.655495 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:06.656526 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:06.657233 18091 raft_consensus.cc:2468] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
I20260709 12:11:06.650467 18639 rpcz_store.cc:276] 0709 12:11:04.110588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:04.518318 (+407730us) service_pool.cc:224] Handling call
0709 12:11:04.518685 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:04.945617 (+426932us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:04.945646 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:04.945696 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:04.945727 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.649869 (+1704142us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b540053e3d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:11:06.649911 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.650011 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":981431168}
I20260709 12:11:06.654458 21702 raft_consensus.cc:2804] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:06.699559 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:11:06.700536 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 44445.3us
I20260709 12:11:06.701176 18062 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:06.704133 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:06.704825 18092 raft_consensus.cc:3060] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:06.707510 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:06.649724 21693 consensus_queue.cc:260] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:06.708096 18095 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 9.
I20260709 12:11:06.708559 21673 consensus_queue.cc:1048] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:06.709954 21673 raft_consensus.cc:2804] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:06.710341 21673 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:06.710750 21673 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:06.714942 21721 consensus_queue.cc:1048] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:06.715628 21660 leader_election.cc:290] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:11:06.717685 18022 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45464 (request call id 1954) took 3128 ms (client timeout 2888 ms). Trace:
W20260709 12:11:06.718101 18022 rpcz_store.cc:269] 0709 12:11:03.588998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:03.613853 (+ 24855us) service_pool.cc:224] Handling call
0709 12:11:04.094018 (+480165us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b5800055898. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4988db71 00007f7f4988da22 00007f7f527a68d9 00007f7f51900ee0 00007f7f519ca0ab 00007f7f519ca131 00007f7f519780a0 00007f7f51977984 00007f7f4aef26d4 00007f7f4aef2662
0709 12:11:06.717442 (+2623424us) spinlock_profiling.cc:243] Waited 969 ms on lock 0x7b54001e5354. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:06.717593 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2254603264}
I20260709 12:11:06.719403 18022 raft_consensus.cc:1240] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:06.720513 18022 raft_consensus.cc:1240] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:06.721107 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:06.721909 18093 raft_consensus.cc:2468] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 6.
I20260709 12:11:06.722962 18017 raft_consensus.cc:1240] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:11:06.697114 21535 raft_consensus.cc:493] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:06.725987 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:06.734066 17942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44668 (request call id 609) took 1612 ms. Trace:
I20260709 12:11:06.734457 17942 rpcz_store.cc:276] 0709 12:11:05.121998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.122134 (+   136us) service_pool.cc:224] Handling call
0709 12:11:05.142737 (+ 20603us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:05.257963 (+115226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.726268 (+1468305us) spinlock_profiling.cc:243] Waited 86.1 ms on lock 0x7b540029fed4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:11:06.734007 (+  7739us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":197976960}
I20260709 12:11:06.736284 18609 leader_election.cc:304] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:06.738085 17946 raft_consensus.cc:2468] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 11.
I20260709 12:11:06.738327 18089 raft_consensus.cc:2468] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 11.
I20260709 12:11:06.742179 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:11:06.743623 17913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:06.744415 17913 leader_election.cc:336] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 2.569s (SENT)
I20260709 12:11:06.612010 18016 rpcz_store.cc:276] 0709 12:11:05.512821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.597641 (+1084820us) service_pool.cc:224] Handling call
0709 12:11:06.601577 (+  3936us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.611306 (+  9729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.611496 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:06.755139 18609 leader_election.cc:304] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:06.756386 17913 leader_election.cc:304] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:06.758662 18092 raft_consensus.cc:2468] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 9.
I20260709 12:11:06.761778 18609 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:06.724479 21702 raft_consensus.cc:697] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 9 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:06.768865 18015 raft_consensus.cc:1240] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 LEADER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:06.774178 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 187987us
I20260709 12:11:06.724375 21535 raft_consensus.cc:515] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:06.722996 21673 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:06.723874 21621 consensus_queue.cc:1059] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 12:11:06.767822 21718 raft_consensus.cc:2804] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:06.772433 21659 raft_consensus.cc:2804] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:06.769778 21085 raft_consensus.cc:2804] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:11:06.800647 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 56259.7us
I20260709 12:11:06.789562 21635 raft_consensus.cc:2749] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:06.781555 21435 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:06.786974 21718 raft_consensus.cc:493] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:06.829447 21738 log.cc:927] Time spent T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:11:06.794036 21085 raft_consensus.cc:493] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:06.795392 21244 consensus_queue.cc:1048] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:11:06.848793 21695 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:06.849321 21695 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:06.851610 21695 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:06.855623 21752 raft_consensus.cc:493] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.856251 21752 raft_consensus.cc:515] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:06.856765 21635 raft_consensus.cc:493] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.857250 21635 raft_consensus.cc:515] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:11:06.858139 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.859416 21635 leader_election.cc:290] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:06.860045 21635 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:06.860605 21635 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:06.833832 21401 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:06.839466 21659 raft_consensus.cc:697] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 11 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:06.883980 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
W20260709 12:11:06.885996 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.886340 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:06.887250 18089 raft_consensus.cc:2393] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 6: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:06.888602 18093 raft_consensus.cc:1240] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:07.015571 18090 raft_consensus.cc:1240] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:06.942499 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 240243us
I20260709 12:11:06.952988 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:06.969509 18023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 2174) took 1140 ms. Trace:
I20260709 12:11:06.916764 18098 raft_consensus.cc:1240] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:07.017726 18062 leader_election.cc:304] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:06.918016 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:11:06.942257 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 437045us
I20260709 12:11:07.017653 18023 rpcz_store.cc:276] 0709 12:11:05.829145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.610183 (+781038us) service_pool.cc:224] Handling call
0709 12:11:06.612883 (+  2700us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:06.616315 (+  3432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:06.616347 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:06.616864 (+   517us) log.cc:844] Serialized 52 byte log entry
0709 12:11:06.740091 (+123227us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:06.740196 (+   105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:06.740286 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:06.954501 (+214215us) raft_consensus.cc:1685] finished
0709 12:11:06.954533 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:06.969434 (+ 14901us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2925,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"thread_start_us":122813,"threads_started":1,"wal-append.queue_time_us":270309}
I20260709 12:11:06.900827 18091 raft_consensus.cc:1275] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:06.848347 21718 raft_consensus.cc:3060] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:06.867503 21085 raft_consensus.cc:3060] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:06.942725 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 286079us
I20260709 12:11:07.023244 18094 raft_consensus.cc:1240] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:06.852499 21435 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:07.038889 17831 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 4ccf0bcc20ae40e79c32530091613e1e with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e28f77912a9c4ba2b9841f6fedddc2db is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
W20260709 12:11:06.946497 21739 log.cc:927] Time spent T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 12:11:07.030675 17989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:06.952687 21663 leader_election.cc:290] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:06.871603 21401 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:07.033937 21635 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:07.035588 21673 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:06.946066 21748 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.022341 18608 leader_election.cc:304] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:07.047004 18093 raft_consensus.cc:1240] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:11:07.020785 21752 leader_election.cc:290] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:06.963570 21535 leader_election.cc:290] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:07.061169 18094 raft_consensus.cc:3055] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:07.062987 18094 raft_consensus.cc:740] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:07.063509 18608 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:07.064867 18608 leader_election.cc:400] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 election: Vote denied by peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297) with higher term. Message: Invalid argument: T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 9. Current term is 10.
I20260709 12:11:07.065902 18608 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:11:07.059414 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 283027us
I20260709 12:11:07.063690 18094 consensus_queue.cc:260] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:07.071120 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:07.074009 18644 raft_consensus.cc:2393] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 7: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:07.067830 17914 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:07.076581 18094 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:07.078118 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:07.067274 21544 raft_consensus.cc:2749] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:06.868717 21702 consensus_queue.cc:237] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:07.068733 21581 raft_consensus.cc:2804] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:07.072598 21673 raft_consensus.cc:2804] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:07.075524 18608 leader_election.cc:304] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:07.072662 21535 raft_consensus.cc:3060] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.082096 18020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53022 (request call id 595) took 2968 ms. Trace:
W20260709 12:11:07.105788 17914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.080725 21752 raft_consensus.cc:2749] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:07.067843 21748 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:07.080704 21629 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
W20260709 12:11:07.143105 17914 leader_election.cc:336] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Timed out: RequestConsensusVote RPC to 127.16.98.195:41931 timed out after 1.530s (SENT)
I20260709 12:11:07.084316 21581 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:06.959275 21659 consensus_queue.cc:237] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:07.154700 18094 raft_consensus.cc:1275] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 12:11:07.155236 18094 pending_rounds.cc:85] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110: Aborting all ops after (but not including) 10
I20260709 12:11:07.155591 18094 pending_rounds.cc:107] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:11:07.155936 18094 raft_consensus.cc:2889] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:07.173331 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 303457us
I20260709 12:11:07.080926 20977 consensus_queue.cc:1048] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 12:11:07.094379 21673 raft_consensus.cc:697] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:07.094451 21754 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:07.108649 21544 raft_consensus.cc:2749] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:07.144784 21663 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:07.166235 21581 raft_consensus.cc:3060] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:07.152230 21695 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:07.176577 21629 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:07.199460 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 175389us
I20260709 12:11:07.186895 21754 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:07.191586 21758 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
W20260709 12:11:07.212870 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 103290us
W20260709 12:11:07.214036 21334 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 12:11:07.214181 21765 consensus_queue.cc:1048] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:11:07.219240 21756 log.cc:927] Time spent T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 12:11:07.220209 21758 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:07.226241 21748 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:07.222478 21758 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:07.259158 21759 log.cc:927] Time spent T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:11:07.259720 21435 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:11:07.260393 17914 leader_election.cc:336] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Timed out: RequestConsensusVote RPC to 127.16.98.195:41931 timed out after 1.659s (SENT)
I20260709 12:11:07.276403 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:11:07.261765 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 61427.9us
W20260709 12:11:07.264091 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.190662 21663 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:07.277832 17941 raft_consensus.cc:2468] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
W20260709 12:11:07.279109 17914 leader_election.cc:336] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Timed out: RequestConsensusVote RPC to 127.16.98.195:41931 timed out after 1.693s (SENT)
W20260709 12:11:07.280051 17914 leader_election.cc:336] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Timed out: RequestConsensusVote RPC to 127.16.98.195:41931 timed out after 1.733s (SENT)
I20260709 12:11:07.280521 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:11:07.280779 17914 leader_election.cc:336] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Timed out: RequestConsensusVote RPC to 127.16.98.195:41931 timed out after 1.749s (SENT)
I20260709 12:11:07.281268 17948 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 9.
I20260709 12:11:07.281306 17914 leader_election.cc:304] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:07.284633 21746 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.286485 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:07.287395 17944 raft_consensus.cc:2393] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 7: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:07.287969 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:07.288663 17945 raft_consensus.cc:3060] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:07.196321 21695 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:07.289855 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:11:07.290148 17914 leader_election.cc:336] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Timed out: RequestConsensusVote RPC to 127.16.98.195:41931 timed out after 1.778s (SENT)
W20260709 12:11:07.291098 17914 leader_election.cc:336] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Timed out: RequestConsensusVote RPC to 127.16.98.195:41931 timed out after 1.883s (SENT)
I20260709 12:11:07.291631 17914 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:07.292443 18094 raft_consensus.cc:1275] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:11:07.294061 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:07.294198 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:07.295259 17947 raft_consensus.cc:2410] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:11:07.267511 21401 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:07.282565 21762 consensus_queue.cc:1048] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
W20260709 12:11:07.304931 18608 leader_election.cc:336] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 1.718s (SENT)
I20260709 12:11:07.307930 18608 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:11:07.309222 18608 leader_election.cc:336] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 1.821s (SENT)
W20260709 12:11:07.306757 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 127517us
I20260709 12:11:07.310238 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:11:07.312130 18608 leader_election.cc:336] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 2.016s (SENT)
W20260709 12:11:07.313135 18608 leader_election.cc:336] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 2.178s (SENT)
I20260709 12:11:07.313604 18608 leader_election.cc:304] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:07.305856 17945 raft_consensus.cc:2468] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
I20260709 12:11:07.316407 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:07.316807 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:07.318255 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:07.319211 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:07.319710 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:11:07.321552 18608 leader_election.cc:336] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 2.212s (SENT)
I20260709 12:11:07.323021 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:07.323673 17941 raft_consensus.cc:2468] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 8.
I20260709 12:11:07.324544 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:07.325281 17941 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.356714 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:07.357790 18022 raft_consensus.cc:2393] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 6: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:07.359421 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:07.360216 17945 raft_consensus.cc:2468] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 7.
W20260709 12:11:07.367511 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.369511 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:07.370059 17944 raft_consensus.cc:3060] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:07.297346 21746 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:07.372014 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:07.376550 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:07.379528 17947 raft_consensus.cc:1240] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:07.368677 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:07.381951 18023 raft_consensus.cc:1275] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:07.380831 18022 raft_consensus.cc:2468] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 8.
W20260709 12:11:07.384658 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 60194.6us
I20260709 12:11:07.317826 21435 raft_consensus.cc:2749] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:07.386374 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
W20260709 12:11:07.387111 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 125577us
I20260709 12:11:07.315157 21764 raft_consensus.cc:2749] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:07.361339 21544 raft_consensus.cc:2749] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:07.390064 17941 raft_consensus.cc:2468] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 9.
I20260709 12:11:07.359251 21763 raft_consensus.cc:2749] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:07.391433 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:07.282789 21673 consensus_queue.cc:237] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:07.395681 17913 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:07.400576 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:07.407280 17949 raft_consensus.cc:1240] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
W20260709 12:11:07.411873 21760 log.cc:927] Time spent T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 12:11:07.413214 18018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 2176) took 1583 ms. Trace:
I20260709 12:11:07.413546 18018 rpcz_store.cc:276] 0709 12:11:05.829787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.645866 (+816079us) service_pool.cc:224] Handling call
0709 12:11:06.646191 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:06.690946 (+ 44755us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:06.691002 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:06.731480 (+ 40478us) log.cc:844] Serialized 26 byte log entry
0709 12:11:07.077820 (+346340us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:07.077856 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.077919 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:07.412993 (+335074us) raft_consensus.cc:1685] finished
0709 12:11:07.413011 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.413147 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21507,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":4552,"thread_start_us":307799,"threads_started":1,"wal-append.queue_time_us":442143}
I20260709 12:11:07.419502 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:07.420084 18094 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
I20260709 12:11:07.424969 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:07.424626 21476 consensus_queue.cc:260] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:07.425184 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:07.425576 18635 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:11:07.425849 18636 raft_consensus.cc:2393] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 9: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:07.427708 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:11:07.399747 21757 log.cc:927] Time spent T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:11:07.428207 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:07.425750 21476 raft_consensus.cc:3060] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:07.438818 21629 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:07.442903 21663 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:07.457202 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:11:07.475582 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.088371 18020 rpcz_store.cc:276] 0709 12:11:04.113461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.583014 (+2469553us) service_pool.cc:224] Handling call
0709 12:11:06.595534 (+ 12520us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.597466 (+  1932us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:06.757157 (+159691us) log.cc:844] Serialized 14 byte log entry
0709 12:11:07.081656 (+324499us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:07.081735 (+    79us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:07.081805 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.081891 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.082028 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":265450,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":2258,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":2606,"thread_start_us":451285,"threads_started":2}
I20260709 12:11:07.408910 21758 raft_consensus.cc:2749] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:07.475658 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:07.483487 18094 raft_consensus.cc:2468] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
W20260709 12:11:07.477275 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 166982us
W20260709 12:11:07.485384 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:07.485376 17914 leader_election.cc:336] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Timed out: RequestConsensusVote RPC to 127.16.98.195:41931 timed out after 2.018s (SENT)
I20260709 12:11:07.485267 17944 raft_consensus.cc:2468] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
I20260709 12:11:07.487995 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:11:07.493888 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 112549us
I20260709 12:11:07.495819 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:07.407327 21764 consensus_queue.cc:1048] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.081s
I20260709 12:11:07.498186 17941 raft_consensus.cc:1240] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:11:07.498744 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:11:07.499749 18608 leader_election.cc:336] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 1.995s (SENT)
I20260709 12:11:07.500497 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:07.501230 17941 raft_consensus.cc:2468] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 7.
I20260709 12:11:07.502985 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:07.503589 17943 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 11.
I20260709 12:11:07.504369 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:07.505373 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:07.506717 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:07.503603 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:11:07.511916 18608 leader_election.cc:336] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 2.123s (SENT)
I20260709 12:11:07.512463 18608 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:07.514703 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:07.517107 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:11:07.517428 18608 leader_election.cc:336] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 2.134s (SENT)
I20260709 12:11:07.518224 17942 raft_consensus.cc:1240] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:07.518384 17948 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "158a286025af4eddba6fb641c128cd25"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:44668
I20260709 12:11:07.519002 17948 raft_consensus.cc:493] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:07.519320 17948 raft_consensus.cc:3060] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:07.520277 21780 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:07.520783 21780 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:07.522774 21629 raft_consensus.cc:2749] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:07.522962 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:07.523468 21535 raft_consensus.cc:2749] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:07.518237 18608 leader_election.cc:336] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 2.171s (SENT)
I20260709 12:11:07.526889 18643 raft_consensus.cc:1240] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:07.527012 18608 leader_election.cc:336] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 2.191s (SENT)
I20260709 12:11:07.506522 21748 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
W20260709 12:11:07.527407 17989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.537989 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:07.548704 17949 raft_consensus.cc:2393] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 9: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:07.538659 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:07.527051 17944 raft_consensus.cc:2468] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 10.
I20260709 12:11:07.539212 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:11:07.527132 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 133118us
I20260709 12:11:07.547185 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:07.548974 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:07.598166 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:07.599439 18094 raft_consensus.cc:2393] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 6: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:07.609747 17945 raft_consensus.cc:1240] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:11:07.580574 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:07.595933 18019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 2173) took 1767 ms. Trace:
I20260709 12:11:07.613451 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:07.614145 17943 raft_consensus.cc:2368] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 6. Current term is 7.
I20260709 12:11:07.579519 17948 raft_consensus.cc:515] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:07.612176 18019 rpcz_store.cc:276] 0709 12:11:05.828744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.600803 (+772059us) service_pool.cc:224] Handling call
0709 12:11:06.601176 (+   373us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:06.607593 (+  6417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:06.607649 (+    56us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:06.609594 (+  1945us) log.cc:844] Serialized 52 byte log entry
0709 12:11:07.072330 (+462736us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:07.072387 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.072481 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:07.580241 (+507760us) raft_consensus.cc:1685] finished
0709 12:11:07.580268 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:07.595867 (+ 15599us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4897,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":71,"thread_start_us":331255,"threads_started":1,"wal-append.queue_time_us":500580}
I20260709 12:11:07.616801 17942 raft_consensus.cc:1240] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 7. Current term is 8. Ops: [4.3-7.5]
I20260709 12:11:07.623111 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:07.623867 17941 raft_consensus.cc:2393] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 6: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:07.625245 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:07.627339 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:07.629730 17947 raft_consensus.cc:1240] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 12:11:07.615774 21779 log.cc:927] Time spent T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 12:11:07.630555 17948 leader_election.cc:290] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:07.631739 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:07.632372 17942 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:07.633805 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 106983us
I20260709 12:11:07.638623 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:07.637950 18094 raft_consensus.cc:1275] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:11:07.638628 17913 leader_election.cc:336] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 1.526s (SENT)
I20260709 12:11:07.639755 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:07.641219 17913 leader_election.cc:304] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:07.645372 21693 raft_consensus.cc:3060] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.623574 21754 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:07.650355 21746 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:07.629994 21695 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:07.663762 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:07.689339 21581 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:07.692505 18640 raft_consensus.cc:1240] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:07.692761 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:07.693055 21581 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:07.694747 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:07.695932 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:07.696592 18640 raft_consensus.cc:2393] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 7: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
W20260709 12:11:07.698524 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 59944.4us
W20260709 12:11:07.699972 17913 leader_election.cc:336] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 1.530s (SENT)
I20260709 12:11:07.700932 17913 leader_election.cc:304] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:07.706379 18609 leader_election.cc:304] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:07.698374 18608 leader_election.cc:304] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:07.720043 18015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45464 (request call id 1964) took 4040 ms. Trace:
I20260709 12:11:07.720431 18015 rpcz_store.cc:276] 0709 12:11:03.661644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:05.345186 (+1683542us) service_pool.cc:224] Handling call
0709 12:11:05.599708 (+254522us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:06.770291 (+1170583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.667106 (+896815us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540005fad4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:11:07.702089 (+ 34983us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2688273792}
I20260709 12:11:07.598042 21748 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:07.726717 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:11:07.728021 17988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.728487 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:07.730759 17913 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:07.728963 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: true dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:07.736256 18636 raft_consensus.cc:3055] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:07.740417 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:07.741127 18092 raft_consensus.cc:2393] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 9: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:07.742003 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:07.742131 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:07.742411 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:07.742125 18091 raft_consensus.cc:1240] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:11:07.743230 18098 raft_consensus.cc:2393] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 6: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:07.743911 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:07.744321 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:11:07.722998 21718 consensus_meta.cc:287] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.678s	user 0.010s	sys 0.000s
I20260709 12:11:07.744855 18096 raft_consensus.cc:2468] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
I20260709 12:11:07.742998 17913 leader_election.cc:304] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:07.736563 18636 raft_consensus.cc:740] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:07.746698 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:07.744108 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:07.745482 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:07.751675 17942 raft_consensus.cc:2410] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:11:07.753067 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:07.715044 21758 raft_consensus.cc:2749] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:07.753070 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:07.755455 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:07.758220 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:07.771749 18091 raft_consensus.cc:3060] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:11:07.759603 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 61286.7us
W20260709 12:11:07.773715 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.777347 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:07.778606 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:07.779181 17947 raft_consensus.cc:2468] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:11:07.779913 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:07.727146 21039 raft_consensus.cc:2749] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:07.735764 21578 raft_consensus.cc:2804] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:11:07.796772 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.801043 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:07.790323 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:07.803871 17944 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
I20260709 12:11:07.753588 21772 raft_consensus.cc:2804] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:07.782230 21544 raft_consensus.cc:3060] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:07.831940 17941 raft_consensus.cc:1240] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:07.828693 18091 raft_consensus.cc:2468] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
I20260709 12:11:07.834511 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:07.754374 21746 consensus_queue.cc:1059] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 12:11:07.750242 21401 consensus_queue.cc:1059] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 12:11:07.752403 21162 consensus_queue.cc:1048] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 12:11:07.770018 21718 raft_consensus.cc:515] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:07.864446 21718 leader_election.cc:290] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:07.864889 21695 consensus_queue.cc:1048] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:11:07.867352 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:07.867950 18095 raft_consensus.cc:3060] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:07.870697 21659 consensus_queue.cc:1059] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:11:07.874802 21629 raft_consensus.cc:3055] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:07.875154 21629 raft_consensus.cc:740] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:07.876116 18019 raft_consensus.cc:1275] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:11:07.875981 21629 consensus_queue.cc:260] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:07.833182 21758 raft_consensus.cc:2749] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:07.877213 21629 raft_consensus.cc:3060] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:07.878973 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:07.879575 18015 raft_consensus.cc:2468] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 7.
I20260709 12:11:07.881008 18636 consensus_queue.cc:260] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:07.882093 18636 raft_consensus.cc:3060] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:11:07.847597 21770 log.cc:927] Time spent T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:11:07.847452 21435 consensus_queue.cc:1048] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:07.848168 21535 consensus_queue.cc:1048] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:07.848860 21762 consensus_queue.cc:1048] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:07.849562 21765 consensus_queue.cc:1048] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:07.851188 21401 raft_consensus.cc:493] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:07.851794 21746 raft_consensus.cc:3055] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:07.850261 21660 consensus_queue.cc:1048] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:11:07.824678 21772 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:07.840970 21334 consensus_queue.cc:1059] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
W20260709 12:11:07.861574 21085 consensus_meta.cc:287] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.828s	user 0.011s	sys 0.000s
I20260709 12:11:07.862402 21786 raft_consensus.cc:3055] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:07.889263 18090 raft_consensus.cc:1275] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:07.896605 21748 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:07.899863 18636 raft_consensus.cc:2468] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
W20260709 12:11:07.963768 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 118764us
I20260709 12:11:07.830988 21578 raft_consensus.cc:697] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 9 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:07.913484 21780 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:11:07.921622 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.914580 18095 raft_consensus.cc:2468] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 8.
W20260709 12:11:07.934489 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.955503 17914 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:11:07.974910 17914 leader_election.cc:304] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:11:07.976483 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 239142us
I20260709 12:11:07.983593 17914 leader_election.cc:304] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:11:07.983786 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:07.974696 18609 leader_election.cc:304] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:07.954303 21746 raft_consensus.cc:740] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:07.965758 21772 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:07.997552 17914 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:08.002315 18062 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:07.969663 21786 raft_consensus.cc:740] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:08.004088 17914 leader_election.cc:304] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:08.006110 18062 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:08.008978 18062 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:08.009214 17914 leader_election.cc:304] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:11:07.973274 21621 raft_consensus.cc:3055] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:08.010277 18062 leader_election.cc:304] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:08.011268 21578 consensus_queue.cc:237] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:07.964592 21401 raft_consensus.cc:515] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:11:08.015581 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 272622us
I20260709 12:11:08.015684 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:08.001827 21635 consensus_queue.cc:1059] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:11:08.021711 17913 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:08.020026 18062 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:11:07.986698 21748 raft_consensus.cc:2804] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:08.025936 18062 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:08.021063 17944 raft_consensus.cc:3060] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:08.030992 18062 leader_election.cc:304] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:08.058055 18062 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:11:08.058903 18062 leader_election.cc:304] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:11:08.060238 21769 raft_consensus.cc:2749] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:08.060900 21769 consensus_queue.cc:1059] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:08.000568 21763 raft_consensus.cc:2749] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:08.015534 21476 consensus_meta.cc:287] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.572s	user 0.011s	sys 0.000s
I20260709 12:11:07.986905 21782 raft_consensus.cc:2749] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:11:08.036846 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 62188.9us
I20260709 12:11:08.037084 17946 raft_consensus.cc:1275] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:08.038264 17913 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:07.972280 21085 raft_consensus.cc:515] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:08.021320 21755 raft_consensus.cc:2749] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:08.017247 21712 raft_consensus.cc:2749] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:08.015276 21721 raft_consensus.cc:2804] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:08.021183 21244 raft_consensus.cc:2749] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:08.018890 21621 raft_consensus.cc:740] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:08.015003 20977 raft_consensus.cc:2804] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:08.005643 21801 raft_consensus.cc:2749] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:08.021039 21663 raft_consensus.cc:2804] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:07.987349 21581 consensus_queue.cc:1048] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 12:11:08.030100 21748 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.030776 21673 raft_consensus.cc:2749] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:08.062862 18062 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:11:08.111090 18608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.039608 21767 raft_consensus.cc:2804] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:08.038866 21792 raft_consensus.cc:2749] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:08.046635 21797 raft_consensus.cc:2804] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:08.039587 21803 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:08.073242 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 55854.2us
I20260709 12:11:08.108325 18636 raft_consensus.cc:1240] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 9 LEADER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:08.122913 18644 raft_consensus.cc:1240] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:08.068917 21768 raft_consensus.cc:2804] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:08.064982 21799 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:08.127254 18608 leader_election.cc:336] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 1.553s (SENT)
I20260709 12:11:08.155019 18608 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:08.069043 21754 raft_consensus.cc:2804] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:08.072322 21769 raft_consensus.cc:3055] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:08.133764 18640 raft_consensus.cc:1275] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:08.072820 21758 raft_consensus.cc:2749] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:08.143155 18635 raft_consensus.cc:1275] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:11:08.105921 21721 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.134565 21663 raft_consensus.cc:697] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:08.202903 21663 consensus_queue.cc:237] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:08.189580 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 60034.6us
I20260709 12:11:08.218429 17944 raft_consensus.cc:2468] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 8.
I20260709 12:11:08.121358 21748 raft_consensus.cc:3060] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:08.120898 21767 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.131115 21755 raft_consensus.cc:2749] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:08.228196 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:08.128669 21797 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:08.144769 20977 raft_consensus.cc:697] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
W20260709 12:11:08.290304 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 227492us
W20260709 12:11:08.228928 21693 consensus_meta.cc:287] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.583s	user 0.012s	sys 0.000s
I20260709 12:11:08.186427 21768 raft_consensus.cc:697] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 9 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:08.194774 21721 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:08.300391 17940 raft_consensus.cc:2410] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:11:08.196043 21769 raft_consensus.cc:740] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:08.074795 21746 consensus_queue.cc:260] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:08.210276 21771 raft_consensus.cc:2749] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:08.290704 21797 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:08.238711 21767 raft_consensus.cc:3060] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:08.105283 21786 consensus_queue.cc:260] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:08.232240 21754 raft_consensus.cc:697] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:08.155576 21803 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:11:08.327409 21804 log.cc:927] Time spent T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:11:08.329779 21811 consensus_queue.cc:1048] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:11:08.331748 21768 consensus_queue.cc:237] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:08.336229 20977 consensus_queue.cc:237] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:08.322260 21746 raft_consensus.cc:3060] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:08.241868 21621 consensus_queue.cc:260] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:08.232764 21799 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:08.318797 21401 leader_election.cc:290] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:11:08.349246 21544 consensus_meta.cc:287] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.513s	user 0.007s	sys 0.003s
W20260709 12:11:08.380206 21629 consensus_meta.cc:287] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.503s	user 0.009s	sys 0.001s
I20260709 12:11:08.382509 21799 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:08.324189 21817 consensus_queue.cc:1059] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 12:11:07.855131 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:08.355510 21769 consensus_queue.cc:260] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 8.11, Last appended by leader: 11, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:08.387743 21769 raft_consensus.cc:3060] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:08.390586 21806 log.cc:927] Time spent T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
I20260709 12:11:08.354619 21803 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:11:08.407030 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:08.403625 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 191322us
W20260709 12:11:08.407501 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 56488us
W20260709 12:11:08.433818 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 377400us
W20260709 12:11:08.436334 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.366696 21544 raft_consensus.cc:2749] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:08.439082 17988 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:08.410634 17989 leader_election.cc:304] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:08.440884 17989 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:08.441843 17989 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:08.406603 21085 leader_election.cc:290] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:08.408200 21803 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:08.456049 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.456943 17989 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:08.466953 17989 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:11:08.457435 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 330185us
I20260709 12:11:08.468003 17989 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:11:08.469863 17989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.471697 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:08.472390 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:08.472992 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:08.360777 21818 consensus_queue.cc:1059] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 12:11:08.471572 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:08.474452 18016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 2185) took 1942 ms. Trace:
I20260709 12:11:08.477139 18016 rpcz_store.cc:276] 0709 12:11:06.532297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:06.751942 (+219645us) service_pool.cc:224] Handling call
0709 12:11:06.753717 (+  1775us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:06.754132 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:06.754172 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:07.668906 (+914734us) spinlock_profiling.cc:243] Waited 3.25 ms on lock 0x7b2c0005beb8. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4b2aba11 00007f7f4b2bb372 00007f7f4c9eda01 00007f7f4c9b243a 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2
0709 12:11:07.698789 (+ 29883us) log.cc:844] Serialized 52 byte log entry
0709 12:11:08.003320 (+304531us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:08.138363 (+135043us) log.cc:844] Serialized 14 byte log entry
0709 12:11:08.290418 (+152055us) log.cc:844] Serialized 14 byte log entry
0709 12:11:08.459802 (+169384us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.459874 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:08.474187 (+ 14313us) raft_consensus.cc:1685] finished
0709 12:11:08.474216 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:08.474382 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5,"prepare.queue_time_us":199875,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":59,"raft.queue_time_us":235904,"raft.run_cpu_time_us":336,"raft.run_wall_time_us":11321,"spinlock_wait_cycles":7485824,"thread_start_us":700769,"threads_started":4,"wal-append.queue_time_us":388508}
I20260709 12:11:08.447054 21401 raft_consensus.cc:2804] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:08.450668 21825 raft_consensus.cc:2749] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:11:08.490628 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 187550us
I20260709 12:11:08.482857 21671 raft_consensus.cc:2749] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:08.483987 21401 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:08.500007 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 61059.8us
I20260709 12:11:08.500942 17988 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:08.488721 21744 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.483959 21812 raft_consensus.cc:2804] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:08.501685 21401 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:08.502141 21799 raft_consensus.cc:2804] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:08.496814 21825 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:08.528703 21825 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:08.496014 21721 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:08.530929 21825 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:08.531522 21721 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:08.447270 21754 consensus_queue.cc:237] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:08.509758 21671 consensus_queue.cc:1059] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:08.473440 21803 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:08.515862 17988 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:08.518440 21744 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:08.494480 21826 raft_consensus.cc:2749] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:08.488482 21819 consensus_queue.cc:1048] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:11:08.497359 21823 raft_consensus.cc:2749] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:08.513671 21772 consensus_meta.cc:287] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.506s	user 0.009s	sys 0.001s
I20260709 12:11:08.554726 17945 raft_consensus.cc:1240] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:08.556001 17945 raft_consensus.cc:1275] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:11:08.552119 21821 log.cc:927] Time spent T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:11:08.554283 21772 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:08.550987 21741 raft_consensus.cc:3055] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:08.519717 21799 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
W20260709 12:11:08.572278 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 56504us
I20260709 12:11:08.577593 17988 leader_election.cc:304] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:08.519891 21812 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.547286 21825 raft_consensus.cc:2804] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:08.571159 21671 consensus_queue.cc:1243] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer e28f77912a9c4ba2b9841f6fedddc2db log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:11:08.584594 17944 raft_consensus.cc:1240] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:08.588987 21834 raft_consensus.cc:2749] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:08.589808 17989 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:08.575152 21741 raft_consensus.cc:740] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:08.579510 21799 raft_consensus.cc:3060] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:08.579975 21812 raft_consensus.cc:3060] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:08.593997 21822 log.cc:927] Time spent T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:11:08.583475 21825 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
W20260709 12:11:08.606583 17913 leader_election.cc:336] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 1.955s (SENT)
I20260709 12:11:08.607199 17913 leader_election.cc:304] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:08.585207 21826 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:08.587796 21823 raft_consensus.cc:493] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.589701 21476 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:08.617871 21823 raft_consensus.cc:515] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:08.586578 21797 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:08.623049 21803 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:08.623267 17948 raft_consensus.cc:1240] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:08.624497 21797 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:08.630151 21741 consensus_queue.cc:260] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:08.618099 21826 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:08.635848 21823 leader_election.cc:290] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:08.638460 21812 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:08.639765 21772 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:08.618326 21476 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:08.642469 21833 raft_consensus.cc:2749] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:08.653949 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:08.619176 21834 raft_consensus.cc:2749] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:08.654376 21790 log.cc:927] Time spent T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.795s	user 0.000s	sys 0.003s
I20260709 12:11:08.611483 21825 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:08.655278 21744 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:11:08.657090 17913 leader_election.cc:336] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 2.018s (SENT)
W20260709 12:11:08.665966 21795 log.cc:927] Time spent T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.810s	user 0.000s	sys 0.002s
I20260709 12:11:08.617148 21763 raft_consensus.cc:2749] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:08.680876 17913 leader_election.cc:304] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:08.663286 21826 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:08.695994 21476 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:08.688992 21813 raft_consensus.cc:2749] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:08.679584 21401 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:08.700862 21401 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:08.701421 21767 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:08.703508 21767 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:08.704408 21825 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:08.677979 21748 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:08.709460 21748 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:08.716789 21825 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:08.724505 21799 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
W20260709 12:11:08.727578 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 150068us
I20260709 12:11:08.728214 17947 raft_consensus.cc:1275] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:11:08.728626 17947 pending_rounds.cc:85] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1: Aborting all ops after (but not including) 4
I20260709 12:11:08.728400 17988 leader_election.cc:304] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:08.728838 17947 pending_rounds.cc:107] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:11:08.729111 17947 raft_consensus.cc:2889] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:08.729686 17940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2249) took 1409 ms. Trace:
I20260709 12:11:08.729936 21843 raft_consensus.cc:2749] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:08.730100 17940 rpcz_store.cc:276] 0709 12:11:07.319223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.319426 (+   203us) service_pool.cc:224] Handling call
0709 12:11:08.727754 (+1408328us) spinlock_profiling.cc:243] Waited 980 ms on lock 0x7b54000a1254. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:08.727902 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2253448960}
I20260709 12:11:08.731616 17988 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:08.732270 21843 raft_consensus.cc:2749] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:08.733299 17988 leader_election.cc:304] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:08.733952 21843 raft_consensus.cc:2804] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:08.734299 21843 raft_consensus.cc:493] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:08.734659 21843 raft_consensus.cc:3060] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:08.735117 18635 raft_consensus.cc:1275] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:11:08.741822 21843 raft_consensus.cc:515] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:08.745529 17988 leader_election.cc:304] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:08.746629 17988 leader_election.cc:400] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Vote denied by peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123) with higher term. Message: Invalid argument: T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 6. Current term is 7.
I20260709 12:11:08.746924 17988 leader_election.cc:403] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:11:08.747347 21811 raft_consensus.cc:2749] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:08.747303 21843 leader_election.cc:290] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:11:08.760236 21794 log.cc:927] Time spent T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.906s	user 0.002s	sys 0.000s
I20260709 12:11:08.761557 17949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44668 (request call id 634) took 1109 ms. Trace:
I20260709 12:11:08.761597 17942 raft_consensus.cc:1240] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:08.762040 17949 rpcz_store.cc:276] 0709 12:11:07.652032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.686226 (+ 34194us) service_pool.cc:224] Handling call
0709 12:11:07.686539 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:07.686910 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:07.686939 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:07.687370 (+   431us) log.cc:844] Serialized 26 byte log entry
0709 12:11:07.811637 (+124267us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:07.811680 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:07.811752 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:08.759692 (+947940us) spinlock_profiling.cc:243] Waited 61.5 ms on lock 0x7b4400022b4c. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f497ebc85 00007f7f497ec6a2 00007f7f4c55e1db 00007f7f4c559aaf 00007f7f4c54d86e 00007f7f4c54cbb6 00007f7f4c54c7d8 00007f7f4c556221 00007f7f4c5561d9 00007f7f4c556169
0709 12:11:08.761266 (+  1574us) raft_consensus.cc:1685] finished
0709 12:11:08.761285 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:08.761503 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13183,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":21352,"spinlock_wait_cycles":141556480,"thread_start_us":123920,"threads_started":1,"wal-append.queue_time_us":166462}
I20260709 12:11:08.763187 17942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50334 (request call id 2248) took 1021 ms. Trace:
I20260709 12:11:08.763581 17942 rpcz_store.cc:276] 0709 12:11:07.741754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.808577 (+ 66823us) service_pool.cc:224] Handling call
0709 12:11:08.761418 (+952841us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:08.762212 (+   794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.763013 (+   801us) spinlock_profiling.cc:243] Waited 952 ms on lock 0x7b54000f7650. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b18ad 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:08.763135 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2190558592}
I20260709 12:11:08.763978 21812 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:08.772146 17988 leader_election.cc:304] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
W20260709 12:11:08.776772 17913 leader_election.cc:336] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 2.055s (SENT)
W20260709 12:11:08.777992 18608 leader_election.cc:336] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 1.897s (SENT)
I20260709 12:11:08.779014 21752 consensus_queue.cc:1048] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:08.780936 21842 raft_consensus.cc:2749] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:11:08.781976 21814 consensus_queue.cc:1059] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:11:08.782887 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.790002 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:08.791064 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:11:08.791786 18608 leader_election.cc:336] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 2.159s (SENT)
W20260709 12:11:08.793040 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 300676us
I20260709 12:11:08.794031 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:08.794229 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:08.794505 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:08.795228 18089 raft_consensus.cc:2393] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 9: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:08.791721 18093 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 13.
I20260709 12:11:08.804669 17989 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:08.805421 17988 leader_election.cc:304] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:08.808418 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:08.809146 18094 raft_consensus.cc:2393] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 10: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:08.771519 21812 raft_consensus.cc:2749] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123) with higher term. Message: Invalid argument: T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 6. Current term is 7.
W20260709 12:11:08.817790 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 244852us
I20260709 12:11:08.822890 17988 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:08.826294 17988 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:08.828717 17988 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:08.819499 21825 raft_consensus.cc:2804] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:08.810590 21817 consensus_queue.cc:1059] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:11:08.831207 17988 leader_election.cc:304] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:08.831626 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:08.823966 21812 raft_consensus.cc:2749] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:08.836918 18092 raft_consensus.cc:1275] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:08.827632 21811 raft_consensus.cc:2749] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:08.829516 21401 raft_consensus.cc:2749] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:08.828397 21842 raft_consensus.cc:2749] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:08.844156 17988 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:08.845201 21767 consensus_queue.cc:1048] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:11:08.845649 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 52025us
I20260709 12:11:08.845784 21784 consensus_queue.cc:1059] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:11:08.843545 21834 raft_consensus.cc:2749] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:08.845993 21842 raft_consensus.cc:2749] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:08.848155 21784 raft_consensus.cc:3055] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:08.848053 21834 consensus_queue.cc:1059] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:08.848548 21784 raft_consensus.cc:740] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:08.849875 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:08.850499 18016 raft_consensus.cc:2468] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
I20260709 12:11:08.842916 17947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50334 (request call id 2250) took 1100 ms. Trace:
I20260709 12:11:08.855638 17947 rpcz_store.cc:276] 0709 12:11:07.742219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:07.813152 (+ 70933us) service_pool.cc:224] Handling call
0709 12:11:08.727882 (+914730us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:08.729385 (+  1503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:08.842740 (+113355us) spinlock_profiling.cc:243] Waited 914 ms on lock 0x7b54000a1250. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b18ad 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:08.842863 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2102877952}
I20260709 12:11:08.856142 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:08.856788 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:08.857542 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:08.858336 18022 raft_consensus.cc:2410] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:11:08.858367 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:08.859035 18023 raft_consensus.cc:2468] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 10.
I20260709 12:11:08.853752 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:08.863345 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:08.863773 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:08.864028 18016 raft_consensus.cc:2393] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 10: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:08.864336 18639 raft_consensus.cc:1240] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:08.863358 18644 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:11:08.835148 21825 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:08.867589 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:08.824908 21792 consensus_queue.cc:1048] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:11:08.856760 18024 raft_consensus.cc:2468] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 7.
I20260709 12:11:08.868837 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:08.869205 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:08.868170 18023 raft_consensus.cc:2468] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 9.
I20260709 12:11:08.869269 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:08.870266 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:08.870276 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:08.871585 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:08.849371 21784 consensus_queue.cc:260] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:11:08.875002 17913 leader_election.cc:336] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 2.239s (SENT)
I20260709 12:11:08.875473 17913 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:08.876284 18023 raft_consensus.cc:2410] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:11:08.877296 18015 raft_consensus.cc:2393] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 10: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:08.869918 18017 raft_consensus.cc:2468] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 7.
I20260709 12:11:08.868109 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:08.878773 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:08.879149 18019 raft_consensus.cc:2393] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 9: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:08.879500 18017 raft_consensus.cc:2393] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 9: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:08.878777 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:08.881829 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:08.881970 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:08.882584 18639 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 12.
I20260709 12:11:08.884476 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:08.885131 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:08.889150 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:08.889243 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:08.890085 18021 raft_consensus.cc:2410] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:11:08.891659 18635 raft_consensus.cc:1240] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:08.897214 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:08.898087 18639 raft_consensus.cc:2393] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 11: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:11:08.871086 21825 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:08.901854 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:08.905553 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:08.845669 21824 consensus_queue.cc:1048] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.095s
I20260709 12:11:08.906219 18021 raft_consensus.cc:2393] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 9: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:08.908860 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:08.910437 18016 raft_consensus.cc:3055] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:08.910852 18016 raft_consensus.cc:740] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:08.913298 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:08.914165 18024 raft_consensus.cc:2368] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 6. Current term is 7.
I20260709 12:11:08.915510 18016 consensus_queue.cc:260] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:08.916592 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:08.928458 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:08.929114 18024 raft_consensus.cc:2368] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 9. Current term is 10.
I20260709 12:11:08.850505 21780 consensus_queue.cc:1048] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:11:08.884821 21758 raft_consensus.cc:2749] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:08.919802 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:08.925500 17987 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:08.902025 21516 consensus_queue.cc:1048] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:11:08.930100 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:08.931488 21817 raft_consensus.cc:2749] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:08.931828 18024 raft_consensus.cc:3060] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:08.941704 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:08.942404 18017 raft_consensus.cc:2376] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7. Re-sending same reply.
I20260709 12:11:08.943413 18016 raft_consensus.cc:3060] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:08.879452 21799 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123)
W20260709 12:11:08.944553 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 95057.9us
I20260709 12:11:08.950306 18062 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:08.957927 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:08.961699 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:08.963075 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:08.963536 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:08.964125 17943 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:08.964187 17989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:08.955715 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:08.970786 17942 raft_consensus.cc:2410] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:11:08.971300 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:08.971485 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:08.971984 17940 raft_consensus.cc:3060] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:08.903082 21784 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:08.973498 17913 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:08.976513 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:08.976810 17913 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:08.977210 17942 raft_consensus.cc:2393] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 9: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:08.974215 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:08.977913 17913 leader_election.cc:304] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:08.978825 17987 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:08.978549 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:08.980057 18023 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 9.
I20260709 12:11:08.983125 18644 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 10.
I20260709 12:11:08.993033 18020 raft_consensus.cc:2468] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
W20260709 12:11:08.998986 18608 leader_election.cc:336] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 2.245s (SENT)
I20260709 12:11:08.995371 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:09.003803 18608 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:08.995837 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:09.005995 17948 raft_consensus.cc:2468] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:11:09.008580 18016 raft_consensus.cc:1275] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:11:09.009045 18016 pending_rounds.cc:85] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb: Aborting all ops after (but not including) 8
I20260709 12:11:09.009315 18016 pending_rounds.cc:107] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:11:09.009603 18016 raft_consensus.cc:2889] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:08.995038 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:11:08.994264 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 102719us
I20260709 12:11:09.017623 17913 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:11:09.027357 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 48290us
W20260709 12:11:09.033396 18608 leader_election.cc:336] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 2.252s (SENT)
I20260709 12:11:08.980481 21755 raft_consensus.cc:2804] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:09.043445 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:09.044047 17945 raft_consensus.cc:2376] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6. Re-sending same reply.
I20260709 12:11:08.982199 21799 raft_consensus.cc:2749] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:08.969967 21721 consensus_queue.cc:1048] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:11:09.045476 17940 raft_consensus.cc:2468] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 11.
I20260709 12:11:09.048173 17943 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 10.
I20260709 12:11:09.004935 21663 raft_consensus.cc:2804] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:09.051803 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:09.053280 17943 raft_consensus.cc:1275] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:11:09.015329 21801 raft_consensus.cc:2749] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:09.055210 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:09.061273 18017 raft_consensus.cc:2468] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:11:09.062695 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:09.064005 17948 raft_consensus.cc:1240] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:09.056774 17913 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:09.019109 21782 raft_consensus.cc:2804] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:09.059551 18097 raft_consensus.cc:1275] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:09.059667 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:09.065462 18608 leader_election.cc:400] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Vote denied by peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297) with higher term. Message: Invalid argument: T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 9. Current term is 10.
I20260709 12:11:09.065790 18608 leader_election.cc:403] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:09.038959 21660 raft_consensus.cc:2749] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:09.078366 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:09.079780 17913 leader_election.cc:304] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:09.041846 21755 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:09.084475 17941 raft_consensus.cc:2393] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 9: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:09.055264 21758 raft_consensus.cc:2749] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:09.055622 21663 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.086573 17913 leader_election.cc:304] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:09.088318 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:09.094924 17988 leader_election.cc:304] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:09.100940 17988 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:09.102792 21843 raft_consensus.cc:2749] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:09.103313 17913 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:09.104094 21797 raft_consensus.cc:2749] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:09.105430 17988 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:09.085484 21748 raft_consensus.cc:2804] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:09.107106 21748 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:09.107473 21748 raft_consensus.cc:3060] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.107491 21843 raft_consensus.cc:2749] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:09.111425 21856 raft_consensus.cc:2749] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297) with higher term. Message: Invalid argument: T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 9. Current term is 10.
I20260709 12:11:09.113919 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:09.115018 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:09.117146 17941 raft_consensus.cc:1275] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:09.091879 21755 raft_consensus.cc:3060] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:09.119581 18024 raft_consensus.cc:2468] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 11.
I20260709 12:11:09.119679 17988 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:09.066661 21782 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:09.105851 17913 leader_election.cc:304] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:09.120414 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:09.121235 17940 raft_consensus.cc:2393] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 10: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:09.118995 18022 raft_consensus.cc:2468] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
I20260709 12:11:09.064787 21753 raft_consensus.cc:493] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:09.121234 18024 raft_consensus.cc:2393] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 9: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:09.122717 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:09.126525 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:09.127427 18022 raft_consensus.cc:2393] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 12: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:09.128166 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:09.128628 17988 leader_election.cc:304] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:09.129052 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:09.131301 17988 leader_election.cc:304] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:09.094530 21663 raft_consensus.cc:3060] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:09.131476 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:09.097585 21811 raft_consensus.cc:493] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.133939 17988 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:09.151643 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:09.124229 21039 raft_consensus.cc:2749] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:11:09.133005 21860 log.cc:927] Time spent T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.099s	user 0.000s	sys 0.003s
I20260709 12:11:09.124776 21782 raft_consensus.cc:3060] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:09.153738 17988 leader_election.cc:304] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:09.121497 21812 consensus_queue.cc:1048] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
W20260709 12:11:09.152401 21846 log.cc:927] Time spent T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 12:11:09.132922 21833 raft_consensus.cc:2749] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:09.164819 21839 log.cc:927] Time spent T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.546s	user 0.003s	sys 0.000s
W20260709 12:11:09.168851 21793 log.cc:927] Time spent T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 1.310s	user 0.004s	sys 0.001s
I20260709 12:11:09.169544 21671 raft_consensus.cc:2749] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:09.200109 21817 raft_consensus.cc:2804] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:09.202528 21817 raft_consensus.cc:697] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:09.204026 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:09.204450 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:09.205514 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:09.129149 21753 raft_consensus.cc:515] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:09.128018 21803 raft_consensus.cc:2749] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:09.128670 21772 raft_consensus.cc:2749] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:09.174573 17988 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
W20260709 12:11:09.173722 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 65231.3us
I20260709 12:11:09.161863 21825 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:09.152148 21695 raft_consensus.cc:2804] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:09.206694 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:09.207212 18098 raft_consensus.cc:1240] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:11:09.130875 21629 consensus_queue.cc:1048] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:11:09.210848 18093 raft_consensus.cc:1275] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:11:09.152952 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:09.239648 18089 raft_consensus.cc:2393] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 9: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
W20260709 12:11:09.238901 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 64397.6us
I20260709 12:11:09.242303 18608 leader_election.cc:304] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:09.244971 21784 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:09.245519 21784 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:09.247538 21784 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:09.248543 21755 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:09.250782 21755 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:09.250801 21671 raft_consensus.cc:2749] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:09.200259 21763 raft_consensus.cc:2749] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:09.252218 21753 leader_election.cc:290] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:09.254823 21780 raft_consensus.cc:493] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.255121 21812 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:09.255347 21780 raft_consensus.cc:515] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:09.255657 21812 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:09.256572 21671 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:09.257095 21671 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:09.257649 21812 leader_election.cc:290] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:09.242270 18022 raft_consensus.cc:2468] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
I20260709 12:11:09.259191 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:11:09.259732 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 50557us
I20260709 12:11:09.260118 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:09.261447 18022 raft_consensus.cc:2368] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 8. Current term is 9.
I20260709 12:11:09.262799 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:09.240422 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:09.268537 18608 leader_election.cc:304] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:09.269127 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:09.272506 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:09.275949 18022 raft_consensus.cc:2393] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 10: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:09.272823 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:09.276800 17989 leader_election.cc:304] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:09.278132 21812 raft_consensus.cc:2749] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:09.270048 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 98110.6us
I20260709 12:11:09.280462 18062 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:09.283577 18024 raft_consensus.cc:2368] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 13. Current term is 14.
I20260709 12:11:09.286612 18608 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:09.240058 21695 raft_consensus.cc:493] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.287806 18608 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:09.217677 21833 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:09.289893 21863 consensus_queue.cc:1048] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:11:09.296326 21865 raft_consensus.cc:2804] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:11:09.296746 21865 raft_consensus.cc:493] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:09.297108 21865 raft_consensus.cc:3060] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:09.297617 21863 raft_consensus.cc:2804] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:09.298113 21863 raft_consensus.cc:697] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 11 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:09.298731 21833 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:09.300945 21833 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:09.203389 21817 consensus_queue.cc:237] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:09.308341 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:09.310058 17945 raft_consensus.cc:2393] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 12: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:09.311542 18062 leader_election.cc:304] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:11:09.291145 21695 raft_consensus.cc:3060] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.177276 21811 raft_consensus.cc:515] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:09.323108 18608 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:09.324160 18608 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:09.325493 21765 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:09.325825 21788 raft_consensus.cc:2804] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:09.326355 21788 raft_consensus.cc:697] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:09.287878 21864 raft_consensus.cc:2749] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:09.266376 21856 consensus_queue.cc:1048] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:11:09.328613 18062 leader_election.cc:304] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:09.325122 18608 leader_election.cc:304] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:09.329214 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:09.331589 21851 consensus_queue.cc:1059] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:11:09.293009 21663 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:09.315650 21818 raft_consensus.cc:2749] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:09.335743 21825 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 14 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:09.295176 21671 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:09.335078 21788 consensus_queue.cc:237] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:09.340149 21516 raft_consensus.cc:2749] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:09.344168 21695 raft_consensus.cc:515] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:09.290467 21792 consensus_queue.cc:1048] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:11:09.349640 17989 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:09.354067 21516 raft_consensus.cc:2749] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:09.356045 21695 leader_election.cc:290] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:09.358600 21765 raft_consensus.cc:2749] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:09.364506 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:09.373021 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:09.373597 18094 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:09.320792 21748 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:09.376395 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
W20260709 12:11:09.377161 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 48613us
I20260709 12:11:09.377442 17949 raft_consensus.cc:3060] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.372411 21803 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:09.372524 21780 leader_election.cc:290] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:09.398187 17913 leader_election.cc:336] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 2.753s (SENT)
I20260709 12:11:09.398717 17913 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:09.398994 21803 raft_consensus.cc:2749] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:09.399791 21039 raft_consensus.cc:2749] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:09.400593 21663 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:09.403396 21786 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.419899 18017 raft_consensus.cc:2468] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
I20260709 12:11:09.420888 21784 raft_consensus.cc:3055] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:09.422228 21784 raft_consensus.cc:740] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:09.423048 21784 consensus_queue.cc:260] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:09.424273 21784 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:09.386101 21782 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:09.428234 21782 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:09.407022 21746 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
W20260709 12:11:09.447453 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 69620.3us
W20260709 12:11:09.448869 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.453455 18094 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 14.
I20260709 12:11:09.347529 21863 consensus_queue.cc:237] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:09.458873 21754 consensus_queue.cc:1059] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:11:09.460989 21811 leader_election.cc:290] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:09.461256 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:09.461805 18021 raft_consensus.cc:3060] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:09.466773 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:09.468571 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:09.469179 17946 raft_consensus.cc:2468] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
I20260709 12:11:09.469482 21872 raft_consensus.cc:2749] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:09.471662 17989 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:09.476890 17949 raft_consensus.cc:2468] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
I20260709 12:11:09.469837 21851 consensus_queue.cc:1048] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:11:09.479259 21746 raft_consensus.cc:2804] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:09.479779 21746 raft_consensus.cc:697] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:09.480873 21621 raft_consensus.cc:3060] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:09.480593 21746 consensus_queue.cc:237] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:09.494402 17988 leader_election.cc:304] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:11:09.495317 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 170252us
I20260709 12:11:09.494472 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:09.496408 18608 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:09.497637 18608 leader_election.cc:400] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Vote denied by peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297) with higher term. Message: Invalid argument: T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 8. Current term is 9.
I20260709 12:11:09.497994 18608 leader_election.cc:403] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:09.498844 18021 raft_consensus.cc:2468] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 10.
I20260709 12:11:09.499982 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:09.500061 17988 leader_election.cc:304] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:09.502132 18021 raft_consensus.cc:3060] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:09.507822 17949 raft_consensus.cc:1240] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:09.509272 17914 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.98.195:41931 timed out after 1.525s (SENT) [suppressed 52 similar messages]
I20260709 12:11:09.516299 17913 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:11:09.517030 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 68879.2us
I20260709 12:11:09.495219 21830 raft_consensus.cc:3055] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:11:09.528082 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 211569us
I20260709 12:11:09.523010 18021 raft_consensus.cc:2468] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 11.
I20260709 12:11:09.534053 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:09.536844 18636 raft_consensus.cc:2393] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 7: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:11:09.534567 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:09.537410 18644 raft_consensus.cc:2393] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 7: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:11:09.537843 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:09.540923 17913 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:09.541945 18640 raft_consensus.cc:1240] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:09.515512 21762 raft_consensus.cc:2804] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:09.514953 21825 raft_consensus.cc:2804] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:09.515347 21535 raft_consensus.cc:2749] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297) with higher term. Message: Invalid argument: T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 8. Current term is 9.
I20260709 12:11:09.550897 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:09.518217 21782 raft_consensus.cc:2804] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:09.549574 21868 raft_consensus.cc:2749] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:09.517825 21803 raft_consensus.cc:2804] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:09.548414 17914 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:09.551505 18635 raft_consensus.cc:2468] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 10.
I20260709 12:11:09.545603 21721 consensus_queue.cc:1059] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:11:09.557788 17949 raft_consensus.cc:1275] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:09.548192 21744 raft_consensus.cc:2804] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:09.612610 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:09.614691 18018 raft_consensus.cc:2410] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:11:09.620779 18095 raft_consensus.cc:2468] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 11.
I20260709 12:11:09.625551 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:09.672356 18062 leader_election.cc:304] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:09.680189 18062 leader_election.cc:304] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:09.624728 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:09.685451 18061 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:09.535187 21830 raft_consensus.cc:740] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:09.547883 21762 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:09.550843 21825 raft_consensus.cc:493] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:09.625829 21039 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:09.627660 21334 raft_consensus.cc:3055] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:11:09.727051 18608 leader_election.cc:336] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Timed out: RequestConsensusVote RPC to 127.16.98.194:36297 timed out after 2.051s (SENT)
I20260709 12:11:09.743223 18608 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:09.604557 21748 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:09.746428 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:09.589471 21782 raft_consensus.cc:697] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:09.688879 21769 raft_consensus.cc:2749] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:09.689201 21695 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.756865 21758 raft_consensus.cc:2749] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:09.593873 21876 consensus_queue.cc:1059] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.198s
I20260709 12:11:09.694206 21803 raft_consensus.cc:697] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:09.700834 21780 raft_consensus.cc:2749] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:09.623732 21865 raft_consensus.cc:515] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:09.702724 21754 raft_consensus.cc:2804] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:09.704766 21825 raft_consensus.cc:3060] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:09.704957 21762 raft_consensus.cc:3060] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.751991 21868 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:09.743090 21334 raft_consensus.cc:740] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:09.758227 21748 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.741130 21039 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:09.781962 18638 raft_consensus.cc:1240] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 4. Current term is 5. Ops: []
W20260709 12:11:09.749715 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 201354us
I20260709 12:11:09.741541 21755 consensus_queue.cc:1059] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 12:11:09.769637 21754 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:09.785912 17914 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:09.773702 21813 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:09.802465 21039 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:09.766021 21695 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:09.816124 17940 raft_consensus.cc:1275] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:09.797140 21830 consensus_queue.cc:260] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:09.803408 21334 consensus_queue.cc:260] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:09.843868 17914 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:09.797902 21754 raft_consensus.cc:3060] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:09.846829 21797 consensus_queue.cc:1048] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:09.849872 21039 raft_consensus.cc:2749] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:09.853128 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:09.855222 18641 raft_consensus.cc:1240] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:11:09.855744 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:09.824345 21803 consensus_queue.cc:237] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:09.824508 21786 consensus_queue.cc:1048] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:11:09.881191 21850 consensus_queue.cc:1059] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:09.818533 21813 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:09.882318 21850 raft_consensus.cc:3055] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:11:09.887727 21850 raft_consensus.cc:740] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:09.862488 21782 consensus_queue.cc:237] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:09.862905 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:09.863571 21830 raft_consensus.cc:3060] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:09.850122 21772 consensus_queue.cc:1059] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:09.874893 21663 raft_consensus.cc:493] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.883474 21813 leader_election.cc:290] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:09.884584 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:09.901787 18021 raft_consensus.cc:2393] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 10: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:09.901407 21663 raft_consensus.cc:515] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:09.902594 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:09.903270 18021 raft_consensus.cc:2393] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 7: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:11:09.903848 21663 leader_election.cc:290] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:09.903935 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:09.904603 18021 raft_consensus.cc:3060] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:09.886972 17987 leader_election.cc:304] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:09.861377 21865 leader_election.cc:290] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:09.785787 21748 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:09.912963 21803 raft_consensus.cc:2749] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:09.825214 21763 raft_consensus.cc:2749] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:09.917455 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 245656us
I20260709 12:11:09.947579 18021 raft_consensus.cc:2468] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
I20260709 12:11:09.953758 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:09.954887 18636 raft_consensus.cc:2410] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 10 because replica has last-logged OpId of term: 8 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 10.
I20260709 12:11:09.913235 21748 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:09.969077 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:09.969811 18021 raft_consensus.cc:3060] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:09.953065 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:09.888654 21850 consensus_queue.cc:260] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:09.976760 17913 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:09.917847 21786 consensus_queue.cc:1059] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:11:09.978060 21772 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.977555 21748 raft_consensus.cc:493] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:09.986867 21875 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:09.999253 18021 raft_consensus.cc:2468] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
I20260709 12:11:09.991677 21797 raft_consensus.cc:2804] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:09.991544 21744 raft_consensus.cc:697] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:10.000486 18608 leader_election.cc:304] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:10.004812 21744 consensus_queue.cc:237] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:09.997776 21850 raft_consensus.cc:3060] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:10.012423 21085 raft_consensus.cc:2804] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:11:10.013116 21085 raft_consensus.cc:697] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:10.015332 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:10.018465 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:10.018620 21085 consensus_queue.cc:237] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:10.019112 18021 raft_consensus.cc:2468] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 11.
I20260709 12:11:10.021734 17940 raft_consensus.cc:1240] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 LEADER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:09.997982 21772 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:10.028542 17913 leader_election.cc:304] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:11:10.031684 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.001232 21748 raft_consensus.cc:515] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:10.019713 21797 raft_consensus.cc:697] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:10.002782 21875 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:10.038156 21782 raft_consensus.cc:2804] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:10.047171 21886 log.cc:927] Time spent T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 12:11:10.058578 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:10.058631 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:10.060354 21730 raft_consensus.cc:3055] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:10.065577 18062 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:10.071889 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:10.067924 21782 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
W20260709 12:11:10.073304 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.073565 21782 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:10.078739 21786 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:10.079281 21786 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:10.083670 18062 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:10.085013 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:10.089691 18062 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:10.072546 21730 raft_consensus.cc:740] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:10.108481 21830 raft_consensus.cc:2749] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:10.120428 18017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45472 (request call id 2198) took 1087 ms. Trace:
I20260709 12:11:10.120831 18017 rpcz_store.cc:276] 0709 12:11:09.033391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.114811 (+ 81420us) service_pool.cc:224] Handling call
0709 12:11:10.120269 (+1005458us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b5400278dd4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:10.120370 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":524089088}
I20260709 12:11:10.123163 17942 raft_consensus.cc:1240] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 LEADER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:11:10.086843 21785 raft_consensus.cc:2749] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:10.090531 21721 raft_consensus.cc:2749] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:10.167847 18095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53954 (request call id 2304) took 1378 ms. Trace:
I20260709 12:11:10.174170 18095 rpcz_store.cc:276] 0709 12:11:08.789685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.789785 (+   100us) service_pool.cc:224] Handling call
0709 12:11:10.167683 (+1377898us) spinlock_profiling.cc:243] Waited 829 ms on lock 0x7b540024a754. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:10.167790 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1905621248}
I20260709 12:11:10.088653 21762 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:10.243661 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.168391 21884 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:10.526449 18643 raft_consensus.cc:1240] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:10.378492 21868 consensus_meta.cc:287] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.592s	user 0.009s	sys 0.000s
I20260709 12:11:10.098215 21730 consensus_queue.cc:260] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:10.535584 21730 raft_consensus.cc:3060] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:10.539209 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 410282us
I20260709 12:11:10.213773 21797 consensus_queue.cc:237] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:10.548123 18023 raft_consensus.cc:1240] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:11:10.381326 21785 raft_consensus.cc:493] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:10.379057 21744 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:10.553709 18023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53022 (request call id 671) took 1629 ms. Trace:
W20260709 12:11:10.555498 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 465845us
I20260709 12:11:10.556998 18023 rpcz_store.cc:276] 0709 12:11:08.924333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.539758 (+1615425us) service_pool.cc:224] Handling call
0709 12:11:10.540065 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:10.553417 (+ 13352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.553655 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:10.584914 18062 leader_election.cc:304] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:10.539984 21868 raft_consensus.cc:2749] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:10.558504 21825 consensus_meta.cc:287] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.771s	user 0.008s	sys 0.002s
I20260709 12:11:10.490067 21884 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:10.585863 18019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45464 (request call id 2006) took 1727 ms. Trace:
I20260709 12:11:10.607851 18635 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:10.589088 21834 raft_consensus.cc:2749] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:10.590422 21769 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:10.604319 18019 rpcz_store.cc:276] 0709 12:11:08.858944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.892427 (+ 33483us) service_pool.cc:224] Handling call
0709 12:11:08.894829 (+  2402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:08.895218 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:08.895259 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:08.895814 (+   555us) log.cc:844] Serialized 26 byte log entry
0709 12:11:09.804158 (+908344us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b1800323260. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f498a7e07 00007f7f527029a9 00007f7f498c469b 00007f7f498c293f 00007f7f498c4c02 00007f7f4c54c20b 00007f7f4c551d23 00007f7f4c5520d1 00007f7f4c96da0f
0709 12:11:09.875681 (+ 71523us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:10.272612 (+396931us) log.cc:844] Serialized 14 byte log entry
0709 12:11:10.585428 (+312816us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.585506 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:10.585553 (+    47us) raft_consensus.cc:1685] finished
0709 12:11:10.585648 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:10.585796 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":312498,"prepare.queue_time_us":105204,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":30,"raft.queue_time_us":779,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":4486,"spinlock_wait_cycles":46592768,"thread_start_us":430497,"threads_started":2,"wal-append.queue_time_us":992907}
I20260709 12:11:10.625180 18096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53954 (request call id 2312) took 1453 ms. Trace:
I20260709 12:11:10.626179 21884 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:10.584591 21744 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:10.625672 18096 rpcz_store.cc:276] 0709 12:11:09.172107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.172329 (+   222us) service_pool.cc:224] Handling call
0709 12:11:09.172594 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:09.252849 (+ 80255us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:09.271665 (+ 18816us) log.cc:844] Serialized 14 byte log entry
0709 12:11:09.294210 (+ 22545us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:09.294255 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:09.294300 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.624900 (+1330600us) spinlock_profiling.cc:243] Waited 80 ms on lock 0x7b5400060c54. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:11:10.624959 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:10.625110 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56001,"prepare.queue_time_us":18898,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":37637,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":4271,"spinlock_wait_cycles":184098688}
I20260709 12:11:10.608847 21772 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:10.613711 21748 leader_election.cc:290] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:10.642665 18019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53022 (request call id 673) took 1694 ms. Trace:
I20260709 12:11:10.603698 21825 raft_consensus.cc:515] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:10.616190 21875 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:10.622669 21899 raft_consensus.cc:3060] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:10.647480 18064 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.025s	sys 0.025s
I20260709 12:11:10.616353 21786 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:10.624024 21762 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:10.646960 18019 rpcz_store.cc:276] 0709 12:11:08.948367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.620156 (+1671789us) service_pool.cc:224] Handling call
0709 12:11:10.620493 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.620699 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:10.620736 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:10.620789 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:10.620841 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.620907 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:10.642581 (+ 21674us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:10.644039 21476 raft_consensus.cc:3055] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:11:10.653632 18064 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.026s	sys 0.025s
I20260709 12:11:10.662796 18020 raft_consensus.cc:1275] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:10.663589 18020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 2200) took 1628 ms. Trace:
I20260709 12:11:10.663985 18020 rpcz_store.cc:276] 0709 12:11:09.035473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.662005 (+1626532us) service_pool.cc:224] Handling call
0709 12:11:10.662365 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.663281 (+   916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.663514 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:10.664911 18607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.623358 21769 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:10.677912 18093 consensus_meta.cc:287] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.522s	user 0.002s	sys 0.005s
I20260709 12:11:10.554016 21830 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:10.678434 18093 raft_consensus.cc:2468] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
W20260709 12:11:10.667019 21782 consensus_meta.cc:287] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.593s	user 0.009s	sys 0.000s
I20260709 12:11:10.659108 21476 raft_consensus.cc:740] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:10.656816 21875 consensus_queue.cc:1048] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
W20260709 12:11:10.688894 21895 log.cc:927] Time spent T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.311s	user 0.001s	sys 0.001s
I20260709 12:11:10.696391 18635 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 14.
I20260709 12:11:10.686496 21830 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:10.700505 21898 log.cc:927] Time spent T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:11:10.701499 21621 raft_consensus.cc:3055] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:10.702008 21621 raft_consensus.cc:740] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:10.702229 21830 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:10.703099 21621 consensus_queue.cc:260] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:10.687667 21782 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:10.583858 21785 raft_consensus.cc:515] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:10.724381 21785 leader_election.cc:290] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:10.727522 21826 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.728083 21826 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:10.740622 21825 leader_election.cc:290] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:11:10.747331 21897 log.cc:927] Time spent T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.109s	user 0.002s	sys 0.001s
I20260709 12:11:10.797144 17944 raft_consensus.cc:1240] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:10.805552 18021 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 12.
I20260709 12:11:10.806953 18018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45464 (request call id 2000) took 1949 ms. Trace:
I20260709 12:11:10.807466 18018 rpcz_store.cc:276] 0709 12:11:08.856939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.857041 (+   102us) service_pool.cc:224] Handling call
0709 12:11:10.806442 (+1949401us) spinlock_profiling.cc:243] Waited 733 ms on lock 0x7b54002c5bd4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:10.806736 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1686064768}
W20260709 12:11:10.809366 18024 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53022 (request call id 666) took 1886 ms (client timeout 2051 ms). Trace:
W20260709 12:11:10.809890 18024 rpcz_store.cc:269] 0709 12:11:08.923103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.127852 (+204749us) service_pool.cc:224] Handling call
0709 12:11:10.808913 (+1681061us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b5400364054. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:10.809196 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":353076096}
I20260709 12:11:10.810941 18019 raft_consensus.cc:1240] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:10.811976 18019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53022 (request call id 675) took 1860 ms. Trace:
I20260709 12:11:10.812304 18019 rpcz_store.cc:276] 0709 12:11:08.951350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.668015 (+1716665us) service_pool.cc:224] Handling call
0709 12:11:10.682424 (+ 14409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.811566 (+129142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.811910 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:10.813881 18019 raft_consensus.cc:1240] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 LEADER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:10.815930 18020 raft_consensus.cc:1240] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 4. Current term is 5. Ops: []
I20260709 12:11:10.816639 18020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 2206) took 1754 ms. Trace:
I20260709 12:11:10.816992 18020 rpcz_store.cc:276] 0709 12:11:09.061875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.814968 (+1753093us) service_pool.cc:224] Handling call
0709 12:11:10.815476 (+   508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.816397 (+   921us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.816585 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:10.817760 18016 raft_consensus.cc:1240] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 10. Current term is 11. Ops: [8.5-10.6]
W20260709 12:11:10.823822 18015 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45464 (request call id 1995) took 1968 ms (client timeout 1955 ms). Trace:
W20260709 12:11:10.824311 18015 rpcz_store.cc:269] 0709 12:11:08.855431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.855546 (+   115us) service_pool.cc:224] Handling call
0709 12:11:10.823359 (+1967813us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b5400363b54. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:10.823637 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29404928}
I20260709 12:11:10.814492 17947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44668 (request call id 659) took 1456 ms. Trace:
I20260709 12:11:10.825907 18015 raft_consensus.cc:1240] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:10.818454 18016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 2207) took 1754 ms. Trace:
I20260709 12:11:10.814519 18019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 2205) took 1753 ms. Trace:
I20260709 12:11:10.826576 18015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 2209) took 1758 ms. Trace:
I20260709 12:11:10.838943 18016 rpcz_store.cc:276] 0709 12:11:09.064304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.816631 (+1752327us) service_pool.cc:224] Handling call
0709 12:11:10.817182 (+   551us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:10.818172 (+   990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.818396 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:10.815948 17942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2276) took 1147 ms. Trace:
I20260709 12:11:10.841023 18015 rpcz_store.cc:276] 0709 12:11:09.067829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.825302 (+1757473us) service_pool.cc:224] Handling call
0709 12:11:10.825698 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.826355 (+   657us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.826520 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:10.840185 18019 rpcz_store.cc:276] 0709 12:11:09.060601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.813172 (+1752571us) service_pool.cc:224] Handling call
0709 12:11:10.813584 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.814283 (+   699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.814444 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:10.847857 18019 raft_consensus.cc:1240] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:10.841801 17942 rpcz_store.cc:276] 0709 12:11:09.668542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.668710 (+   168us) service_pool.cc:224] Handling call
0709 12:11:09.669069 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:10.123568 (+454499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.815375 (+691807us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b5400291654. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:11:10.815762 (+   387us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1043734784}
I20260709 12:11:10.841276 18020 raft_consensus.cc:1275] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:10.868353 18020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 2208) took 1788 ms. Trace:
I20260709 12:11:10.868932 18020 rpcz_store.cc:276] 0709 12:11:09.064941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.817806 (+1752865us) service_pool.cc:224] Handling call
0709 12:11:10.818300 (+   494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.852343 (+ 34043us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.853774 (+  1431us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:10.854187 18019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 2210) took 1313 ms. Trace:
I20260709 12:11:10.870994 18019 rpcz_store.cc:276] 0709 12:11:09.538851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.846867 (+1308016us) service_pool.cc:224] Handling call
0709 12:11:10.847470 (+   603us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.851688 (+  4218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.851895 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:10.883071 21801 raft_consensus.cc:493] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:10.884042 21801 raft_consensus.cc:515] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:10.884965 21798 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:10.885772 21798 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:10.887431 18098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41818 (request call id 1018) took 1605 ms. Trace:
I20260709 12:11:10.887831 18098 rpcz_store.cc:276] 0709 12:11:09.281417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.283702 (+  2285us) service_pool.cc:224] Handling call
0709 12:11:09.284011 (+   309us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:09.320497 (+ 36486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:09.320524 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:10.541255 (+1220731us) spinlock_profiling.cc:243] Waited 7.22 ms on lock 0x7b2c000bf908. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4b2aba11 00007f7f4b2bb372 00007f7f4c9eda01 00007f7f4c9b243a 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2
0709 12:11:10.542435 (+  1180us) log.cc:844] Serialized 52 byte log entry
0709 12:11:10.630452 (+ 88017us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:10.886198 (+255746us) log.cc:844] Serialized 14 byte log entry
0709 12:11:10.886701 (+   503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.886817 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:10.886889 (+    72us) raft_consensus.cc:1685] finished
0709 12:11:10.886998 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:10.887186 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48432,"raft.queue_time_us":36386,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":5265,"spinlock_wait_cycles":16607488,"thread_start_us":289197,"threads_started":2,"wal-append.queue_time_us":164688}
I20260709 12:11:10.883116 21884 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:10.891238 18016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45464 (request call id 2021) took 1483 ms. Trace:
I20260709 12:11:10.891165 21884 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:10.891629 18016 rpcz_store.cc:276] 0709 12:11:09.408243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.852945 (+1444702us) service_pool.cc:224] Handling call
0709 12:11:10.890465 (+ 37520us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.890850 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:10.890881 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:10.890966 (+    85us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:10.891008 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.891078 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:10.891189 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:10.898208 21798 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:10.898839 21884 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:10.905851 21782 leader_election.cc:290] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:11:10.907061 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 315077us
W20260709 12:11:10.911450 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:10.707628 21476 consensus_queue.cc:260] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:10.913998 21908 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:10.915337 21476 raft_consensus.cc:3060] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:10.918254 21744 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:10.925222 21900 raft_consensus.cc:493] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:10.730480 21826 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:10.720396 21769 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:10.932744 18093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41818 (request call id 1025) took 1070 ms. Trace:
I20260709 12:11:10.825990 17947 rpcz_store.cc:276] 0709 12:11:09.357714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.358861 (+  1147us) service_pool.cc:224] Handling call
0709 12:11:09.359145 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.062721 (+703576us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:10.063005 (+   284us) log.cc:844] Serialized 14 byte log entry
0709 12:11:10.490917 (+427912us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:10.490970 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:10.491041 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.746884 (+255843us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b4400022b4c. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f497ebc85 00007f7f497ec6a2 00007f7f4c55e1db 00007f7f4c559aaf 00007f7f4c54d86e 00007f7f4c54cbb6 00007f7f4c54c7d8 00007f7f4c556221 00007f7f4c5561d9 00007f7f4c556169
0709 12:11:10.813971 (+ 67087us) spinlock_profiling.cc:243] Waited 703 ms on lock 0x7b54000f7654. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:11:10.814035 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:10.814306 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3509,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":76,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":15016,"spinlock_wait_cycles":1622189312,"thread_start_us":427573,"threads_started":1,"wal-append.queue_time_us":548475}
I20260709 12:11:10.933197 18093 rpcz_store.cc:276] 0709 12:11:09.862523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.862699 (+   176us) service_pool.cc:224] Handling call
0709 12:11:10.932336 (+1069637us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b54003a9b54. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:10.932531 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":596324608}
I20260709 12:11:10.939747 18021 raft_consensus.cc:1240] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 LEADER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:10.940629 18021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 2202) took 1902 ms. Trace:
I20260709 12:11:10.940997 18021 rpcz_store.cc:276] 0709 12:11:09.038202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.808194 (+1769992us) service_pool.cc:224] Handling call
0709 12:11:10.938284 (+130090us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.940324 (+  2040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.940568 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:10.942440 18021 raft_consensus.cc:1240] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:10.952380 18021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 2212) took 1408 ms. Trace:
I20260709 12:11:10.954167 18021 rpcz_store.cc:276] 0709 12:11:09.544249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.941753 (+1397504us) service_pool.cc:224] Handling call
0709 12:11:10.942213 (+   460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.952081 (+  9868us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.952313 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:10.956044 21834 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:10.956836 21834 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:10.960173 18635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60424 (request call id 1022) took 1106 ms. Trace:
I20260709 12:11:10.960672 18635 rpcz_store.cc:276] 0709 12:11:09.853094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.855516 (+  2422us) service_pool.cc:224] Handling call
0709 12:11:10.959664 (+1104148us) spinlock_profiling.cc:243] Waited 730 ms on lock 0x7b54006630d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:10.959888 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1678165248}
I20260709 12:11:10.963390 18643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60412 (request call id 1073) took 1414 ms. Trace:
I20260709 12:11:10.964143 21907 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:10.965095 21907 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:10.967027 21910 raft_consensus.cc:493] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:10.968351 21334 raft_consensus.cc:3060] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:10.967973 21910 raft_consensus.cc:515] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:10.971222 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:10.956079 21842 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:10.938669 21900 raft_consensus.cc:515] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:10.974725 21842 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:10.977632 21900 leader_election.cc:290] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:10.980012 21845 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:10.981050 21845 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:10.989878 21801 leader_election.cc:290] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:10.992866 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:10.994849 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:10.997149 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:10.977707 21842 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:11.016964 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:11.020376 21721 raft_consensus.cc:493] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:11.021202 21721 raft_consensus.cc:515] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:11.022159 21754 consensus_meta.cc:287] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 1.114s	user 0.007s	sys 0.011s
I20260709 12:11:10.963835 18643 rpcz_store.cc:276] 0709 12:11:09.549053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.549197 (+   144us) service_pool.cc:224] Handling call
0709 12:11:09.549434 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.527049 (+977615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:10.962743 (+435694us) spinlock_profiling.cc:243] Waited 977 ms on lock 0x7b54005447d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:11:10.963147 (+   404us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2246344576}
I20260709 12:11:11.047464 18638 raft_consensus.cc:3055] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:11.047955 18638 raft_consensus.cc:740] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:11.048409 18021 raft_consensus.cc:1275] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:11:11.049150 18021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 2213) took 1501 ms. Trace:
I20260709 12:11:11.049237 18638 consensus_queue.cc:260] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:11.050911 21797 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.052728 21797 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:11.051833 21782 raft_consensus.cc:493] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:11.054899 21900 raft_consensus.cc:493] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.055426 21782 raft_consensus.cc:515] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:11.055651 21900 raft_consensus.cc:515] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:11.057744 21782 leader_election.cc:290] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:11.058552 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:11.062960 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:11.058228 21900 leader_election.cc:290] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:11.064576 18096 raft_consensus.cc:1275] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:11.050611 18638 raft_consensus.cc:3060] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:11.059612 18089 raft_consensus.cc:3055] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:11.049517 18021 rpcz_store.cc:276] 0709 12:11:09.548065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.999227 (+1451162us) service_pool.cc:224] Handling call
0709 12:11:11.047877 (+ 48650us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:11.048832 (+   955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.049070 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:11.068593 18089 raft_consensus.cc:740] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:11.062300 21797 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:11.065632 21910 leader_election.cc:290] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:11.077739 17914 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:11.064606 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:11.079373 18097 raft_consensus.cc:2410] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:11:11.082824 21910 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:11.083271 21817 raft_consensus.cc:493] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.083607 21910 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:11.084151 21786 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.084024 21817 raft_consensus.cc:515] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:11.084745 21786 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:11.085917 21910 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:11.086261 21817 leader_election.cc:290] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:11.040160 21754 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:11.086773 21085 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.087417 21085 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:11.088404 21754 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:11.099385 21834 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:11.101544 21695 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:11.102947 21825 raft_consensus.cc:493] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.103626 21825 raft_consensus.cc:515] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:11.107677 21768 raft_consensus.cc:493] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.108371 21768 raft_consensus.cc:515] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:11.042321 21908 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:11.205910 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 109790us
I20260709 12:11:11.205713 18019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 2218) took 1592 ms. Trace:
I20260709 12:11:11.115789 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:11.300714 18091 raft_consensus.cc:2410] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 10 because replica has last-logged OpId of term: 8 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 10.
I20260709 12:11:11.210431 18021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 2214) took 1599 ms. Trace:
I20260709 12:11:11.111896 21085 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:11.304080 18021 rpcz_store.cc:276] 0709 12:11:09.611014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.097146 (+1486132us) service_pool.cc:224] Handling call
0709 12:11:11.209601 (+112455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:11.210010 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:11.210051 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:11.210111 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:11.210156 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.210231 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:11.210361 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:11.296151 18019 rpcz_store.cc:276] 0709 12:11:09.613258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.089166 (+1475908us) service_pool.cc:224] Handling call
0709 12:11:11.204798 (+115632us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:11.205265 (+   467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:11.205305 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:11.205385 (+    80us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:11.205436 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.205504 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:11.205644 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:11.110134 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:11.109553 18095 raft_consensus.cc:1275] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:11:11.216636 18020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 2219) took 1603 ms. Trace:
I20260709 12:11:11.336021 18020 rpcz_store.cc:276] 0709 12:11:09.613488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.205107 (+1591619us) service_pool.cc:224] Handling call
0709 12:11:11.216052 (+ 10945us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:11.216339 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:11.216368 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:11.216405 (+    37us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:11.216431 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.216488 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:11.216588 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:11.221750 18089 consensus_queue.cc:260] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:11.118615 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:11.346601 18017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53022 (request call id 670) took 2414 ms. Trace:
I20260709 12:11:11.346964 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:11.347677 18098 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 12.
I20260709 12:11:11.347029 18017 rpcz_store.cc:276] 0709 12:11:08.924105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.121722 (+1197617us) service_pool.cc:224] Handling call
0709 12:11:10.122025 (+   303us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:10.545113 (+423088us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:10.545140 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:10.556203 (+ 11063us) log.cc:844] Serialized 52 byte log entry
0709 12:11:10.939921 (+383718us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:10.940502 (+   581us) log.cc:844] Serialized 14 byte log entry
0709 12:11:11.121093 (+180591us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b180033aba0. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f4983fc0a 00007f7f52f7f219 00007f7f498c7a40 00007f7f498c24e4 00007f7f498c2455 00007f7f503aa3c7 00007f7f4c9bc9a7 00007f7f4c9cc0bf 00007f7f4c9cc038
0709 12:11:11.121301 (+   208us) log.cc:844] Serialized 14 byte log entry
0709 12:11:11.121802 (+   501us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.187093 (+ 65291us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:11.266872 (+ 79779us) raft_consensus.cc:1685] finished
0709 12:11:11.266900 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:11.337988 (+ 71088us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":516114,"prepare.queue_time_us":179301,"prepare.run_cpu_time_us":135,"prepare.run_wall_time_us":25984,"raft.queue_time_us":573004,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":104412,"spinlock_wait_cycles":94762624,"thread_start_us":335317,"threads_started":1,"wal-append.queue_time_us":367772}
I20260709 12:11:11.348675 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:11.349875 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:11:11.350360 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.291121 21768 leader_election.cc:290] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:11.351295 21845 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:11.351460 18019 raft_consensus.cc:1240] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:11.351689 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 279277us
I20260709 12:11:11.353017 18021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45464 (request call id 2024) took 1722 ms. Trace:
I20260709 12:11:11.211545 21721 leader_election.cc:290] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:11.213230 21907 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:11.266350 21842 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.214162 21825 leader_election.cc:290] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:11.350769 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:11.115875 21544 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
W20260709 12:11:11.354588 18607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.356814 18638 raft_consensus.cc:1275] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:11.372555 18019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 2220) took 1670 ms. Trace:
I20260709 12:11:11.211900 21786 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:11.368505 18021 rpcz_store.cc:276] 0709 12:11:09.630823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.333731 (+1702908us) service_pool.cc:224] Handling call
0709 12:11:11.352321 (+ 18590us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:11.352566 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:11.352603 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:11.352679 (+    76us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:11.352726 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.352802 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:11.352954 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:11.186700 21797 raft_consensus.cc:2749] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:11.283712 20977 raft_consensus.cc:493] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.356914 18023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53022 (request call id 672) took 2281 ms. Trace:
I20260709 12:11:11.379575 18019 rpcz_store.cc:276] 0709 12:11:09.701989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.332836 (+1630847us) service_pool.cc:224] Handling call
0709 12:11:11.351212 (+ 18376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:11.372318 (+ 21106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.372500 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:11.378207 18024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 2204) took 2320 ms. Trace:
I20260709 12:11:11.386266 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:11.359382 18098 raft_consensus.cc:2468] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 10.
W20260709 12:11:11.381964 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:11.391067 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.395959 21762 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.396347 21782 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:11.396620 21762 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:11.397403 21782 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:11.399082 21816 raft_consensus.cc:493] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:11.399819 21816 raft_consensus.cc:515] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:11.400717 21762 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:11.389072 18024 rpcz_store.cc:276] 0709 12:11:09.057786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.810918 (+1753132us) service_pool.cc:224] Handling call
0709 12:11:10.811317 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.811820 (+   503us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:11:10.947410 (+135590us) log.cc:844] Serialized 14 byte log entry
0709 12:11:11.377741 (+430331us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:11.377803 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:11.377884 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.377955 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:11.378155 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5569,"prepare.queue_time_us":111036,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":10515,"thread_start_us":456244,"threads_started":2}
I20260709 12:11:11.401991 21816 leader_election.cc:290] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:11.402837 21673 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:11.403403 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 112079us
I20260709 12:11:11.403541 21673 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:11.405695 21673 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:11.407232 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:11.408782 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:11.410269 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:11.384392 18017 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45464 (request call id 2026) took 1518 ms. Trace:
I20260709 12:11:11.388417 18094 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 12.
I20260709 12:11:11.110154 21905 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:11.410506 21741 raft_consensus.cc:3060] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:11.413702 20977 raft_consensus.cc:515] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:11.416286 18089 raft_consensus.cc:3060] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:11.356343 21908 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:11.416930 21755 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:11.416841 21544 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:11.418656 18608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.419849 18021 raft_consensus.cc:1275] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:11.420658 18017 rpcz_store.cc:276] 0709 12:11:09.857149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.349195 (+1492046us) service_pool.cc:224] Handling call
0709 12:11:11.349508 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:11.375405 (+ 25897us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:11.375451 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:11.375506 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:11.375552 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.375631 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:11.375770 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:11.389786 18644 raft_consensus.cc:2468] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
I20260709 12:11:11.119654 21780 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:11.380795 18018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 2203) took 2341 ms. Trace:
I20260709 12:11:11.109720 17847 catalog_manager.cc:5697] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 6 to 7, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 7 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:11.406260 21673 consensus_queue.cc:1059] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:11:11.442113 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:11.449090 18021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53022 (request call id 678) took 1451 ms. Trace:
I20260709 12:11:11.452072 18021 rpcz_store.cc:276] 0709 12:11:09.997424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.387985 (+1390561us) service_pool.cc:224] Handling call
0709 12:11:11.419402 (+ 31417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:11.436386 (+ 16984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.449039 (+ 12653us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:11.452945 18062 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.457897 21826 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:11.458662 21826 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:11.459343 20977 leader_election.cc:290] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:11.460881 21765 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.461318 21826 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:11.441809 17914 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:11.386981 18023 rpcz_store.cc:276] 0709 12:11:08.948080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.586989 (+1638909us) service_pool.cc:224] Handling call
0709 12:11:10.587346 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:10.819169 (+231823us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:10.819214 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:10.820314 (+  1100us) log.cc:844] Serialized 26 byte log entry
0709 12:11:10.840507 (+ 20193us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:11.024418 (+183911us) log.cc:844] Serialized 14 byte log entry
0709 12:11:11.045400 (+ 20982us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.089734 (+ 44334us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:11.089776 (+    42us) raft_consensus.cc:1685] finished
0709 12:11:11.089787 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:11.226576 (+136789us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31402,"prepare.queue_time_us":78063,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":96329,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":7885,"thread_start_us":392476,"threads_started":3,"wal-append.queue_time_us":26620}
W20260709 12:11:11.481859 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.487078 21924 raft_consensus.cc:493] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:11.487520 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:11.487720 17989 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:11.498323 18607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.491050 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:11.435983 21842 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:11.492293 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:11.461987 21867 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.442839 21825 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:11.506771 18092 raft_consensus.cc:2468] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 7.
I20260709 12:11:11.461575 21765 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:11.514989 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:11:11.517472 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 123106us
I20260709 12:11:11.519646 21906 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:11.519767 17914 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:11.520205 21906 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:11.520885 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.520054 17847 catalog_manager.cc:5697] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: config changed from index -1 to 5, term changed from 4 to 8, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 8 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:11.521306 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.521410 17913 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:11:11.521806 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.523120 21868 raft_consensus.cc:493] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:11.441522 18018 rpcz_store.cc:276] 0709 12:11:09.039602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.808643 (+1769041us) service_pool.cc:224] Handling call
0709 12:11:10.809353 (+   710us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:10.809887 (+   534us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:11:10.810435 (+   548us) log.cc:844] Serialized 14 byte log entry
0709 12:11:11.362082 (+551647us) log.cc:844] Serialized 14 byte log entry
0709 12:11:11.372794 (+ 10712us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:11.373007 (+   213us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:11.380109 (+  7102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.380393 (+   284us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:11.380681 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78541,"prepare.queue_time_us":208802,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":96,"raft.queue_time_us":15095,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":11552,"spinlock_wait_cycles":1905024,"thread_start_us":441317,"threads_started":2,"wal-append.queue_time_us":534828}
I20260709 12:11:11.531280 21813 raft_consensus.cc:2749] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:11.532568 21842 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:11.533869 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 154578us
I20260709 12:11:11.536329 21762 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:11.539250 18091 raft_consensus.cc:3055] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:11.547456 18091 raft_consensus.cc:740] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:11.542536 18093 raft_consensus.cc:2468] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 11.
I20260709 12:11:11.523983 21868 raft_consensus.cc:515] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:11.549643 18098 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 10.
I20260709 12:11:11.526079 21755 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:11.551920 18096 raft_consensus.cc:2468] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
I20260709 12:11:11.513927 21673 consensus_queue.cc:1243] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer 63f5bddeebd84e5788d671a176cfa8e1 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:11:11.504222 21924 raft_consensus.cc:515] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:11.532286 21867 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:11.537176 21476 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.528024 21721 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:11.551368 21816 raft_consensus.cc:2804] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:11.555338 21660 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:11.590945 21660 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:11.575479 21762 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:11.594406 21660 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:11.594731 21748 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:11.595430 21748 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:11.597167 21842 consensus_queue.cc:1048] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:11.600082 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:11.600378 21755 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:11.601217 21868 leader_election.cc:290] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:11.601400 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:11.536680 21780 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:11.603379 21782 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:11.604943 21780 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:11.586670 21816 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.605993 21816 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:11.606921 21476 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:11.607604 17913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.609697 21476 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:11.575647 17914 leader_election.cc:304] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:11.512665 21909 raft_consensus.cc:493] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:11.524788 21905 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:11.614229 18015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53022 (request call id 676) took 2096 ms. Trace:
I20260709 12:11:11.583459 21772 raft_consensus.cc:2804] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:11.587679 21932 log.cc:927] Time spent T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 12:11:11.587873 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 282969us
I20260709 12:11:11.576458 21825 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:11.597618 21748 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:11.598590 17989 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:11.614670 18015 rpcz_store.cc:276] 0709 12:11:09.518361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.867368 (+1349007us) service_pool.cc:224] Handling call
0709 12:11:10.878350 (+ 10982us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:11.074526 (+196176us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:11.111958 (+ 37432us) spinlock_profiling.cc:243] Waited 23.1 ms on lock 0x7b48002727d8. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f518dbaa1 00007f7f518d2b37 00007f7f518d29ca 00007f7f519ca26f 00007f7f519c9f37 00007f7f519de55c 00007f7f519de508 00007f7f519de488 00007f7f519de443 00007f7f519dd6ec 00007f7f50907a96
0709 12:11:11.285852 (+173894us) log.cc:844] Serialized 14 byte log entry
0709 12:11:11.437252 (+151400us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:11.486870 (+ 49618us) log.cc:844] Serialized 26 byte log entry
0709 12:11:11.491442 (+  4572us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:11.491667 (+   225us) log.cc:844] Serialized 14 byte log entry
0709 12:11:11.491840 (+   173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.491913 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:11.613991 (+122078us) raft_consensus.cc:1685] finished
0709 12:11:11.614013 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:11.614169 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":406208,"prepare.queue_time_us":210624,"prepare.run_cpu_time_us":120,"prepare.run_wall_time_us":2316,"raft.queue_time_us":224453,"raft.run_cpu_time_us":2718,"raft.run_wall_time_us":95839,"spinlock_wait_cycles":53197056,"thread_start_us":181884,"threads_started":2,"wal-append.queue_time_us":280156}
I20260709 12:11:11.624344 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:11.624291 21909 raft_consensus.cc:515] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:11.625512 21721 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:11.639599 18021 raft_consensus.cc:1275] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:11.621570 21772 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:11.627447 21544 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:11.629102 21780 consensus_queue.cc:1048] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:11.629503 21867 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:11.630146 17946 raft_consensus.cc:2410] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:11:11.630146 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:11.631995 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:11.626538 21825 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:11.653703 18023 raft_consensus.cc:2468] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
I20260709 12:11:11.638031 18016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 2211) took 2098 ms. Trace:
I20260709 12:11:11.638841 18020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45464 (request call id 2025) took 1777 ms. Trace:
I20260709 12:11:11.643945 18089 raft_consensus.cc:1275] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:11:11.647960 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 49461.6us
W20260709 12:11:11.639528 21899 consensus_meta.cc:287] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.968s	user 0.013s	sys 0.001s
W20260709 12:11:11.659188 21767 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:11:11.659559 21899 raft_consensus.cc:2749] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:11.649354 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:11.649987 21926 raft_consensus.cc:2804] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:11:11.650743 21334 consensus_meta.cc:287] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.682s	user 0.013s	sys 0.000s
I20260709 12:11:11.654314 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:11.646873 21772 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:11.658352 18020 rpcz_store.cc:276] 0709 12:11:09.856867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.346511 (+1489644us) service_pool.cc:224] Handling call
0709 12:11:11.450597 (+104086us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:11.631160 (+180563us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:11.631192 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:11.631236 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:11.631286 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.633622 (+  2336us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b54000b3454. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:11:11.633661 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:11.633782 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":414676352}
I20260709 12:11:11.659111 17989 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:11.671187 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:11.672149 18641 raft_consensus.cc:2468] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 9.
I20260709 12:11:11.676049 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:11.660355 21764 raft_consensus.cc:493] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.657073 18016 rpcz_store.cc:276] 0709 12:11:09.539108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:10.892577 (+1353469us) service_pool.cc:224] Handling call
0709 12:11:10.893067 (+   490us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:11.311512 (+418445us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:11:11.356567 (+ 45055us) log.cc:844] Serialized 14 byte log entry
0709 12:11:11.503655 (+147088us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:11.543627 (+ 39972us) log.cc:844] Serialized 26 byte log entry
0709 12:11:11.544272 (+   645us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:11.544402 (+   130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.544630 (+   228us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:11.633098 (+ 88468us) raft_consensus.cc:1685] finished
0709 12:11:11.633123 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:11.637840 (+  4717us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":108837,"prepare.queue_time_us":38776,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":145828,"raft.run_cpu_time_us":321,"raft.run_wall_time_us":47432,"thread_start_us":381611,"threads_started":2,"wal-append.queue_time_us":264356}
I20260709 12:11:11.685079 18093 raft_consensus.cc:2468] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 10.
I20260709 12:11:11.683207 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:11.686408 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:11.683147 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:11.662434 21926 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.692384 18094 raft_consensus.cc:1275] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:11.695858 17944 raft_consensus.cc:3060] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:11.671227 21039 raft_consensus.cc:2749] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:11.679534 21544 raft_consensus.cc:493] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:11.680153 21924 leader_election.cc:290] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:11.689407 21926 raft_consensus.cc:3060] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:11.700399 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:11.666821 21885 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:11.693243 21825 raft_consensus.cc:2764] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:11:11.705691 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:11.708781 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:11.705725 17847 catalog_manager.cc:5697] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 5 to 6, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 6 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:11.710083 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:11.711202 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:11.711606 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:11.712303 21334 consensus_queue.cc:1059] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:11.674791 21816 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:11.674309 21867 consensus_queue.cc:1048] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
W20260709 12:11:11.722340 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 156846us
I20260709 12:11:11.723119 17914 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:11.723449 21762 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:11.724421 21883 raft_consensus.cc:2804] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:11.724848 21883 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:11.725203 21883 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:11.725486 21765 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:11.702956 21660 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.731459 21660 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:11.710875 21753 raft_consensus.cc:493] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.734215 21660 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:11.736294 21721 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:11.712853 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:11:11.738994 17946 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2274) took 2130 ms (client timeout 2364 ms). Trace:
I20260709 12:11:11.718843 18019 raft_consensus.cc:1275] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:11:11.739550 17946 rpcz_store.cc:269] 0709 12:11:09.608767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.608944 (+   177us) service_pool.cc:224] Handling call
0709 12:11:11.738697 (+2129753us) spinlock_profiling.cc:243] Waited 1.95 s on lock 0x7b5400072bd4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:11.738899 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4486069504}
I20260709 12:11:11.740651 18644 raft_consensus.cc:1275] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:11:11.710734 17847 catalog_manager.cc:5697] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:11.690657 21764 raft_consensus.cc:515] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:11.719910 21544 raft_consensus.cc:515] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:11.745601 21544 leader_election.cc:290] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:11.747355 18638 raft_consensus.cc:2468] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 10.
I20260709 12:11:11.687443 21748 consensus_queue.cc:1048] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:11:11.720676 21899 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.720552 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:11.752588 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:11.720423 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:11.751075 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:11.756902 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:11.758400 18021 raft_consensus.cc:2393] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 10: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:11.733765 21753 raft_consensus.cc:515] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:11.757700 18094 raft_consensus.cc:2468] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 9.
I20260709 12:11:11.742156 21883 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:11.763603 21764 leader_election.cc:290] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:11.764020 17947 raft_consensus.cc:2393] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 13: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:11.765410 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:11.765570 18635 raft_consensus.cc:1240] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 9 LEADER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:11.752947 21899 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:11.771741 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:11.773490 21905 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:11.777835 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:11:11.780449 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 121458us
W20260709 12:11:11.781853 21925 log.cc:927] Time spent T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 12:11:11.781690 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:11.781083 17989 leader_election.cc:304] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:11.791455 17948 raft_consensus.cc:2393] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 11: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
W20260709 12:11:11.792897 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 44539.4us
I20260709 12:11:11.793375 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:11.792631 21924 raft_consensus.cc:2804] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:11.796391 21924 raft_consensus.cc:493] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.796736 21924 raft_consensus.cc:3060] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:11.797281 21899 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:11.797392 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:11.798095 18092 raft_consensus.cc:2468] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 10.
I20260709 12:11:11.799078 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:11.799224 21476 consensus_queue.cc:1048] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:11.796657 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:11.799103 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:11.790715 21905 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.804489 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:11.805362 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:11.810901 17941 raft_consensus.cc:1240] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:11.827677 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 102040us
I20260709 12:11:11.828384 17946 raft_consensus.cc:2468] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
I20260709 12:11:11.828994 17989 leader_election.cc:304] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:11.808604 21826 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.826373 21842 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:11.839102 21816 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 13 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:11.839277 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:11.832552 18091 consensus_queue.cc:260] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:11.841535 18021 raft_consensus.cc:2468] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
W20260709 12:11:11.839708 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 89474.2us
I20260709 12:11:11.790285 21885 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:11.847877 21922 raft_consensus.cc:2804] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:11.848351 21922 raft_consensus.cc:493] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.848723 21922 raft_consensus.cc:3060] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:11.852136 21906 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:11.852771 21621 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:11.856843 21768 consensus_queue.cc:1048] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:11.858994 21926 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:11.859709 18609 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:11.861315 21938 raft_consensus.cc:2804] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:11.861546 21926 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:11.861786 21938 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.862174 21938 raft_consensus.cc:3060] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:11.862493 21885 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:11.866186 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 59434.1us
I20260709 12:11:11.867206 21842 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:11.869987 21842 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:11.846263 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:11.879483 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:11.880780 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:11.881417 18019 raft_consensus.cc:1275] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:11:11.881525 17988 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:11.881979 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:11.883006 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:11.883597 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:11.886183 18022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53022 (request call id 668) took 2962 ms. Trace:
I20260709 12:11:11.876304 21085 consensus_queue.cc:1048] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 12:11:11.886929 21784 consensus_queue.cc:1059] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:11:11.887203 21768 consensus_queue.cc:1048] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:11:11.886586 18022 rpcz_store.cc:276] 0709 12:11:08.923622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:09.313409 (+389787us) service_pool.cc:224] Handling call
0709 12:11:09.313699 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:09.314002 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:09.314029 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:11.053003 (+1738974us) spinlock_profiling.cc:243] Waited 8.59 ms on lock 0x7b2c0005beb8. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4b2aba11 00007f7f4b2bb372 00007f7f4c9eda01 00007f7f4c9b243a 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2
0709 12:11:11.053635 (+   632us) log.cc:844] Serialized 26 byte log entry
0709 12:11:11.340697 (+287062us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:11.378298 (+ 37601us) log.cc:844] Serialized 14 byte log entry
0709 12:11:11.453543 (+ 75245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:11.471913 (+ 18370us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:11.885638 (+413725us) raft_consensus.cc:1685] finished
0709 12:11:11.885733 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:11.885941 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78008,"prepare.queue_time_us":41079,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":83,"raft.queue_time_us":79648,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":35522,"spinlock_wait_cycles":19767680,"thread_start_us":285973,"threads_started":1,"wal-append.queue_time_us":650531}
I20260709 12:11:11.889397 21850 raft_consensus.cc:3055] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:11.889814 21850 raft_consensus.cc:740] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:11.890929 21850 consensus_queue.cc:260] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:11:11.876032 21334 consensus_queue.cc:1059] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:11:11.892231 21334 consensus_queue.cc:1243] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Peer c5ffa786c8fb43f7864fa8fbe76534cb log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:11:11.892318 21850 raft_consensus.cc:3060] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:11.895648 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:11.884199 18609 leader_election.cc:304] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:11.838366 21826 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:11:11.899358 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:11.884852 18090 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 10.
I20260709 12:11:11.900174 18092 raft_consensus.cc:2468] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
I20260709 12:11:11.903110 21085 raft_consensus.cc:2804] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:11.905398 21085 raft_consensus.cc:493] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:11.905710 21085 raft_consensus.cc:3060] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:11.906395 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:11.874306 21748 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:12.253118 21748 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:11:11.944356 21085 raft_consensus.cc:515] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:12.126150 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
W20260709 12:11:12.198501 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.235531 18097 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 12.
I20260709 12:11:12.351297 18094 raft_consensus.cc:3060] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:12.246832 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:12.355032 18093 raft_consensus.cc:2468] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 12.
I20260709 12:11:12.106127 21753 leader_election.cc:290] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:12.184019 21660 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.183307 21741 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.483358 21741 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:12.486245 21741 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:11.866364 21772 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:11.844230 17912 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:12.279871 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:13.124976 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:13.126066 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:12.279021 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:12.277570 17943 raft_consensus.cc:1275] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:11:11.970741 17945 raft_consensus.cc:1240] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 8. Current term is 9. Ops: [4.3-8.6]
I20260709 12:11:13.129726 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:13.130317 17945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2280) took 1359 ms. Trace:
I20260709 12:11:13.130702 17945 rpcz_store.cc:276] 0709 12:11:11.770973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.777433 (+  6460us) service_pool.cc:224] Handling call
0709 12:11:11.791477 (+ 14044us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 12:11:13.130004 (+1338527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.130262 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.131862 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:13.132450 17945 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 12.
I20260709 12:11:13.133391 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:12.196408 17947 raft_consensus.cc:1275] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:12.191819 17948 raft_consensus.cc:1240] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 10. Current term is 11. Ops: []
W20260709 12:11:11.975467 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 77453.9us
I20260709 12:11:13.239184 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:13.240103 18019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45472 (request call id 2223) took 1114 ms. Trace:
I20260709 12:11:13.240406 18019 rpcz_store.cc:276] 0709 12:11:12.125239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.238920 (+1113681us) service_pool.cc:224] Handling call
0709 12:11:13.240009 (+  1089us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:12.082698 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 187599us
I20260709 12:11:11.899984 18016 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 12.
I20260709 12:11:13.296692 18016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45472 (request call id 2221) took 1401 ms. Trace:
I20260709 12:11:13.297071 18016 rpcz_store.cc:276] 0709 12:11:11.895019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.895145 (+   126us) service_pool.cc:224] Handling call
0709 12:11:13.296631 (+1401486us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.297606 21956 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.126266 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:13.300618 18022 raft_consensus.cc:2468] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 9.
W20260709 12:11:13.301072 18022 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45472 (request call id 2222) took 1176 ms (client timeout 1506 ms). Trace:
W20260709 12:11:13.301397 18022 rpcz_store.cc:269] 0709 12:11:12.124905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.126026 (+  1121us) service_pool.cc:224] Handling call
0709 12:11:13.301023 (+1174997us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:12.231842 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:12.365960 21947 raft_consensus.cc:493] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:13.302911 21947 raft_consensus.cc:515] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:13.305135 21947 leader_election.cc:290] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:13.305575 21947 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:12.432408 18015 raft_consensus.cc:1240] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:13.307122 18015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 2227) took 1181 ms. Trace:
I20260709 12:11:13.307314 18023 raft_consensus.cc:2393] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 10: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:13.307902 18023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45472 (request call id 2225) took 1182 ms. Trace:
I20260709 12:11:13.307461 18015 rpcz_store.cc:276] 0709 12:11:12.126169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.431902 (+305733us) service_pool.cc:224] Handling call
0709 12:11:12.432242 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:13.306859 (+874617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.307074 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.308414 18023 rpcz_store.cc:276] 0709 12:11:12.125731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.231537 (+105806us) service_pool.cc:224] Handling call
0709 12:11:13.307844 (+1076307us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:12.452572 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:13.309722 17949 raft_consensus.cc:2468] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 9.
I20260709 12:11:13.310386 17949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2291) took 1033 ms. Trace:
I20260709 12:11:13.310797 17949 rpcz_store.cc:276] 0709 12:11:12.277013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.452208 (+175195us) service_pool.cc:224] Handling call
0709 12:11:13.310287 (+858079us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.312194 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:13.312927 17949 raft_consensus.cc:2468] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 9.
I20260709 12:11:13.313952 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:12.495465 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:13.315551 17946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2292) took 1038 ms. Trace:
I20260709 12:11:13.315953 17946 rpcz_store.cc:276] 0709 12:11:12.277373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.495220 (+217847us) service_pool.cc:224] Handling call
0709 12:11:13.315490 (+820270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.317013 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:11:12.351351 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.319370 21960 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
W20260709 12:11:13.320099 17913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.319929 21960 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:12.419445 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:12.269842 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:12.427398 18091 raft_consensus.cc:3060] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:12.368774 18094 raft_consensus.cc:2468] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:11:13.340785 18094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53954 (request call id 2343) took 1446 ms. Trace:
I20260709 12:11:12.399649 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:13.347748 21966 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.348233 18636 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 10.
I20260709 12:11:13.348316 21966 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:13.349766 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:13.350667 21966 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:13.351137 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:13.352002 21966 raft_consensus.cc:493] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:13.338369 21957 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:12.444716 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:13.358628 18638 raft_consensus.cc:2410] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 12:11:13.359364 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:13.360297 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:13.360783 18638 raft_consensus.cc:2468] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:11:13.352710 21952 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:13.361514 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:13.361888 21952 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:12.396389 18637 raft_consensus.cc:1240] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:11:13.364153 21952 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:13.364261 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:13.364634 21952 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:13.364770 18637 raft_consensus.cc:3060] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:13.365096 21952 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:12.398744 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:13.367360 18642 raft_consensus.cc:2468] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 10.
I20260709 12:11:13.368208 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:13.368986 18642 raft_consensus.cc:2410] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for term 15 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:11:13.369967 18642 raft_consensus.cc:1275] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:12.453599 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:12.396245 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:13.372087 18635 raft_consensus.cc:2468] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:11:12.358203 21085 leader_election.cc:290] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:12.358865 21660 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:12.511049 21741 raft_consensus.cc:493] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:13.408093 21741 raft_consensus.cc:515] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:12.255566 21748 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:13.412575 21748 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:13.413094 21748 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:13.413641 21971 consensus_queue.cc:1048] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:13.414815 17942 raft_consensus.cc:2468] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 10.
I20260709 12:11:13.416529 17942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2288) took 1140 ms. Trace:
I20260709 12:11:12.185220 21782 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.417986 21782 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:13.418337 21969 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:13.418859 21969 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:13.420073 21782 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:12.397303 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:13.421415 18643 raft_consensus.cc:2468] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
I20260709 12:11:13.421733 21748 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:13.421898 18643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60424 (request call id 1027) took 1025 ms. Trace:
I20260709 12:11:12.398949 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:13.432140 17913 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:11.977375 21826 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123)
I20260709 12:11:12.187909 21845 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:13.435559 21845 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:13.437808 21845 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:11.902320 21883 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:13.439357 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 8 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:13.439893 18095 raft_consensus.cc:3060] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:11.838706 21905 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:13.442227 21905 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:12.152966 21908 raft_consensus.cc:3055] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:13.449510 21908 raft_consensus.cc:740] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:11.943852 21909 leader_election.cc:290] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:11.985846 21922 raft_consensus.cc:515] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:13.453353 21922 leader_election.cc:290] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:11.959787 21924 raft_consensus.cc:515] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:11.900754 21926 raft_consensus.cc:2749] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:11.946332 21929 log.cc:927] Time spent T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.143s	user 0.000s	sys 0.002s
I20260709 12:11:13.457043 18095 raft_consensus.cc:2468] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 10.
I20260709 12:11:11.986696 21938 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:12.286895 21941 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.465356 21941 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:11:13.465631 21908 consensus_queue.cc:260] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:12.496500 21937 raft_consensus.cc:493] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:13.467625 21937 raft_consensus.cc:515] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:13.468197 21883 raft_consensus.cc:2749] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:13.469660 21937 leader_election.cc:290] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:12.957486 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:13.470494 18024 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 12.
W20260709 12:11:13.470960 18024 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45472 (request call id 2228) took 1344 ms (client timeout 1640 ms). Trace:
W20260709 12:11:13.471285 18024 rpcz_store.cc:269] 0709 12:11:12.126403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.957211 (+830808us) service_pool.cc:224] Handling call
0709 12:11:13.470905 (+513694us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.102319 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:13.472102 18639 raft_consensus.cc:2468] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 4.
I20260709 12:11:13.472571 18639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60424 (request call id 1038) took 1072 ms. Trace:
I20260709 12:11:13.472847 18639 rpcz_store.cc:276] 0709 12:11:12.399647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.101992 (+702345us) service_pool.cc:224] Handling call
0709 12:11:13.472488 (+370496us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.135722 21772 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 13 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:13.137041 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 1.29282e+06us
I20260709 12:11:13.134495 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:13.136543 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:13.474906 17945 raft_consensus.cc:2468] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 7.
I20260709 12:11:13.475090 17940 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 10.
I20260709 12:11:13.476547 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:13.478034 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:13.161062 21949 raft_consensus.cc:2804] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:13.478880 21949 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.479475 21949 raft_consensus.cc:3060] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:13.480775 21941 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:11:13.172930 17944 consensus_meta.cc:287] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 1.469s	user 0.016s	sys 0.005s
I20260709 12:11:13.162489 21950 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.482899 17944 raft_consensus.cc:2468] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 7.
I20260709 12:11:13.483013 21950 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:11:13.483650 17944 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50334 (request call id 2278) took 1820 ms (client timeout 1619 ms). Trace:
W20260709 12:11:13.484117 17944 rpcz_store.cc:269] 0709 12:11:11.663129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.664222 (+  1093us) service_pool.cc:224] Handling call
0709 12:11:13.483548 (+1819326us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.485206 21950 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:13.485251 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:13.220119 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:13.232415 21951 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
W20260709 12:11:13.245776 17845 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45928 (request call id 368) took 25020 ms (client timeout 15000 ms). Trace:
I20260709 12:11:13.241194 17847 catalog_manager.cc:5697] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 1 to 7, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 7 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:13.247969 21842 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
W20260709 12:11:13.248679 17988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.254726 18097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53954 (request call id 2338) took 1459 ms. Trace:
I20260709 12:11:13.257244 21954 raft_consensus.cc:493] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:13.261153 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 1.35848e+06us
I20260709 12:11:13.269868 21825 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:13.502712 21842 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:13.274040 18665 debug-util.cc:398] Leaking SignalData structure 0x7b080015bae0 after lost signal to thread 16782
I20260709 12:11:12.272361 18018 raft_consensus.cc:1240] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:13.298318 21956 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:13.299026 21959 raft_consensus.cc:493] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:13.299428 21953 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:13.547621 18018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 2224) took 1422 ms. Trace:
I20260709 12:11:13.547652 21959 raft_consensus.cc:515] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:13.548121 18018 rpcz_store.cc:276] 0709 12:11:12.125480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.271737 (+146257us) service_pool.cc:224] Handling call
0709 12:11:12.272127 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:13.547379 (+1275252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.547568 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.548890 21956 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:13.306078 21947 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:13.549168 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:13.549787 18018 raft_consensus.cc:2468] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 6.
I20260709 12:11:13.550051 21959 leader_election.cc:290] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:13.314577 17949 raft_consensus.cc:3060] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.550835 21947 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:13.341073 18094 rpcz_store.cc:276] 0709 12:11:11.894318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.894723 (+   405us) service_pool.cc:224] Handling call
0709 12:11:13.340740 (+1446017us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.551741 18644 raft_consensus.cc:2468] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:11:13.552613 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:13.553395 18644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60424 (request call id 1030) took 1155 ms. Trace:
I20260709 12:11:13.523353 21954 raft_consensus.cc:515] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:13.344836 21964 consensus_queue.cc:1059] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:13.553743 18644 rpcz_store.cc:276] 0709 12:11:12.397594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.453333 (+ 55739us) service_pool.cc:224] Handling call
0709 12:11:13.553255 (+1099922us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b54006f0254. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:13.553350 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":414487296}
I20260709 12:11:13.323474 21767 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:13.354285 21957 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:13.355836 21960 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:13.357470 21961 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:13.567595 21961 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:13.568558 21957 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:13.569662 21961 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:12.397459 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:13.370715 21544 raft_consensus.cc:493] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.375231 21958 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:13.377355 18637 raft_consensus.cc:2468] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:11:13.362498 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:13.382246 18091 raft_consensus.cc:1275] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
W20260709 12:11:13.392023 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 48345.8us
I20260709 12:11:13.579607 18091 pending_rounds.cc:85] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110: Aborting all ops after (but not including) 5
I20260709 12:11:13.579703 18638 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 12.
I20260709 12:11:13.580158 18609 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
W20260709 12:11:13.396015 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 74076.8us
I20260709 12:11:13.352525 21966 raft_consensus.cc:515] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:11:13.398886 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 55356.4us
W20260709 12:11:13.400219 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.401665 21968 raft_consensus.cc:493] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:13.403831 21970 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:13.416821 17942 rpcz_store.cc:276] 0709 12:11:12.276041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.278753 (+  2712us) service_pool.cc:224] Handling call
0709 12:11:13.416365 (+1137612us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b540015f4d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:13.416457 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":661131008}
I20260709 12:11:13.417002 18608 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:13.420899 21969 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:13.422220 18643 rpcz_store.cc:276] 0709 12:11:12.396912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.397043 (+   131us) service_pool.cc:224] Handling call
0709 12:11:13.421842 (+1024799us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.423060 17943 raft_consensus.cc:2468] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 12.
I20260709 12:11:13.427745 21967 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:13.428558 21975 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:13.430893 21660 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:13.431283 21972 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.422418 21741 leader_election.cc:290] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:13.432034 21748 consensus_queue.cc:1048] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:12.185331 21816 raft_consensus.cc:493] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:13.646270 21816 raft_consensus.cc:515] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:13.646875 21981 raft_consensus.cc:493] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:13.647398 21981 raft_consensus.cc:515] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:13.432402 18641 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60424 (request call id 1031) took 1034 ms. Trace:
I20260709 12:11:12.183826 21885 raft_consensus.cc:493] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:13.426513 21952 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:13.639222 18061 leader_election.cc:304] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:13.454910 18017 raft_consensus.cc:2368] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 9. Current term is 10.
I20260709 12:11:13.649927 21885 raft_consensus.cc:515] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:11:13.650744 18017 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45464 (request call id 2039) took 1858 ms (client timeout 1759 ms). Trace:
I20260709 12:11:13.651057 18061 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
W20260709 12:11:13.651104 18017 rpcz_store.cc:269] 0709 12:11:11.793960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.794079 (+   119us) service_pool.cc:224] Handling call
0709 12:11:13.650552 (+1856473us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b54000b2a54. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:13.650677 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3784131456}
I20260709 12:11:13.651911 21885 leader_election.cc:290] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:13.652247 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:13.653424 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:13.654101 18017 raft_consensus.cc:2393] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 8: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:13.456425 21924 leader_election.cc:290] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:13.464216 21938 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:13.654798 21982 raft_consensus.cc:2764] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:11:13.655556 21982 raft_consensus.cc:2804] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:13.655982 21982 raft_consensus.cc:697] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:13.656621 21816 leader_election.cc:290] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:13.657291 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:13.475426 17945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2298) took 1192 ms. Trace:
I20260709 12:11:13.658243 18017 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 12.
I20260709 12:11:13.200040 17948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44668 (request call id 670) took 1016 ms. Trace:
I20260709 12:11:13.198160 17947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44668 (request call id 669) took 1015 ms. Trace:
I20260709 12:11:13.486042 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:13.509016 18020 raft_consensus.cc:2468] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 12.
I20260709 12:11:13.469899 17913 leader_election.cc:304] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:13.661070 17947 rpcz_store.cc:276] 0709 12:11:12.182918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.195743 (+ 12825us) service_pool.cc:224] Handling call
0709 12:11:12.196071 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:13.197812 (+1001741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.198089 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.509639 17941 raft_consensus.cc:1240] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 6. Current term is 7. Ops: []
W20260709 12:11:13.661366 18020 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45472 (request call id 2226) took 1535 ms (client timeout 2011 ms). Trace:
W20260709 12:11:13.661919 18020 rpcz_store.cc:269] 0709 12:11:12.125955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.219738 (+1093783us) service_pool.cc:224] Handling call
0709 12:11:13.661310 (+441572us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.515456 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:13.516774 21951 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:13.518601 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:13.518769 21926 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.520603 21922 raft_consensus.cc:493] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.521138 21909 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.522045 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:13.665664 17949 raft_consensus.cc:2468] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 10.
I20260709 12:11:13.503029 21825 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:13.531489 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:13.665930 18015 raft_consensus.cc:2468] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 10.
I20260709 12:11:13.667755 18023 raft_consensus.cc:2468] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 9.
I20260709 12:11:13.668114 21926 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:13.668659 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:13.669301 18023 raft_consensus.cc:2468] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 12.
I20260709 12:11:13.670061 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:13.530035 17847 catalog_manager.cc:5697] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 5 to 8, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 8 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } }
I20260709 12:11:13.670526 21951 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:11:13.670668 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 200879us
I20260709 12:11:13.538762 21950 raft_consensus.cc:493] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:13.671458 17913 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:13.671329 17847 catalog_manager.cc:5697] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 5 to 6, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 6 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:13.672380 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:13.672655 21825 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:13.671344 21950 raft_consensus.cc:515] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:13.673511 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:13.674117 18642 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 12.
I20260709 12:11:13.535127 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:13.674904 18024 raft_consensus.cc:2468] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 8.
I20260709 12:11:13.675362 18640 raft_consensus.cc:2468] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:11:13.675674 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:13.676187 17947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44668 (request call id 673) took 1164 ms. Trace:
I20260709 12:11:13.526624 21782 raft_consensus.cc:493] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.676923 18640 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60424 (request call id 1028) took 1279 ms. Trace:
I20260709 12:11:13.676854 21782 raft_consensus.cc:515] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:13.677388 18640 rpcz_store.cc:276] 0709 12:11:12.397156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.397247 (+    91us) service_pool.cc:224] Handling call
0709 12:11:13.676778 (+1279531us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54005406d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:13.676873 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":239583104}
I20260709 12:11:13.678948 17944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44668 (request call id 674) took 1167 ms. Trace:
I20260709 12:11:13.679026 21782 leader_election.cc:290] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:13.540738 17940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2296) took 1262 ms. Trace:
I20260709 12:11:13.546880 21842 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:13.545675 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:13.547757 21953 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:13.679383 17944 rpcz_store.cc:276] 0709 12:11:12.511910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.678162 (+1166252us) service_pool.cc:224] Handling call
0709 12:11:13.678429 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:13.678623 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:13.678673 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:13.678722 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:13.678758 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.678810 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:13.678897 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.680055 18019 raft_consensus.cc:2393] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 8: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:13.680824 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:13.681120 17944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44668 (request call id 675) took 1169 ms. Trace:
I20260709 12:11:13.681305 18019 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:13.681356 21953 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:13.554730 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:13.352481 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:13.681491 17944 rpcz_store.cc:276] 0709 12:11:12.512180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.680379 (+1168199us) service_pool.cc:224] Handling call
0709 12:11:13.680633 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:13.680831 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:13.680863 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:13.680901 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:13.680935 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.680983 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:13.681075 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.682291 18018 raft_consensus.cc:2468] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
I20260709 12:11:13.683357 17941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2285) took 1854 ms. Trace:
I20260709 12:11:13.582976 18638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60424 (request call id 1037) took 1180 ms. Trace:
I20260709 12:11:13.684379 18638 rpcz_store.cc:276] 0709 12:11:12.399371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.362292 (+962921us) service_pool.cc:224] Handling call
0709 12:11:13.580177 (+217885us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.684500 21922 raft_consensus.cc:515] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:13.566350 17988 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:13.684384 21909 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:11:13.687198 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 120931us
I20260709 12:11:13.583741 18637 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60424 (request call id 1041) took 1179 ms. Trace:
I20260709 12:11:13.596488 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:13.598414 17989 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:13.598989 17943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50336 (request call id 2295) took 1320 ms. Trace:
I20260709 12:11:13.587235 18091 pending_rounds.cc:107] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110: Aborting uncommitted NO_OP operation due to leader change: 8.6
W20260709 12:11:13.602286 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 185338us
I20260709 12:11:13.614454 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:13.589304 21960 raft_consensus.cc:2764] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:11:13.620164 18609 leader_election.cc:304] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
W20260709 12:11:13.509624 17845 rpcz_store.cc:269] 0709 12:10:48.224911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:48.231803 (+  6892us) service_pool.cc:224] Handling call
0709 12:11:13.244963 (+25013160us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:02.517298 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:02.517973 (+   675us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:02.518020 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:11:02.518036 (+    16us) tablet.cc:662] Decoding operations
0709 12:11:02.523465 (+  5429us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:02.523548 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:02.523582 (+    34us) tablet.cc:685] Acquiring locks for 21 operations
0709 12:11:02.526856 (+  3274us) tablet.cc:701] Row locks acquired
0709 12:11:02.543003 (+ 16147us) write_op.cc:260] PREPARE: finished
0709 12:11:02.571496 (+ 28493us) write_op.cc:270] Start()
0709 12:11:02.589941 (+ 18445us) write_op.cc:276] Timestamp: P: 1783599062566289 usec, L: 0
0709 12:11:02.591747 (+  1806us) op_driver.cc:348] REPLICATION: starting
0709 12:11:02.777779 (+186032us) log.cc:844] Serialized 8254 byte log entry
0709 12:11:04.258153 (+1480374us) op_driver.cc:464] REPLICATION: finished
0709 12:11:04.810226 (+552073us) write_op.cc:301] APPLY: starting
0709 12:11:04.810326 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:04.810727 (+   401us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:04.810863 (+   136us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:05.161965 (+351102us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:05.162346 (+   381us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0709 12:11:05.162389 (+    43us) write_op.cc:312] APPLY: finished
0709 12:11:05.162909 (+   520us) log.cc:844] Serialized 145 byte log entry
0709 12:11:05.290671 (+127762us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:05.302990 (+ 12319us) write_op.cc:454] Released schema lock
0709 12:11:05.341286 (+ 38296us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:05.443149 (+101863us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:05.464004 (+ 20855us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3008290,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":551763,"apply.run_cpu_time_us":20996,"apply.run_wall_time_us":598757,"num_ops":21,"prepare.queue_time_us":135733,"prepare.run_cpu_time_us":22472,"prepare.run_wall_time_us":504026,"raft.queue_time_us":605484,"raft.run_cpu_time_us":19643,"raft.run_wall_time_us":373657,"replication_time_us":1664532,"thread_start_us":922053,"threads_started":5,"wal-append.queue_time_us":467201,"wal-append.run_cpu_time_us":25855,"wal-append.run_wall_time_us":3056946}]]}
I20260709 12:11:13.621995 17942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2297) took 1339 ms. Trace:
I20260709 12:11:13.610319 21964 raft_consensus.cc:3055] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:11:13.625325 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 62994.4us
W20260709 12:11:13.625885 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.586894 21544 raft_consensus.cc:515] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:13.571273 21767 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:13.604866 21956 raft_consensus.cc:2749] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:13.635061 21974 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:13.766506 21767 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:13.766815 18608 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:13.766743 21974 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:13.768688 21937 raft_consensus.cc:2804] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:13.768927 21974 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:13.769083 21937 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.589006 21958 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:13.769482 21937 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:13.699256 21816 raft_consensus.cc:2749] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:13.769716 21956 consensus_queue.cc:1048] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:11:13.770586 18045 debug-util.cc:398] Leaking SignalData structure 0x7b080036b720 after lost signal to thread 16782
I20260709 12:11:13.770999 21958 leader_election.cc:290] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:11:13.771683 18045 debug-util.cc:398] Leaking SignalData structure 0x7b08001335a0 after lost signal to thread 17881
I20260709 12:11:13.597386 21968 raft_consensus.cc:515] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:13.772892 18045 debug-util.cc:398] Leaking SignalData structure 0x7b08001cb4e0 after lost signal to thread 17973
I20260709 12:11:13.773427 18062 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:11:13.773988 18045 debug-util.cc:398] Leaking SignalData structure 0x7b08001d5f00 after lost signal to thread 18048
I20260709 12:11:13.774163 21767 raft_consensus.cc:2804] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:13.602895 21970 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:13.619444 21972 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:11:13.649204 18641 rpcz_store.cc:276] 0709 12:11:12.397814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.398717 (+   903us) service_pool.cc:224] Handling call
0709 12:11:13.432343 (+1033626us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.649498 21981 leader_election.cc:290] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:13.656879 21982 consensus_queue.cc:237] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:13.467096 21908 raft_consensus.cc:3060] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:13.658151 17945 rpcz_store.cc:276] 0709 12:11:12.282947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.134266 (+851319us) service_pool.cc:224] Handling call
0709 12:11:13.475352 (+341086us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.478796 21772 consensus_queue.cc:1048] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:11:13.510999 18665 debug-util.cc:398] Leaking SignalData structure 0x7b0800246a80 after lost signal to thread 17881
I20260709 12:11:13.509016 18097 rpcz_store.cc:276] 0709 12:11:11.795699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.796415 (+   716us) service_pool.cc:224] Handling call
0709 12:11:13.254488 (+1458073us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b54000389d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:13.254636 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":993819904}
I20260709 12:11:13.658934 17948 rpcz_store.cc:276] 0709 12:11:12.183174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:12.191297 (+  8123us) service_pool.cc:224] Handling call
0709 12:11:12.191643 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:13.199780 (+1008137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.199984 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.666299 17949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44668 (request call id 686) took 1151 ms. Trace:
I20260709 12:11:13.666273 18022 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 9.
I20260709 12:11:13.667042 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:13.785243 18020 raft_consensus.cc:2468] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 9.
I20260709 12:11:13.668746 21954 leader_election.cc:290] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:13.670152 21926 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:13.676231 18024 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 12.
I20260709 12:11:13.536513 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:13.541692 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:13.553838 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:13.682456 18636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60424 (request call id 1042) took 1281 ms. Trace:
I20260709 12:11:13.566963 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:13.683703 17941 rpcz_store.cc:276] 0709 12:11:11.829316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.829451 (+   135us) service_pool.cc:224] Handling call
0709 12:11:13.509362 (+1679911us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:13.665515 (+156153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.683199 (+ 17684us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b540031bd50. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b18ad 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:13.683307 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3800160000}
I20260709 12:11:13.676698 17947 rpcz_store.cc:276] 0709 12:11:12.511636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.675449 (+1163813us) service_pool.cc:224] Handling call
0709 12:11:13.675728 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:13.675910 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:13.675935 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:13.675975 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:13.676003 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.676051 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:13.676139 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.688994 17943 rpcz_store.cc:276] 0709 12:11:12.278262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.129492 (+851230us) service_pool.cc:224] Handling call
0709 12:11:13.598825 (+469333us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b54003e6054. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:13.598933 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":673256704}
I20260709 12:11:13.689373 18023 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 10.
I20260709 12:11:13.758558 21842 raft_consensus.cc:2804] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:13.718425 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.688362 21922 leader_election.cc:290] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:13.673880 17847 catalog_manager.cc:5697] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 5 to 7, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 7 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:13.761546 18091 raft_consensus.cc:2889] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:13.763000 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.758949 21950 leader_election.cc:290] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:13.695114 18018 raft_consensus.cc:1275] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 12:11:13.695354 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.600127 21967 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:13.774246 21968 leader_election.cc:290] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:13.643828 21966 leader_election.cc:290] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:13.679577 17940 rpcz_store.cc:276] 0709 12:11:12.278524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.526596 (+1248072us) service_pool.cc:224] Handling call
0709 12:11:13.535595 (+  8999us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:13.540426 (+  4831us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:13.540462 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:13.540503 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:11:13.540537 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.540596 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:13.540686 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.781919 21964 raft_consensus.cc:740] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
W20260709 12:11:13.776458 18045 debug-util.cc:398] Leaking SignalData structure 0x7b0800354f40 after lost signal to thread 18122
I20260709 12:11:13.776818 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:13.840938 18017 raft_consensus.cc:2468] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 10.
I20260709 12:11:13.707211 17988 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
W20260709 12:11:13.841535 18045 debug-util.cc:398] Leaking SignalData structure 0x7b08003e7f20 after lost signal to thread 18668
W20260709 12:11:13.841871 18045 debug-util.cc:398] Leaking SignalData structure 0x7b080032a0e0 after lost signal to thread 18669
W20260709 12:11:13.842231 18045 debug-util.cc:398] Leaking SignalData structure 0x7b080038bfc0 after lost signal to thread 21782
I20260709 12:11:13.687959 18637 rpcz_store.cc:276] 0709 12:11:12.400304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.364031 (+963727us) service_pool.cc:224] Handling call
0709 12:11:13.579399 (+215368us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:13.700314 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 101972us
I20260709 12:11:13.621929 21975 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:13.785377 17949 rpcz_store.cc:276] 0709 12:11:12.515155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.313679 (+798524us) service_pool.cc:224] Handling call
0709 12:11:13.666243 (+352564us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:13.785466 18665 debug-util.cc:398] Leaking SignalData structure 0x7b08002a2fe0 after lost signal to thread 17973
I20260709 12:11:13.814054 21660 raft_consensus.cc:2804] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:13.803623 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 183557us
I20260709 12:11:13.849226 21660 raft_consensus.cc:697] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:13.715819 21949 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:13.850193 21660 consensus_queue.cc:237] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 8.11, Last appended by leader: 11, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:13.804287 18021 raft_consensus.cc:2468] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 4.
I20260709 12:11:13.807137 21842 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.775771 21825 raft_consensus.cc:2804] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:13.806003 21909 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:13.805873 18636 rpcz_store.cc:276] 0709 12:11:12.400526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.352220 (+951694us) service_pool.cc:224] Handling call
0709 12:11:13.682401 (+330181us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:13.787814 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 101844us
I20260709 12:11:13.807299 17945 raft_consensus.cc:1240] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:13.807318 17944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44668 (request call id 676) took 1274 ms. Trace:
I20260709 12:11:13.808363 21816 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:13.809223 17947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44668 (request call id 685) took 1294 ms. Trace:
I20260709 12:11:13.905027 17947 rpcz_store.cc:276] 0709 12:11:12.514847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.806686 (+1291839us) service_pool.cc:224] Handling call
0709 12:11:13.808790 (+  2104us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:13.808957 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:13.808988 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:13.809018 (+    30us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:13.809042 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.809075 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:13.809176 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.779759 21767 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.815151 18091 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53954 (request call id 2329) took 2409 ms. Trace:
I20260709 12:11:13.906021 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:13.816224 17943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44668 (request call id 684) took 1301 ms. Trace:
I20260709 12:11:13.775476 18062 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:11:13.907240 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:13.839504 17941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44668 (request call id 683) took 1322 ms. Trace:
I20260709 12:11:13.907603 17941 rpcz_store.cc:276] 0709 12:11:12.514290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.804356 (+1290066us) service_pool.cc:224] Handling call
0709 12:11:13.816711 (+ 12355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:13.835906 (+ 19195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:13.835938 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:13.835987 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:13.836026 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.836097 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:13.836214 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.777913 17942 rpcz_store.cc:276] 0709 12:11:12.282598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.587997 (+1305399us) service_pool.cc:224] Handling call
0709 12:11:13.600099 (+ 12102us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:13.604607 (+  4508us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:13.604633 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:13.604671 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:13.621679 (+ 17008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.621772 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:13.621914 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.836194 21976 raft_consensus.cc:493] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.908929 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:13.842931 17989 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:13.909369 18090 raft_consensus.cc:2410] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:11:13.909711 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 66862.1us
W20260709 12:11:13.844671 18045 debug-util.cc:398] Leaking SignalData structure 0x7b08002cf800 after lost signal to thread 21816
I20260709 12:11:13.907421 17943 rpcz_store.cc:276] 0709 12:11:12.514546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.804571 (+1290025us) service_pool.cc:224] Handling call
0709 12:11:13.815816 (+ 11245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:13.815958 (+   142us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:13.815978 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:13.816012 (+    34us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:13.816050 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.816098 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:13.816178 (+    80us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:13.910493 18045 debug-util.cc:398] Leaking SignalData structure 0x7b0800387a00 after lost signal to thread 21826
W20260709 12:11:13.910794 18045 debug-util.cc:398] Leaking SignalData structure 0x7b08003176a0 after lost signal to thread 21845
W20260709 12:11:13.911020 18045 debug-util.cc:398] Leaking SignalData structure 0x7b08003457e0 after lost signal to thread 21883
W20260709 12:11:13.911245 18045 debug-util.cc:398] Leaking SignalData structure 0x7b08002579c0 after lost signal to thread 21885
W20260709 12:11:13.911453 18045 debug-util.cc:398] Leaking SignalData structure 0x7b080004ea60 after lost signal to thread 21905
W20260709 12:11:13.911638 18045 debug-util.cc:398] Leaking SignalData structure 0x7b08003702a0 after lost signal to thread 21906
W20260709 12:11:13.911819 18045 debug-util.cc:398] Leaking SignalData structure 0x7b08002e2fa0 after lost signal to thread 21908
W20260709 12:11:13.912012 18045 debug-util.cc:398] Leaking SignalData structure 0x7b08003920e0 after lost signal to thread 21909
W20260709 12:11:13.912230 18045 debug-util.cc:398] Leaking SignalData structure 0x7b08003997a0 after lost signal to thread 21922
W20260709 12:11:13.912417 18045 debug-util.cc:398] Leaking SignalData structure 0x7b08003a7ae0 after lost signal to thread 21924
W20260709 12:11:13.912607 18045 debug-util.cc:398] Leaking SignalData structure 0x7b08001956c0 after lost signal to thread 21926
W20260709 12:11:13.912817 18045 debug-util.cc:398] Leaking SignalData structure 0x7b08003fa100 after lost signal to thread 21929
W20260709 12:11:13.913079 18045 debug-util.cc:398] Leaking SignalData structure 0x7b08003cfc00 after lost signal to thread 21938
W20260709 12:11:13.913281 18045 debug-util.cc:398] Leaking SignalData structure 0x7b08000ad560 after lost signal to thread 21939
W20260709 12:11:13.845095 18665 debug-util.cc:398] Leaking SignalData structure 0x7b0800306480 after lost signal to thread 18048
W20260709 12:11:13.786866 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 115478us
I20260709 12:11:13.846141 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:13.846289 21544 leader_election.cc:290] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:13.845930 17847 catalog_manager.cc:5697] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 1 to 7, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 7 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:13.846812 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:13.906076 18091 rpcz_store.cc:276] 0709 12:11:11.404669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:11.428470 (+ 23801us) service_pool.cc:224] Handling call
0709 12:11:11.507391 (+ 78921us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:11.777643 (+270252us) spinlock_profiling.cc:243] Waited 9.43 ms on lock 0x7b4c0032bac0. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4ac7ea20 00007f7f4ac8fa29 00007f7f4ac55644 00007f7f4ac7cf2d 00007f7f4ac7cb93 00007f7f4c9ad18b 00007f7f4c9adcb5 00007f7f4c9a8f30 00007f7f4c9aa7de 00007f7f4c9b4b49 00007f7f4c9b5416
0709 12:11:12.427020 (+649377us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b5400209f20. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c927a1d 00007f7f4c90e1a4 00007f7f4c990447 00007f7f4c9a8fe7 00007f7f4c9aa7de 00007f7f4c9b4b49 00007f7f4c9b5416 00007f7f4c9b1d8f 00007f7f4c9b183e 00007f7f51976419
0709 12:11:13.814048 (+1387028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.814224 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69749888}
I20260709 12:11:13.847666 21964 consensus_queue.cc:260] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:13.923079 18665 debug-util.cc:398] Leaking SignalData structure 0x7b08002a5400 after lost signal to thread 18122
I20260709 12:11:13.923360 21964 raft_consensus.cc:3060] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:13.924760 18665 debug-util.cc:398] Leaking SignalData structure 0x7b08003900c0 after lost signal to thread 18668
W20260709 12:11:13.925064 18665 debug-util.cc:398] Leaking SignalData structure 0x7b08003b5020 after lost signal to thread 18669
I20260709 12:11:13.848541 21970 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:13.787230 21782 raft_consensus.cc:2749] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:13.893800 17946 raft_consensus.cc:2393] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 9: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:13.894855 17944 rpcz_store.cc:276] 0709 12:11:12.512439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.682603 (+1170164us) service_pool.cc:224] Handling call
0709 12:11:13.699700 (+ 17097us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:13.764776 (+ 65076us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:13.776534 (+ 11758us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:13.786183 (+  9649us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:13.786226 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.786276 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:13.786853 (+   577us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:11:13.934180 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 246304us
I20260709 12:11:13.812870 18019 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 13.
I20260709 12:11:13.902120 17945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44668 (request call id 678) took 1389 ms. Trace:
I20260709 12:11:13.935199 17945 rpcz_store.cc:276] 0709 12:11:12.512969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.780525 (+1267556us) service_pool.cc:224] Handling call
0709 12:11:13.807133 (+ 26608us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:13.901865 (+ 94732us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:13.902066 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:11:13.902395 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:13.902550 18016 raft_consensus.cc:2468] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 8.
I20260709 12:11:13.903100 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:13.893910 21825 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:13.919318 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:13.941447 18095 raft_consensus.cc:2468] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 6.
I20260709 12:11:13.919894 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:13.920940 21909 raft_consensus.cc:2804] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:13.921504 21974 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:13.933568 17847 catalog_manager.cc:5697] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 3 to 4, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 4 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:13.948843 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:13.915933 18097 raft_consensus.cc:2468] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:11:13.927685 17913 leader_election.cc:304] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:13.936951 18089 raft_consensus.cc:2468] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
I20260709 12:11:13.940521 21085 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:13.895517 21842 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.942270 18096 raft_consensus.cc:2468] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 6.
I20260709 12:11:13.950026 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:13.950086 21085 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:13.915518 21767 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:13.945312 21825 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:13.936877 21922 raft_consensus.cc:2749] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:13.963402 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:13.964932 17913 leader_election.cc:304] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:13.967365 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:13.969198 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:13.969898 18091 raft_consensus.cc:3060] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:13.972050 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:13.972586 18092 raft_consensus.cc:3060] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:13.975841 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 200441us
I20260709 12:11:13.980020 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:13.962914 21974 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:13.947904 21981 raft_consensus.cc:2804] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:13.926577 21816 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:13.987607 17913 leader_election.cc:400] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Vote denied by peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297) with higher term. Message: Invalid argument: T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 9. Current term is 10.
I20260709 12:11:13.994881 21085 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:13.941387 21772 consensus_queue.cc:1048] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:11:13.995934 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:13.954180 21909 raft_consensus.cc:697] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:13.999583 17847 catalog_manager.cc:5697] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:13.971599 21782 raft_consensus.cc:2749] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:13.942543 21976 raft_consensus.cc:515] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:14.005288 17913 leader_election.cc:403] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:14.005903 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:11:14.020679 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 206910us
I20260709 12:11:14.023813 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:14.024387 18636 raft_consensus.cc:3060] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:13.978773 21949 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:13.994724 21981 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:13.983034 21883 consensus_queue.cc:1048] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:11:14.028729 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:14.034276 18095 raft_consensus.cc:2468] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 7.
W20260709 12:11:14.031328 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 65399.1us
W20260709 12:11:14.022521 18062 connection.cc:256] RPC call timeout handler was delayed by -2.3134153280000191s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2364s for a response
I20260709 12:11:14.035859 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:14.032434 21741 raft_consensus.cc:3060] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.036495 18024 raft_consensus.cc:2468] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 8.
I20260709 12:11:14.036583 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:14.037312 21980 raft_consensus.cc:2749] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:14.037519 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:14.037708 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:14.038156 18022 raft_consensus.cc:2468] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 8.
I20260709 12:11:14.038311 18019 raft_consensus.cc:2468] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 8.
I20260709 12:11:14.038878 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:14.039264 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:14.039448 18098 raft_consensus.cc:2468] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:11:14.039810 18021 raft_consensus.cc:3060] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:14.039846 21816 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:14.042972 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:14.043200 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:14.044091 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:14.044754 18017 raft_consensus.cc:2468] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 10.
I20260709 12:11:14.054070 17913 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:11:13.989641 17987 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.016s	sys 0.028s
W20260709 12:11:14.058677 17987 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.016s	sys 0.029s
W20260709 12:11:14.059966 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 630217us
I20260709 12:11:14.065667 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:14.033155 21981 raft_consensus.cc:3060] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.075331 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:11:14.078439 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:14.078998 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.080161 17913 leader_election.cc:304] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:14.083812 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:14.085086 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:14.089819 17987 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:14.097911 17987 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:14.095991 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:14.098945 18095 raft_consensus.cc:2468] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
I20260709 12:11:14.099457 21969 raft_consensus.cc:2804] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:14.100665 17987 leader_election.cc:304] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:14.110927 17987 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:14.090587 21782 raft_consensus.cc:2804] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:11:14.142268 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 62182us
I20260709 12:11:14.126483 18091 raft_consensus.cc:2468] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 10.
I20260709 12:11:14.108397 21969 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.147792 17913 leader_election.cc:304] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:14.110215 21772 raft_consensus.cc:2804] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:14.110548 21961 raft_consensus.cc:2749] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:14.113579 21905 raft_consensus.cc:2749] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:14.154322 17913 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:14.158480 17913 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:14.120299 21782 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.152813 21772 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.100099 21963 consensus_queue.cc:1059] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:11:14.101380 21954 consensus_queue.cc:1048] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:11:14.118606 21972 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123)
I20260709 12:11:14.097499 21937 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:14.189486 21937 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:14.175580 18021 raft_consensus.cc:2468] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 11.
I20260709 12:11:14.190997 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:14.192243 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:14.192407 21825 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:14.193629 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:14.194928 21976 leader_election.cc:290] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:14.171756 21782 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:14.179088 17940 raft_consensus.cc:1275] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:14.157572 21949 raft_consensus.cc:2804] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:14.183995 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:14.175289 21950 raft_consensus.cc:2804] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:14.101603 21909 consensus_queue.cc:237] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:14.175442 21967 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:14.162187 21953 raft_consensus.cc:2804] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:14.157063 21969 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:14.161182 21974 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:14.162549 21845 raft_consensus.cc:2804] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:14.249014 21845 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.249404 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:14.249424 21845 raft_consensus.cc:3060] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:14.263475 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:14.264225 18021 raft_consensus.cc:2468] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 9.
I20260709 12:11:14.223843 21949 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:14.272504 21949 raft_consensus.cc:3060] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.210552 17847 catalog_manager.cc:5697] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 3 to 5, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 5 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:14.171936 21772 raft_consensus.cc:3060] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:14.279637 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:14.291615 21967 consensus_queue.cc:1048] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:11:14.292893 21767 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:14.294406 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:14.295966 17847 catalog_manager.cc:5697] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 6 to 7, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 7 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:14.300617 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:14.301606 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:14.230232 18636 raft_consensus.cc:2468] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 9.
I20260709 12:11:14.235280 21981 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:14.239663 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:14.241719 21950 raft_consensus.cc:697] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:14.242187 21953 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.306967 18092 raft_consensus.cc:2468] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 11.
W20260709 12:11:14.310159 17988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.315063 17946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44668 (request call id 672) took 1803 ms. Trace:
W20260709 12:11:14.322006 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 211126us
W20260709 12:11:14.329442 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 243535us
I20260709 12:11:14.329727 17946 rpcz_store.cc:276] 0709 12:11:12.511335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.316729 (+805394us) service_pool.cc:224] Handling call
0709 12:11:14.314829 (+998100us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b540031b854. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:14.314992 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1229880576}
I20260709 12:11:14.330096 17987 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:14.322907 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:14.330991 17947 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 10.
I20260709 12:11:14.343632 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:14.343896 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:14.344511 17946 raft_consensus.cc:2468] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 9.
I20260709 12:11:14.344666 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:14.345259 17941 raft_consensus.cc:2468] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
I20260709 12:11:14.345418 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:14.346104 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:14.346665 17949 raft_consensus.cc:2376] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 7. Re-sending same reply.
I20260709 12:11:14.194941 21825 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 13 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:14.354242 17948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44668 (request call id 679) took 1841 ms. Trace:
I20260709 12:11:14.354696 17948 rpcz_store.cc:276] 0709 12:11:12.513221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:13.784683 (+1271462us) service_pool.cc:224] Handling call
0709 12:11:13.786490 (+  1807us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:13.803191 (+ 16701us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:11:14.083694 (+280503us) log.cc:844] Serialized 14 byte log entry
0709 12:11:14.353909 (+270215us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:14.353960 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:14.354009 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:14.354071 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:14.354184 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":268640,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":481,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":147,"thread_start_us":490975,"threads_started":2,"wal-append.queue_time_us":260136}
I20260709 12:11:14.357349 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:14.357743 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:14.357419 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:14.358618 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:14.359961 17946 raft_consensus.cc:3060] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:14.360742 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:14.363338 17940 raft_consensus.cc:2393] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 9: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:14.368352 18608 leader_election.cc:304] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:14.370584 17987 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:14.371461 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:14.372279 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:14.372671 17987 leader_election.cc:304] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:14.332340 21953 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:14.373056 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:14.356876 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:14.347002 21954 raft_consensus.cc:2749] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:14.385406 17987 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:14.387598 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:14.386394 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:14.388626 17947 raft_consensus.cc:2393] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 12: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:14.389348 21767 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:14.395351 21825 consensus_queue.cc:1048] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:14.395087 21950 consensus_queue.cc:237] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:14.396693 21825 raft_consensus.cc:2804] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:11:14.397119 21825 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:14.397476 21825 raft_consensus.cc:3060] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:14.398947 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:14.399647 17943 raft_consensus.cc:2393] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 13: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:14.389379 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:14.400354 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:14.400964 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:14.401342 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:14.401901 17943 raft_consensus.cc:2468] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 9.
I20260709 12:11:14.401994 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:14.402884 21961 raft_consensus.cc:2804] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:14.403333 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 293470us
I20260709 12:11:14.402482 17947 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:14.388196 17987 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:14.387101 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:14.404448 17913 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:14.406344 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:11:14.413017 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 44744.5us
I20260709 12:11:14.409319 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:11:14.411777 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.413978 18608 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:14.404039 17989 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:14.412722 17987 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:14.415373 17987 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:14.405174 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:14.416329 18608 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:14.403285 21961 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:14.373996 21741 raft_consensus.cc:2749] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297) with higher term. Message: Invalid argument: T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 9. Current term is 10.
I20260709 12:11:14.405987 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:11:14.420397 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.328229 21845 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:14.417754 21961 raft_consensus.cc:3060] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:14.403381 21958 raft_consensus.cc:2804] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:14.434839 21958 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
W20260709 12:11:14.435178 22005 log.cc:927] Time spent T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:11:14.435361 21958 raft_consensus.cc:3060] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:14.437341 21996 raft_consensus.cc:2804] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:14.437932 21996 raft_consensus.cc:493] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:14.438397 21996 raft_consensus.cc:3060] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:14.424739 18608 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:14.422036 21967 raft_consensus.cc:2804] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:14.447198 21967 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
W20260709 12:11:14.426999 21986 log.cc:927] Time spent T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.580s	user 0.006s	sys 0.004s
I20260709 12:11:14.427379 18020 raft_consensus.cc:2393] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 9: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:14.418093 21979 raft_consensus.cc:2804] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:14.423892 21660 raft_consensus.cc:2804] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:14.423904 21905 raft_consensus.cc:2804] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:14.428350 21991 consensus_queue.cc:1048] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:14.429193 17942 raft_consensus.cc:2468] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 10.
I20260709 12:11:14.429593 21954 raft_consensus.cc:2804] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:14.348140 21969 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:14.426509 21845 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:14.440300 17941 raft_consensus.cc:1217] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 LEADER]: Deduplicated request from leader. Original: 5.3->[7.4-10.6]   Dedup: 8.5->[10.6-10.6]
I20260709 12:11:14.442728 17946 raft_consensus.cc:2468] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 11.
I20260709 12:11:14.446014 18608 leader_election.cc:304] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:11:14.425335 21964 consensus_meta.cc:287] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.501s	user 0.003s	sys 0.008s
I20260709 12:11:14.420622 21987 raft_consensus.cc:2764] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:11:14.394438 21949 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:14.421437 21909 raft_consensus.cc:2804] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:14.481258 17989 leader_election.cc:304] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:14.466589 21975 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:14.476974 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:14.477502 17988 leader_election.cc:304] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:11:14.481791 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 58561.6us
W20260709 12:11:14.448307 21908 consensus_meta.cc:287] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.659s	user 0.010s	sys 0.000s
I20260709 12:11:14.495747 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:14.496433 17946 raft_consensus.cc:2393] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 9: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:14.491830 17941 raft_consensus.cc:1240] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 LEADER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 10. Current term is 11. Ops: [7.4-10.6]
I20260709 12:11:14.453356 21967 raft_consensus.cc:3060] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:14.512411 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.453312 21959 raft_consensus.cc:2804] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:14.481685 21905 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.517776 21959 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:14.518009 21905 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:14.518450 21959 raft_consensus.cc:3060] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:14.455868 21979 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:14.497897 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 51947.7us
I20260709 12:11:14.520742 18608 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:14.497761 17989 leader_election.cc:304] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:14.442580 21842 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:11:14.522264 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 47728.2us
I20260709 12:11:14.456111 21772 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:14.527776 18018 raft_consensus.cc:2393] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 11: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:14.497252 21954 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.528545 21954 raft_consensus.cc:3060] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:14.531421 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:14.532619 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:14.533133 18017 raft_consensus.cc:2468] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 5.
I20260709 12:11:14.533900 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:14.535277 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:14.535876 18024 raft_consensus.cc:2468] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 9.
I20260709 12:11:14.536085 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:14.536710 18015 raft_consensus.cc:2468] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 9.
I20260709 12:11:14.537137 21969 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:14.537870 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:14.539944 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:14.541414 17988 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:14.456106 21660 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
W20260709 12:11:14.550700 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 53020.7us
I20260709 12:11:14.552706 18609 leader_election.cc:304] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:14.516403 21957 raft_consensus.cc:2804] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:14.562472 17988 leader_election.cc:304] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:14.517297 21963 raft_consensus.cc:2749] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:14.566331 18609 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:14.567459 21937 raft_consensus.cc:2804] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:14.567792 21956 raft_consensus.cc:2804] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:14.567978 21937 raft_consensus.cc:493] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:14.568300 21956 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:14.568555 21937 raft_consensus.cc:3060] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:14.568783 21956 raft_consensus.cc:3060] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:14.568576 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 47913.1us
I20260709 12:11:14.569809 18608 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:14.570577 18608 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:14.568735 21998 raft_consensus.cc:2804] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:14.571542 21998 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:14.571887 21998 raft_consensus.cc:3060] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:14.572866 18608 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:14.492007 21909 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:14.574946 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:14.576387 17989 leader_election.cc:304] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:14.520171 21981 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:14.579650 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:14.534216 21959 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:14.597302 17989 leader_election.cc:304] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:14.522097 21979 raft_consensus.cc:3060] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.581594 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:14.607323 18095 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:14.583320 18093 raft_consensus.cc:1240] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:14.583941 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:14.584908 18023 raft_consensus.cc:2393] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 10: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:14.582918 18609 leader_election.cc:304] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:14.541496 21975 raft_consensus.cc:2749] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:14.596228 18022 raft_consensus.cc:2393] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 11: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
W20260709 12:11:14.609694 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 47309.3us
I20260709 12:11:14.560913 21660 raft_consensus.cc:3060] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:14.623631 17988 leader_election.cc:304] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:14.573993 21957 raft_consensus.cc:493] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.573666 21926 raft_consensus.cc:2804] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:14.590669 21952 raft_consensus.cc:2804] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:14.595805 21909 raft_consensus.cc:3060] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:14.643296 22006 raft_consensus.cc:2804] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:14.643770 22006 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:14.644104 22006 raft_consensus.cc:3060] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.644416 21922 raft_consensus.cc:2749] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:14.646770 21999 raft_consensus.cc:2804] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:14.625785 21845 raft_consensus.cc:2804] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:14.627913 21938 raft_consensus.cc:2804] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:14.625638 21969 raft_consensus.cc:2804] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:14.661036 21959 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:14.666807 21938 raft_consensus.cc:493] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:14.667246 21938 raft_consensus.cc:3060] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:14.664496 21772 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:14.665227 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:14.629984 21957 raft_consensus.cc:3060] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:14.666033 21958 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:14.673724 17947 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 11.
I20260709 12:11:14.629542 21926 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:14.672088 21845 raft_consensus.cc:697] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:14.672259 21969 raft_consensus.cc:697] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:14.682519 21845 consensus_queue.cc:237] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:14.682992 21969 consensus_queue.cc:237] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:14.678164 18095 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 11.
I20260709 12:11:14.642870 21952 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:14.647782 21975 raft_consensus.cc:2804] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:14.703980 21949 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:14.704703 21782 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:14.706943 21782 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 13 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:14.708503 21958 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:14.712118 21998 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:14.705010 21951 raft_consensus.cc:3055] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:14.719090 17945 raft_consensus.cc:2393] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 13: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:14.671844 21999 raft_consensus.cc:697] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:14.686314 21926 raft_consensus.cc:3060] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:14.725165 18015 raft_consensus.cc:1240] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:11:14.690575 21952 raft_consensus.cc:3060] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:14.710237 21937 raft_consensus.cc:515] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:14.736231 17912 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:14.719732 21951 raft_consensus.cc:740] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:14.718947 21975 raft_consensus.cc:697] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
W20260709 12:11:14.743294 22022 log.cc:927] Time spent T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:11:14.744396 22015 raft_consensus.cc:2804] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:14.748664 21999 consensus_queue.cc:237] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:14.736406 21973 raft_consensus.cc:2804] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:14.714929 21825 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:14.769393 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:14.769635 18642 raft_consensus.cc:1240] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:14.771100 21825 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:14.776571 21951 consensus_queue.cc:260] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:14.777850 21951 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:14.781430 22006 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:11:14.784484 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 187275us
I20260709 12:11:14.790812 18644 raft_consensus.cc:1240] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:14.738911 21959 consensus_queue.cc:1059] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
W20260709 12:11:14.805259 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 181674us
I20260709 12:11:14.764462 21973 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:14.806349 17988 leader_election.cc:304] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:14.741744 21954 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:11:14.783598 22006 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:14.785868 21842 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:11:14.813865 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 215777us
I20260709 12:11:14.765341 22015 raft_consensus.cc:697] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:14.824862 22015 consensus_queue.cc:237] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:14.764673 21961 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:14.827250 22000 raft_consensus.cc:2749] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:14.829766 22012 log.cc:927] Time spent T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:11:14.809988 21998 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:14.808310 21973 raft_consensus.cc:3060] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:14.858137 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 54078.8us
I20260709 12:11:14.842039 21954 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123)
I20260709 12:11:14.761179 18018 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:44098
I20260709 12:11:14.844046 21961 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:14.844987 21947 raft_consensus.cc:3055] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:14.864543 21947 raft_consensus.cc:740] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:14.865468 21947 consensus_queue.cc:260] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:14.866277 21950 consensus_queue.cc:1059] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:14.845834 21996 raft_consensus.cc:515] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:14.848147 22002 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.848476 21938 raft_consensus.cc:515] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:14.849146 21959 consensus_queue.cc:1059] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:11:14.851135 18062 connection.cc:256] RPC call timeout handler was delayed by -1.4358943660001842s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1815s for a response
I20260709 12:11:14.851480 21937 leader_election.cc:290] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:11:14.873827 18062 connection.cc:256] RPC call timeout handler was delayed by -1.2083946160000778s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1517s for a response
I20260709 12:11:14.851606 21983 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.800194 21956 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:14.879009 21983 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:14.880280 18090 raft_consensus.cc:1275] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 8 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 12:11:14.880465 21956 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:14.790999 21905 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:14.881183 18637 raft_consensus.cc:1240] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:14.883641 21905 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 13 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:14.863152 18018 raft_consensus.cc:606] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:14.884296 18018 raft_consensus.cc:614] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:11:14.847714 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:14.885190 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:14.885789 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:14.886088 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.887627 21909 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:14.867619 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.853539 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:14.889851 18092 raft_consensus.cc:3060] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:14.890761 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:14.891326 18089 raft_consensus.cc:3060] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:14.800624 21967 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:14.833213 21953 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:14.866806 21947 raft_consensus.cc:3060] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.897246 21971 consensus_queue.cc:1048] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:14.897552 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:11:14.877395 21938 leader_election.cc:290] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:14.899314 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:14.878311 21959 raft_consensus.cc:3055] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:14.899816 21959 raft_consensus.cc:740] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:14.900837 21959 consensus_queue.cc:260] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:14.902025 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
W20260709 12:11:14.874173 18062 connection.cc:256] RPC call timeout handler was delayed by -1.1984946160000618s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15280000000000002s for a response
I20260709 12:11:14.902709 18096 raft_consensus.cc:3060] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:14.902740 18062 connection.cc:256] RPC call timeout handler was delayed by -1.1910943660000157s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20870000000000002s for a response
W20260709 12:11:14.903271 18062 connection.cc:256] RPC call timeout handler was delayed by -1.0605943660000321s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22320000000000004s for a response
I20260709 12:11:14.903589 17944 raft_consensus.cc:2393] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 13: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:14.905329 21660 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:14.906378 18638 raft_consensus.cc:1240] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:14.906924 17940 raft_consensus.cc:1240] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 11. Current term is 13. Ops: []
I20260709 12:11:14.907382 21660 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:14.889474 21885 raft_consensus.cc:3055] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:14.908303 21885 raft_consensus.cc:740] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:14.909344 21885 consensus_queue.cc:260] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:14.869554 18020 raft_consensus.cc:1217] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Deduplicated request from leader. Original: 7.4->[8.5-10.6]   Dedup: 8.5->[10.6-10.6]
I20260709 12:11:14.892354 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:14.911643 18020 raft_consensus.cc:1240] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 12:11:14.911722 18094 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:14.912627 21967 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:14.915938 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:14.916787 21953 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 13 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:14.892513 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 52115.6us
I20260709 12:11:14.896857 21981 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:14.918994 21981 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:14.919399 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:14.920447 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:14.920921 21981 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:14.873569 22002 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:14.921439 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:14.921597 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:14.922124 18095 raft_consensus.cc:2368] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 9. Current term is 10.
I20260709 12:11:14.922631 18608 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:14.923555 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:14.872450 21883 consensus_queue.cc:1059] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:11:14.826185 21975 consensus_queue.cc:237] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:14.924841 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:14.925666 17940 raft_consensus.cc:1275] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 7 index: 10. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 12:11:14.902120 21959 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:14.923731 21937 raft_consensus.cc:2804] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:14.926927 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:14.927412 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:14.930369 18092 raft_consensus.cc:2468] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
I20260709 12:11:14.931202 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:11:14.940979 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.941371 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:14.942026 18638 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:14.943949 18094 raft_consensus.cc:2468] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 13.
I20260709 12:11:14.944780 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:14.946943 21953 consensus_queue.cc:1059] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:14.947306 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:14.947563 21937 raft_consensus.cc:697] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:14.947968 21953 raft_consensus.cc:3055] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:14.948303 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:14.948567 18609 leader_election.cc:304] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:14.948829 21883 consensus_queue.cc:1059] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:14.949182 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:14.949345 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:11:14.949612 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:14.948369 21953 raft_consensus.cc:740] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:14.950115 21938 raft_consensus.cc:2804] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:14.945662 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:14.950783 21938 raft_consensus.cc:697] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:14.951054 18090 raft_consensus.cc:2468] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:11:14.950876 21953 consensus_queue.cc:260] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:14.952028 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:14.952181 21953 raft_consensus.cc:3060] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:14.949784 18098 raft_consensus.cc:3060] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:14.950341 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:14.956429 17940 raft_consensus.cc:1240] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:14.953096 17989 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:14.958411 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:14.958284 18097 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:14.965777 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:14.966252 18096 raft_consensus.cc:2468] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 8.
I20260709 12:11:14.965844 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:14.964213 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:14.967365 18609 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:14.967006 17989 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:14.928400 21885 raft_consensus.cc:3060] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:14.969311 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:14.970016 21085 raft_consensus.cc:2804] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:14.973758 18095 raft_consensus.cc:2468] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
I20260709 12:11:14.970291 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:14.970196 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:14.973122 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:14.973831 21085 raft_consensus.cc:697] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:14.971618 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:14.975375 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:14.976313 18094 raft_consensus.cc:2393] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 11: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:11:14.976269 18089 raft_consensus.cc:2468] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
I20260709 12:11:14.951879 21938 consensus_queue.cc:237] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:14.977788 18609 leader_election.cc:304] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:14.979283 21971 raft_consensus.cc:2804] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:14.979487 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:14.979761 21971 raft_consensus.cc:697] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:14.980767 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:14.981385 18090 raft_consensus.cc:3060] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:14.949807 21883 raft_consensus.cc:3055] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:14.989552 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:14.993121 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:14.993889 18089 raft_consensus.cc:2393] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 13: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:14.998523 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:14.999095 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:14.999234 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:14.999464 18095 raft_consensus.cc:2368] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 10. Current term is 11.
I20260709 12:11:14.999835 18091 raft_consensus.cc:2393] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 13: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:14.999945 18089 raft_consensus.cc:2393] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 11: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:11:14.973151 21954 raft_consensus.cc:2804] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:14.998494 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:14.995345 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:14.987342 21085 consensus_queue.cc:237] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:14.996724 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:14.969966 21967 raft_consensus.cc:2804] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:15.008176 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:15.002668 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:15.003832 18089 raft_consensus.cc:1275] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:11:15.003724 17988 leader_election.cc:304] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:15.009907 18089 pending_rounds.cc:85] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110: Aborting all ops after (but not including) 5
I20260709 12:11:15.011893 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:15.013880 21952 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:15.014925 18638 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 13.
I20260709 12:11:15.017628 21983 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:15.018821 21996 leader_election.cc:290] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:15.019899 22002 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:15.020841 18098 raft_consensus.cc:2468] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 10.
I20260709 12:11:15.021984 17989 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:15.022907 21969 raft_consensus.cc:2804] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:15.023461 21969 raft_consensus.cc:697] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:15.024394 21969 consensus_queue.cc:237] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:11:15.026116 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.027871 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:11:15.028393 17914 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.98.195:41931 timed out after 1.893s (SENT) [suppressed 19 similar messages]
I20260709 12:11:15.029138 18092 raft_consensus.cc:1240] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:15.030270 18092 raft_consensus.cc:1240] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:15.032719 18097 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 13.
I20260709 12:11:15.010365 18089 pending_rounds.cc:107] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:11:15.036010 18089 raft_consensus.cc:2889] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:15.037215 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:15.040244 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:15.039502 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:14.991816 21883 raft_consensus.cc:740] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:15.050655 18096 raft_consensus.cc:1240] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:15.058674 17912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.058666 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:14.968984 21979 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:15.059732 18643 raft_consensus.cc:2376] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8. Re-sending same reply.
I20260709 12:11:15.061866 18017 raft_consensus.cc:1240] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:15.069363 18635 raft_consensus.cc:1240] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:15.064093 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:15.060801 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:15.072568 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:15.074208 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:15.075031 18641 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
I20260709 12:11:15.075275 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:15.068023 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:15.079407 18017 raft_consensus.cc:1275] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:15.081364 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:15.083192 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:15.091375 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:15.093602 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:15.095016 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:15.076140 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:15.097865 18642 raft_consensus.cc:2468] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 7.
I20260709 12:11:15.098801 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:15.099570 18021 raft_consensus.cc:3060] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:15.091444 18024 raft_consensus.cc:1240] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:15.091444 18016 raft_consensus.cc:1240] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:11:15.102609 18636 raft_consensus.cc:2393] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 8: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:11:15.103032 18019 raft_consensus.cc:1240] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:14.948674 21937 consensus_queue.cc:237] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:15.102926 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:15.116312 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:15.107458 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:15.108345 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:15.109139 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:15.007133 21967 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:15.123906 18638 raft_consensus.cc:2393] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 13: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:15.120656 18641 raft_consensus.cc:2393] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 9: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:15.051397 21954 raft_consensus.cc:697] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:15.126904 18016 raft_consensus.cc:1240] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:15.060735 22030 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:15.129304 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 100920us
I20260709 12:11:15.132061 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:15.134063 18020 raft_consensus.cc:2393] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 13: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:15.137343 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:15.138273 18096 raft_consensus.cc:2368] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 10. Current term is 11.
I20260709 12:11:15.127602 21967 raft_consensus.cc:3060] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:15.147684 18641 raft_consensus.cc:1240] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:15.150982 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:15.163323 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:15.069160 21926 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:15.162022 18021 raft_consensus.cc:2468] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 10.
I20260709 12:11:15.167019 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:15.171518 18640 raft_consensus.cc:1275] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:15.171577 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:15.180684 18018 raft_consensus.cc:1240] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:15.183525 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.183542 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:15.184422 18096 raft_consensus.cc:2393] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 13: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
W20260709 12:11:15.191464 22032 log.cc:927] Time spent T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 12:11:15.191033 21954 consensus_queue.cc:237] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:15.199904 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:15.201082 18096 raft_consensus.cc:1275] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:15.192836 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:15.201668 18062 leader_election.cc:304] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:15.202273 18095 raft_consensus.cc:2393] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 13: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
W20260709 12:11:15.203051 21957 consensus_meta.cc:287] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.516s	user 0.006s	sys 0.003s
I20260709 12:11:15.117274 21971 consensus_queue.cc:237] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:15.203939 18062 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:15.204071 21982 consensus_queue.cc:1059] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:15.205049 21982 raft_consensus.cc:2749] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:15.205607 18062 leader_election.cc:304] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:15.206089 21982 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:15.206298 21964 raft_consensus.cc:3055] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:15.206710 21964 raft_consensus.cc:740] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:15.207561 21964 consensus_queue.cc:260] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:15.208703 21964 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:15.209093 21983 raft_consensus.cc:2749] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:15.211890 18062 leader_election.cc:304] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:15.216759 21981 raft_consensus.cc:2749] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:15.218947 22034 log.cc:927] Time spent T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:11:15.219960 21957 raft_consensus.cc:515] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:15.221622 22035 log.cc:927] Time spent T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:11:15.222203 21957 leader_election.cc:290] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:15.222452 21949 raft_consensus.cc:3055] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:15.222919 21949 raft_consensus.cc:740] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
W20260709 12:11:15.223834 17912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.223717 21949 consensus_queue.cc:260] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:15.224881 21949 raft_consensus.cc:3060] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:15.225839 21816 consensus_queue.cc:1059] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:15.226806 22017 consensus_queue.cc:1059] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:15.227028 18024 raft_consensus.cc:2393] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 8: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:15.227626 22017 raft_consensus.cc:3055] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:15.227959 22017 raft_consensus.cc:740] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:15.228760 22017 consensus_queue.cc:260] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:15.229849 22017 raft_consensus.cc:3060] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:15.226977 21816 raft_consensus.cc:3055] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:15.236800 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:15.237668 18020 raft_consensus.cc:2468] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 8.
I20260709 12:11:15.239179 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:15.239905 18635 raft_consensus.cc:2393] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 13: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:15.242292 21981 consensus_queue.cc:1048] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:11:15.242677 18641 raft_consensus.cc:1240] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 LEADER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:15.242991 22030 raft_consensus.cc:2749] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:15.245294 22036 log.cc:927] Time spent T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:11:15.235167 21816 raft_consensus.cc:740] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:15.247646 21816 consensus_queue.cc:260] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:15.248957 21816 raft_consensus.cc:3060] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:15.192054 21909 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:15.254312 18095 raft_consensus.cc:3055] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:15.254705 18095 raft_consensus.cc:740] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:15.246214 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:15.262982 18024 raft_consensus.cc:2393] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 13: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:15.251811 21979 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:15.255401 18095 consensus_queue.cc:260] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:15.264253 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:15.264525 18095 raft_consensus.cc:3060] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:15.264981 18093 raft_consensus.cc:3060] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:15.267113 18062 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:15.175048 21883 consensus_queue.cc:260] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:15.277813 18095 raft_consensus.cc:1275] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:11:15.273146 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:15.278723 18018 raft_consensus.cc:2393] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 5: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:15.279547 18090 raft_consensus.cc:2468] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
I20260709 12:11:15.278232 18095 pending_rounds.cc:85] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110: Aborting all ops after (but not including) 4
I20260709 12:11:15.280354 18095 pending_rounds.cc:107] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:11:15.280843 17989 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:15.280821 18095 raft_consensus.cc:2889] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:15.294132 18090 raft_consensus.cc:1275] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:15.300918 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:15.301714 18644 raft_consensus.cc:2468] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 8.
W20260709 12:11:15.305341 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.307902 18093 raft_consensus.cc:2468] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:11:15.308027 18062 leader_election.cc:304] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:15.309146 17989 leader_election.cc:304] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:15.311028 18635 raft_consensus.cc:1240] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 LEADER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:15.300395 21981 raft_consensus.cc:2749] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:15.313511 21973 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:15.315560 21973 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:15.316576 17987 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:15.317646 18640 raft_consensus.cc:1240] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:15.319939 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:15.323048 18024 raft_consensus.cc:1240] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:15.327800 22006 consensus_queue.cc:1048] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:15.329134 21981 raft_consensus.cc:2749] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:15.329838 17987 leader_election.cc:304] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:15.330912 17987 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:15.331617 21842 raft_consensus.cc:2749] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:15.331789 21905 raft_consensus.cc:2749] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:15.331975 18062 leader_election.cc:304] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:15.332295 21842 raft_consensus.cc:2749] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:15.332872 21981 raft_consensus.cc:2804] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:15.333226 21981 raft_consensus.cc:493] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:15.333355 21926 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:15.333606 21981 raft_consensus.cc:3060] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:15.333866 17987 leader_election.cc:304] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:15.335393 17987 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:15.338203 17987 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:15.345378 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:15.353132 17940 raft_consensus.cc:1240] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:15.353434 17987 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:15.354378 17987 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:11:15.356006 17912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.356467 18062 leader_election.cc:304] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:15.334586 21926 raft_consensus.cc:2749] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:15.358629 17987 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:15.359555 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:15.347916 21825 raft_consensus.cc:2804] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:15.356308 18061 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:15.360778 21825 raft_consensus.cc:697] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:15.361125 21767 raft_consensus.cc:2804] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:15.361528 21767 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:15.361346 21966 consensus_queue.cc:1059] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:15.361977 21767 raft_consensus.cc:3060] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:15.361680 21825 consensus_queue.cc:237] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:15.362201 21966 consensus_queue.cc:1243] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer e28f77912a9c4ba2b9841f6fedddc2db log is divergent from this leader: its last log entry 11.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:11:15.362763 21966 raft_consensus.cc:3055] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:15.363066 21966 raft_consensus.cc:740] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:15.363855 21966 consensus_queue.cc:260] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.12, Last appended by leader: 12, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:15.364964 21966 raft_consensus.cc:3060] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:15.366883 21996 consensus_queue.cc:1048] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:15.300710 21909 raft_consensus.cc:2804] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:15.368352 21909 raft_consensus.cc:697] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:15.369187 21909 consensus_queue.cc:237] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:11:15.369479 21967 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:15.336122 21969 consensus_queue.cc:1048] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:11:15.356647 21957 raft_consensus.cc:2749] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:15.374307 22030 raft_consensus.cc:2749] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:15.287245 21952 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:15.380946 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:15.381590 18020 raft_consensus.cc:2376] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 11. Re-sending same reply.
I20260709 12:11:15.381592 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:15.383558 22029 raft_consensus.cc:2749] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:15.384902 22042 log.cc:927] Time spent T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.165s	user 0.000s	sys 0.002s
I20260709 12:11:15.386883 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:15.388655 18062 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:11:15.388705 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:15.390223 21908 raft_consensus.cc:2804] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:15.390790 22002 raft_consensus.cc:2764] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:11:15.390785 21908 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:15.391690 21908 raft_consensus.cc:3060] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:15.393260 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:15.399482 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:15.402359 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:15.351223 22000 raft_consensus.cc:2804] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:15.407863 18098 raft_consensus.cc:1275] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 10. (index mismatch)
I20260709 12:11:15.408273 18644 raft_consensus.cc:1275] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:15.409341 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:15.390259 18062 leader_election.cc:304] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:11:15.410331 17949 raft_consensus.cc:2393] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 11: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:11:15.417217 17987 leader_election.cc:304] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:15.418836 17913 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:15.419589 17944 raft_consensus.cc:2468] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 9.
I20260709 12:11:15.422307 17987 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:15.272584 22020 consensus_queue.cc:1059] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 12:11:15.435350 17943 raft_consensus.cc:2468] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
I20260709 12:11:15.436789 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:15.437348 17949 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:15.424062 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:15.427069 18062 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:15.424479 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
W20260709 12:11:15.431130 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.446368 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:15.382299 21981 raft_consensus.cc:515] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:15.461645 18062 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:11:15.462774 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:15.464403 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.414357 21961 raft_consensus.cc:2749] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:15.428278 21885 raft_consensus.cc:2804] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:15.420818 22000 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:15.466939 18062 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:11:15.469493 17949 raft_consensus.cc:2410] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:11:15.470572 22020 consensus_queue.cc:1243] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer e28f77912a9c4ba2b9841f6fedddc2db log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:11:15.494757 21885 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:15.495445 21885 raft_consensus.cc:3060] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:15.428027 21964 raft_consensus.cc:2764] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:11:15.500315 21964 raft_consensus.cc:2764] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:11:15.449684 21975 raft_consensus.cc:2749] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:15.511198 17947 raft_consensus.cc:2468] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
I20260709 12:11:15.427829 21952 consensus_queue.cc:1048] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 12:11:15.428639 21953 consensus_queue.cc:1048] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 12:11:15.501506 21782 consensus_queue.cc:1059] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:11:15.491678 21976 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:15.469272 22002 raft_consensus.cc:2749] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:15.501446 22000 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:15.502913 22034 log.cc:927] Time spent T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:11:15.584883 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.469147 22017 consensus_queue.cc:1048] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 12:11:15.456444 21926 consensus_queue.cc:1048] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 12:11:15.519222 21772 consensus_queue.cc:1059] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:11:15.535889 21816 consensus_queue.cc:1059] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.089s
I20260709 12:11:15.515342 22015 consensus_queue.cc:1059] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.110s
I20260709 12:11:15.646384 17942 raft_consensus.cc:2468] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 11.
W20260709 12:11:15.668936 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:15.672792 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 237887us
I20260709 12:11:15.641378 21950 consensus_queue.cc:1059] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:11:15.680863 18093 raft_consensus.cc:1275] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:15.683521 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:15.635735 21967 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:15.690941 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:15.691485 18644 raft_consensus.cc:3060] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:15.692374 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:15.694025 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 227135us
I20260709 12:11:15.695118 18062 leader_election.cc:304] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:15.702332 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
W20260709 12:11:15.707553 17831 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 4ccf0bcc20ae40e79c32530091613e1e with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e28f77912a9c4ba2b9841f6fedddc2db is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
W20260709 12:11:15.717801 21982 consensus_meta.cc:287] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.511s	user 0.011s	sys 0.000s
I20260709 12:11:15.717664 21908 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:15.719959 21767 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:15.723205 18642 raft_consensus.cc:1240] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 LEADER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 7. Current term is 8. Ops: []
W20260709 12:11:15.724993 22046 log.cc:927] Time spent T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.269s	user 0.002s	sys 0.000s
I20260709 12:11:15.692874 22017 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:15.689659 21905 raft_consensus.cc:2749] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:11:15.743516 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 45552.6us
I20260709 12:11:15.746315 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:15.760078 18097 raft_consensus.cc:1275] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 11 index: 12. (term mismatch)
I20260709 12:11:15.760515 18097 pending_rounds.cc:85] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110: Aborting all ops after (but not including) 11
I20260709 12:11:15.760771 18097 pending_rounds.cc:107] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110: Aborting uncommitted NO_OP operation due to leader change: 10.12
I20260709 12:11:15.761049 18097 raft_consensus.cc:2889] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:11:15.761234 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:15.763075 18021 raft_consensus.cc:2393] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 9: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:15.745462 21982 raft_consensus.cc:2749] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:15.764789 18090 raft_consensus.cc:1240] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:15.766453 18019 raft_consensus.cc:1275] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:11:15.766275 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:15.705526 21981 leader_election.cc:290] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:15.752532 21772 consensus_queue.cc:1059] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:11:15.822885 18094 raft_consensus.cc:1240] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:15.775017 21938 consensus_queue.cc:1048] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:15.821602 18644 raft_consensus.cc:2468] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:11:15.782769 22057 consensus_queue.cc:1048] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:11:15.743093 22059 raft_consensus.cc:2749] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:15.743369 21937 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.032s	sys 0.034s
W20260709 12:11:15.844170 17912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:15.850677 22053 log.cc:927] Time spent T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
W20260709 12:11:15.829007 22047 log.cc:927] Time spent T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.288s	user 0.000s	sys 0.003s
W20260709 12:11:15.837604 22046 log.cc:927] Time spent T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:11:15.858879 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 365502us
I20260709 12:11:15.860080 17913 leader_election.cc:304] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:15.765089 22017 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:11:15.843438 21937 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.032s	sys 0.034s
I20260709 12:11:15.845647 21772 consensus_queue.cc:1243] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer e28f77912a9c4ba2b9841f6fedddc2db log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:11:15.881862 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:15.882447 17941 raft_consensus.cc:3060] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:11:15.883231 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:15.883920 17949 raft_consensus.cc:2393] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 10: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:15.883239 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:15.887372 17946 raft_consensus.cc:2393] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 13: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:15.888976 18096 raft_consensus.cc:2468] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:11:15.881386 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:15.893399 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:15.895598 21767 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:15.896615 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:15.897670 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:15.900827 17946 raft_consensus.cc:1275] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:11:15.902081 17946 raft_consensus.cc:1275] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:15.923453 17988 leader_election.cc:304] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:15.925155 17988 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:15.927443 21957 raft_consensus.cc:2749] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:15.928627 21957 raft_consensus.cc:2749] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:15.930332 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:15.937750 21885 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:15.944368 21979 raft_consensus.cc:3055] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:15.944937 21979 raft_consensus.cc:740] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:15.947152 18641 raft_consensus.cc:1240] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 6. Current term is 7. Ops: []
W20260709 12:11:15.948714 18095 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.021s	sys 0.080s
W20260709 12:11:15.949244 18095 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.022s	sys 0.080s
W20260709 12:11:15.954627 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:15.956434 17914 leader_election.cc:336] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Timed out: RequestConsensusVote RPC to 127.16.98.195:41931 timed out after 1.759s (SENT)
I20260709 12:11:15.961758 17988 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:15.892782 21772 raft_consensus.cc:2804] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:15.978139 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 144490us
I20260709 12:11:15.979202 17948 raft_consensus.cc:1275] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:15.979976 18062 leader_election.cc:304] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:15.979774 17988 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:15.981529 18062 leader_election.cc:304] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:16.006871 18062 leader_election.cc:304] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:16.008881 17988 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:16.009358 18062 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:15.894429 22015 consensus_queue.cc:1059] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 12:11:16.027064 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:16.026152 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:16.028810 18096 raft_consensus.cc:2393] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 10: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:16.006045 21981 raft_consensus.cc:2804] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:16.010223 22059 raft_consensus.cc:2749] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:16.076830 21085 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.006414 22067 raft_consensus.cc:2749] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:16.012370 21983 raft_consensus.cc:2749] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:16.012529 22002 raft_consensus.cc:2749] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:16.053252 17941 raft_consensus.cc:2468] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
W20260709 12:11:16.048799 21959 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.014s	sys 0.007s
I20260709 12:11:16.045246 21885 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:16.012372 22050 raft_consensus.cc:2749] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:11:16.089780 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 244472us
I20260709 12:11:16.243191 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:16.081852 18096 raft_consensus.cc:1275] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 12:11:16.244441 17914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.012171 21967 raft_consensus.cc:2749] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:16.058337 21981 raft_consensus.cc:493] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
W20260709 12:11:16.178826 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 155278us
W20260709 12:11:16.113473 21959 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.014s	sys 0.007s
I20260709 12:11:16.185250 22071 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:16.185683 22039 log.cc:927] Time spent T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.883s	user 0.000s	sys 0.009s
I20260709 12:11:16.186412 18015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45464 (request call id 2072) took 1130 ms. Trace:
W20260709 12:11:16.186729 22064 log.cc:927] Time spent T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:11:16.187512 18608 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:16.261706 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:16.046594 22058 consensus_queue.cc:1059] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.138s
I20260709 12:11:16.196133 22017 leader_election.cc:290] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:11:16.203799 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:16.178609 21976 consensus_meta.cc:287] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.629s	user 0.012s	sys 0.008s
I20260709 12:11:16.077826 21979 consensus_queue.cc:260] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:16.236143 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:16.270911 17941 raft_consensus.cc:2393] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 9: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:16.258430 21981 raft_consensus.cc:3060] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:16.239174 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:16.240120 17947 raft_consensus.cc:1240] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:16.241396 17946 raft_consensus.cc:1240] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:11:16.047866 21926 raft_consensus.cc:493] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:16.078871 21085 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:16.247715 18096 raft_consensus.cc:1275] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:16.248952 18089 raft_consensus.cc:1275] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:16.250824 17989 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:16.280385 17946 raft_consensus.cc:1275] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:16.252767 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:16.253249 17988 leader_election.cc:304] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:16.256641 18017 raft_consensus.cc:1240] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:16.281332 18024 raft_consensus.cc:2468] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 12.
I20260709 12:11:16.257898 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:16.258524 18016 raft_consensus.cc:1240] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:11:16.260673 18015 rpcz_store.cc:276] 0709 12:11:15.056379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.056495 (+   116us) service_pool.cc:224] Handling call
0709 12:11:16.186103 (+1129608us) spinlock_profiling.cc:243] Waited 558 ms on lock 0x7b540005f5d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:16.186322 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1283811712}
I20260709 12:11:16.262322 18021 raft_consensus.cc:3060] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:16.263459 21998 raft_consensus.cc:2749] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:16.284484 17912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:16.262266 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 74925.3us
I20260709 12:11:16.247048 17914 leader_election.cc:304] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:16.265471 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:16.287930 17948 raft_consensus.cc:1275] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:16.266706 18019 raft_consensus.cc:1275] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:16.251956 21924 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:16.289729 21924 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:16.271834 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:16.237932 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:16.276921 17942 raft_consensus.cc:1240] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:16.291771 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 44879us
I20260709 12:11:16.292416 17940 raft_consensus.cc:2393] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 13: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:16.292721 17914 leader_election.cc:304] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:16.293359 18608 leader_election.cc:304] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:16.294509 18096 raft_consensus.cc:1275] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:16.264830 21885 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:16.300895 18089 raft_consensus.cc:1275] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:16.266585 21772 raft_consensus.cc:697] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:16.304548 21085 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:16.305866 17914 leader_election.cc:304] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:16.263760 21957 consensus_queue.cc:1048] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:11:16.279687 22017 consensus_queue.cc:1059] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:11:16.275136 21976 raft_consensus.cc:2749] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:16.312071 21924 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:16.296134 22059 consensus_queue.cc:1059] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:11:16.267163 22071 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:16.296011 21947 consensus_queue.cc:1048] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:11:16.335322 22071 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:16.315111 22030 raft_consensus.cc:2749] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:16.338706 21772 consensus_queue.cc:237] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:16.341799 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:11:16.316582 22080 log.cc:927] Time spent T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:11:16.291767 21926 raft_consensus.cc:515] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:16.317250 22058 consensus_queue.cc:1059] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:16.264081 21961 consensus_queue.cc:1048] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
W20260709 12:11:16.319177 22000 consensus_meta.cc:287] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.758s	user 0.007s	sys 0.003s
I20260709 12:11:16.344744 21926 leader_election.cc:290] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:16.345116 22000 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:16.308665 21885 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:16.347153 22000 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:16.348232 21885 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:16.348645 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:16.290755 21982 consensus_queue.cc:1059] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:11:16.350201 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:16.351579 22082 raft_consensus.cc:2749] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:16.327206 21937 raft_consensus.cc:2749] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:16.352411 21981 raft_consensus.cc:515] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:16.308820 21909 consensus_queue.cc:1048] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:11:16.353219 21976 raft_consensus.cc:3055] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:16.353554 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:16.353797 18091 raft_consensus.cc:1240] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 5. Current term is 6. Ops: []
I20260709 12:11:16.353943 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:16.357743 22085 raft_consensus.cc:2749] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:16.319669 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.291651 21967 raft_consensus.cc:2804] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:16.358867 21967 raft_consensus.cc:697] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:16.353592 21976 raft_consensus.cc:740] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:16.359200 21883 raft_consensus.cc:3060] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:16.359885 21967 consensus_queue.cc:237] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:16.365538 18018 raft_consensus.cc:2393] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 11: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:16.328887 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:16.331069 18021 raft_consensus.cc:2468] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 10.
I20260709 12:11:16.359999 21976 consensus_queue.cc:260] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:16.377852 21981 leader_election.cc:290] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:16.381289 18015 raft_consensus.cc:1240] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 9. Current term is 10. Ops: []
W20260709 12:11:16.384212 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 114757us
I20260709 12:11:16.386869 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:16.387567 18097 raft_consensus.cc:2468] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 11.
I20260709 12:11:16.389760 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:16.397336 18097 raft_consensus.cc:2468] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 8.
I20260709 12:11:16.399245 18609 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:16.348766 21885 raft_consensus.cc:2749] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:16.326694 17914 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:11:16.416612 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 130751us
I20260709 12:11:16.420390 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:16.426134 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:11:16.429148 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 102541us
W20260709 12:11:16.431607 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 138313us
I20260709 12:11:16.431697 18021 raft_consensus.cc:1240] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:16.432422 18608 leader_election.cc:304] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:16.433760 18609 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:16.441313 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:16.441617 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:16.444239 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:11:16.430873 21974 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.006s	sys 0.017s
I20260709 12:11:16.445272 18017 raft_consensus.cc:2393] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 13: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:16.443186 22029 consensus_queue.cc:1048] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:11:16.446559 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:16.447949 22084 raft_consensus.cc:2749] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:16.448650 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 195461us
I20260709 12:11:16.451901 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:16.428525 22017 consensus_queue.cc:1243] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer e28f77912a9c4ba2b9841f6fedddc2db log is divergent from this leader: its last log entry 7.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 12:11:16.450078 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 150335us
I20260709 12:11:16.440228 21938 raft_consensus.cc:2804] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:16.449031 21974 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.006s	sys 0.018s
I20260709 12:11:16.466959 18062 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:16.486032 18641 raft_consensus.cc:1240] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:16.454310 21660 raft_consensus.cc:2804] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:16.495364 21660 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:16.495445 22081 raft_consensus.cc:3055] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:16.495862 21660 raft_consensus.cc:3060] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:16.495951 22081 raft_consensus.cc:740] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
W20260709 12:11:16.498543 17943 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44668 (request call id 707) took 1500 ms (client timeout 1889 ms). Trace:
W20260709 12:11:16.498974 17943 rpcz_store.cc:269] 0709 12:11:14.998210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:14.998308 (+    98us) service_pool.cc:224] Handling call
0709 12:11:16.498385 (+1500077us) spinlock_profiling.cc:243] Waited 393 ms on lock 0x7b5400251cd4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:16.498487 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":903704448}
I20260709 12:11:16.489338 22087 raft_consensus.cc:3055] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:16.486932 21966 raft_consensus.cc:2749] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:16.483841 21969 consensus_queue.cc:1048] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:11:16.506222 17945 raft_consensus.cc:2468] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 11.
I20260709 12:11:16.466917 21938 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:16.505671 22087 raft_consensus.cc:740] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:16.485608 22017 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:16.488217 22084 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.467411 22006 consensus_queue.cc:1048] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:11:16.465957 22000 consensus_queue.cc:1048] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:11:16.516208 18062 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:11:16.547511 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 113807us
W20260709 12:11:16.550614 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 65891.2us
I20260709 12:11:16.486948 22067 consensus_queue.cc:1048] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:11:16.546892 21905 consensus_queue.cc:1048] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:11:16.552186 21938 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:16.559659 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 43550us
I20260709 12:11:16.574553 18062 leader_election.cc:304] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:16.576119 18062 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:16.581076 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:16.581831 17943 raft_consensus.cc:2393] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 7: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:16.565325 17836 maintenance_manager.cc:419] P b852ae4791e4401b8356c71ae33bbc7d: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033383
I20260709 12:11:16.583705 18062 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:16.589059 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:16.597301 17913 leader_election.cc:304] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:16.598006 17914 leader_election.cc:304] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:16.576596 21966 raft_consensus.cc:2749] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:16.496932 22081 consensus_queue.cc:260] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:16.601300 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:16.601325 21772 consensus_queue.cc:1059] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:11:16.563807 21971 consensus_queue.cc:1059] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:11:16.606009 21971 raft_consensus.cc:3055] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:11:16.605792 22063 consensus_queue.cc:1059] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:11:16.607050 21883 raft_consensus.cc:2749] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:16.607118 22062 raft_consensus.cc:2804] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:16.607795 22062 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:16.608235 22062 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:16.597688 22087 consensus_queue.cc:260] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:11:16.586817 22052 log.cc:927] Time spent T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.805s	user 0.004s	sys 0.000s
I20260709 12:11:16.554533 22017 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:16.616207 18062 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:16.606413 21971 raft_consensus.cc:740] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:16.586928 21767 raft_consensus.cc:2749] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:16.618724 22059 raft_consensus.cc:2749] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:16.624061 21966 raft_consensus.cc:2749] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:16.625490 22099 consensus_queue.cc:1048] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:16.611871 22087 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:16.593760 22070 raft_consensus.cc:2749] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:16.584760 22092 raft_consensus.cc:2749] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:16.623312 17913 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:16.635092 17913 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:16.637297 17988 leader_election.cc:304] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:16.638490 21969 raft_consensus.cc:3060] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:16.555748 22084 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:16.635813 21883 raft_consensus.cc:2804] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:11:16.652613 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.582940 22094 consensus_queue.cc:1059] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 12:11:16.653672 22020 raft_consensus.cc:3055] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:11:16.661566 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 63627.3us
I20260709 12:11:16.662616 17914 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:16.666231 17914 leader_election.cc:304] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:16.661003 22020 raft_consensus.cc:740] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
W20260709 12:11:16.682950 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.663765 21883 raft_consensus.cc:697] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:16.699533 18637 raft_consensus.cc:1240] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:16.671847 22117 raft_consensus.cc:2749] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:16.676545 21983 raft_consensus.cc:3055] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:16.686976 21816 raft_consensus.cc:2749] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:16.726352 18637 raft_consensus.cc:1240] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:16.719696 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 287317us
I20260709 12:11:16.738813 18608 leader_election.cc:304] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
W20260709 12:11:16.741279 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 75124.5us
I20260709 12:11:16.741566 18608 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:16.742817 18608 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:16.743901 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:16.744503 18024 raft_consensus.cc:2468] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
I20260709 12:11:16.744498 18017 raft_consensus.cc:1240] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:16.745682 17913 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:16.745146 17914 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:16.748546 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:16.735435 21983 raft_consensus.cc:740] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:16.752310 22083 raft_consensus.cc:2749] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:16.753110 22103 log.cc:927] Time spent T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 12:11:16.750279 22063 raft_consensus.cc:2804] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:16.755003 22113 raft_consensus.cc:2804] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:16.787487 22113 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:16.800014 22113 raft_consensus.cc:3060] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:16.676987 21971 consensus_queue.cc:260] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:16.804957 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:16.806105 18637 raft_consensus.cc:2468] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 9.
I20260709 12:11:16.756336 21816 consensus_queue.cc:1059] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:11:16.808887 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:16.739050 22020 consensus_queue.cc:260] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:16.800009 22084 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:16.812713 17912 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:16.803668 22017 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:16.809206 21996 raft_consensus.cc:3060] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:16.811685 22063 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:16.827178 22059 raft_consensus.cc:493] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:16.827771 22059 raft_consensus.cc:515] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:16.800927 22116 raft_consensus.cc:2749] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:16.831787 17912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.778949 21883 consensus_queue.cc:237] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:16.818207 21971 raft_consensus.cc:3060] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:16.816411 21983 consensus_queue.cc:260] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:16.830814 21816 consensus_queue.cc:1048] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:11:16.839069 22109 consensus_queue.cc:1059] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 10, Time since last communication: 0.097s
I20260709 12:11:16.836340 22125 consensus_queue.cc:1059] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:11:16.837356 22059 leader_election.cc:290] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:16.854044 22000 raft_consensus.cc:493] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:16.854238 22112 raft_consensus.cc:493] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:16.855011 21908 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:16.854772 22112 raft_consensus.cc:515] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:16.856865 22112 leader_election.cc:290] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:16.847599 22017 raft_consensus.cc:2749] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:16.813936 22099 consensus_queue.cc:1059] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:11:16.859817 18097 raft_consensus.cc:1240] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:16.857204 21660 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:16.833472 22063 raft_consensus.cc:3060] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:16.868801 22056 consensus_queue.cc:1059] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:11:16.870214 22056 raft_consensus.cc:3055] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:16.870692 22056 raft_consensus.cc:740] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:16.873941 22097 raft_consensus.cc:2749] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:16.875955 22062 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:16.864120 22109 consensus_queue.cc:1243] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer e28f77912a9c4ba2b9841f6fedddc2db log is divergent from this leader: its last log entry 7.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:11:16.880625 22083 consensus_queue.cc:1059] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:16.880540 21938 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:16.885205 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:16.885766 18097 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:16.867507 21983 raft_consensus.cc:3060] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:16.907984 18091 raft_consensus.cc:1240] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:16.885447 21938 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:16.865404 22000 raft_consensus.cc:515] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:16.903684 21926 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:16.933565 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:16.934316 18098 raft_consensus.cc:3060] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:16.920245 22094 raft_consensus.cc:493] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:16.948664 18097 raft_consensus.cc:2468] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 12.
I20260709 12:11:16.949888 18609 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
W20260709 12:11:16.955219 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 152483us
I20260709 12:11:16.956245 17914 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:16.961793 18098 raft_consensus.cc:2468] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 9.
I20260709 12:11:16.963915 18609 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
W20260709 12:11:16.993386 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:16.935248 22062 leader_election.cc:290] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 13 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:16.936764 22118 raft_consensus.cc:493] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:16.935156 21660 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:11:17.038569 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 82377.9us
I20260709 12:11:17.039889 17914 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:17.041308 17914 leader_election.cc:400] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931) with higher term. Message: Invalid argument: T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 10. Current term is 11.
I20260709 12:11:17.041656 17914 leader_election.cc:403] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:17.045730 21961 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:17.001914 22057 raft_consensus.cc:2804] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:16.937772 21926 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:17.034710 22112 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.078845 17914 leader_election.cc:304] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:17.080418 17914 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:11:17.087697 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 123834us
I20260709 12:11:17.100549 17914 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:17.053503 21883 raft_consensus.cc:2749] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:17.104765 22130 raft_consensus.cc:2749] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:17.105741 22130 raft_consensus.cc:2749] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:17.055492 22116 raft_consensus.cc:2749] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:16.953374 22094 raft_consensus.cc:515] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:16.951122 22056 consensus_queue.cc:260] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:17.072296 22057 raft_consensus.cc:697] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
W20260709 12:11:17.115346 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 334238us
I20260709 12:11:17.055929 22083 consensus_queue.cc:1059] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:11:17.054663 21961 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:17.151665 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 51190.2us
I20260709 12:11:17.065533 22128 raft_consensus.cc:2749] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931) with higher term. Message: Invalid argument: T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 10. Current term is 11.
I20260709 12:11:17.106874 21660 raft_consensus.cc:2804] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:17.152575 18608 leader_election.cc:304] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:17.152716 17914 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:17.101177 22017 raft_consensus.cc:2749] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:11:17.157580 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 139018us
I20260709 12:11:17.081950 22112 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:17.160003 17914 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:17.116278 21908 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.166706 18608 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:17.168442 21085 raft_consensus.cc:2749] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:17.168751 18608 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:17.169842 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:17.037966 22118 raft_consensus.cc:515] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:17.111366 21974 consensus_queue.cc:1048] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:11:17.118469 22097 consensus_queue.cc:1059] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 12:11:17.173151 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:17.177604 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:17.177915 18091 raft_consensus.cc:2468] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 12.
I20260709 12:11:17.178233 18089 raft_consensus.cc:2468] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 11.
W20260709 12:11:17.174364 21969 consensus_meta.cc:287] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.535s	user 0.009s	sys 0.001s
I20260709 12:11:17.170073 21908 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:17.193835 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:17.194772 22135 raft_consensus.cc:2749] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:17.195144 21908 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:17.164880 22116 raft_consensus.cc:2749] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:17.210660 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:17.215608 17947 raft_consensus.cc:3055] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:17.216007 17947 raft_consensus.cc:740] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:17.167884 21660 raft_consensus.cc:697] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:17.235617 21961 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:17.216769 17947 consensus_queue.cc:260] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:17.215130 21969 raft_consensus.cc:2749] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:17.179139 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:17.256816 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:17.257303 18089 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:17.179721 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:17.180262 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:17.181301 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:17.165215 21952 raft_consensus.cc:2749] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:17.294468 18092 raft_consensus.cc:2393] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 13: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:17.175175 22017 raft_consensus.cc:493] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.169865 18608 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:17.297468 22120 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:17.299960 17945 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50334 (request call id 2322) took 1418 ms (client timeout 1843 ms). Trace:
W20260709 12:11:17.307053 17945 rpcz_store.cc:269] 0709 12:11:15.881765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.892595 (+ 10830us) service_pool.cc:224] Handling call
0709 12:11:17.299775 (+1407180us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b54001fca54. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:17.299908 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1108244352}
I20260709 12:11:17.306389 17947 raft_consensus.cc:3060] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:11:17.308008 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 138199us
I20260709 12:11:17.308674 22118 leader_election.cc:290] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:17.310951 22108 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:17.311177 21952 raft_consensus.cc:2749] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:11:17.311831 22087 consensus_meta.cc:287] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.680s	user 0.007s	sys 0.003s
I20260709 12:11:17.311494 22108 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:17.316555 17987 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:17.315886 17914 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:17.321516 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:17.324229 18015 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 12.
I20260709 12:11:17.321846 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:17.322463 18021 raft_consensus.cc:1240] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:17.325525 18024 raft_consensus.cc:3060] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:17.319412 21952 consensus_queue.cc:1048] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.011s
W20260709 12:11:17.330583 22126 log.cc:927] Time spent T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 12:11:17.330662 18017 raft_consensus.cc:1240] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:17.331329 21952 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.332000 17947 raft_consensus.cc:1275] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 10. (index mismatch)
I20260709 12:11:17.331841 21952 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:17.333235 18089 raft_consensus.cc:2468] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 13.
I20260709 12:11:17.334092 21952 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:17.334910 21926 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:17.335253 22094 leader_election.cc:290] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:17.340327 22112 leader_election.cc:290] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:11:17.340539 21996 consensus_meta.cc:287] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.509s	user 0.004s	sys 0.004s
I20260709 12:11:17.341603 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:17.345921 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:17.343376 18062 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:17.347801 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:17.320541 22000 leader_election.cc:290] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:17.332067 22132 log.cc:927] Time spent T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 12:11:17.354543 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:17.355368 17944 raft_consensus.cc:2468] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 11.
I20260709 12:11:17.236693 22057 consensus_queue.cc:237] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:17.326215 22118 raft_consensus.cc:2804] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:17.313951 22017 raft_consensus.cc:515] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:17.320888 21969 raft_consensus.cc:2749] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:17.341030 21996 raft_consensus.cc:2749] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:11:17.362588 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:17.342061 21952 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.366086 17946 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:17.360889 22113 consensus_meta.cc:287] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.560s	user 0.008s	sys 0.004s
I20260709 12:11:17.351320 22112 raft_consensus.cc:2804] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:17.323165 22120 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:17.366665 18610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.357623 22118 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:17.376493 17941 raft_consensus.cc:1275] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:11:17.360019 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:17.368868 17944 raft_consensus.cc:1275] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:11:17.377355 18017 raft_consensus.cc:2468] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 12.
I20260709 12:11:17.370584 22108 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:17.382483 22120 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:17.383306 21949 raft_consensus.cc:3055] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:11:17.383708 21949 raft_consensus.cc:740] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:17.384485 21949 consensus_queue.cc:260] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:17.385519 21949 raft_consensus.cc:3060] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:11:17.375525 22112 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:17.391462 22112 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:17.391709 18090 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41818 (request call id 1099) took 1708 ms. Trace:
I20260709 12:11:17.392536 22118 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:17.376336 22113 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:17.398365 21953 raft_consensus.cc:3055] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:17.398907 21953 raft_consensus.cc:740] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:17.399953 21953 consensus_queue.cc:260] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:17.401438 21953 raft_consensus.cc:3060] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:17.354813 22087 consensus_queue.cc:1059] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:11:17.361828 21660 consensus_queue.cc:237] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:17.405570 21908 raft_consensus.cc:3055] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:17.405937 21908 raft_consensus.cc:740] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:17.406277 22113 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:17.372104 21952 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:17.406659 21908 consensus_queue.cc:260] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:17.368227 17914 leader_election.cc:304] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:17.408115 21908 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:17.372376 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:17.357690 22131 log.cc:927] Time spent T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.273s	user 0.000s	sys 0.000s
W20260709 12:11:17.419524 22086 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:11:17.420085 22086 raft_consensus.cc:2749] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:17.421491 22117 consensus_queue.cc:1175] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4813437da0a74e65b61eb7bd1d18f110" responder_term: 8 status { last_received { term: 8 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 8 index: 4 } }
I20260709 12:11:17.414316 18016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45464 (request call id 2084) took 1162 ms. Trace:
I20260709 12:11:17.423350 18016 rpcz_store.cc:276] 0709 12:11:16.252169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:16.254022 (+  1853us) service_pool.cc:224] Handling call
0709 12:11:16.254288 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:16.282344 (+ 28056us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.414013 (+1131669us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b54000b3454. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:11:17.414243 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4922624}
W20260709 12:11:17.424641 17913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.426128 17944 raft_consensus.cc:1240] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:11:17.427050 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:17.427237 18018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53022 (request call id 711) took 2073 ms. Trace:
I20260709 12:11:17.427559 18018 rpcz_store.cc:276] 0709 12:11:15.353874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.354100 (+   226us) service_pool.cc:224] Handling call
0709 12:11:17.427066 (+2072966us) spinlock_profiling.cc:243] Waited 924 ms on lock 0x7b540030c5d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:17.427183 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2125622016}
I20260709 12:11:17.428861 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:17.426498 21782 raft_consensus.cc:493] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.429574 21782 raft_consensus.cc:515] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:17.430778 22101 log.cc:927] Time spent T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.884s	user 0.014s	sys 0.021s
I20260709 12:11:17.430804 21975 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:17.431882 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:17.392199 18090 rpcz_store.cc:276] 0709 12:11:15.682966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.683145 (+   179us) service_pool.cc:224] Handling call
0709 12:11:15.683498 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:15.768195 (+ 84697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.391425 (+1623230us) spinlock_profiling.cc:243] Waited 81.1 ms on lock 0x7b5400061654. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:11:17.391639 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":186430208}
I20260709 12:11:17.429600 17944 raft_consensus.cc:2393] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 13: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:17.440435 17988 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:17.442827 21969 raft_consensus.cc:2804] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:17.443300 21969 raft_consensus.cc:697] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:17.443894 21782 leader_election.cc:290] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:17.433326 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:17.444183 21969 consensus_queue.cc:237] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:17.444726 22017 leader_election.cc:290] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:17.445323 22000 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:17.445809 22000 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:17.447816 22000 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:17.449252 21983 consensus_meta.cc:287] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.529s	user 0.003s	sys 0.007s
I20260709 12:11:17.455432 18018 raft_consensus.cc:1275] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:11:17.456578 21971 consensus_meta.cc:287] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.608s	user 0.006s	sys 0.003s
I20260709 12:11:17.457039 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:17.457355 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:17.459595 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:17.460348 18018 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:17.467242 18016 raft_consensus.cc:1240] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:17.468868 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c560710763a42e79b5b8080eff3b58b" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:11:17.468982 18062 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.469096 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:17.470227 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:17.470589 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:17.470852 18016 raft_consensus.cc:2468] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
I20260709 12:11:17.471266 17942 raft_consensus.cc:2393] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 11: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
W20260709 12:11:17.473472 18608 connection.cc:256] RPC call timeout handler was delayed by -1.0263133010000729s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1516s for a response
I20260709 12:11:17.474486 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:17.474831 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:17.475587 17942 raft_consensus.cc:2393] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 7: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:11:17.475829 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:17.477475 22056 raft_consensus.cc:3060] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:17.478304 17913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.479238 17942 raft_consensus.cc:1275] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:17.480624 18641 raft_consensus.cc:1275] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:11:17.481367 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.481657 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:17.482190 18644 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:17.478889 21975 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:17.482951 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:17.484131 21975 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:17.484248 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:17.482227 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:17.484869 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:17.485298 18640 raft_consensus.cc:2393] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 11: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:11:17.485555 18639 raft_consensus.cc:2393] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 7: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:11:17.487058 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:17.488091 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:17.488620 18641 raft_consensus.cc:2376] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8. Re-sending same reply.
I20260709 12:11:17.489583 18636 raft_consensus.cc:3055] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:17.489886 18636 raft_consensus.cc:740] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:17.490041 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:17.490574 18018 raft_consensus.cc:2468] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 13.
I20260709 12:11:17.490619 18641 raft_consensus.cc:2468] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 7.
I20260709 12:11:17.491537 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:17.492084 17912 leader_election.cc:304] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:17.490576 18636 consensus_queue.cc:260] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:17.492075 18643 raft_consensus.cc:2468] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 10.
I20260709 12:11:17.493454 18636 raft_consensus.cc:3060] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:17.494270 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:17.495671 18608 leader_election.cc:304] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:17.496034 22086 raft_consensus.cc:2804] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:17.496474 22086 raft_consensus.cc:493] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.496889 22086 raft_consensus.cc:3060] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:17.498301 22098 raft_consensus.cc:2804] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:17.498821 22098 raft_consensus.cc:697] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:17.499611 22098 consensus_queue.cc:237] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:17.500825 18062 leader_election.cc:304] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:17.537472 21967 raft_consensus.cc:3055] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:17.544157 21883 raft_consensus.cc:2749] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:17.548799 21967 raft_consensus.cc:740] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:17.549697 21967 consensus_queue.cc:260] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:17.551050 21967 raft_consensus.cc:3060] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:17.538911 18644 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 10.
I20260709 12:11:17.555198 21767 raft_consensus.cc:2749] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:17.542150 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.560946 22062 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.561420 22062 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:17.561957 21979 raft_consensus.cc:3060] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:17.563186 18024 raft_consensus.cc:2468] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
I20260709 12:11:17.563582 22062 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:17.542425 22117 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.542799 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:17.564823 18089 raft_consensus.cc:2393] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 10: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:17.564771 22117 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:17.566367 22020 raft_consensus.cc:3060] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:17.543393 21952 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:17.543944 21961 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:17.484877 18635 raft_consensus.cc:2468] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
I20260709 12:11:17.545650 17946 raft_consensus.cc:2468] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 12.
I20260709 12:11:17.508194 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:17.572492 21976 raft_consensus.cc:3060] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:17.533327 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 165146us
I20260709 12:11:17.575405 17914 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:17.576570 17914 leader_election.cc:304] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:17.577049 17913 leader_election.cc:304] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:17.577616 17914 leader_election.cc:304] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:11:17.555199 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 54446.5us
I20260709 12:11:17.570127 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:17.578497 18089 raft_consensus.cc:1275] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:17.541566 18636 raft_consensus.cc:1275] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:17.578860 18062 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:11:17.547842 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 52248.5us
I20260709 12:11:17.579228 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:17.578778 18644 raft_consensus.cc:2468] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 11.
I20260709 12:11:17.578713 18092 raft_consensus.cc:1240] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:17.580016 18062 leader_election.cc:304] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:17.579960 18608 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:17.581254 18062 leader_election.cc:304] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:17.581918 18090 raft_consensus.cc:1240] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:11:17.587507 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:17.587797 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:17.588169 18024 raft_consensus.cc:2468] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 10.
I20260709 12:11:17.588397 18016 raft_consensus.cc:2468] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 9.
I20260709 12:11:17.590233 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:17.591081 18089 raft_consensus.cc:2468] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 10.
I20260709 12:11:17.588403 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:17.595741 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:17.596364 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:17.597195 18089 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 13.
I20260709 12:11:17.603196 17914 leader_election.cc:304] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:17.544167 22055 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
W20260709 12:11:17.455613 22063 consensus_meta.cc:287] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.570s	user 0.011s	sys 0.000s
I20260709 12:11:17.626001 18018 raft_consensus.cc:1275] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:11:17.628911 17914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:17.600641 21991 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:11:17.633957 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:17.634603 17913 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:11:17.632718 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 53045us
I20260709 12:11:17.582938 21767 raft_consensus.cc:2764] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:11:17.638265 17913 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:17.640153 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:17.640851 18097 raft_consensus.cc:2393] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 9: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:17.605827 21981 raft_consensus.cc:2804] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:17.583026 21983 raft_consensus.cc:2749] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:17.623476 22015 raft_consensus.cc:2749] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:17.631116 22084 raft_consensus.cc:2749] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:17.605559 22062 raft_consensus.cc:2749] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:17.663726 18642 raft_consensus.cc:1240] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 LEADER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:17.627746 22111 log.cc:927] Time spent T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:11:17.569890 22112 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:17.636127 18608 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:17.604995 21949 raft_consensus.cc:2749] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:17.623274 22017 raft_consensus.cc:2804] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:11:17.623229 22154 log.cc:927] Time spent T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:11:17.575471 21961 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:17.605055 22067 consensus_queue.cc:1048] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:11:17.604559 21973 consensus_queue.cc:1059] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:11:17.642967 21782 raft_consensus.cc:2804] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:17.668084 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:17.669922 18018 raft_consensus.cc:1275] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:17.605180 22118 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:17.648311 21974 raft_consensus.cc:2804] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:17.679041 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:17.653290 22117 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:17.678894 18609 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:17.652393 22142 raft_consensus.cc:2804] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:17.631515 22055 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:17.656354 21981 raft_consensus.cc:697] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:17.547888 22086 raft_consensus.cc:515] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:17.697918 21981 consensus_queue.cc:237] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:17.688160 18062 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.700491 22086 leader_election.cc:290] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:17.663013 22087 raft_consensus.cc:493] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:17.651574 22109 consensus_queue.cc:1048] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:11:17.696453 18096 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 13.
I20260709 12:11:17.701578 22087 raft_consensus.cc:515] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:17.694217 18094 raft_consensus.cc:1240] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:17.704186 22087 leader_election.cc:290] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:17.707921 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:17.709916 22087 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:17.710561 22087 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:17.713722 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:17.632118 22063 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:17.679160 21938 raft_consensus.cc:2804] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:17.680356 22070 consensus_queue.cc:1048] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
W20260709 12:11:17.725065 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 46260.5us
I20260709 12:11:17.685127 21782 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.684756 22017 raft_consensus.cc:697] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:17.696128 21974 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.730860 21938 raft_consensus.cc:697] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:17.730032 21782 raft_consensus.cc:3060] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:17.740311 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:17.731315 22070 raft_consensus.cc:2804] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:17.741000 22087 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:17.747753 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:17.753254 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:17.753847 17947 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 13.
I20260709 12:11:17.737330 22142 raft_consensus.cc:697] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 11 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:17.758740 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:17.755213 18635 raft_consensus.cc:1240] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:17.755302 17912 leader_election.cc:304] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:17.755952 18643 raft_consensus.cc:1240] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:17.749923 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:17.734974 21974 raft_consensus.cc:3060] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:17.762198 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
W20260709 12:11:17.763159 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 124428us
W20260709 12:11:17.762750 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 105541us
I20260709 12:11:17.763243 18609 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:17.761194 22082 raft_consensus.cc:2749] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:17.764432 22117 consensus_queue.cc:1048] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:11:17.769493 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:17.770766 21772 consensus_queue.cc:1048] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:17.770571 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:17.774358 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:17.775378 21961 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:17.743829 22070 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:17.778867 22070 raft_consensus.cc:3060] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:17.782532 17947 raft_consensus.cc:1240] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:17.784703 18640 raft_consensus.cc:2468] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 6.
I20260709 12:11:17.784899 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:17.786192 17987 leader_election.cc:304] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:17.789429 18639 raft_consensus.cc:2468] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 11.
I20260709 12:11:17.790232 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:17.790869 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:17.791173 18018 raft_consensus.cc:2468] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 9.
I20260709 12:11:17.740644 21999 consensus_queue.cc:1048] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:11:17.743180 21971 consensus_queue.cc:1048] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:11:17.803287 18061 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:17.823580 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:17.879925 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:17.880669 18019 raft_consensus.cc:3060] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 8
W20260709 12:11:17.883688 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 97562.6us
I20260709 12:11:17.884449 17987 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:11:17.889079 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 80203.4us
W20260709 12:11:17.882974 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 115947us
I20260709 12:11:17.818288 21960 raft_consensus.cc:2804] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:17.881434 21981 raft_consensus.cc:2749] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:11:17.975157 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 186773us
W20260709 12:11:17.977326 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 92948.1us
I20260709 12:11:17.978346 17987 leader_election.cc:304] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:11:17.985467 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 94830.3us
I20260709 12:11:17.956365 21960 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:17.975485 22156 log.cc:927] Time spent T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 12:11:17.889786 22164 raft_consensus.cc:2749] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:17.995836 22056 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:18.001959 17945 raft_consensus.cc:1275] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:17.889942 22162 consensus_queue.cc:1048] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.172s
I20260709 12:11:17.988404 22067 raft_consensus.cc:3060] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:17.823539 22017 consensus_queue.cc:237] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:18.011667 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:18.010013 22118 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:17.997121 21960 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:17.994760 22112 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:17.888744 21938 consensus_queue.cc:237] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:18.024226 17913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.026202 18024 raft_consensus.cc:2410] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 12:11:18.031278 22165 log.cc:927] Time spent T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:11:18.032682 22063 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:18.034972 22146 log.cc:927] Time spent T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.270s	user 0.000s	sys 0.000s
W20260709 12:11:18.036170 22155 log.cc:927] Time spent T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
I20260709 12:11:18.039193 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:18.039868 18639 raft_consensus.cc:3060] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.042258 18098 raft_consensus.cc:2468] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 10.
I20260709 12:11:18.051904 18019 raft_consensus.cc:2468] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
I20260709 12:11:18.013785 22056 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:17.989148 22142 consensus_queue.cc:237] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:18.034229 22070 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:18.044123 22087 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:18.084830 22166 log.cc:927] Time spent T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:11:18.081254 17949 raft_consensus.cc:2468] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 9.
I20260709 12:11:18.122188 18639 raft_consensus.cc:2468] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 10.
I20260709 12:11:18.124001 17912 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:18.065282 21782 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:18.087627 22056 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:18.140123 21782 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:18.144655 21960 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:18.148639 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:18.153788 21960 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 14 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:18.168882 21974 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:18.170845 22055 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:18.130995 22118 raft_consensus.cc:2804] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:18.176940 22118 raft_consensus.cc:697] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:18.177965 22118 consensus_queue.cc:237] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:18.086982 22087 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:11:18.182116 22171 log.cc:927] Time spent T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 12:11:18.193035 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 214777us
I20260709 12:11:18.193641 22108 raft_consensus.cc:2749] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:18.194002 17987 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:11:18.194360 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 203564us
I20260709 12:11:18.195801 17987 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:18.196056 17989 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:18.201061 22074 consensus_queue.cc:1048] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:11:18.198810 22164 raft_consensus.cc:2749] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:18.214030 22094 consensus_queue.cc:1059] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:18.215199 22094 raft_consensus.cc:2804] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:18.215605 22094 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:18.216032 22094 raft_consensus.cc:3060] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.220890 21967 raft_consensus.cc:3055] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:18.224514 22160 raft_consensus.cc:2804] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:18.224977 22160 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:18.225332 22160 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:18.229115 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.221000 22174 consensus_queue.cc:1048] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:11:18.235846 21924 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.236320 21924 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:18.238266 21924 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:18.240754 22070 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:11:18.241546 18062 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.241936 21883 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:18.219522 21908 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:18.244799 22173 log.cc:927] Time spent T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:11:18.245030 21908 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:11:18.247165 17914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.244802 21883 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:18.249248 21883 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:18.251286 21908 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:18.221443 21967 raft_consensus.cc:740] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:18.252306 21967 consensus_queue.cc:260] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:18.253489 21967 raft_consensus.cc:3060] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.242950 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:18.264667 22125 raft_consensus.cc:3055] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:18.265182 22125 raft_consensus.cc:740] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:18.275473 17914 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:18.279779 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:18.280529 18095 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:18.287993 18093 raft_consensus.cc:1240] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:18.290977 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:18.292394 17913 leader_election.cc:304] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:18.293099 21983 raft_consensus.cc:493] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:18.293160 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:18.293851 17945 raft_consensus.cc:2468] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 10.
I20260709 12:11:18.293726 21983 raft_consensus.cc:515] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:18.295261 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:18.295838 17944 raft_consensus.cc:2468] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
I20260709 12:11:18.296357 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:18.297084 18097 raft_consensus.cc:2393] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 8: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:18.298506 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:18.299042 18024 raft_consensus.cc:3060] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.299340 18089 raft_consensus.cc:1275] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:18.299877 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:18.303129 18093 raft_consensus.cc:3060] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:18.299259 22082 raft_consensus.cc:2804] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:18.304355 21883 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.304628 22082 raft_consensus.cc:697] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:18.304636 18022 raft_consensus.cc:1240] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:18.305248 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:18.305765 18021 raft_consensus.cc:3060] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.313220 18062 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
W20260709 12:11:18.321265 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 168242us
I20260709 12:11:18.322746 18061 leader_election.cc:304] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:18.330677 18061 leader_election.cc:304] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:18.295881 21983 leader_election.cc:290] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:18.333057 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:18.339423 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:18.340018 17947 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:18.162041 22067 raft_consensus.cc:2749] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:18.334671 17945 raft_consensus.cc:1275] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:18.340276 17988 leader_election.cc:304] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:18.339002 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:18.300355 21885 raft_consensus.cc:2749] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:18.357263 17942 raft_consensus.cc:2468] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 9.
I20260709 12:11:18.366663 18024 raft_consensus.cc:2468] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 10.
I20260709 12:11:18.317713 21974 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:18.370569 18021 raft_consensus.cc:2468] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 10.
I20260709 12:11:18.317330 21908 raft_consensus.cc:493] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:18.336704 22112 raft_consensus.cc:2804] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:18.336550 21976 raft_consensus.cc:2749] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:18.390777 17913 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:18.404302 18095 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 14.
I20260709 12:11:18.395208 21845 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.304872 21883 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:18.336414 21981 raft_consensus.cc:2749] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:18.380785 18093 raft_consensus.cc:2468] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 11.
I20260709 12:11:18.387841 18019 raft_consensus.cc:3060] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:18.427949 21883 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:18.388749 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:18.389607 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:18.431414 18024 raft_consensus.cc:2393] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 11: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:18.395154 21969 raft_consensus.cc:2804] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:18.432119 21969 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.432518 21969 raft_consensus.cc:3060] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.266151 22125 consensus_queue.cc:260] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:18.393600 21908 raft_consensus.cc:515] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:18.435278 22125 raft_consensus.cc:3060] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:18.436841 21908 leader_election.cc:290] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:18.438114 18098 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53964 (request call id 1987) took 1266 ms (client timeout 1604 ms). Trace:
W20260709 12:11:18.438524 18098 rpcz_store.cc:269] 0709 12:11:17.171484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.171692 (+   208us) service_pool.cc:224] Handling call
0709 12:11:18.437965 (+1266273us) spinlock_profiling.cc:243] Waited 814 ms on lock 0x7b540024a254. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:18.438063 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1871550336}
I20260709 12:11:18.439201 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:18.440097 18096 raft_consensus.cc:1275] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:11:18.423038 18609 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:18.386756 22112 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.420885 21885 raft_consensus.cc:2804] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:18.420626 21845 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:18.395614 21960 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:18.374320 21983 consensus_queue.cc:1059] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 12:11:18.445962 18019 raft_consensus.cc:2468] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 12.
W20260709 12:11:18.447645 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.408697 22081 raft_consensus.cc:3060] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.453678 18609 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:18.396332 22072 consensus_queue.cc:1048] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:11:18.381699 17947 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 14.
W20260709 12:11:18.461649 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 265889us
I20260709 12:11:18.463510 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:18.465832 17987 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:18.399114 22055 consensus_queue.cc:1048] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 12:11:18.451457 22062 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.451766 21981 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.449509 22002 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
W20260709 12:11:18.469885 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 273876us
I20260709 12:11:18.454609 21999 raft_consensus.cc:2804] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:18.449329 21908 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:18.451730 22112 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:18.335225 22082 consensus_queue.cc:237] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:18.504606 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:18.507856 17987 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:18.469801 21957 raft_consensus.cc:2749] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:18.468400 21885 raft_consensus.cc:697] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
W20260709 12:11:18.567746 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 59995us
I20260709 12:11:18.569432 17987 leader_election.cc:304] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:18.494617 21938 raft_consensus.cc:2804] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:18.512384 21905 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.519414 22029 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.523092 21845 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:18.448364 22098 consensus_queue.cc:1175] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4813437da0a74e65b61eb7bd1d18f110" responder_term: 8 status { last_received { term: 7 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:11:18.500449 21981 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:18.498909 22002 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:18.502585 21908 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:11:18.536340 22177 log.cc:927] Time spent T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:11:18.509023 21999 raft_consensus.cc:697] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 14 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:18.539240 17949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44668 (request call id 721) took 1369 ms. Trace:
I20260709 12:11:18.548369 18021 raft_consensus.cc:1275] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 10. (term mismatch)
I20260709 12:11:18.614204 18021 pending_rounds.cc:85] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb: Aborting all ops after (but not including) 9
I20260709 12:11:18.614537 18021 pending_rounds.cc:107] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260709 12:11:18.614845 18021 raft_consensus.cc:2889] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:18.600147 21976 raft_consensus.cc:3055] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:18.462481 21960 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:18.595918 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:18.596014 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:18.596544 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:18.597146 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:18.597297 18636 raft_consensus.cc:1275] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:11:18.595376 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:18.607079 21782 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.621410 18635 raft_consensus.cc:2376] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 11. Re-sending same reply.
W20260709 12:11:18.600764 18023 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.049s	sys 0.100s
W20260709 12:11:18.601265 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 269436us
I20260709 12:11:18.503588 22117 consensus_queue.cc:1048] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:11:18.496498 22062 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:18.608498 21938 raft_consensus.cc:697] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 11 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:18.610450 17949 rpcz_store.cc:276] 0709 12:11:17.169451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.169612 (+   161us) service_pool.cc:224] Handling call
0709 12:11:18.539077 (+1369465us) spinlock_profiling.cc:243] Waited 874 ms on lock 0x7b54002bedd4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:18.539184 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2010563968}
I20260709 12:11:18.597827 21967 raft_consensus.cc:2804] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:18.613478 18608 leader_election.cc:304] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:18.601338 21905 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:11:18.627808 18023 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.049s	sys 0.100s
I20260709 12:11:18.593479 21969 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:18.604737 22029 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:18.667218 22029 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:18.549978 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:18.668366 18089 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 13.
I20260709 12:11:18.669600 18089 raft_consensus.cc:1275] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:18.642822 21969 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:18.672303 21772 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:18.672814 21905 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:18.673241 21767 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.629611 21782 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:18.673866 21767 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:11:18.643285 22172 log.cc:927] Time spent T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.618s	user 0.002s	sys 0.002s
I20260709 12:11:18.625782 22183 raft_consensus.cc:2804] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:18.643431 21996 raft_consensus.cc:2804] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:18.645707 18608 leader_election.cc:304] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:18.648383 22187 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.651775 21967 raft_consensus.cc:697] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:18.652464 21885 consensus_queue.cc:237] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:18.609426 21952 consensus_queue.cc:1059] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 12:11:18.657467 21908 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:18.664109 21960 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:18.617637 21976 raft_consensus.cc:740] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:18.612672 21959 consensus_queue.cc:1048] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:11:18.643018 18018 raft_consensus.cc:2368] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 9. Current term is 10.
I20260709 12:11:18.675757 18023 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
mode: GRACEFUL
new_leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:44098
I20260709 12:11:18.677995 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:18.795933 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:18.678764 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:18.680011 18015 raft_consensus.cc:1275] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:11:18.638407 22160 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:18.682529 22081 raft_consensus.cc:493] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:18.687469 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:18.672848 21772 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:18.692389 22062 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:18.695271 21981 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:18.695948 21999 consensus_queue.cc:237] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:18.701116 18090 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53954 (request call id 2421) took 1091 ms. Trace:
I20260709 12:11:18.828611 18090 rpcz_store.cc:276] 0709 12:11:17.595602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.598046 (+  2444us) service_pool.cc:224] Handling call
0709 12:11:17.598418 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:18.185687 (+587269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:18.185717 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:18.186189 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 12:11:18.456912 (+270723us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:18.456958 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.686137 (+229179us) spinlock_profiling.cc:243] Waited 587 ms on lock 0x7b54000384d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:11:18.686205 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:18.686271 (+    66us) raft_consensus.cc:1685] finished
0709 12:11:18.686294 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:18.686565 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11669,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":983,"spinlock_wait_cycles":1349716352,"thread_start_us":270323,"threads_started":1,"wal-append.queue_time_us":345969}
W20260709 12:11:18.704578 17915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:18.785329 22006 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:18.665557 22112 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:18.786986 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:18.832532 18096 raft_consensus.cc:2468] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:11:18.798436 18023 raft_consensus.cc:606] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Received request to transfer leadership to TS e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:18.833339 18023 raft_consensus.cc:614] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:18.736002 21996 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:18.796960 18016 raft_consensus.cc:2468] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 10.
I20260709 12:11:18.777019 22105 raft_consensus.cc:2749] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:18.737110 22183 raft_consensus.cc:493] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
W20260709 12:11:18.739573 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 93934.7us
I20260709 12:11:18.840983 18608 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:18.842285 18094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41818 (request call id 1137) took 1166 ms. Trace:
I20260709 12:11:18.842718 18094 rpcz_store.cc:276] 0709 12:11:17.675684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.675825 (+   141us) service_pool.cc:224] Handling call
0709 12:11:17.676097 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:17.705736 (+ 29639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.842023 (+1136287us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b5400338454. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:11:18.842218 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41157888}
I20260709 12:11:18.848444 22117 raft_consensus.cc:493] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:18.849048 22117 raft_consensus.cc:515] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:18.853026 22094 consensus_meta.cc:287] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.637s	user 0.010s	sys 0.000s
I20260709 12:11:18.853458 22094 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:18.854476 18020 raft_consensus.cc:3060] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:18.856034 18089 raft_consensus.cc:2393] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 11: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
W20260709 12:11:18.856468 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 68336.4us
I20260709 12:11:18.759137 22187 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:18.858119 17948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50334 (request call id 2356) took 1071 ms. Trace:
I20260709 12:11:18.836974 22062 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.864742 17989 leader_election.cc:304] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:18.866096 18061 leader_election.cc:304] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:18.860396 17948 rpcz_store.cc:276] 0709 12:11:17.787173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:17.787285 (+   112us) service_pool.cc:224] Handling call
0709 12:11:17.794789 (+  7504us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:17.795111 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:17.795141 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:17.795597 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 12:11:17.975884 (+180287us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:17.975924 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:17.975989 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:18.622768 (+646779us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b4400022b4c. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f497ebc85 00007f7f497ec6a2 00007f7f4c55e1db 00007f7f4c559aaf 00007f7f4c54d86e 00007f7f4c54cbb6 00007f7f4c54c7d8 00007f7f4c556221 00007f7f4c5561d9 00007f7f4c556169
0709 12:11:18.842456 (+219688us) raft_consensus.cc:1685] finished
0709 12:11:18.842476 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:18.858061 (+ 15585us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":826,"raft.run_cpu_time_us":48,"raft.run_wall_time_us":49,"spinlock_wait_cycles":4194176,"thread_start_us":179856,"threads_started":1,"wal-append.queue_time_us":229070}
I20260709 12:11:18.836781 21996 raft_consensus.cc:3060] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.823063 22081 raft_consensus.cc:515] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:18.875412 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:18.877140 17949 raft_consensus.cc:2376] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 9. Re-sending same reply.
I20260709 12:11:18.838177 22183 raft_consensus.cc:3060] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:18.875797 22020 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:18.881817 18061 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:18.866444 21960 raft_consensus.cc:3060] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.881690 17941 raft_consensus.cc:1240] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:18.886127 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:18.887475 18024 raft_consensus.cc:1240] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:18.837446 22006 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:18.878324 21957 raft_consensus.cc:2804] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:18.892879 17946 raft_consensus.cc:1275] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:18.890709 18016 raft_consensus.cc:1240] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:18.893688 18061 leader_election.cc:304] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:18.874007 22189 raft_consensus.cc:2749] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:18.874104 21976 consensus_queue.cc:260] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:18.897900 22200 raft_consensus.cc:2749] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:18.924554 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:18.857880 21938 consensus_queue.cc:237] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:18.927386 22160 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 14 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:18.876250 21967 consensus_queue.cc:237] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:18.931846 22087 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:18.933231 22006 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:18.876787 22062 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:18.899665 22193 log.cc:927] Time spent T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:11:18.892876 22020 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:18.900079 22188 log.cc:927] Time spent T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 12:11:18.900276 21981 raft_consensus.cc:2749] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:18.936048 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:18.906847 21767 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:18.936592 22094 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:18.911774 21951 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:18.937218 22062 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:18.912071 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:18.938517 18635 raft_consensus.cc:2468] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
I20260709 12:11:18.938587 18094 raft_consensus.cc:1275] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:18.902892 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:18.939399 18097 raft_consensus.cc:2368] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 10. Current term is 11.
W20260709 12:11:18.944980 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 46272.3us
I20260709 12:11:18.945871 18061 leader_election.cc:304] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:18.949031 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:18.950778 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:18.951138 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:18.946908 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:18.952205 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:18.952739 18635 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 13.
I20260709 12:11:18.898362 21957 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:18.954069 18020 raft_consensus.cc:2468] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 11.
I20260709 12:11:18.956226 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:18.957584 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:18.958454 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:18.937444 21951 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:18.960136 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:18.960826 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:18.960850 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:18.919358 21976 raft_consensus.cc:3060] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:18.964879 18640 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 13.
I20260709 12:11:18.921558 22112 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:18.953315 21767 raft_consensus.cc:2804] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:18.989977 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:18.991703 18608 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:18.966084 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:18.969115 17987 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:18.994246 17987 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:18.964569 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:18.918694 22187 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:18.917614 21772 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:19.002259 18061 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.006773 17912 leader_election.cc:304] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:19.007531 18644 raft_consensus.cc:1275] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:19.010476 17912 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:19.011288 18636 raft_consensus.cc:1275] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:11:18.963121 22062 raft_consensus.cc:493] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:18.961748 21957 raft_consensus.cc:3060] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:19.017153 17987 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:19.021442 22074 raft_consensus.cc:2804] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:19.021912 22074 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:19.022292 22074 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:19.023408 21772 raft_consensus.cc:2804] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:19.023867 21772 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:19.024243 21772 raft_consensus.cc:3060] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:18.959442 21952 consensus_queue.cc:1059] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 12:11:18.967975 22142 consensus_queue.cc:1048] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:11:19.025195 21991 raft_consensus.cc:3055] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:19.025559 21991 raft_consensus.cc:740] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:19.018447 21937 raft_consensus.cc:2749] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:19.027422 22070 consensus_queue.cc:1059] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:19.028270 22070 raft_consensus.cc:3055] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:19.028589 22070 raft_consensus.cc:740] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:19.004395 22094 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.029357 22094 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:19.029762 18608 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:19.011194 21909 raft_consensus.cc:2749] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:19.031015 22125 raft_consensus.cc:2804] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:19.031509 22125 raft_consensus.cc:697] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:19.032439 22125 consensus_queue.cc:237] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:19.003711 21981 raft_consensus.cc:493] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:19.026364 21991 consensus_queue.cc:260] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:19.035002 21981 raft_consensus.cc:515] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:18.961625 22197 consensus_queue.cc:1048] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 12:11:19.038743 21952 raft_consensus.cc:3055] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:19.039108 21952 raft_consensus.cc:740] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:19.039984 21952 consensus_queue.cc:260] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:19.029363 22070 consensus_queue.cc:260] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:19.043910 22070 raft_consensus.cc:3060] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:19.049007 21952 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:19.018217 22098 consensus_queue.cc:1059] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:11:19.037509 21947 raft_consensus.cc:2955] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 LEADER]: Committing config change with OpId 8.7: config changed from index 5 to 7, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:19.051472 22098 raft_consensus.cc:3055] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:19.051828 22098 raft_consensus.cc:740] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:19.052124 17913 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:19.052588 22098 consensus_queue.cc:260] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:19.053689 22098 raft_consensus.cc:3060] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:19.054260 21979 raft_consensus.cc:493] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:19.054770 21979 raft_consensus.cc:515] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:19.056797 21979 leader_election.cc:290] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:19.057156 21772 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:19.057704 22017 raft_consensus.cc:2804] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:19.058198 22017 raft_consensus.cc:697] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:19.042769 22082 consensus_queue.cc:1048] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:18.990485 21767 raft_consensus.cc:697] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:19.068655 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:19.068936 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:19.069224 17943 raft_consensus.cc:3060] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:19.069509 17942 raft_consensus.cc:2468] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
I20260709 12:11:19.064524 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:19.070783 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:19.071141 17948 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 13.
I20260709 12:11:19.071516 17942 raft_consensus.cc:2410] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:11:19.072891 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:19.075917 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:19.019894 17987 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:19.076257 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:11:19.076736 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 56939.6us
W20260709 12:11:19.077752 18062 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.019054 22139 raft_consensus.cc:2749] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:19.067018 18093 raft_consensus.cc:2955] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 5 to 7, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:19.097211 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:19.097976 17942 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 13.
I20260709 12:11:19.062593 22187 raft_consensus.cc:493] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:19.111747 18062 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:19.104009 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:19.113034 17942 raft_consensus.cc:2468] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 7.
I20260709 12:11:19.090513 22164 raft_consensus.cc:2749] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:19.132259 22197 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:19.132956 22197 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:19.135525 22197 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:19.135864 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:19.137285 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:19.064080 22128 consensus_queue.cc:1048] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:11:19.146067 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:19.150676 17942 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.075205 22182 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:19.061491 22062 raft_consensus.cc:515] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:19.153640 21960 raft_consensus.cc:2749] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:19.118999 21767 consensus_queue.cc:237] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:19.181991 21782 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:19.159071 21951 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:19.159134 17942 raft_consensus.cc:2468] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 11.
I20260709 12:11:19.161037 22094 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:19.123601 22187 raft_consensus.cc:515] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:19.162694 22183 raft_consensus.cc:515] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:19.184697 22187 leader_election.cc:290] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:19.184887 22081 leader_election.cc:290] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:19.185209 22183 leader_election.cc:290] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:19.163190 21981 leader_election.cc:290] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:19.158124 21957 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:19.188675 21957 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:19.127408 22189 raft_consensus.cc:2749] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:19.174966 17943 raft_consensus.cc:2468] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 10.
I20260709 12:11:19.167649 21772 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:19.145035 22198 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:19.190568 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:19.191663 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:19.196347 22198 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:19.129444 22087 consensus_queue.cc:1048] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 12:11:19.199344 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:19.208007 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:19.208609 18094 raft_consensus.cc:3060] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Advancing to term 10
W20260709 12:11:19.216517 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 186810us
I20260709 12:11:19.218271 17940 raft_consensus.cc:1240] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 LEADER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:19.220286 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:19.145961 22017 consensus_queue.cc:237] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:19.174760 22182 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:19.240779 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:19.221938 21957 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.251133 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:19.252081 17942 raft_consensus.cc:2468] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 5.
I20260709 12:11:19.257679 18061 leader_election.cc:304] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:19.246469 22118 raft_consensus.cc:2749] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:19.267331 22198 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:19.263376 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:19.271142 17942 raft_consensus.cc:3060] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:19.271826 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:19.275107 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:19.261502 22094 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.277205 18094 raft_consensus.cc:2468] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 10.
I20260709 12:11:19.249087 21957 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:19.279451 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:19.258586 21951 consensus_queue.cc:1048] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 12:11:19.258838 21996 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:19.269642 18018 raft_consensus.cc:2955] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 5 to 7, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:19.287734 18643 raft_consensus.cc:2468] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
I20260709 12:11:19.288601 17942 raft_consensus.cc:2468] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 10.
I20260709 12:11:19.287777 18608 leader_election.cc:400] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Vote denied by peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297) with higher term. Message: Invalid argument: T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 9. Current term is 10.
W20260709 12:11:19.296653 22203 log.cc:927] Time spent T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.276s	user 0.003s	sys 0.000s
I20260709 12:11:19.303776 17989 leader_election.cc:400] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Vote denied by peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931) with higher term. Message: Invalid argument: T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 10. Current term is 11.
I20260709 12:11:19.304136 17989 leader_election.cc:403] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:11:19.312058 18062 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:19.274312 22074 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:19.323801 22208 log.cc:927] Time spent T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:11:19.325791 22074 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 14 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:19.313243 18062 leader_election.cc:304] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:11:19.291344 21999 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.345028 21999 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:19.345670 22205 log.cc:927] Time spent T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:11:19.347147 21999 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:19.350071 21957 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:19.342808 17988 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
W20260709 12:11:19.343065 22206 log.cc:927] Time spent T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:11:19.344291 22002 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:19.355314 21996 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:19.332414 21883 raft_consensus.cc:493] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:19.355760 17989 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:19.340480 22125 raft_consensus.cc:493] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:19.361745 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:19.369889 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:19.282162 22094 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:19.380708 17948 raft_consensus.cc:2368] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 9. Current term is 10.
I20260709 12:11:19.368193 17988 leader_election.cc:304] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:19.335269 21767 raft_consensus.cc:2804] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:19.372258 17947 raft_consensus.cc:2468] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 5.
W20260709 12:11:19.342466 22207 log.cc:927] Time spent T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:11:19.337553 22006 raft_consensus.cc:2749] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931) with higher term. Message: Invalid argument: T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 10. Current term is 11.
I20260709 12:11:19.338092 22062 leader_election.cc:290] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:19.378163 22182 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:19.369490 22139 raft_consensus.cc:2749] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:19.301689 22057 consensus_queue.cc:1048] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 12:11:19.387969 17988 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:19.382417 21767 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:19.388968 17989 leader_election.cc:304] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:19.392148 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:19.393165 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:19.400290 18016 raft_consensus.cc:2468] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 9.
I20260709 12:11:19.392093 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:19.401095 18023 raft_consensus.cc:2468] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 7.
I20260709 12:11:19.396847 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:19.387452 22164 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.402796 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:19.403223 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:19.403746 18023 raft_consensus.cc:2393] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 14: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:19.403931 18019 raft_consensus.cc:2393] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 14: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:19.389580 22087 raft_consensus.cc:2749] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:19.407538 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:19.394686 22074 raft_consensus.cc:2804] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:19.412151 18017 raft_consensus.cc:2410] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:11:19.412096 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:19.416451 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:19.418407 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:19.401929 21767 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:19.410881 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:19.413146 22182 raft_consensus.cc:2804] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:11:19.434787 22182 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:19.435196 22182 raft_consensus.cc:3060] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:19.435439 22094 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:19.387404 22125 raft_consensus.cc:515] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:19.437383 22125 leader_election.cc:290] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:19.437949 22074 raft_consensus.cc:697] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:19.439177 22074 consensus_queue.cc:237] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:19.422664 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:19.443011 18091 raft_consensus.cc:2468] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
I20260709 12:11:19.446190 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:19.446805 18638 raft_consensus.cc:2468] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 5.
I20260709 12:11:19.447614 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:19.422894 21926 raft_consensus.cc:2804] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:19.423251 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:19.427611 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:19.428344 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:19.387562 21883 raft_consensus.cc:515] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:19.448208 18640 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:19.448908 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:19.455801 18642 raft_consensus.cc:2468] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
I20260709 12:11:19.428829 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:19.448211 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:19.457059 18644 raft_consensus.cc:3060] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:19.454052 18015 raft_consensus.cc:2468] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 7.
I20260709 12:11:19.462745 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:19.463133 22006 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:19.464093 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:19.463878 22006 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:19.465222 18092 raft_consensus.cc:1275] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:19.466442 22006 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:19.473373 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:19.473486 17987 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:19.475301 22094 raft_consensus.cc:2804] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:19.476095 22094 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:19.476755 22094 raft_consensus.cc:3060] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:19.483158 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.489068 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:11:19.508297 18608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:19.512897 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:19.513969 18019 raft_consensus.cc:2393] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 10: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:19.514968 21883 leader_election.cc:290] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:19.515484 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:11:19.516103 22215 log.cc:927] Time spent T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 12:11:19.516454 18019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
mode: GRACEFUL
new_leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:44098
I20260709 12:11:19.516582 21960 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.516966 18019 raft_consensus.cc:606] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 LEADER]: Received request to transfer leadership to TS 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:19.517086 21960 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:19.518693 18019 raft_consensus.cc:1240] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:11:19.490877 21926 raft_consensus.cc:697] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:19.519271 21960 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:19.519301 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:19.520028 21926 consensus_queue.cc:237] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:19.521920 18022 raft_consensus.cc:1275] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:19.524024 17949 raft_consensus.cc:1275] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:19.511411 18644 raft_consensus.cc:2468] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 10.
I20260709 12:11:19.512856 18640 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 14.
I20260709 12:11:19.527922 18017 raft_consensus.cc:1275] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:19.530779 17987 leader_election.cc:304] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:19.521955 18019 raft_consensus.cc:1275] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:19.532593 22164 raft_consensus.cc:2749] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:19.543605 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:19.550149 18019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
mode: GRACEFUL
new_leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:44098
I20260709 12:11:19.550861 18019 raft_consensus.cc:606] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Received request to transfer leadership to TS e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:19.551254 18019 raft_consensus.cc:614] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:19.543403 21951 raft_consensus.cc:493] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:19.554963 21951 raft_consensus.cc:515] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:19.556977 21951 leader_election.cc:290] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:19.557880 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:19.558699 17949 raft_consensus.cc:2468] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 10.
I20260709 12:11:19.560649 22094 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:19.565776 22094 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:19.566933 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:19.567620 18643 raft_consensus.cc:3060] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:19.579838 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:19.585994 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:19.586568 17948 raft_consensus.cc:2468] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
I20260709 12:11:19.543758 22164 raft_consensus.cc:2804] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:19.600368 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:19.577751 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:19.601383 17940 raft_consensus.cc:3060] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:19.589956 17913 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:19.604640 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:19.592471 18021 raft_consensus.cc:2468] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 11.
I20260709 12:11:19.606294 17913 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:11:19.567152 22210 log.cc:927] Time spent T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.285s	user 0.001s	sys 0.000s
I20260709 12:11:19.610028 18019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:44098
I20260709 12:11:19.610587 18019 raft_consensus.cc:606] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:19.613874 18019 raft_consensus.cc:614] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:19.614317 18643 raft_consensus.cc:2468] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 10.
I20260709 12:11:19.615516 17987 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:19.616119 21767 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:19.616506 22160 raft_consensus.cc:2804] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:19.617130 22160 raft_consensus.cc:697] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:19.617362 18098 raft_consensus.cc:2393] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 14: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:19.617944 22160 consensus_queue.cc:237] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:19.534858 22182 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:19.619400 18024 raft_consensus.cc:2393] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 6: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:19.619943 18019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:44098
I20260709 12:11:19.620317 22182 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:19.621309 22164 raft_consensus.cc:697] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:19.621788 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:19.622340 18643 raft_consensus.cc:3060] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:19.622294 22164 consensus_queue.cc:237] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:19.623705 17940 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 14.
I20260709 12:11:19.631496 21975 consensus_queue.cc:1048] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:19.631551 22117 leader_election.cc:290] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:19.634918 22201 log.cc:927] Time spent T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.646s	user 0.003s	sys 0.000s
I20260709 12:11:19.635308 17988 leader_election.cc:304] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:19.636044 21975 raft_consensus.cc:2749] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:19.636847 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:19.638991 17988 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:19.639247 22097 consensus_queue.cc:1048] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:19.642886 18636 raft_consensus.cc:1275] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:19.645052 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:19.645988 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:19.646404 18643 raft_consensus.cc:2468] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
I20260709 12:11:19.652519 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:19.654953 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:19.657133 18635 raft_consensus.cc:2393] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 11: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:19.663470 18018 raft_consensus.cc:1275] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:19.669579 18643 raft_consensus.cc:1275] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:11:19.670001 18643 pending_rounds.cc:85] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db: Aborting all ops after (but not including) 7
I20260709 12:11:19.670046 17988 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:19.670423 18643 pending_rounds.cc:107] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:11:19.670863 18643 raft_consensus.cc:2889] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:19.664997 17987 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:19.671912 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:19.672637 17940 raft_consensus.cc:3060] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:11:19.673441 17912 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:19.676798 18635 raft_consensus.cc:1275] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 12:11:19.677772 18635 pending_rounds.cc:85] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db: Aborting all ops after (but not including) 9
I20260709 12:11:19.678369 18635 pending_rounds.cc:107] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 12:11:19.678812 18635 raft_consensus.cc:2889] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:19.654183 22117 raft_consensus.cc:2804] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:19.650305 22017 raft_consensus.cc:2749] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:19.682922 17940 raft_consensus.cc:2468] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 6.
I20260709 12:11:19.683727 17912 leader_election.cc:304] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:19.667711 21767 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 14 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:19.669395 21967 raft_consensus.cc:2804] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:19.691937 17912 leader_election.cc:304] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:19.692708 21883 raft_consensus.cc:2749] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:19.693315 21883 raft_consensus.cc:3060] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:19.693377 21979 consensus_queue.cc:1048] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:19.702771 17940 raft_consensus.cc:1275] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:19.683125 22117 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:19.674316 22118 consensus_queue.cc:1059] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:11:19.691402 22062 raft_consensus.cc:2749] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:11:19.681416 21947 consensus_queue.cc:1048] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:11:19.670145 22183 consensus_queue.cc:1048] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 12:11:19.723397 21842 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:19.703292 21924 raft_consensus.cc:2804] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:11:19.745817 21924 raft_consensus.cc:697] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:19.746711 21924 consensus_queue.cc:237] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:19.730155 18641 raft_consensus.cc:2468] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
I20260709 12:11:19.730715 22117 raft_consensus.cc:3060] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:19.686760 21905 raft_consensus.cc:2804] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:19.751904 21905 raft_consensus.cc:697] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:19.680817 21885 consensus_queue.cc:1048] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:11:19.680658 21772 consensus_queue.cc:1048] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:11:19.744940 22137 raft_consensus.cc:993] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb: : Instructing follower 63f5bddeebd84e5788d671a176cfa8e1 to start an election
I20260709 12:11:19.744562 21842 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:19.755638 17912 leader_election.cc:304] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
W20260709 12:11:19.824170 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 366196us
I20260709 12:11:19.957731 17941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44668 (request call id 740) took 1620 ms. Trace:
I20260709 12:11:19.958441 17941 rpcz_store.cc:276] 0709 12:11:18.337279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.337383 (+   104us) service_pool.cc:224] Handling call
0709 12:11:18.337632 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:18.885605 (+547973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:19.957433 (+1071828us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b5400291154. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:11:19.957656 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1250768768}
I20260709 12:11:19.756286 22099 raft_consensus.cc:3055] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:11:19.960127 22074 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.005s	sys 0.010s
I20260709 12:11:19.936858 22118 raft_consensus.cc:493] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:19.752857 21905 consensus_queue.cc:237] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:19.738579 21979 consensus_queue.cc:1048] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.251s
W20260709 12:11:20.039902 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:20.053120 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 739911us
I20260709 12:11:20.053944 18062 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
W20260709 12:11:20.021353 22074 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.005s	sys 0.011s
I20260709 12:11:20.022347 22137 raft_consensus.cc:1081] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 LEADER]: Signalling peer 63f5bddeebd84e5788d671a176cfa8e1 to start an election
I20260709 12:11:19.993690 22099 raft_consensus.cc:740] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:20.024299 22062 raft_consensus.cc:2804] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:20.092161 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:11:20.055697 21926 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.019s	sys 0.023s
I20260709 12:11:20.068200 22198 raft_consensus.cc:2804] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:20.031934 22118 raft_consensus.cc:515] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:11:20.101076 21926 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.020s	sys 0.023s
W20260709 12:11:20.114343 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 482521us
I20260709 12:11:20.125867 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:20.126606 18093 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 10.
I20260709 12:11:20.143352 17945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50334 (request call id 2376) took 1070 ms. Trace:
I20260709 12:11:20.143890 17945 rpcz_store.cc:276] 0709 12:11:19.073063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.076991 (+  3928us) service_pool.cc:224] Handling call
0709 12:11:19.077227 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:19.195505 (+118278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:19.195536 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:19.195582 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:11:19.195617 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:20.143049 (+947432us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54002f0154. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:11:20.143111 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:20.143279 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":271590656}
I20260709 12:11:20.104230 22062 raft_consensus.cc:697] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:20.151818 18019 raft_consensus.cc:606] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 LEADER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:20.109035 21767 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:20.115641 22198 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:20.199615 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:20.114246 21908 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.157548 21767 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:20.157555 22094 consensus_queue.cc:1048] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 12:11:20.215559 21767 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:20.216925 22002 raft_consensus.cc:2804] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:20.217417 22002 raft_consensus.cc:697] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 11 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:20.199333 22198 raft_consensus.cc:3060] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:20.219939 22234 log.cc:927] Time spent T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
W20260709 12:11:20.221099 22228 log.cc:927] Time spent T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 12:11:20.221858 21767 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:20.222463 22231 log.cc:927] Time spent T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
I20260709 12:11:20.222558 21967 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:20.232018 22118 leader_election.cc:290] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:20.233111 22020 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:20.235179 22202 log.cc:927] Time spent T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 1.215s	user 0.009s	sys 0.007s
W20260709 12:11:20.236642 21883 consensus_meta.cc:287] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1: Time spent flushing consensus metadata: real 0.543s	user 0.007s	sys 0.000s
I20260709 12:11:20.237495 22117 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:20.152247 22099 consensus_queue.cc:260] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:20.211143 21908 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:20.273305 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 517752us
I20260709 12:11:20.265235 21967 raft_consensus.cc:3060] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:20.277837 18644 raft_consensus.cc:3055] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:20.278194 18644 raft_consensus.cc:740] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:20.278972 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:20.279565 18094 raft_consensus.cc:3060] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:20.281507 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:20.218250 22002 consensus_queue.cc:237] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:20.284409 21979 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.302426 18095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53954 (request call id 2427) took 1799 ms. Trace:
I20260709 12:11:20.333055 17943 raft_consensus.cc:1240] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 LEADER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:20.339301 18094 raft_consensus.cc:2468] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 10.
I20260709 12:11:20.273121 22062 consensus_queue.cc:237] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:20.312626 18608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.347546 18023 raft_consensus.cc:1275] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:20.316464 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:20.350692 18097 raft_consensus.cc:1275] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:20.319074 22099 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:20.321439 22117 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:20.324587 21842 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:20.269742 21883 raft_consensus.cc:2749] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:20.247244 21767 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:20.330951 18095 rpcz_store.cc:276] 0709 12:11:18.502855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:18.502960 (+   105us) service_pool.cc:224] Handling call
0709 12:11:18.503271 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:18.699227 (+195956us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:18.699261 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:18.746192 (+ 46931us) log.cc:844] Serialized 26 byte log entry
0709 12:11:18.871221 (+125029us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:18.871258 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:18.871388 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:20.234614 (+1363226us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b4400022b4c. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f497ebc85 00007f7f497ec6a2 00007f7f4c55e1db 00007f7f4c559aaf 00007f7f4c54d86e 00007f7f4c54cbb6 00007f7f4c54c7d8 00007f7f4c556221 00007f7f4c5561d9 00007f7f4c556169
0709 12:11:20.302047 (+ 67433us) raft_consensus.cc:1685] finished
0709 12:11:20.302080 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:20.302343 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":144547,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"spinlock_wait_cycles":6755072,"thread_start_us":258458,"threads_started":2,"wal-append.queue_time_us":201035}
I20260709 12:11:20.354365 18020 raft_consensus.cc:1275] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:20.346612 18644 consensus_queue.cc:260] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:20.357389 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:20.360634 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:20.362377 18024 raft_consensus.cc:1275] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:11:20.363111 22200 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.326604 22198 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:20.369161 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:20.360584 17989 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:20.363703 22230 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
W20260709 12:11:20.378813 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 324925us
I20260709 12:11:20.380213 18609 leader_election.cc:304] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:20.379191 22000 raft_consensus.cc:2749] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:20.372133 17941 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:50334
I20260709 12:11:20.394652 17941 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:20.395040 17941 raft_consensus.cc:3060] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.344997 21979 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:20.405043 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:20.392696 22142 raft_consensus.cc:2749] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:20.432053 17941 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:20.433652 17943 raft_consensus.cc:1240] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:20.441711 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:20.445362 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:20.448215 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:20.448467 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:20.449213 17940 raft_consensus.cc:2393] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 14: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:20.449210 17945 raft_consensus.cc:2368] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for earlier term 9. Current term is 10.
I20260709 12:11:20.452612 21908 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:20.452692 22198 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:20.379596 22200 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:20.454720 22200 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:20.387599 22230 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:20.457954 18094 raft_consensus.cc:1275] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:20.457857 21979 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:20.462845 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:20.465005 17945 raft_consensus.cc:2393] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 12: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:20.468488 17945 raft_consensus.cc:1275] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:11:20.452652 21767 leader_election.cc:290] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:20.458918 22117 consensus_queue.cc:1048] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:11:20.465579 22200 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.482156 22200 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:20.484484 22200 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:20.487892 22230 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:20.498103 18644 raft_consensus.cc:3060] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:20.482007 21967 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:20.504849 21967 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:20.507689 18644 raft_consensus.cc:1275] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:11:20.508075 18644 pending_rounds.cc:85] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db: Aborting all ops after (but not including) 9
I20260709 12:11:20.508306 18644 pending_rounds.cc:107] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:11:20.508539 18644 raft_consensus.cc:2889] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:20.514863 22250 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:20.515479 22250 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:20.517712 22250 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:20.519248 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 132083us
I20260709 12:11:20.519855 21767 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:20.520468 21767 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:20.520747 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:20.527321 17941 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:20.540527 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:20.542444 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:20.542763 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:20.546746 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:20.547451 18092 raft_consensus.cc:3060] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.543898 21767 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:20.548951 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:20.551061 18093 raft_consensus.cc:2393] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 8: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:20.550521 18062 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:20.552148 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:20.557051 18090 raft_consensus.cc:2393] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 10: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:20.557276 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:20.567641 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:20.568313 18093 raft_consensus.cc:2468] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 11.
W20260709 12:11:20.569396 22246 log.cc:927] Time spent T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.300s	user 0.003s	sys 0.000s
I20260709 12:11:20.570598 22253 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:20.572456 18062 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:11:20.573431 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 181725us
I20260709 12:11:20.560393 22256 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.578943 18062 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:20.571166 22253 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:20.575068 22198 raft_consensus.cc:2749] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:20.575935 21767 raft_consensus.cc:2804] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:20.580543 21767 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:20.580925 21767 raft_consensus.cc:3060] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:20.581087 18062 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:20.582062 22253 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:20.583464 18609 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:20.582427 18015 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45464 (request call id 2122) took 1154 ms. Trace:
I20260709 12:11:20.589998 18015 rpcz_store.cc:276] 0709 12:11:19.428487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.463826 (+ 35339us) service_pool.cc:224] Handling call
0709 12:11:20.582251 (+1118425us) spinlock_profiling.cc:243] Waited 687 ms on lock 0x7b5400030cd4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:20.582371 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1579828096}
I20260709 12:11:20.592545 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:20.593644 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:20.606307 18062 leader_election.cc:304] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:20.608939 22212 raft_consensus.cc:2804] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:11:20.620263 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.590157 22256 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:20.628953 22256 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:20.609822 22257 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:20.611584 22253 raft_consensus.cc:2749] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:20.631944 18062 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:20.630393 21660 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.634517 18062 leader_election.cc:304] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:20.620792 22212 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:20.645572 22212 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:20.636979 21660 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:20.619943 22198 raft_consensus.cc:2749] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:20.631551 21999 consensus_queue.cc:1048] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 12:11:20.608865 22020 consensus_queue.cc:1048] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:11:20.610746 21971 consensus_queue.cc:1048] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 12:11:20.670811 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:20.671679 18089 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 13.
I20260709 12:11:20.672860 18092 raft_consensus.cc:2468] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 9.
W20260709 12:11:20.675603 18607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.674603 18609 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
W20260709 12:11:20.676226 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 163167us
W20260709 12:11:20.678102 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 157172us
I20260709 12:11:20.681002 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:20.681348 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:20.681869 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:20.682575 17945 raft_consensus.cc:3060] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:20.682827 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:20.685807 18090 raft_consensus.cc:1275] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:20.661732 21660 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:20.692875 18090 raft_consensus.cc:1275] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:11:20.703410 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:20.701719 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:20.719193 17941 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 14.
I20260709 12:11:20.720309 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:20.721154 17940 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 11.
I20260709 12:11:20.720446 18062 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:20.677382 22253 raft_consensus.cc:2749] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:20.698300 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:20.723627 18015 raft_consensus.cc:3060] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:20.702085 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:20.724469 18022 raft_consensus.cc:2468] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 11.
I20260709 12:11:20.704975 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:20.693022 18094 raft_consensus.cc:3055] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:20.725911 18094 raft_consensus.cc:740] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:20.691236 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:20.707037 18023 raft_consensus.cc:1240] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 LEADER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:20.705375 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:20.709614 17914 leader_election.cc:304] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:20.728997 18092 raft_consensus.cc:2393] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 13: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:20.729696 17914 leader_election.cc:304] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:20.690635 17945 raft_consensus.cc:2468] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 8.
I20260709 12:11:20.731410 17914 leader_election.cc:304] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:20.727968 18089 raft_consensus.cc:2468] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
I20260709 12:11:20.726861 18094 consensus_queue.cc:260] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:20.733994 17914 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:20.735263 21883 raft_consensus.cc:2749] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:20.736608 17914 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:11:20.737536 21883 raft_consensus.cc:2804] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:20.737985 21883 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:20.738399 21883 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:20.745223 22200 raft_consensus.cc:2749] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:11:20.746547 18062 leader_election.cc:400] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123) with higher term. Message: Invalid argument: T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for earlier term 9. Current term is 10.
I20260709 12:11:20.746385 17914 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:11:20.746985 18062 leader_election.cc:403] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:20.692080 21937 raft_consensus.cc:2804] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:20.749634 21937 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:20.722790 21767 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:20.750830 22257 raft_consensus.cc:2749] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:20.751855 18094 raft_consensus.cc:3060] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:20.732801 21885 raft_consensus.cc:2749] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:20.766871 18062 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:11:20.768241 18062 leader_election.cc:304] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:11:20.769613 21969 consensus_queue.cc:1048] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:11:20.770226 22261 log.cc:927] Time spent T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:11:20.770543 22248 raft_consensus.cc:493] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:20.771132 22248 raft_consensus.cc:515] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:20.772675 22200 consensus_queue.cc:1048] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:20.773313 22248 leader_election.cc:290] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:20.776207 21991 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:20.776437 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 54135.3us
I20260709 12:11:20.777920 22161 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.779508 22006 consensus_queue.cc:1059] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:20.779942 18094 raft_consensus.cc:1275] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:20.780530 22006 raft_consensus.cc:3055] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:20.780965 22006 raft_consensus.cc:740] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:20.791241 18023 raft_consensus.cc:1240] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:11:20.799049 17913 leader_election.cc:304] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:20.781924 22006 consensus_queue.cc:260] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:20.747756 22117 raft_consensus.cc:2749] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:20.809520 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:20.819299 18015 raft_consensus.cc:2468] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 8.
I20260709 12:11:20.791770 18062 leader_election.cc:304] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:20.807407 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:20.835747 18024 raft_consensus.cc:2468] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 8.
W20260709 12:11:20.835944 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 44290.6us
I20260709 12:11:20.800654 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:20.804240 17989 leader_election.cc:304] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:20.747555 22085 raft_consensus.cc:2749] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:20.834457 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 445157us
I20260709 12:11:20.752382 22128 raft_consensus.cc:2804] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:20.759408 21937 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:20.765533 22257 raft_consensus.cc:2749] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123) with higher term. Message: Invalid argument: T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 for earlier term 9. Current term is 10.
I20260709 12:11:20.843413 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
W20260709 12:11:20.846360 18607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.847136 18608 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:20.752424 21767 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:20.778383 22161 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:20.836905 18062 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:20.857187 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:20.813053 22253 raft_consensus.cc:2804] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:20.859383 18062 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:11:20.861317 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 57159.3us
I20260709 12:11:20.810030 22062 raft_consensus.cc:2749] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:20.809562 22136 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:20.840873 22198 raft_consensus.cc:2749] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:20.850539 22256 raft_consensus.cc:2749] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:20.800793 22248 consensus_queue.cc:1048] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 12:11:20.859241 22002 raft_consensus.cc:2804] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:20.896267 18090 raft_consensus.cc:1240] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:20.863339 18608 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:20.869074 21909 raft_consensus.cc:2804] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:20.857970 21924 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:20.753808 21883 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:20.884475 22161 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:20.859273 22128 raft_consensus.cc:697] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:20.885603 22249 consensus_queue.cc:1048] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:20.886250 22182 consensus_queue.cc:1048] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:20.887241 18089 raft_consensus.cc:1275] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:20.868642 22253 raft_consensus.cc:697] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:20.861268 22085 raft_consensus.cc:493] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:20.853751 22212 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:20.865775 21971 raft_consensus.cc:493] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:20.863845 22125 raft_consensus.cc:2749] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:20.893093 18062 leader_election.cc:304] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:20.893599 22017 raft_consensus.cc:493] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:20.866519 21767 raft_consensus.cc:2749] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:20.905556 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:20.906957 18608 leader_election.cc:400] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 election: Vote denied by peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123) with higher term. Message: Invalid argument: T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 9. Current term is 10.
I20260709 12:11:20.951247 18608 leader_election.cc:403] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:11:20.907652 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:11:20.943683 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 50670.8us
I20260709 12:11:20.899430 21909 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:20.920163 22057 raft_consensus.cc:2764] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:11:20.904531 22117 raft_consensus.cc:493] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:20.906128 21999 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:20.863379 22136 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:20.982342 22006 raft_consensus.cc:3060] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:20.988819 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 82048us
I20260709 12:11:20.951689 21908 raft_consensus.cc:2804] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:11:20.996030 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:20.976086 22269 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:21.003445 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 204459us
I20260709 12:11:20.983374 21909 raft_consensus.cc:3060] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:20.950225 22254 raft_consensus.cc:2804] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:11:20.999022 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 78430.3us
I20260709 12:11:20.935523 21937 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:21.007608 18023 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 11.
I20260709 12:11:20.942893 22161 consensus_queue.cc:1048] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:11:20.990103 22125 raft_consensus.cc:493] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:20.923291 21924 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:21.009353 18608 leader_election.cc:304] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:20.989696 22002 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:20.950080 21971 raft_consensus.cc:515] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:20.995338 22265 raft_consensus.cc:3060] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:20.974673 22017 raft_consensus.cc:515] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:21.002195 22000 raft_consensus.cc:493] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:21.160265 22000 raft_consensus.cc:515] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:20.945712 22085 raft_consensus.cc:515] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:21.163589 22085 leader_election.cc:290] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:21.137298 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:21.113963 22136 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:21.113591 22274 log.cc:927] Time spent T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:11:21.166484 22265 raft_consensus.cc:2749] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123) with higher term. Message: Invalid argument: T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for earlier term 9. Current term is 10.
I20260709 12:11:21.152525 22017 leader_election.cc:290] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:21.023526 22125 raft_consensus.cc:515] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:21.171479 22125 leader_election.cc:290] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:21.019328 22253 consensus_queue.cc:237] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:21.078264 18643 raft_consensus.cc:1240] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 12:11:21.119306 22212 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:21.172986 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:21.173727 18643 raft_consensus.cc:2368] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 13. Current term is 14.
I20260709 12:11:21.174459 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:21.175559 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:21.176553 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:21.176695 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:21.177129 18643 raft_consensus.cc:2468] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 9.
I20260709 12:11:21.177390 18640 raft_consensus.cc:2393] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 14: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:21.177973 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:21.178126 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:21.179157 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:21.180234 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:21.128487 21979 consensus_queue.cc:1048] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:21.102437 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:21.183380 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:21.109788 18637 raft_consensus.cc:1275] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:21.008828 22269 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:21.024055 22062 raft_consensus.cc:493] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:21.007319 22254 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:20.995765 22117 raft_consensus.cc:515] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:21.026345 22002 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:21.080363 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:21.095479 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:20.998754 21999 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:21.012027 22248 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:21.074874 21996 raft_consensus.cc:2804] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:21.029907 22277 consensus_queue.cc:1048] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.090s
I20260709 12:11:21.195361 22248 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:21.197547 21996 raft_consensus.cc:493] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.086364 21952 consensus_queue.cc:1048] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:11:21.197971 21996 raft_consensus.cc:3060] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:21.114459 22271 log.cc:927] Time spent T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:11:21.017033 22128 consensus_queue.cc:237] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:21.200868 22269 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:21.135972 21971 leader_election.cc:290] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:21.133952 21924 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:21.151427 22279 log.cc:927] Time spent T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 12:11:21.193522 22254 raft_consensus.cc:3060] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:21.152352 22292 log.cc:927] Time spent T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:11:21.155511 21937 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 14 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:21.156183 21883 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 13 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:21.158632 21908 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:21.204923 21908 raft_consensus.cc:3060] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.194806 22062 raft_consensus.cc:515] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:21.207652 22117 leader_election.cc:290] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:21.168787 21909 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:21.199977 21999 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:21.212246 21909 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:21.199219 22248 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:21.213311 22062 leader_election.cc:290] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:21.214551 21908 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:21.216670 21908 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:21.227913 22254 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:21.012403 17913 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:21.006448 17912 leader_election.cc:304] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:11:21.264271 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 251762us
I20260709 12:11:21.266084 17913 leader_election.cc:304] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:11:21.071019 18062 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.120419 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
W20260709 12:11:21.143656 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.324631 21999 consensus_queue.cc:1059] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:21.326241 21999 raft_consensus.cc:3055] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:21.154729 18641 raft_consensus.cc:2468] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 12.
I20260709 12:11:21.086149 18642 raft_consensus.cc:1275] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:21.371704 22284 raft_consensus.cc:2749] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.183617 18643 raft_consensus.cc:2468] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 8.
W20260709 12:11:21.271311 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 317288us
I20260709 12:11:21.279196 18638 raft_consensus.cc:2393] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 9: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:11:21.360576 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:21.375223 18094 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 14.
I20260709 12:11:21.374405 17846 catalog_manager.cc:5697] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 5 to 8, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 8 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:21.376067 22097 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.377028 22097 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:21.378029 22297 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:20.952699 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:21.378777 22297 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:11:21.381742 22297 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:21.281620 18639 raft_consensus.cc:1240] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:21.283537 18644 raft_consensus.cc:1275] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:11:21.283576 18607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:21.290406 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 283909us
I20260709 12:11:21.304322 22268 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:21.293326 21909 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:21.190270 18637 raft_consensus.cc:1275] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:21.332218 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:21.337853 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:21.345288 22136 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:21.346323 18061 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:21.377332 17846 catalog_manager.cc:5697] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 2 to 7, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 7 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:21.279806 22254 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:21.346571 22000 leader_election.cc:290] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:21.360827 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:21.356552 22299 raft_consensus.cc:2749] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.408434 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:21.409742 18094 raft_consensus.cc:2368] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 9. Current term is 10.
I20260709 12:11:21.410897 21909 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:21.414027 21909 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:21.367688 21999 raft_consensus.cc:740] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:21.437064 22299 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.438176 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:21.442456 18095 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:21.457275 22097 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:21.461138 22252 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.461334 22002 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:21.449659 17846 catalog_manager.cc:5697] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 8 to 11, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 11 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:21.467573 18017 raft_consensus.cc:1240] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:21.482079 17943 raft_consensus.cc:2955] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 5 to 7, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
W20260709 12:11:21.493330 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 147400us
W20260709 12:11:21.494020 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 187807us
I20260709 12:11:21.497104 18061 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:21.499578 22029 consensus_queue.cc:1059] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:21.500666 22029 raft_consensus.cc:3055] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:21.501052 22254 raft_consensus.cc:2749] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:21.501789 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:21.502385 18644 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:21.503156 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:21.442893 22268 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:21.434433 22136 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:21.505568 22268 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:21.487949 17945 raft_consensus.cc:1240] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 11. Current term is 13. Ops: []
I20260709 12:11:21.506994 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:21.489727 17987 leader_election.cc:400] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 13 pre-election: Vote denied by peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647) with higher term. Message: Invalid argument: T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 13. Current term is 14.
I20260709 12:11:21.508327 17987 leader_election.cc:403] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:21.508842 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:21.509639 22161 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:11:21.510288 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:21.490599 21999 consensus_queue.cc:260] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:21.506589 22136 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:21.519016 18095 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 14.
I20260709 12:11:21.508353 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:21.522773 17846 catalog_manager.cc:5697] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:21.440153 22118 raft_consensus.cc:2749] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:21.516117 17987 leader_election.cc:304] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:21.529300 17846 catalog_manager.cc:5697] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:21.501065 22029 raft_consensus.cc:740] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:21.511233 21909 raft_consensus.cc:493] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:21.539494 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:11:21.543393 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 46380.3us
I20260709 12:11:21.540680 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:21.547256 18024 raft_consensus.cc:2468] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 9.
I20260709 12:11:21.442116 22299 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:21.550380 18644 raft_consensus.cc:2468] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 13.
I20260709 12:11:21.532718 22297 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:21.578431 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 50680.5us
I20260709 12:11:21.570673 21999 raft_consensus.cc:3060] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:21.583014 18643 raft_consensus.cc:1275] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:21.559190 21909 raft_consensus.cc:515] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:21.585785 22230 raft_consensus.cc:2749] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:21.586452 22248 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.586778 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:21.587191 22248 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:21.589442 22248 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:21.591306 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:11:21.593225 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 82695us
I20260709 12:11:21.595641 22006 consensus_queue.cc:1048] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:21.602147 22002 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 15 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:21.603744 17947 raft_consensus.cc:1240] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:21.608775 17941 raft_consensus.cc:1275] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:11:21.611001 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:11:21.616032 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 69936.7us
I20260709 12:11:21.615280 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:21.607770 22298 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:21.619835 22298 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:21.620406 17948 raft_consensus.cc:1275] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:11:21.609320 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:21.622421 22298 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:21.625373 18093 raft_consensus.cc:1240] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:21.627123 18092 raft_consensus.cc:1275] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:21.602430 22252 raft_consensus.cc:2749] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:21.606632 21883 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:21.652070 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:21.657780 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:21.656077 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:21.610805 22297 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:21.670989 18097 raft_consensus.cc:1240] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 15 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:21.658957 22230 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:21.676505 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:21.688331 17945 raft_consensus.cc:1275] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:21.690179 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:11:21.691293 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 119551us
I20260709 12:11:21.690348 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:21.693545 17912 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:21.694420 22248 raft_consensus.cc:2804] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:21.695044 22248 raft_consensus.cc:697] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:21.694878 22293 consensus_queue.cc:1048] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:21.696236 22248 consensus_queue.cc:237] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:21.699720 17846 catalog_manager.cc:5697] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:21.702123 17846 catalog_manager.cc:5697] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 8 to 12, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 12 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:21.643711 22029 consensus_queue.cc:260] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:21.725306 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:21.722729 18092 raft_consensus.cc:2468] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
W20260709 12:11:21.735172 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 152608us
I20260709 12:11:21.739256 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:21.737289 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:21.743832 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:21.745677 18017 raft_consensus.cc:1275] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:21.745877 17989 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:21.739880 18609 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:21.750808 18641 raft_consensus.cc:3060] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:21.752354 22029 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:21.758993 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:21.760320 17949 raft_consensus.cc:1275] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:21.760789 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:21.741959 22230 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:21.764392 22230 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:21.766016 18024 raft_consensus.cc:3060] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:21.771656 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 44401.5us
I20260709 12:11:21.787410 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:21.790308 18642 raft_consensus.cc:2468] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 6.
I20260709 12:11:21.726120 21883 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:21.794059 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 77696.7us
W20260709 12:11:21.803282 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 86041us
W20260709 12:11:21.801314 22306 log.cc:927] Time spent T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 12:11:21.806564 22136 consensus_queue.cc:1048] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:21.801986 21924 raft_consensus.cc:993] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb: : Instructing follower 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:11:21.809689 21924 raft_consensus.cc:1081] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 LEADER]: Signalling peer 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:11:21.809697 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:21.811689 21973 raft_consensus.cc:2804] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:21.812273 21973 raft_consensus.cc:697] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 14 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:21.813200 21973 consensus_queue.cc:237] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:21.818769 22283 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:21.819463 22283 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:21.818840 17846 catalog_manager.cc:5697] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:21.821658 22283 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:21.820971 17846 catalog_manager.cc:5697] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 3 to 4, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 4 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
W20260709 12:11:21.822324 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 47197.5us
I20260709 12:11:21.823506 18061 leader_election.cc:304] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:21.827628 18024 raft_consensus.cc:2468] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 10.
I20260709 12:11:21.800658 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:21.839787 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:21.840632 17989 leader_election.cc:400] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Vote denied by peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931) with higher term. Message: Invalid argument: T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 9. Current term is 10.
I20260709 12:11:21.846249 17989 leader_election.cc:403] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:11:21.831650 17846 catalog_manager.cc:5697] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:21.849181 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:21.831887 22230 raft_consensus.cc:2804] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:21.856928 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:21.836966 22002 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:21.828902 22252 raft_consensus.cc:493] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:21.846872 22299 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:21.872779 17914 leader_election.cc:304] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:21.872822 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:11:21.871505 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 43752.5us
I20260709 12:11:21.845343 22283 raft_consensus.cc:493] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
W20260709 12:11:21.877938 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.879567 22070 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:21.880163 22070 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:21.882341 18062 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:21.884568 21883 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:21.886790 22002 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:21.888921 22002 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:21.889413 22002 raft_consensus.cc:2804] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:21.855288 22230 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:21.891975 18641 raft_consensus.cc:2468] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 10.
I20260709 12:11:21.890126 17846 catalog_manager.cc:5697] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 6 to 8, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 8 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:21.884608 18062 leader_election.cc:304] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:11:21.873365 21996 consensus_meta.cc:287] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.548s	user 0.010s	sys 0.010s
I20260709 12:11:21.864845 22252 raft_consensus.cc:515] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:21.894376 22230 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:21.846657 22097 consensus_queue.cc:1059] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:11:21.876211 21924 raft_consensus.cc:2749] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931) with higher term. Message: Invalid argument: T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 9. Current term is 10.
I20260709 12:11:21.889781 22002 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
W20260709 12:11:21.920846 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 51569.7us
I20260709 12:11:21.922603 17914 leader_election.cc:304] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:21.930982 18017 raft_consensus.cc:1240] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 9. Current term is 10. Ops: [9.10-9.10]
W20260709 12:11:21.931876 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 93207.2us
I20260709 12:11:21.907517 22299 raft_consensus.cc:2749] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:21.918274 22307 log.cc:927] Time spent T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 12:11:21.908397 22297 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:21.930588 17846 catalog_manager.cc:5697] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 7 to 8, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 8 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:21.915810 21883 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:21.927556 22002 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:21.948096 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:21.950146 17945 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 14.
W20260709 12:11:21.952591 18608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.907284 22254 consensus_queue.cc:1048] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:11:21.941242 21908 raft_consensus.cc:2804] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:21.956662 21937 raft_consensus.cc:3055] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:21.972654 18022 raft_consensus.cc:2410] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:11:21.959833 22074 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:21.959897 22071 consensus_queue.cc:1059] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.089s
W20260709 12:11:21.960405 22310 log.cc:927] Time spent T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 12:11:21.960685 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:21.960790 22268 consensus_queue.cc:1048] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:21.957001 17846 catalog_manager.cc:5697] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 4 to 7, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 7 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:21.961555 21924 consensus_queue.cc:1048] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:11:21.962963 22308 log.cc:927] Time spent T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.204s	user 0.004s	sys 0.000s
W20260709 12:11:21.966934 22311 log.cc:927] Time spent T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.238s	user 0.004s	sys 0.000s
W20260709 12:11:21.966795 17847 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45912 (request call id 380) took 31377 ms (client timeout 15000 ms). Trace:
I20260709 12:11:21.967465 21979 consensus_queue.cc:1048] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:11:21.967350 21883 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:11:21.967355 17990 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:21.970049 18607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:21.973876 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 51370.1us
W20260709 12:11:21.997006 18607 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:21.919713 21996 raft_consensus.cc:515] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:21.926030 22283 raft_consensus.cc:515] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:21.945210 22298 raft_consensus.cc:2749] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:21.995245 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 110675us
I20260709 12:11:21.973436 22070 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:21.975261 21908 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.007356 17914 leader_election.cc:304] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:21.975447 21937 raft_consensus.cc:740] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:22.003027 17846 catalog_manager.cc:5697] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 6 to 9, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 9 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:22.015306 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:22.019748 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:22.022569 18638 raft_consensus.cc:2410] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:11:21.995203 22161 raft_consensus.cc:2749] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647) with higher term. Message: Invalid argument: T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 13. Current term is 14.
I20260709 12:11:22.023805 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:22.017671 21908 raft_consensus.cc:3060] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:22.044409 18023 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 14.
I20260709 12:11:22.041714 17846 catalog_manager.cc:5697] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 5 to 9, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 9 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:22.053630 22277 raft_consensus.cc:3055] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:22.053874 18636 raft_consensus.cc:1240] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:22.054280 22277 raft_consensus.cc:740] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:22.055622 22277 consensus_queue.cc:260] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:22.056315 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:22.057233 22277 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:22.010021 22074 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:22.069983 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 59192.9us
W20260709 12:11:22.075626 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 77820.8us
I20260709 12:11:22.090782 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:22.091363 18093 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:53954
I20260709 12:11:22.093997 22161 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.094739 22161 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:22.097254 22161 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:22.102964 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:22.077329 17846 catalog_manager.cc:5697] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 8 to 11, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 11 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
W20260709 12:11:22.110248 22279 log.cc:927] Time spent T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 12:11:22.115092 18019 raft_consensus.cc:1275] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 12:11:21.994127 17847 rpcz_store.cc:269] 0709 12:10:50.609553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:50.671074 (+ 61521us) service_pool.cc:224] Handling call
0709 12:11:21.892603 (+31221529us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:14.723336 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:14.829131 (+105795us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:14.829177 (+    46us) write_op.cc:435] Acquired schema lock
0709 12:11:14.829194 (+    17us) tablet.cc:662] Decoding operations
0709 12:11:15.022866 (+193672us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:15.022946 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:15.022971 (+    25us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:11:15.024111 (+  1140us) tablet.cc:701] Row locks acquired
0709 12:11:15.024164 (+    53us) write_op.cc:260] PREPARE: finished
0709 12:11:15.024339 (+   175us) write_op.cc:270] Start()
0709 12:11:15.024472 (+   133us) write_op.cc:276] Timestamp: P: 1783599075024277 usec, L: 0
0709 12:11:15.024493 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:11:15.025160 (+   667us) log.cc:844] Serialized 5221 byte log entry
0709 12:11:15.517884 (+492724us) op_driver.cc:464] REPLICATION: finished
0709 12:11:15.946878 (+428994us) write_op.cc:301] APPLY: starting
0709 12:11:15.947003 (+   125us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:15.947349 (+   346us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:15.947512 (+   163us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:16.296655 (+349143us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:16.311135 (+ 14480us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 12:11:16.311188 (+    53us) write_op.cc:312] APPLY: finished
0709 12:11:16.311601 (+   413us) log.cc:844] Serialized 95 byte log entry
0709 12:11:16.311804 (+   203us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:16.311944 (+   140us) write_op.cc:454] Released schema lock
0709 12:11:16.312015 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:16.312400 (+   385us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:16.312426 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4138376,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":362789,"apply.run_cpu_time_us":5781,"apply.run_wall_time_us":365548,"num_ops":13,"prepare.queue_time_us":204419,"prepare.run_cpu_time_us":24070,"prepare.run_wall_time_us":462166,"raft.queue_time_us":212100,"raft.run_cpu_time_us":63887,"raft.run_wall_time_us":276810,"replication_time_us":479533,"thread_start_us":585825,"threads_started":4,"wal-append.queue_time_us":153510,"wal-append.run_cpu_time_us":17121,"wal-append.run_wall_time_us":2138982}]]}
I20260709 12:11:22.118889 22062 raft_consensus.cc:2804] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:22.119030 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:22.119383 22062 raft_consensus.cc:493] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:22.119822 22062 raft_consensus.cc:3060] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:22.120393 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:22.121145 17948 raft_consensus.cc:2393] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 8: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:22.121901 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:22.123086 22322 raft_consensus.cc:2804] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:22.123646 22322 raft_consensus.cc:697] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 10 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:22.124378 17846 catalog_manager.cc:5697] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 7 to 8, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 8 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
W20260709 12:11:22.125846 22318 log.cc:927] Time spent T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:11:22.126078 17846 catalog_manager.cc:5697] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 8 to 9, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 9 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:22.128407 17846 catalog_manager.cc:5697] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 7 to 10, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 10 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:22.129900 17846 catalog_manager.cc:5697] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 5 to 8, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 8 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:22.124646 22322 consensus_queue.cc:237] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:22.142975 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:11:22.149747 22321 log.cc:927] Time spent T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:11:22.155553 22062 raft_consensus.cc:515] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:22.157760 22062 leader_election.cc:290] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:22.159672 21996 leader_election.cc:290] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:11:22.163296 22314 log.cc:927] Time spent T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 12:11:22.168517 21883 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:11:22.175118 22287 log.cc:927] Time spent T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 12:11:22.178123 22074 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:22.180436 18608 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:22.181289 22071 consensus_queue.cc:1059] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:22.182289 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:22.182619 22125 raft_consensus.cc:3055] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:22.183097 22125 raft_consensus.cc:740] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:22.184101 22125 consensus_queue.cc:260] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:22.185099 21909 leader_election.cc:290] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:22.185274 22125 raft_consensus.cc:3060] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:22.143801 22252 leader_election.cc:290] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:22.194160 22283 leader_election.cc:290] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:22.197140 17846 catalog_manager.cc:5697] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
W20260709 12:11:22.149838 22315 log.cc:927] Time spent T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:11:22.201340 18093 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:22.205516 18093 raft_consensus.cc:3060] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:22.199714 17846 catalog_manager.cc:5697] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 4 to 7, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 7 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:22.220198 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
W20260709 12:11:22.220595 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 50193.5us
I20260709 12:11:22.220983 18642 raft_consensus.cc:2368] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 9. Current term is 10.
I20260709 12:11:22.227744 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:11:22.230831 22324 log.cc:927] Time spent T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:11:22.182305 22071 raft_consensus.cc:2749] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:22.238786 17846 catalog_manager.cc:5697] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 6 to 9, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 9 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:22.246248 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:22.250376 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:22.251591 21909 consensus_queue.cc:1048] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:22.251962 17988 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:22.252763 22074 raft_consensus.cc:2749] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:22.253443 17846 catalog_manager.cc:5697] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 3 to 10, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 10 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:22.241854 22284 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.262553 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:22.267729 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:22.268298 18642 raft_consensus.cc:2468] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
W20260709 12:11:22.269026 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 133841us
W20260709 12:11:22.271828 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 241886us
I20260709 12:11:22.275904 17913 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:22.267031 17846 catalog_manager.cc:5697] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:22.258989 21909 consensus_queue.cc:1048] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:11:22.375047 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:22.375103 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:22.375764 18094 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 14.
I20260709 12:11:22.377370 17846 catalog_manager.cc:5697] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 5 to 7, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 7 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:22.379673 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:22.376359 21979 raft_consensus.cc:2749] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:22.379292 22074 consensus_queue.cc:1048] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
W20260709 12:11:22.381419 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 105636us
I20260709 12:11:22.271406 22284 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:22.393092 17846 catalog_manager.cc:5697] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:22.395632 17913 leader_election.cc:304] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:22.382100 17988 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:22.397213 18093 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:11:22.422109 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 45938.5us
I20260709 12:11:22.422541 18089 raft_consensus.cc:1275] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:11:22.428023 22074 raft_consensus.cc:2749] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:22.406205 17846 catalog_manager.cc:5697] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 7 to 9, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 9 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:22.380357 22293 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:22.431361 17988 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:22.432371 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:22.433202 18089 raft_consensus.cc:3060] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:22.434916 21937 consensus_queue.cc:260] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:22.435747 17846 catalog_manager.cc:5697] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 4 to 10, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 10 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:22.439230 22002 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:22.440671 18098 raft_consensus.cc:1240] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:22.442207 22002 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:22.432246 21979 raft_consensus.cc:2749] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:22.459208 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 65680.8us
I20260709 12:11:22.436287 21937 raft_consensus.cc:3060] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:22.467029 17913 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:22.464280 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:22.471385 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:22.455229 21924 raft_consensus.cc:2749] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:22.472922 22283 raft_consensus.cc:2749] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:22.500943 18089 raft_consensus.cc:2468] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 9.
I20260709 12:11:22.503875 22284 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:22.504700 18094 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:22.510916 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:22.512590 17946 raft_consensus.cc:1275] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:11:22.515196 17988 leader_election.cc:304] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:22.519861 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
W20260709 12:11:22.514806 22230 consensus_meta.cc:287] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 0.585s	user 0.008s	sys 0.003s
W20260709 12:11:22.524080 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 44958.7us
I20260709 12:11:22.526751 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:22.466370 22293 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:22.530284 22002 consensus_queue.cc:1048] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:22.531096 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:22.531482 22164 raft_consensus.cc:2749] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:22.531994 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:22.547535 17940 raft_consensus.cc:2410] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 12:11:22.534240 22330 log.cc:927] Time spent T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.435s	user 0.012s	sys 0.009s
I20260709 12:11:22.544041 18094 raft_consensus.cc:1275] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:22.544278 17914 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:11:22.551681 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:22.552803 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:22.555799 18024 raft_consensus.cc:2393] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 10: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:22.555349 17914 leader_election.cc:304] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:11:22.557086 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:22.557690 17947 raft_consensus.cc:2468] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 7.
I20260709 12:11:22.565718 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:22.528863 22230 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:22.556953 22284 raft_consensus.cc:2804] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:22.582470 22284 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.569203 18608 leader_election.cc:304] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:22.578841 22333 consensus_queue.cc:1048] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:11:22.582918 22284 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:22.580274 22071 raft_consensus.cc:493] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:22.580693 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
W20260709 12:11:22.582055 21908 consensus_meta.cc:287] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110: Time spent flushing consensus metadata: real 0.507s	user 0.011s	sys 0.000s
I20260709 12:11:22.579404 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:22.561336 22062 raft_consensus.cc:2804] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:22.596145 17913 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:22.599013 22071 raft_consensus.cc:515] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:22.599646 18016 raft_consensus.cc:1275] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:11:22.600644 22271 log.cc:927] Time spent T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.561s	user 0.000s	sys 0.011s
I20260709 12:11:22.601293 22071 leader_election.cc:290] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:22.602006 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:22.556833 22283 consensus_queue.cc:1048] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:11:22.607395 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:22.614228 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:22.615159 18024 raft_consensus.cc:2393] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 15: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:22.612723 18015 raft_consensus.cc:2468] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 11.
I20260709 12:11:22.623214 17988 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:22.626494 17988 leader_election.cc:304] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:22.567108 21883 consensus_queue.cc:1048] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
W20260709 12:11:22.631319 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 67099.2us
I20260709 12:11:22.587330 22070 raft_consensus.cc:2749] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:22.642939 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 46905.2us
I20260709 12:11:22.646627 22327 raft_consensus.cc:2804] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:22.647115 22327 raft_consensus.cc:493] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:22.647539 22327 raft_consensus.cc:3060] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:22.634756 22268 raft_consensus.cc:2749] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:22.602919 21908 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:22.649396 17913 leader_election.cc:304] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:22.650133 22128 raft_consensus.cc:2749] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:22.667912 18608 leader_election.cc:304] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:22.671597 22230 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 15 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:22.685912 17913 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:22.687399 17913 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:22.679689 22062 raft_consensus.cc:697] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:22.703181 18090 raft_consensus.cc:1240] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:11:22.679731 22333 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:22.689018 22074 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
W20260709 12:11:22.695072 22319 log.cc:927] Time spent T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.619s	user 0.000s	sys 0.012s
I20260709 12:11:22.710916 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:22.721632 18097 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:22.743659 22339 log.cc:927] Time spent T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:11:22.745075 22062 consensus_queue.cc:237] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:22.749380 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 81550.8us
I20260709 12:11:22.750314 18608 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:11:22.751230 22340 log.cc:927] Time spent T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:11:22.742426 22333 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:22.752753 22347 consensus_queue.cc:1048] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:11:22.753387 21883 raft_consensus.cc:2804] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:22.753785 21883 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:22.754117 21883 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:22.758931 22283 raft_consensus.cc:2749] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:22.706449 22128 raft_consensus.cc:2749] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:22.721273 22125 raft_consensus.cc:2749] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:22.765981 22071 raft_consensus.cc:2749] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:22.754551 18636 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60412 (request call id 1125) took 1621 ms. Trace:
I20260709 12:11:22.720885 22293 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:22.783429 22074 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:22.831350 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 144028us
I20260709 12:11:23.000955 22283 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:23.012615 22283 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:23.014492 22074 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:23.015117 18061 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.16.98.196:43647 timed out after 1.699s (SENT) [suppressed 13 similar messages]
I20260709 12:11:23.015334 22293 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:23.016891 22128 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:23.017500 18609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.017468 22128 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:23.018992 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:23.019428 18608 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:23.020081 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:23.021456 18091 raft_consensus.cc:1240] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:23.022841 18095 raft_consensus.cc:1240] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:23.022877 21971 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.003643 21908 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:22.754518 22333 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:23.016202 22293 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:22.893217 22341 log.cc:927] Time spent T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
W20260709 12:11:23.039245 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 342084us
I20260709 12:11:23.026679 18636 rpcz_store.cc:276] 0709 12:11:21.137328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.272402 (+135074us) service_pool.cc:224] Handling call
0709 12:11:21.273170 (+   768us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:22.054517 (+781347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:22.754312 (+699795us) spinlock_profiling.cc:243] Waited 759 ms on lock 0x7b5400790254. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:11:22.754477 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1745612160}
I20260709 12:11:23.047148 18097 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 15.
I20260709 12:11:23.053032 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:23.041177 22283 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:23.031818 22322 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:23.076165 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:23.077004 18023 raft_consensus.cc:2468] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 11.
I20260709 12:11:23.077787 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:23.025199 21971 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:23.050297 22070 raft_consensus.cc:2749] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:23.076090 21999 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:23.080253 17989 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:23.098944 21924 raft_consensus.cc:2804] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:23.098898 21999 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:23.099618 21924 raft_consensus.cc:697] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 15 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:23.101044 21999 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:23.101861 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:23.084822 21883 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:23.086767 22322 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:23.088501 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:23.103631 18020 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:23.092904 22284 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:23.048712 22327 raft_consensus.cc:515] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:23.111218 17949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50334 (request call id 2415) took 1226 ms. Trace:
I20260709 12:11:23.100688 21924 consensus_queue.cc:237] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:23.083205 22331 consensus_queue.cc:1048] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:11:23.118625 18097 raft_consensus.cc:2393] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 12: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:23.111730 17949 rpcz_store.cc:276] 0709 12:11:21.891226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:21.891340 (+   114us) service_pool.cc:224] Handling call
0709 12:11:21.916169 (+ 24829us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:22.060840 (+144671us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:22.060886 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:22.060942 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:11:22.060994 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.102107 (+1041113us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54003e6054. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:11:23.102147 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:23.102249 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":285380480}
I20260709 12:11:23.120688 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:23.122859 17948 raft_consensus.cc:1240] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:11:23.123005 22125 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:23.128551 22125 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:23.130762 22125 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:23.135954 22327 leader_election.cc:290] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:23.139904 22284 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 15 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:23.142205 22322 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:23.143570 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 49159.8us
I20260709 12:11:23.144392 17987 leader_election.cc:400] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Vote denied by peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647) with higher term. Message: Invalid argument: T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 9. Current term is 10.
I20260709 12:11:23.145282 17987 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:23.148804 21883 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:23.156054 18093 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:23.156558 18093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:53954 (request call id 2516) took 1065 ms. Trace:
I20260709 12:11:23.156656 21909 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:23.156880 18093 rpcz_store.cc:276] 0709 12:11:22.090983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.091151 (+   168us) service_pool.cc:224] Handling call
0709 12:11:23.154994 (+1063843us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54001b4c54. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9a9a3d 00007f7f51979cd0 00007f7f4aefe254 00007f7f4aefe1e2 00007f7f4aefe111 00007f7f4aefe08c 00007f7f4aefd342 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:23.156462 (+  1468us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":250782080}
I20260709 12:11:23.157249 21909 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:23.164656 22336 log.cc:927] Time spent T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.738s	user 0.003s	sys 0.000s
I20260709 12:11:23.168349 21971 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:23.169293 22118 raft_consensus.cc:493] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:23.169819 22118 raft_consensus.cc:515] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:23.172720 22128 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:23.146440 17987 leader_election.cc:304] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:23.124635 17912 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:11:23.184188 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 59665.2us
I20260709 12:11:23.182178 17987 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:23.185900 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:23.187914 22164 raft_consensus.cc:2749] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:23.191071 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:23.192196 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:23.192509 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:23.192822 17948 raft_consensus.cc:2393] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 15: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:23.193535 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:23.193625 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:23.194283 18095 raft_consensus.cc:2393] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 15: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:23.197885 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:23.181830 22322 raft_consensus.cc:493] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:23.200203 18098 raft_consensus.cc:1275] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:23.200531 22322 raft_consensus.cc:515] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:23.182857 22006 raft_consensus.cc:2749] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:23.212414 22283 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:23.213073 22283 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:23.216836 18019 raft_consensus.cc:1275] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:23.221724 22331 raft_consensus.cc:493] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:23.222287 22331 raft_consensus.cc:515] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:23.190539 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:11:23.227495 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 45422us
I20260709 12:11:23.228560 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:23.228834 17987 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:23.235340 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
W20260709 12:11:23.245167 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 60094.4us
I20260709 12:11:23.246074 17912 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:23.245064 18020 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 12.
I20260709 12:11:23.250267 17987 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:23.251662 17912 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:23.252847 17912 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:23.258327 18642 raft_consensus.cc:1275] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:23.255429 22326 consensus_queue.cc:1059] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:11:23.259334 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:23.259964 22326 raft_consensus.cc:3055] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:23.260299 22326 raft_consensus.cc:740] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:23.261294 22326 consensus_queue.cc:260] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:23.262880 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:23.263371 18098 raft_consensus.cc:1240] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:23.263918 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:23.264899 22328 consensus_queue.cc:1059] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:11:23.265756 22328 raft_consensus.cc:3055] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:23.266129 22328 raft_consensus.cc:740] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:23.266950 22328 consensus_queue.cc:260] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:23.268334 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:23.266975 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:23.202556 22322 leader_election.cc:290] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:23.272729 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 254104us
I20260709 12:11:23.274117 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:23.262465 22326 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:23.294530 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 279415us
I20260709 12:11:23.224566 22331 leader_election.cc:290] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:23.293294 18062 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:23.243299 22006 raft_consensus.cc:2749] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:23.320007 22322 raft_consensus.cc:2804] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:23.320550 22322 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:23.321000 22322 raft_consensus.cc:3060] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:23.323439 22002 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.324100 22002 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:23.328264 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.251037 22347 raft_consensus.cc:2749] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:23.329469 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 53577.8us
I20260709 12:11:23.268249 22328 raft_consensus.cc:3060] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:23.338449 22348 raft_consensus.cc:3060] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.342832 22094 raft_consensus.cc:2804] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:23.343344 22094 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:23.343742 22094 raft_consensus.cc:3060] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:23.346915 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:23.338450 21999 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:23.348253 21999 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:23.350312 21999 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:23.347532 22331 consensus_queue.cc:1059] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:23.363509 22331 raft_consensus.cc:3055] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:23.363848 22331 raft_consensus.cc:740] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:23.364161 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: true dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:23.364728 22331 consensus_queue.cc:260] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:23.365950 22331 raft_consensus.cc:3060] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:23.332855 22128 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:23.369292 22347 consensus_queue.cc:1048] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:23.369485 22128 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:23.369848 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:23.353369 18608 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:23.371658 22128 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:23.335947 18020 raft_consensus.cc:1275] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:23.373813 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:23.374083 21971 raft_consensus.cc:2749] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:23.374472 18636 raft_consensus.cc:2468] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 10.
I20260709 12:11:23.375891 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:23.355320 18609 leader_election.cc:304] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:23.378247 22125 raft_consensus.cc:2749] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:23.378883 22125 consensus_queue.cc:1059] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:23.356024 21937 consensus_queue.cc:1059] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:23.380079 22125 consensus_queue.cc:1059] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:23.380301 21937 raft_consensus.cc:3055] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:23.380757 21937 raft_consensus.cc:740] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:23.381006 22125 raft_consensus.cc:3055] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:23.381389 22125 raft_consensus.cc:740] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:23.381680 21937 consensus_queue.cc:260] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:23.382227 22125 consensus_queue.cc:260] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:23.383384 22347 consensus_queue.cc:1059] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:23.384232 22125 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:23.385326 21999 raft_consensus.cc:3055] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:23.385829 21999 raft_consensus.cc:740] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:23.386797 21999 consensus_queue.cc:260] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:23.297354 22136 raft_consensus.cc:2749] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:23.270320 21979 raft_consensus.cc:2749] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:23.389084 21999 raft_consensus.cc:3060] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:23.394819 18061 leader_election.cc:304] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:23.396706 17949 raft_consensus.cc:1240] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 LEADER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:23.397667 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:23.403192 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:23.405898 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:23.406489 18637 raft_consensus.cc:2468] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 12.
I20260709 12:11:23.407531 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:23.337669 22268 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.400059 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:23.419281 22268 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:23.420049 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:23.420265 18017 raft_consensus.cc:2468] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 9.
I20260709 12:11:23.413693 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:23.421397 22268 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:23.414697 18641 raft_consensus.cc:2468] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 15.
I20260709 12:11:23.394896 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:11:23.415714 18610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.415967 21909 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:23.416291 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:23.416953 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:23.417371 21937 raft_consensus.cc:3060] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:23.423485 18098 raft_consensus.cc:2393] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 10: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
W20260709 12:11:23.415207 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 139079us
I20260709 12:11:23.397714 22002 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:23.450606 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:23.451162 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:23.453593 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:23.458986 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:23.413803 22164 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:23.460366 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:23.463727 22164 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:23.464202 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:23.466033 22164 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:23.467316 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:23.467797 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:23.468079 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:23.468389 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:23.469188 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:23.471262 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:23.471936 18024 raft_consensus.cc:2393] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 12: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:23.443737 21908 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:23.478237 17913 leader_election.cc:304] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:23.479869 17913 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:23.474259 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:23.507707 18021 raft_consensus.cc:2468] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 10.
I20260709 12:11:23.443961 22333 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:23.515219 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:23.536108 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:11:23.533715 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 57559.7us
I20260709 12:11:23.450603 22331 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:23.459617 22002 raft_consensus.cc:2749] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:23.543139 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:23.539891 17987 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
W20260709 12:11:23.544751 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 64962us
I20260709 12:11:23.548693 17913 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:23.551141 22128 raft_consensus.cc:2749] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:23.552670 22322 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:23.553534 22128 raft_consensus.cc:2749] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:23.545876 22333 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:23.556357 22333 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:23.556857 22333 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:23.557339 22333 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:23.548699 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:23.562897 22322 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:23.564173 22333 leader_election.cc:290] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:23.565263 22348 raft_consensus.cc:2749] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:23.565943 17949 raft_consensus.cc:2468] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 10.
I20260709 12:11:23.575378 22136 raft_consensus.cc:2804] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:23.575933 22136 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:23.576406 22136 raft_consensus.cc:3060] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:23.577664 18643 raft_consensus.cc:1275] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:11:23.579327 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:23.580883 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:23.581961 17987 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:23.583616 22074 raft_consensus.cc:2804] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:23.583979 22074 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:23.584344 22074 raft_consensus.cc:3060] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:23.587384 17987 leader_election.cc:304] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:11:23.611896 18092 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.006s	sys 0.012s
W20260709 12:11:23.612380 18092 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.006s	sys 0.012s
W20260709 12:11:23.617278 17835 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.011s	sys 0.007s
W20260709 12:11:23.617671 17835 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.011s	sys 0.007s
I20260709 12:11:23.544085 21909 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:23.617990 22161 raft_consensus.cc:2749] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:23.516270 21908 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:23.652127 17940 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.004s	sys 0.017s
W20260709 12:11:23.654052 17940 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.004s	sys 0.017s
I20260709 12:11:23.656163 22356 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:23.672276 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.616078 22331 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:23.712559 22356 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:23.750262 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:11:23.758565 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.759332 18023 raft_consensus.cc:2468] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 11.
I20260709 12:11:23.626335 22094 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:23.628116 21909 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:23.768229 18637 raft_consensus.cc:2393] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 15: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:23.797776 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:23.739302 22002 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:23.801018 18095 raft_consensus.cc:2393] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 12: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:23.824062 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:23.826969 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:23.769107 22361 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:23.870590 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:23.894454 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:23.895236 18093 raft_consensus.cc:2393] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 15: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:23.889357 22361 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:23.942759 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:23.947640 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:23.948282 18023 raft_consensus.cc:3060] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:23.951041 17914 leader_election.cc:304] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:23.956066 18090 raft_consensus.cc:1275] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 15 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 12:11:23.958828 18639 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.004s	sys 0.040s
W20260709 12:11:23.981570 18639 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.004s	sys 0.040s
I20260709 12:11:23.893144 22283 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:23.983785 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:23.985755 17912 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:23.904183 22293 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:23.832943 22002 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:23.993498 17912 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:23.996416 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:11:24.024928 17942 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.014s	sys 0.018s
W20260709 12:11:24.030673 17942 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.015s	sys 0.019s
I20260709 12:11:24.030789 18644 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 12.
I20260709 12:11:23.981227 22097 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:23.984506 22347 raft_consensus.cc:2749] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:24.036028 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 487353us
W20260709 12:11:24.044812 18020 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.007s	sys 0.030s
W20260709 12:11:24.059500 18020 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.007s	sys 0.030s
I20260709 12:11:24.076846 18023 raft_consensus.cc:2468] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 12.
I20260709 12:11:24.067327 22283 raft_consensus.cc:2749] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:24.072134 22322 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.040681 22368 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:24.041217 21883 raft_consensus.cc:2804] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:24.090523 17945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2359) took 1055 ms. Trace:
I20260709 12:11:24.091224 22349 raft_consensus.cc:2749] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:24.089372 22363 log.cc:927] Time spent T 00000000000000000000000000000000 P b852ae4791e4401b8356c71ae33bbc7d: Append to log took a long time: real 0.142s	user 0.003s	sys 0.000s
I20260709 12:11:24.092696 21979 raft_consensus.cc:2749] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:24.090112 21908 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:24.102358 18061 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.023s	sys 0.018s
W20260709 12:11:24.108667 18061 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.024s	sys 0.018s
W20260709 12:11:24.109477 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 714683us
I20260709 12:11:24.110594 18062 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:24.111058 18061 leader_election.cc:304] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:24.099395 17945 rpcz_store.cc:276] 0709 12:11:23.035563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.035728 (+   165us) service_pool.cc:224] Handling call
0709 12:11:23.047013 (+ 11285us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:23.060931 (+ 13918us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:23.060960 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:23.097634 (+ 36674us) log.cc:844] Serialized 52 byte log entry
0709 12:11:23.541110 (+443476us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:24.049742 (+508632us) log.cc:844] Serialized 14 byte log entry
0709 12:11:24.090112 (+ 40370us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.090211 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:24.090263 (+    52us) raft_consensus.cc:1685] finished
0709 12:11:24.090283 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.090445 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40643,"prepare.queue_time_us":414814,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":3889,"raft.queue_time_us":67708,"raft.run_cpu_time_us":44,"raft.run_wall_time_us":45,"thread_start_us":828895,"threads_started":2,"wal-append.queue_time_us":703789}
I20260709 12:11:24.097239 22331 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:24.097400 22118 leader_election.cc:290] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:24.059505 22097 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:24.145025 18610 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.007s	sys 0.018s
W20260709 12:11:24.174211 18610 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.007s	sys 0.018s
W20260709 12:11:24.175542 18610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.051548 22293 consensus_queue.cc:1048] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.094s
I20260709 12:11:24.094946 22322 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:24.139132 22094 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:24.201707 17940 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.005s	sys 0.014s
I20260709 12:11:24.228652 17944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50336 (request call id 2358) took 1207 ms. Trace:
W20260709 12:11:24.229663 17940 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.005s	sys 0.015s
I20260709 12:11:24.200265 17942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50334 (request call id 2438) took 1180 ms. Trace:
I20260709 12:11:24.108738 22368 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:24.246953 17835 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 1.215s	user 0.012s	sys 0.008s
I20260709 12:11:24.143718 21908 consensus_queue.cc:1048] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 12:11:24.192960 22331 raft_consensus.cc:2749] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:24.202258 21999 consensus_meta.cc:287] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 0.785s	user 0.004s	sys 0.007s
I20260709 12:11:24.251636 18608 leader_election.cc:304] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:24.196413 22377 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:24.216037 22369 log.cc:927] Time spent T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
W20260709 12:11:24.297770 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 240602us
I20260709 12:11:24.204473 22333 raft_consensus.cc:2749] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:11:24.319382 17913 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:24.202863 22062 raft_consensus.cc:493] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
W20260709 12:11:24.320314 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 326895us
I20260709 12:11:24.326853 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:24.216889 21909 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:24.236827 17942 rpcz_store.cc:276] 0709 12:11:23.019663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.025676 (+  6013us) service_pool.cc:224] Handling call
0709 12:11:23.044527 (+ 18851us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:23.044705 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:23.415572 (+370867us) log.cc:844] Serialized 14 byte log entry
0709 12:11:24.199860 (+784288us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:24.199925 (+    65us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:24.199986 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.200070 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.200199 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12473,"prepare.queue_time_us":659185,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":58934,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":7166,"thread_start_us":1072007,"threads_started":3,"wal-append.queue_time_us":770123}
W20260709 12:11:24.341248 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:24.253443 22364 log.cc:927] Time spent T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.106s	user 0.001s	sys 0.001s
I20260709 12:11:24.229122 17944 rpcz_store.cc:276] 0709 12:11:23.021583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.038007 (+ 16424us) service_pool.cc:224] Handling call
0709 12:11:23.049429 (+ 11422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:23.062562 (+ 13133us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:11:23.709352 (+646790us) log.cc:844] Serialized 14 byte log entry
0709 12:11:24.202603 (+493251us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:24.202680 (+    77us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:11:24.202733 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.228441 (+ 25708us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.228594 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":659903,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":9852,"thread_start_us":788950,"threads_started":2}
I20260709 12:11:24.372897 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:24.374002 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:24.375396 17948 raft_consensus.cc:1275] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 15 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:11:24.254173 22002 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:24.234740 22361 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:24.141985 22356 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:24.393112 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 282191us
W20260709 12:11:24.393985 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.394547 18061 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:24.347976 22353 raft_consensus.cc:493] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:24.411482 18061 leader_election.cc:304] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:24.368300 22118 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:24.367945 22070 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.418819 18061 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
W20260709 12:11:24.404335 22371 log.cc:927] Time spent T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.407s	user 0.001s	sys 0.001s
I20260709 12:11:24.423053 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:24.424731 17945 raft_consensus.cc:2468] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 8.
I20260709 12:11:24.422257 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:11:24.421044 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 279482us
I20260709 12:11:24.427292 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:24.426553 18062 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:24.432909 18638 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60424 (request call id 1128) took 1061 ms. Trace:
I20260709 12:11:24.428498 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:24.416980 22331 raft_consensus.cc:2749] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:24.343755 22377 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:24.382359 22062 raft_consensus.cc:515] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:24.430930 22070 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:24.447444 22070 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:24.433292 18638 rpcz_store.cc:276] 0709 12:11:23.371897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.375701 (+  3804us) service_pool.cc:224] Handling call
0709 12:11:23.375998 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:23.376391 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:23.376416 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:23.376801 (+   385us) log.cc:844] Serialized 26 byte log entry
0709 12:11:23.709309 (+332508us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:23.709350 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.710123 (+   773us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:24.432706 (+722583us) raft_consensus.cc:1685] finished
0709 12:11:24.432725 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.432852 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1707,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"spinlock_wait_cycles":8576,"thread_start_us":332154,"threads_started":1,"wal-append.queue_time_us":659121}
I20260709 12:11:24.411509 21971 consensus_queue.cc:1048] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:11:24.452710 18644 raft_consensus.cc:2468] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
I20260709 12:11:24.457127 18092 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53964 (request call id 2046) took 1698 ms. Trace:
I20260709 12:11:24.458374 18092 rpcz_store.cc:276] 0709 12:11:22.753457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:22.769330 (+ 15873us) service_pool.cc:224] Handling call
0709 12:11:23.002028 (+232698us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:23.037396 (+ 35368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:23.037431 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:23.049035 (+ 11604us) log.cc:844] Serialized 26 byte log entry
0709 12:11:23.612776 (+563741us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:11:23.612814 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.613002 (+   188us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:24.451704 (+838702us) raft_consensus.cc:1685] finished
0709 12:11:24.451726 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.451868 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7408,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":75,"thread_start_us":518537,"threads_started":1,"wal-append.queue_time_us":703412}
I20260709 12:11:24.458802 22002 raft_consensus.cc:2749] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:24.462342 22376 log.cc:927] Time spent T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 12:11:24.463352 22386 log.cc:927] Time spent T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:11:24.464521 17947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50334 (request call id 2431) took 1446 ms. Trace:
W20260709 12:11:24.465601 21937 consensus_meta.cc:287] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent flushing consensus metadata: real 1.016s	user 0.009s	sys 0.001s
I20260709 12:11:24.464885 17947 rpcz_store.cc:276] 0709 12:11:23.017664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.024585 (+  6921us) service_pool.cc:224] Handling call
0709 12:11:23.024920 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:23.540889 (+515969us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:23.540936 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:23.586922 (+ 45986us) log.cc:844] Serialized 26 byte log entry
0709 12:11:24.034818 (+447896us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:24.034859 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.034922 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:24.464303 (+429381us) raft_consensus.cc:1685] finished
0709 12:11:24.464330 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.464460 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":60929,"raft.run_cpu_time_us":61,"raft.run_wall_time_us":61,"thread_start_us":852288,"threads_started":2,"wal-append.queue_time_us":577662}
I20260709 12:11:24.466097 18642 raft_consensus.cc:2468] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 10.
W20260709 12:11:24.478891 22373 log.cc:927] Time spent T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:11:24.422269 22353 raft_consensus.cc:515] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:24.453509 17912 leader_election.cc:304] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:11:24.497923 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 44487.5us
I20260709 12:11:24.444316 22391 raft_consensus.cc:2749] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:24.460745 22378 raft_consensus.cc:2804] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:24.522061 18641 raft_consensus.cc:2468] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 9.
I20260709 12:11:24.502446 21908 raft_consensus.cc:2804] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:24.502705 22399 raft_consensus.cc:2749] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:24.523629 18639 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60424 (request call id 1129) took 1151 ms. Trace:
I20260709 12:11:24.519340 22353 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:24.459231 22331 consensus_queue.cc:1048] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:11:24.519887 22097 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:24.525233 18639 rpcz_store.cc:276] 0709 12:11:23.372170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.372278 (+   108us) service_pool.cc:224] Handling call
0709 12:11:23.372574 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:23.372937 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:23.372962 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:23.373466 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 12:11:23.981991 (+608525us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:23.982030 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:23.982103 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:24.523416 (+541313us) raft_consensus.cc:1685] finished
0709 12:11:24.523440 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.523575 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1854,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":608123,"threads_started":1,"wal-append.queue_time_us":872842}
I20260709 12:11:24.524750 21908 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:24.525071 22322 leader_election.cc:290] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:24.528085 22378 raft_consensus.cc:697] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 15 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
W20260709 12:11:24.545989 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 127273us
W20260709 12:11:24.546567 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 120149us
I20260709 12:11:24.527935 22402 raft_consensus.cc:493] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
W20260709 12:11:24.552525 22401 log.cc:927] Time spent T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:11:24.552249 22402 raft_consensus.cc:515] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:24.554455 22402 leader_election.cc:290] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:24.549690 18062 leader_election.cc:304] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:24.552356 22283 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:24.555745 22378 consensus_queue.cc:237] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:24.556314 22283 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:24.558440 22283 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:24.559084 22393 log.cc:927] Time spent T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 12:11:24.560355 18018 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45464 (request call id 2159) took 1108 ms. Trace:
I20260709 12:11:24.560772 18018 rpcz_store.cc:276] 0709 12:11:23.452180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.452285 (+   105us) service_pool.cc:224] Handling call
0709 12:11:23.613748 (+161463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:23.624422 (+ 10674us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:23.624451 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:23.707226 (+ 82775us) log.cc:844] Serialized 26 byte log entry
0709 12:11:24.126352 (+419126us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:24.126414 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.126512 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:24.558502 (+431990us) raft_consensus.cc:1685] finished
0709 12:11:24.558523 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.560041 (+  1518us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b540005fad0. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b18ad 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:24.560248 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":91,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":2494,"spinlock_wait_cycles":347703168,"thread_start_us":381894,"threads_started":1,"wal-append.queue_time_us":786650}
I20260709 12:11:24.531596 22353 raft_consensus.cc:493] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:24.563004 22353 raft_consensus.cc:515] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:24.549830 18061 leader_election.cc:304] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:24.564471 22402 raft_consensus.cc:2749] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:24.565119 22377 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:24.565651 22377 raft_consensus.cc:2804] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:24.566102 22377 raft_consensus.cc:697] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:24.566875 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:24.570247 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:24.570094 18062 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
W20260709 12:11:24.568953 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 617076us
W20260709 12:11:24.573376 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.547673 21908 raft_consensus.cc:3060] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:24.574963 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:24.577890 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:24.565665 22353 leader_election.cc:290] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:24.582006 18095 raft_consensus.cc:1240] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:11:24.583869 18062 leader_election.cc:304] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:24.585783 18062 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:24.581125 22403 raft_consensus.cc:2804] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:24.609198 22403 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:24.609688 22403 raft_consensus.cc:3060] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:24.582707 22002 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:24.577860 22322 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:24.631603 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:24.643185 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:24.643826 18018 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 11.
I20260709 12:11:24.583756 22368 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:24.659134 18019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53022 (request call id 781) took 1440 ms. Trace:
I20260709 12:11:24.661262 22410 raft_consensus.cc:2749] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:24.615064 22377 consensus_queue.cc:237] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:24.643947 22353 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:24.680565 22353 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:24.682614 22399 raft_consensus.cc:493] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:24.683240 22399 raft_consensus.cc:515] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:24.661036 21979 raft_consensus.cc:493] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:24.684446 22353 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:24.684625 21979 raft_consensus.cc:515] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:24.643754 22322 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:24.685698 18020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 2306) took 1292 ms. Trace:
I20260709 12:11:24.685361 22399 leader_election.cc:290] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:24.714253 17940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50334 (request call id 2433) took 1696 ms. Trace:
I20260709 12:11:24.721314 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:24.723153 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:24.721982 17940 rpcz_store.cc:276] 0709 12:11:23.018220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.037936 (+ 19716us) service_pool.cc:224] Handling call
0709 12:11:23.049855 (+ 11919us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:23.661404 (+611549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:23.662059 (+   655us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:23.669179 (+  7120us) log.cc:844] Serialized 26 byte log entry
0709 12:11:24.230112 (+560933us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:11:24.316333 (+ 86221us) log.cc:844] Serialized 14 byte log entry
0709 12:11:24.347756 (+ 31423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.348165 (+   409us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:24.714009 (+365844us) raft_consensus.cc:1685] finished
0709 12:11:24.714036 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.714184 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35787,"prepare.queue_time_us":89084,"prepare.run_wall_time_us":49,"raft.queue_time_us":72666,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":15191,"spinlock_wait_cycles":13556992,"thread_start_us":1167179,"threads_started":2,"wal-append.queue_time_us":950633}
W20260709 12:11:24.723866 18610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.697098 22062 leader_election.cc:290] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:24.724597 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:24.725606 18636 raft_consensus.cc:2393] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 12: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:11:24.727531 22409 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.710634 22331 raft_consensus.cc:493] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:24.728186 22409 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:24.728410 22331 raft_consensus.cc:515] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:24.731526 22410 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:24.663313 22006 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:24.733109 22409 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:24.668341 22412 raft_consensus.cc:2804] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:24.732211 22410 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:24.734181 22412 raft_consensus.cc:697] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:24.711285 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:24.735822 18023 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 14.
I20260709 12:11:24.708204 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:24.737252 18024 raft_consensus.cc:2468] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 11.
I20260709 12:11:24.732782 22006 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:24.636428 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 384849us
W20260709 12:11:24.693540 22074 consensus_meta.cc:287] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 1.109s	user 0.006s	sys 0.004s
W20260709 12:11:24.703673 22136 consensus_meta.cc:287] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb: Time spent flushing consensus metadata: real 1.127s	user 0.012s	sys 0.002s
I20260709 12:11:24.745774 18608 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:24.764087 18608 leader_election.cc:304] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:24.764964 22368 raft_consensus.cc:2749] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:24.659643 18019 rpcz_store.cc:276] 0709 12:11:23.223461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.223749 (+   288us) service_pool.cc:224] Handling call
0709 12:11:23.224044 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:23.224261 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:23.536242 (+311981us) log.cc:844] Serialized 14 byte log entry
0709 12:11:24.563317 (+1027075us) spinlock_profiling.cc:243] Waited 9.09 ms on lock 0x7b1800499240. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f4983fc0a 00007f7f52f7f219 00007f7f498c7a40 00007f7f498c24e4 00007f7f498c2455 00007f7f4c9aa060 00007f7f4c9bc716 00007f7f4c9cd287 00007f7f4c9cd208
0709 12:11:24.564880 (+  1563us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b1800499240. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f5278dab1 00007f7f5279a281 00007f7f498c53f3 00007f7f498c77c1 00007f7f498c7779 00007f7f498c7709 00007f7f498c76d1 00007f7f498c69cd 0000000000388634 0000000000388479 00007f7f498a883a
0709 12:11:24.658793 (+ 93913us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:24.658852 (+    59us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:24.658902 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.658972 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.659085 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61110,"prepare.queue_time_us":679745,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":655965,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":65147008,"thread_start_us":670455,"threads_started":3,"wal-append.queue_time_us":1013372}
W20260709 12:11:24.767241 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 190888us
I20260709 12:11:24.769943 22368 raft_consensus.cc:493] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:24.770460 22368 raft_consensus.cc:515] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:24.772670 22368 leader_election.cc:290] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:24.774416 22161 consensus_queue.cc:1048] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:24.766497 18608 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:24.778205 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:24.779114 18095 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 14.
I20260709 12:11:24.779320 18608 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:24.780046 22359 raft_consensus.cc:2749] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:24.780802 22359 raft_consensus.cc:2749] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:24.781773 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:24.782585 18095 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 10.
I20260709 12:11:24.784003 18022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 2301) took 1723 ms. Trace:
I20260709 12:11:24.720386 18020 rpcz_store.cc:276] 0709 12:11:23.393404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.393514 (+   110us) service_pool.cc:224] Handling call
0709 12:11:23.409690 (+ 16176us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:23.446660 (+ 36970us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:11:24.060149 (+613489us) log.cc:844] Serialized 14 byte log entry
0709 12:11:24.607898 (+547749us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:24.608520 (+   622us) log.cc:844] Serialized 26 byte log entry
0709 12:11:24.608709 (+   189us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:11:24.608757 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.608846 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:24.685440 (+ 76594us) raft_consensus.cc:1685] finished
0709 12:11:24.685467 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.685620 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":194872,"prepare.queue_time_us":644683,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":2242,"raft.queue_time_us":256164,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":4925,"thread_start_us":824863,"threads_started":2,"wal-append.queue_time_us":418626}
W20260709 12:11:24.760982 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 175251us
I20260709 12:11:24.660071 22002 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:24.761487 21908 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:24.791265 18062 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:24.833101 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:24.839689 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:24.793632 22118 raft_consensus.cc:2749] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:24.847801 22006 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:24.792285 18022 rpcz_store.cc:276] 0709 12:11:23.060936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.074209 (+ 13273us) service_pool.cc:224] Handling call
0709 12:11:23.096674 (+ 22465us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:11:23.104558 (+  7884us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:23.104597 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:11:23.125969 (+ 21372us) log.cc:844] Serialized 52 byte log entry
0709 12:11:23.672657 (+546688us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:24.107060 (+434403us) log.cc:844] Serialized 14 byte log entry
0709 12:11:24.783619 (+676559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.783716 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:24.783769 (+    53us) raft_consensus.cc:1685] finished
0709 12:11:24.783787 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.783936 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":500357,"prepare.queue_time_us":546903,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":513771,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":18105,"thread_start_us":1135970,"threads_started":3,"wal-append.queue_time_us":807032}
W20260709 12:11:24.848265 18641 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60430 (request call id 1034) took 1312 ms (client timeout 1647 ms). Trace:
I20260709 12:11:24.789319 22406 raft_consensus.cc:2804] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:24.831637 22359 raft_consensus.cc:493] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.831310 21979 leader_election.cc:290] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:24.850948 18016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45464 (request call id 2169) took 1383 ms. Trace:
I20260709 12:11:24.852380 18095 raft_consensus.cc:1275] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:24.854460 17947 raft_consensus.cc:2393] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 8: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:24.854779 18643 raft_consensus.cc:1275] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:11:24.857452 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:24.857863 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:24.851851 17989 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:24.858656 18092 raft_consensus.cc:1240] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:24.788516 22062 raft_consensus.cc:493] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:24.829042 22402 raft_consensus.cc:493] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:24.857406 18641 rpcz_store.cc:269] 0709 12:11:23.535852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.535977 (+   125us) service_pool.cc:224] Handling call
0709 12:11:24.848050 (+1312073us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b54006cf7d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:24.848181 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1779167616}
I20260709 12:11:24.868372 17835 maintenance_manager.cc:643] P b852ae4791e4401b8356c71ae33bbc7d: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 8.261s	user 0.167s	sys 0.060s Metrics: {"bytes_written":29323,"cfile_init":1,"dirs.queue_time_us":259404,"dirs.run_cpu_time_us":586,"dirs.run_wall_time_us":30265,"drs_written":1,"lbm_read_time_us":6613,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":3,"lbm_write_time_us":202813,"lbm_writes_10-100_ms":8,"lbm_writes_lt_1ms":22,"peak_mem_usage":0,"raft.queue_time_us":96931,"raft.run_cpu_time_us":10682,"raft.run_wall_time_us":235967,"rows_written":63,"thread_start_us":745319,"threads_started":3,"wal-append.queue_time_us":758149}
I20260709 12:11:24.794556 22399 raft_consensus.cc:493] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:24.791500 22368 raft_consensus.cc:493] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:24.832008 22331 leader_election.cc:290] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:24.910876 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:24.911525 18024 raft_consensus.cc:2468] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
I20260709 12:11:24.912184 22062 raft_consensus.cc:515] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:24.915994 18642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60412 (request call id 1141) took 1465 ms. Trace:
I20260709 12:11:24.916123 22398 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
W20260709 12:11:24.916796 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 152923us
I20260709 12:11:24.864869 22410 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:24.858603 22406 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.843005 22419 raft_consensus.cc:2804] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:24.855207 22161 raft_consensus.cc:493] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:24.918071 22331 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:24.860141 18016 rpcz_store.cc:276] 0709 12:11:23.467706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.469224 (+  1518us) service_pool.cc:224] Handling call
0709 12:11:23.469502 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:23.469678 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:11:23.780120 (+310442us) log.cc:844] Serialized 14 byte log entry
0709 12:11:24.850657 (+1070537us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:11:24.850703 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:24.850745 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.850799 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:24.850899 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":397097,"prepare.queue_time_us":677939,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":428605,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"thread_start_us":1001740,"threads_started":3,"wal-append.queue_time_us":632173}
I20260709 12:11:24.919041 22398 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:24.920416 22331 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:24.789767 22136 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:24.870919 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:24.788482 22074 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:24.922418 22331 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:24.923148 22074 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:24.910882 22368 raft_consensus.cc:515] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:24.876528 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:24.924500 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:24.925107 18640 raft_consensus.cc:2468] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 10.
I20260709 12:11:24.925379 22368 leader_election.cc:290] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:24.876932 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:24.877543 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:24.926951 18019 raft_consensus.cc:2468] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 8.
I20260709 12:11:24.878527 22322 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:24.880153 18643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60430 (request call id 1038) took 1298 ms. Trace:
I20260709 12:11:24.881484 18018 raft_consensus.cc:1240] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:24.871583 22359 raft_consensus.cc:515] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:24.882058 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:24.882273 21883 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:24.929225 18643 rpcz_store.cc:276] 0709 12:11:23.581950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.582061 (+   111us) service_pool.cc:224] Handling call
0709 12:11:24.852782 (+1270721us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:24.860773 (+  7991us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:24.879969 (+ 19196us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54006cf7d0. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b18ad 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:24.880092 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2921790208}
I20260709 12:11:24.932400 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:24.839262 22412 consensus_queue.cc:237] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:24.883975 22002 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:24.884379 18020 raft_consensus.cc:1240] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:24.885887 22248 raft_consensus.cc:3055] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:24.920086 22419 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:24.933403 22248 raft_consensus.cc:740] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:24.933713 22419 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.934319 22248 consensus_queue.cc:260] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:24.934796 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:24.935235 22359 leader_election.cc:290] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:24.935339 22248 raft_consensus.cc:3060] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:24.935555 18016 raft_consensus.cc:2393] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 11: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:24.935747 18636 raft_consensus.cc:2376] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 10. Re-sending same reply.
I20260709 12:11:24.937304 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:24.919191 22161 raft_consensus.cc:515] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:24.886981 22418 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:24.889935 22391 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:24.939714 22418 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:24.939802 22391 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:24.940564 22161 leader_election.cc:290] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:24.941057 21883 raft_consensus.cc:3060] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:24.941840 22418 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:24.887848 22416 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:24.942015 22391 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:24.879681 22403 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:24.897423 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2753b334cd624cd290d57dacd79d8edc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:11:24.899910 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 48168.7us
I20260709 12:11:24.900545 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:24.942471 22416 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:24.891861 22071 consensus_queue.cc:1048] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:24.945778 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:24.902760 22377 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:24.903434 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:24.903926 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:24.904458 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:24.904487 22402 raft_consensus.cc:515] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:24.960395 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:24.906833 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:24.908134 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:24.908485 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:24.908607 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:24.916371 18642 rpcz_store.cc:276] 0709 12:11:23.450265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:23.450378 (+   113us) service_pool.cc:224] Handling call
0709 12:11:24.915842 (+1465464us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54005447d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b62fa 00007f7f51977b17 00007f7f4aef26d4 00007f7f4aef2662 00007f7f4aef2591 00007f7f4aef250c 00007f7f4aef17c2 00007f7f4aced48c 00007f7f4acec8c6 00007f7f4acec26f
0709 12:11:24.915938 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2333698432}
I20260709 12:11:24.925928 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:24.928319 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:24.922359 22406 raft_consensus.cc:3060] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:24.938375 22381 consensus_queue.cc:1048] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:24.961032 17989 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:24.938349 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:24.959959 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:24.905602 22421 raft_consensus.cc:2804] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:24.970072 18641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:24.962061 18015 raft_consensus.cc:2410] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for term 12 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:11:24.975735 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:11:24.976404 18063 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:24.895856 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:24.962452 17946 raft_consensus.cc:2468] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 12.
I20260709 12:11:24.977041 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:24.965346 18639 raft_consensus.cc:2393] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 11: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:11:24.959831 22377 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:24.979739 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:24.980316 17942 raft_consensus.cc:2468] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 12.
I20260709 12:11:24.980926 22377 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:24.983232 22416 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:24.983479 22421 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:24.983929 17836 maintenance_manager.cc:419] P b852ae4791e4401b8356c71ae33bbc7d: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10653 bytes on disk
I20260709 12:11:24.996752 18024 raft_consensus.cc:1240] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:24.982548 22403 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:24.991550 22356 raft_consensus.cc:2804] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:25.002668 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:25.003023 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:24.918720 22399 raft_consensus.cc:515] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:24.950452 22349 raft_consensus.cc:493] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:24.998036 17987 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:25.025935 17912 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:25.040210 22283 raft_consensus.cc:2804] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:25.040709 22283 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:25.041066 22283 raft_consensus.cc:3060] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:25.043176 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:24.983944 22421 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:25.040215 21908 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:25.046242 22062 leader_election.cc:290] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:25.047493 22402 leader_election.cc:290] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:25.048732 22419 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:25.049968 18097 raft_consensus.cc:2410] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db for term 12 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:11:25.050141 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:25.025360 18640 raft_consensus.cc:2376] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 9. Re-sending same reply.
I20260709 12:11:25.028052 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:25.067028 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:25.104894 18638 raft_consensus.cc:2468] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 12.
I20260709 12:11:25.097815 17835 maintenance_manager.cc:643] P b852ae4791e4401b8356c71ae33bbc7d: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.106s	user 0.001s	sys 0.001s Metrics: {"cfile_init":1,"lbm_read_time_us":430,"lbm_reads_lt_1ms":4}
W20260709 12:11:25.106441 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 108497us
I20260709 12:11:25.108080 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:11:25.108072 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 81592.2us
I20260709 12:11:25.105887 17914 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:25.106748 18021 raft_consensus.cc:2468] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 11.
I20260709 12:11:25.121121 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:25.121843 18089 raft_consensus.cc:2393] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 12: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:25.123188 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:25.123943 18090 raft_consensus.cc:2468] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 12.
I20260709 12:11:25.125347 18094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:25.126406 22248 raft_consensus.cc:3060] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:25.127120 22419 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:25.128146 18098 raft_consensus.cc:1240] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 LEADER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:25.131487 17989 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:25.134579 18062 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:25.135579 18062 leader_election.cc:304] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:25.138578 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:11:25.140090 18610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.107148 22416 raft_consensus.cc:3060] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.148006 18062 leader_election.cc:304] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:25.149632 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:25.152415 22322 raft_consensus.cc:2749] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:25.153959 22421 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:25.156345 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:25.145236 21924 raft_consensus.cc:2804] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:25.157454 21924 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:25.157800 21924 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.158340 22398 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:25.161746 17987 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.149945 18062 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:25.162883 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:25.164619 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:25.164793 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:25.168519 18022 raft_consensus.cc:1240] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 15 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:11:25.169984 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:25.170866 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:25.172061 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:25.172935 18021 raft_consensus.cc:2393] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 8: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:25.167347 18062 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:25.172655 17947 raft_consensus.cc:2468] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 11.
I20260709 12:11:25.173936 22381 consensus_queue.cc:1059] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:11:25.177675 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:25.178377 22381 raft_consensus.cc:3055] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:25.178540 18638 raft_consensus.cc:2393] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 12: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:25.178861 22381 raft_consensus.cc:740] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:25.179695 22381 consensus_queue.cc:260] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:25.180814 22381 raft_consensus.cc:3060] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.174082 22402 raft_consensus.cc:2804] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:25.183122 22402 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:25.183562 22402 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:25.185108 22362 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:25.185629 22362 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:11:25.187806 22362 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:25.187837 22423 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:25.188499 22423 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:25.192186 22094 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:25.192873 22094 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:11:25.194875 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 46016.6us
I20260709 12:11:25.204272 22406 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:25.211043 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:25.155942 22421 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 15 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:25.209956 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:25.217662 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:25.215639 17988 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:25.220810 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:25.190501 22423 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:11:25.222796 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 55568.8us
I20260709 12:11:25.136174 22349 raft_consensus.cc:515] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:25.225065 17988 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:25.228839 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:25.229723 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:25.238384 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:25.226070 18062 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:11:25.251045 18062 leader_election.cc:304] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:11:25.251842 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:25.255128 22002 raft_consensus.cc:2804] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:25.281601 22002 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:25.281548 21924 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:25.282335 22002 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:25.275007 22136 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:25.274803 22268 raft_consensus.cc:2749] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:25.224365 22328 consensus_queue.cc:1048] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 12:11:25.283847 21924 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:25.269230 21883 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:25.286350 21883 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:25.224247 22074 raft_consensus.cc:493] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:25.255419 22399 leader_election.cc:290] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:25.240496 22398 raft_consensus.cc:493] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:25.228662 22164 raft_consensus.cc:2749] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:25.260886 18097 raft_consensus.cc:1240] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 8. Current term is 9. Ops: []
I20260709 12:11:25.261940 22419 raft_consensus.cc:2804] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:25.227134 21908 raft_consensus.cc:2749] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:25.287346 18023 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 11.
I20260709 12:11:25.293529 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
W20260709 12:11:25.309135 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 58137.8us
I20260709 12:11:25.322501 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee9612b75b8d458dab1e3d254afae227" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:25.327952 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:25.329913 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:25.334743 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:25.336098 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffcd5906663d452ca5003ea36d28164f" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:25.337931 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:25.341306 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:25.345216 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:25.328014 22333 raft_consensus.cc:2804] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:25.364049 22333 raft_consensus.cc:493] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:25.364456 22333 raft_consensus.cc:3060] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:25.364657 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:25.309725 22074 raft_consensus.cc:515] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:25.367946 22074 leader_election.cc:290] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:25.371637 18062 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:25.373279 22248 raft_consensus.cc:2749] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:25.266619 22283 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:25.375281 22283 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:25.376058 17948 raft_consensus.cc:2393] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 9: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:25.377511 22412 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:25.377998 22412 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:25.379642 22406 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:25.379916 22412 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:25.380456 22412 raft_consensus.cc:2749] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:25.351794 22071 consensus_queue.cc:1059] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:11:25.382141 22416 raft_consensus.cc:2749] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:25.382620 22368 raft_consensus.cc:3055] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:25.383028 22368 raft_consensus.cc:740] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:25.270128 22402 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:25.357493 17987 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:25.359052 18061 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:25.324807 22356 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:25.362447 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:25.351276 22391 raft_consensus.cc:493] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.354547 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:25.388707 18098 raft_consensus.cc:2468] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 9.
I20260709 12:11:25.390791 22402 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:25.390820 22391 raft_consensus.cc:515] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:25.393453 22391 leader_election.cc:290] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:25.394428 18095 raft_consensus.cc:2368] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 12. Current term is 13.
I20260709 12:11:25.394474 17914 leader_election.cc:304] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:25.395668 17914 leader_election.cc:304] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:25.396652 22002 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:25.397574 22347 raft_consensus.cc:3060] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:25.397672 18096 raft_consensus.cc:1240] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:25.398811 21883 raft_consensus.cc:2749] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:25.400250 22349 leader_election.cc:290] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:25.341241 22398 raft_consensus.cc:515] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:25.402479 22398 leader_election.cc:290] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:25.402973 21908 raft_consensus.cc:2804] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:25.403360 21908 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:25.403710 21908 raft_consensus.cc:3060] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:25.404045 17913 leader_election.cc:304] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:25.405241 17913 leader_election.cc:304] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:25.406235 17913 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:25.388309 22409 consensus_queue.cc:1059] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 12:11:25.407577 22409 consensus_queue.cc:1243] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer 4813437da0a74e65b61eb7bd1d18f110 log is divergent from this leader: its last log entry 12.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:11:25.408136 22409 raft_consensus.cc:3055] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:25.408432 22409 raft_consensus.cc:740] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:25.408768 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:25.409310 18642 raft_consensus.cc:3060] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:25.409202 22409 consensus_queue.cc:260] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:25.410380 22409 raft_consensus.cc:3060] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.412701 22399 consensus_queue.cc:1059] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:25.387408 18091 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 14.
I20260709 12:11:25.414197 22002 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:25.414706 22062 raft_consensus.cc:2749] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:25.415125 21979 raft_consensus.cc:2749] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:25.417475 22419 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:25.417589 22333 raft_consensus.cc:515] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:25.421890 18642 raft_consensus.cc:2468] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 9.
I20260709 12:11:25.422959 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:11:25.423215 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 65839.1us
I20260709 12:11:25.423938 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:11:25.423457 18608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.425196 18061 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:25.427178 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:25.429147 17913 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:11:25.429149 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 47481.2us
I20260709 12:11:25.439543 17912 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:25.387991 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:25.389164 22356 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:25.441279 18061 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:25.441737 18608 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:25.442551 18062 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:25.446916 18061 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:11:25.449209 17914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.449257 18024 raft_consensus.cc:1275] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:25.424877 22136 raft_consensus.cc:2749] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:25.455006 17913 leader_election.cc:304] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:25.456795 18062 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:25.430596 22432 raft_consensus.cc:2749] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:25.466037 18089 raft_consensus.cc:2368] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 12. Current term is 13.
I20260709 12:11:25.466089 17989 leader_election.cc:400] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 election: Vote denied by peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931) with higher term. Message: Invalid argument: T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 12. Current term is 13.
I20260709 12:11:25.432801 22248 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.464596 18061 leader_election.cc:304] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:25.467108 17989 leader_election.cc:403] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:11:25.437472 22419 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:25.466475 17913 leader_election.cc:304] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:25.475987 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:25.453603 22412 raft_consensus.cc:2804] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:25.482394 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:25.461418 22359 raft_consensus.cc:2764] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:11:25.488333 22406 raft_consensus.cc:493] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.466709 22397 raft_consensus.cc:2804] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:25.503450 22397 raft_consensus.cc:697] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:25.504355 22347 raft_consensus.cc:2749] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:25.504539 22402 raft_consensus.cc:2749] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:25.476980 22362 raft_consensus.cc:3060] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:25.476864 22377 raft_consensus.cc:2749] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:25.480854 22322 raft_consensus.cc:2804] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:25.434374 22391 consensus_queue.cc:1059] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 12:11:25.517668 22322 raft_consensus.cc:697] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:25.518869 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:25.518739 22322 consensus_queue.cc:237] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:25.520573 21909 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:25.484205 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:25.461638 22353 raft_consensus.cc:2749] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:25.483068 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:25.529063 17987 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:25.533978 17945 raft_consensus.cc:2393] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 12: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:25.487025 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:25.484831 22412 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:25.483599 22062 raft_consensus.cc:2749] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:25.462383 22403 raft_consensus.cc:2749] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:11:25.453802 22002 raft_consensus.cc:2749] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:25.480909 22248 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:25.430753 22368 consensus_queue.cc:260] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:25.500176 22333 leader_election.cc:290] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:25.500635 21908 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:25.522307 22094 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:25.541224 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:25.538072 17987 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:25.551218 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:25.571762 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:25.581590 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:25.582116 17943 raft_consensus.cc:3060] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:11:25.582335 17945 raft_consensus.cc:1275] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:11:25.583636 17942 raft_consensus.cc:1275] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 15 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:25.572893 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48619849881f46989095c1f3642592b7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:25.584599 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:25.585852 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:25.574127 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:25.586721 17948 raft_consensus.cc:2393] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 12: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:25.573503 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:25.575218 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75266a6e976c41a99e22b9d7d7a2cd65" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:25.587221 18021 raft_consensus.cc:3060] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:25.588287 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 50301.3us
I20260709 12:11:25.536092 22412 raft_consensus.cc:3060] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:25.488796 22406 raft_consensus.cc:515] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:25.592051 17940 raft_consensus.cc:1240] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 6. Current term is 7. Ops: []
I20260709 12:11:25.589183 17987 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:25.593132 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:25.597713 17988 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:25.599920 22136 raft_consensus.cc:2749] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:25.550853 22404 log.cc:927] Time spent T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.067s	user 0.000s	sys 0.004s
I20260709 12:11:25.616158 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:25.546996 22161 raft_consensus.cc:2749] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:25.602425 17914 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:11:25.616403 17988 leader_election.cc:304] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:25.638597 17943 raft_consensus.cc:2468] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 13.
I20260709 12:11:25.603820 22381 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:11:25.639801 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 198159us
W20260709 12:11:25.641059 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 178446us
I20260709 12:11:25.644946 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:25.604154 22094 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:25.615828 22164 raft_consensus.cc:2749] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:25.504386 22397 consensus_queue.cc:237] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:25.655915 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c726e58f614fbdab58f22a7da00365" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:25.657100 17988 leader_election.cc:304] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:25.650861 18097 raft_consensus.cc:1240] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:25.622453 22368 raft_consensus.cc:3060] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:25.659255 22398 raft_consensus.cc:3055] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:25.659643 22398 raft_consensus.cc:740] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
W20260709 12:11:25.671808 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 207325us
I20260709 12:11:25.672518 18061 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:25.672154 18608 leader_election.cc:304] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:25.601416 22419 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:25.651434 22349 raft_consensus.cc:2804] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:25.617147 22331 consensus_queue.cc:1048] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
W20260709 12:11:25.705605 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 48591.1us
I20260709 12:11:25.706315 18608 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:25.629149 22402 consensus_queue.cc:1048] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 12:11:25.712697 18608 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:25.651727 22442 raft_consensus.cc:2749] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:11:25.691334 22423 raft_consensus.cc:2749] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:25.728209 18092 raft_consensus.cc:1240] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 15 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 14. Current term is 15. Ops: []
I20260709 12:11:25.730542 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:25.706877 22349 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:25.658609 22381 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:25.732161 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 70060.6us
I20260709 12:11:25.737176 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae30b26b2734033a87c3e1ba937a39f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:25.724315 22377 raft_consensus.cc:2804] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:25.708639 22445 raft_consensus.cc:2749] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:25.751623 18018 raft_consensus.cc:1240] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Rejecting Update request from peer 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:25.687217 22094 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:25.756192 22381 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:25.736820 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 95757.9us
I20260709 12:11:25.723042 22328 raft_consensus.cc:2749] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:25.751808 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:25.742848 22349 raft_consensus.cc:3060] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:25.758884 22248 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:25.761770 22356 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:25.762633 22368 raft_consensus.cc:2749] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:25.722525 22359 consensus_queue.cc:1059] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:11:25.764052 22359 raft_consensus.cc:3055] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:25.764472 22359 raft_consensus.cc:740] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:25.765501 22359 consensus_queue.cc:260] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:25.767241 22377 raft_consensus.cc:697] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 12 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:25.763007 22097 consensus_queue.cc:1059] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:25.768431 22377 consensus_queue.cc:237] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:25.771384 22359 raft_consensus.cc:3060] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:25.742856 22161 consensus_queue.cc:1059] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:11:25.778766 22349 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:11:25.749195 21909 raft_consensus.cc:2749] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931) with higher term. Message: Invalid argument: T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 12. Current term is 13.
I20260709 12:11:25.781600 22349 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:25.784303 21971 raft_consensus.cc:3055] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:25.784811 21971 raft_consensus.cc:740] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
W20260709 12:11:25.792469 22443 log.cc:927] Time spent T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 12:11:25.803431 22406 leader_election.cc:290] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:25.804164 22406 raft_consensus.cc:3055] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:25.804569 22406 raft_consensus.cc:740] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:25.805137 22398 consensus_queue.cc:260] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:25.806216 22398 raft_consensus.cc:3060] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:25.805589 22406 consensus_queue.cc:260] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:25.728694 22403 consensus_queue.cc:1048] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
W20260709 12:11:25.815691 22441 log.cc:927] Time spent T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:11:25.817494 22006 raft_consensus.cc:3055] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:11:25.817868 22006 raft_consensus.cc:740] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:25.818001 22419 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 15 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:25.734377 22449 raft_consensus.cc:2749] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:25.818761 22006 consensus_queue.cc:260] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:25.819926 22006 raft_consensus.cc:3060] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:25.827730 18021 raft_consensus.cc:2468] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 9.
I20260709 12:11:25.785889 21971 consensus_queue.cc:260] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:25.833025 21908 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:25.836097 22362 raft_consensus.cc:2749] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:25.836968 21971 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:25.814538 22094 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:25.843199 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:25.843747 18016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:25.844393 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:25.844967 18018 raft_consensus.cc:2468] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 10.
I20260709 12:11:25.851051 17945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:25.853561 18062 leader_election.cc:304] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
W20260709 12:11:25.854578 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 217192us
W20260709 12:11:25.851066 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 200740us
I20260709 12:11:25.856662 17914 leader_election.cc:304] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:25.865337 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:25.870589 18644 raft_consensus.cc:2393] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 11: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:11:25.884277 17914 leader_election.cc:400] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931) with higher term. Message: Invalid argument: T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 12. Current term is 13.
I20260709 12:11:25.884763 17914 leader_election.cc:403] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:11:25.884903 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 161106us
I20260709 12:11:25.886123 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:25.888168 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:25.888504 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:25.888336 17913 leader_election.cc:304] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:25.889036 18090 raft_consensus.cc:3060] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:25.893088 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 49461.9us
W20260709 12:11:25.896552 17988 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.896736 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:25.897784 17913 leader_election.cc:304] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:25.871071 22331 raft_consensus.cc:2804] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:25.903990 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:25.902168 18635 raft_consensus.cc:1275] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 15 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:25.906695 18644 raft_consensus.cc:2468] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 9.
I20260709 12:11:25.904726 18640 raft_consensus.cc:2468] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 12.
I20260709 12:11:25.907280 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:25.891924 22062 raft_consensus.cc:2749] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:25.892102 22349 raft_consensus.cc:2749] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931) with higher term. Message: Invalid argument: T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 12. Current term is 13.
I20260709 12:11:25.909694 18636 raft_consensus.cc:2393] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 11: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:11:25.916146 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
W20260709 12:11:25.919689 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 247232us
W20260709 12:11:25.925076 18610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:25.900152 21979 raft_consensus.cc:2749] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:25.944314 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:25.950966 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:25.955873 18024 raft_consensus.cc:2393] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 15: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:25.956027 18016 raft_consensus.cc:1275] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 12:11:25.956702 18608 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:25.909963 22331 raft_consensus.cc:697] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:25.909127 22283 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
W20260709 12:11:25.961244 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 225313us
I20260709 12:11:25.964246 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:25.970383 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:25.971087 18020 raft_consensus.cc:3060] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:25.976820 18097 raft_consensus.cc:1240] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:25.948804 22423 raft_consensus.cc:493] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:25.985498 18021 raft_consensus.cc:2468] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 13.
I20260709 12:11:25.987146 18608 leader_election.cc:304] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:25.978453 18061 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:26.014896 18062 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:25.992918 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:25.964704 22451 raft_consensus.cc:2749] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:25.998495 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:25.990944 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c29a91be76451a9328d8cd9e3eecab" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:25.961763 22248 raft_consensus.cc:2749] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:26.038206 22460 raft_consensus.cc:2804] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:26.008365 22406 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:26.010344 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:25.997848 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:26.046936 17941 raft_consensus.cc:3060] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:26.051268 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 307306us
I20260709 12:11:26.058784 18062 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:26.057737 17989 leader_election.cc:304] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:26.016227 18021 raft_consensus.cc:1240] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:26.020474 18020 raft_consensus.cc:2468] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 11.
I20260709 12:11:25.956091 18017 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "137ed415b9d242989f28f349c1618c74"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:44098
I20260709 12:11:25.978487 22283 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:25.990788 22412 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:25.993490 22423 raft_consensus.cc:515] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:26.040720 22356 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:26.042632 22331 consensus_queue.cc:237] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:26.044267 18090 raft_consensus.cc:2468] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 10.
I20260709 12:11:26.022413 17987 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:11:26.028082 22459 log.cc:927] Time spent T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:11:26.022461 17944 raft_consensus.cc:2393] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 13: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
W20260709 12:11:26.061269 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 74244.8us
I20260709 12:11:25.995069 22333 consensus_queue.cc:1048] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.063s
W20260709 12:11:26.035339 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 56940us
I20260709 12:11:26.050590 22449 raft_consensus.cc:2749] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:26.075603 17989 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:26.116813 17914 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
W20260709 12:11:26.125838 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 103506us
I20260709 12:11:26.126449 18608 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:26.116775 18017 raft_consensus.cc:606] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
W20260709 12:11:26.117949 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 211404us
I20260709 12:11:26.054488 22460 raft_consensus.cc:697] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:26.061570 22456 consensus_queue.cc:1048] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
I20260709 12:11:26.061058 22402 raft_consensus.cc:2749] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:26.109773 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 212059us
I20260709 12:11:26.128093 18017 raft_consensus.cc:614] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:26.137622 17913 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:26.073534 22002 raft_consensus.cc:2804] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:11:26.140467 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 64974.3us
I20260709 12:11:26.107971 22466 raft_consensus.cc:2749] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:26.150813 22356 consensus_queue.cc:1059] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:26.153674 22327 raft_consensus.cc:3055] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:26.154026 22327 raft_consensus.cc:740] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:26.155138 18090 raft_consensus.cc:1240] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:26.154841 22327 consensus_queue.cc:260] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:26.155946 22327 raft_consensus.cc:3060] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:26.170150 22469 log.cc:927] Time spent T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:11:26.133630 22442 raft_consensus.cc:2749] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:26.147368 22328 raft_consensus.cc:2749] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:26.170849 22473 raft_consensus.cc:2749] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:11:26.171916 22412 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:26.142397 22359 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.136178 22419 consensus_queue.cc:1059] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:11:26.143200 22452 raft_consensus.cc:2804] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:26.138254 21971 raft_consensus.cc:2749] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:26.173447 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:26.211002 18020 raft_consensus.cc:3060] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:26.176137 18021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
mode: GRACEFUL
new_leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:44098
I20260709 12:11:26.213351 18021 raft_consensus.cc:606] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Received request to transfer leadership to TS e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:26.213675 18021 raft_consensus.cc:614] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:26.163445 22460 consensus_queue.cc:237] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:26.184037 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:26.185156 17941 raft_consensus.cc:2468] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 11.
I20260709 12:11:26.186420 18643 raft_consensus.cc:2468] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 13.
I20260709 12:11:26.188611 22283 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:26.136390 18608 leader_election.cc:304] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:11:26.221421 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 85094.7us
I20260709 12:11:26.222303 21971 raft_consensus.cc:2749] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:26.222404 18608 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:26.223512 21971 raft_consensus.cc:2804] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:26.223987 21971 raft_consensus.cc:697] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:26.224550 18644 raft_consensus.cc:1275] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 12:11:26.224817 21971 consensus_queue.cc:237] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:26.225750 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:26.226927 18021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
mode: GRACEFUL
new_leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:44098
I20260709 12:11:26.227480 18021 raft_consensus.cc:606] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Received request to transfer leadership to TS e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:26.227793 18021 raft_consensus.cc:614] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:26.228142 18640 raft_consensus.cc:1275] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:11:26.229068 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:26.232482 22136 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.232972 22136 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:26.247049 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:26.247632 18643 raft_consensus.cc:3060] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:26.189968 22002 raft_consensus.cc:697] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 13 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:26.252640 18016 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
mode: GRACEFUL
new_leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:44098
I20260709 12:11:26.252704 22002 consensus_queue.cc:237] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:26.255543 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:26.256273 18640 raft_consensus.cc:3060] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:26.268126 18061 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:26.269603 22402 raft_consensus.cc:2804] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:26.270247 22402 raft_consensus.cc:697] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:26.271440 22402 consensus_queue.cc:237] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:26.275419 22136 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:26.193300 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 52059.7us
I20260709 12:11:26.201686 17913 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:26.282855 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
W20260709 12:11:26.283233 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 81599.3us
I20260709 12:11:26.284613 17913 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:11:26.203805 22467 log.cc:927] Time spent T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:11:26.203392 22359 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:26.205886 22419 raft_consensus.cc:3055] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:26.206301 22452 raft_consensus.cc:697] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:26.288295 18020 raft_consensus.cc:2468] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 11.
I20260709 12:11:26.304076 18061 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:11:26.304454 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 298583us
I20260709 12:11:26.306366 18642 raft_consensus.cc:1275] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:26.296077 18643 raft_consensus.cc:2468] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 13.
I20260709 12:11:26.308656 17988 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:26.309013 18015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:26.309710 18609 leader_election.cc:304] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:26.312927 18062 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:26.307015 18608 leader_election.cc:304] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:26.299229 22419 raft_consensus.cc:740] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
W20260709 12:11:26.335352 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 49396.4us
I20260709 12:11:26.311962 22322 raft_consensus.cc:2749] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:11:26.324816 22333 raft_consensus.cc:2804] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:26.329234 22368 raft_consensus.cc:2749] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:26.317775 21883 raft_consensus.cc:2764] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:11:26.324635 22094 raft_consensus.cc:2749] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:26.306787 22377 consensus_queue.cc:1048] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 12:11:26.342871 18016 raft_consensus.cc:606] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Received request to transfer leadership to TS e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:26.343876 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:26.347239 18089 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 12.
I20260709 12:11:26.346467 18016 raft_consensus.cc:614] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:26.317114 22412 consensus_queue.cc:1048] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:11:26.355481 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:26.356077 18643 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 12.
I20260709 12:11:26.364751 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:26.365403 18635 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.369990 18640 raft_consensus.cc:2468] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 11.
I20260709 12:11:26.372310 22419 consensus_queue.cc:260] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:26.372469 22452 consensus_queue.cc:237] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:11:26.373607 22419 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:26.352406 22283 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.350700 22381 raft_consensus.cc:493] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:26.352208 22333 raft_consensus.cc:697] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:26.386298 18636 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 15.
I20260709 12:11:26.368428 22398 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.357393 22268 consensus_queue.cc:1059] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:11:26.397993 21883 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:26.434393 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:26.435010 18642 raft_consensus.cc:2468] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:11:26.438913 18061 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:26.439311 17987 leader_election.cc:304] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:26.419478 22423 leader_election.cc:290] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:26.437737 22471 log.cc:927] Time spent T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 12:11:26.425899 22470 consensus_queue.cc:1048] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.121s
W20260709 12:11:26.460562 22478 log.cc:927] Time spent T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:11:26.428139 22472 raft_consensus.cc:2749] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:26.437232 21883 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:26.465945 22327 raft_consensus.cc:3055] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:26.467350 22359 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:26.468451 22006 raft_consensus.cc:2804] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:26.400890 22283 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:26.419569 22398 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:26.483973 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:26.521971 18017 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 12.
I20260709 12:11:26.405506 22381 raft_consensus.cc:515] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:26.551034 22381 leader_election.cc:290] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:26.494998 17989 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
W20260709 12:11:26.552060 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 57172.9us
I20260709 12:11:26.553587 22458 raft_consensus.cc:2804] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:26.554044 22458 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:26.508425 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 69598.3us
W20260709 12:11:26.510545 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 48445.8us
I20260709 12:11:26.560096 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:26.560698 18090 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 12.
I20260709 12:11:26.562875 18020 raft_consensus.cc:1275] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:11:26.554443 22458 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:26.566677 18022 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:44098
I20260709 12:11:26.568681 22398 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:26.571517 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:26.572098 18089 raft_consensus.cc:2468] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 10.
I20260709 12:11:26.515151 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:26.573019 17942 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 12.
I20260709 12:11:26.519155 22002 raft_consensus.cc:2804] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:26.573947 22002 raft_consensus.cc:697] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 15 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:26.574810 22002 consensus_queue.cc:237] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:26.580948 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:26.529467 22283 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:26.592738 18643 raft_consensus.cc:1275] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:11:26.453411 22333 consensus_queue.cc:237] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:26.513695 22006 raft_consensus.cc:493] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.535208 17948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:26.538816 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:26.602756 17940 raft_consensus.cc:2468] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:11:26.515938 22327 raft_consensus.cc:740] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:26.542204 21883 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:26.499473 22353 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:26.519464 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:26.616994 18092 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 12.
I20260709 12:11:26.500095 22473 raft_consensus.cc:493] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:26.545512 17913 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:26.581529 18639 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 12.
I20260709 12:11:26.582033 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:26.587435 18608 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:26.594954 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:26.596695 18635 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 12.
I20260709 12:11:26.602257 17948 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 12.
I20260709 12:11:26.604202 17914 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:11:26.604826 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:26.623418 18642 raft_consensus.cc:1240] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 11. Current term is 12. Ops: [10.11-11.12]
I20260709 12:11:26.606824 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:26.620223 17944 raft_consensus.cc:1240] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 LEADER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 9. Current term is 10. Ops: []
I20260709 12:11:26.625639 17912 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
W20260709 12:11:26.622072 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 76624.8us
I20260709 12:11:26.622834 18643 raft_consensus.cc:2468] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
I20260709 12:11:26.623962 18097 raft_consensus.cc:2468] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 9.
I20260709 12:11:26.631047 17912 leader_election.cc:304] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:26.630931 17987 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:26.601754 22409 raft_consensus.cc:2749] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:26.610143 22006 raft_consensus.cc:3060] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:26.634964 22062 raft_consensus.cc:2804] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:26.677392 22062 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.677942 22062 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:11:26.708999 17846 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40276 (request call id 255) took 17930 ms (client timeout 15000 ms). Trace:
I20260709 12:11:26.613413 22412 consensus_queue.cc:1048] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 12:11:26.635073 22406 raft_consensus.cc:2804] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:26.683274 22347 raft_consensus.cc:2804] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:26.713936 18020 raft_consensus.cc:1275] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:11:26.710814 22480 log.cc:927] Time spent T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.159s	user 0.000s	sys 0.003s
I20260709 12:11:26.692986 22396 raft_consensus.cc:2804] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:26.632823 21883 raft_consensus.cc:2804] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:26.631327 22452 raft_consensus.cc:2749] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:26.631536 22473 raft_consensus.cc:515] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:26.631671 22353 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:26.717481 22406 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.725646 22347 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.732221 21883 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:26.677428 22327 consensus_queue.cc:260] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:11:26.762243 21971 consensus_queue.cc:1048] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.018s
W20260709 12:11:26.709506 17846 rpcz_store.cc:269] 0709 12:11:08.778224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:08.778394 (+   170us) service_pool.cc:224] Handling call
0709 12:11:26.708929 (+17930535us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:23.125916 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:23.147352 (+ 21436us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:23.147401 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:11:23.147421 (+    20us) tablet.cc:662] Decoding operations
0709 12:11:23.417027 (+269606us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:23.417105 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:23.417134 (+    29us) tablet.cc:685] Acquiring locks for 29 operations
0709 12:11:23.585239 (+168105us) tablet.cc:701] Row locks acquired
0709 12:11:23.585299 (+    60us) write_op.cc:260] PREPARE: finished
0709 12:11:23.585571 (+   272us) write_op.cc:270] Start()
0709 12:11:23.585716 (+   145us) write_op.cc:276] Timestamp: P: 1783599083585453 usec, L: 0
0709 12:11:23.585743 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:11:23.763226 (+177483us) log.cc:844] Serialized 11324 byte log entry
0709 12:11:24.566989 (+803763us) op_driver.cc:464] REPLICATION: finished
0709 12:11:24.767774 (+200785us) write_op.cc:301] APPLY: starting
0709 12:11:24.767889 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:24.773308 (+  5419us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:24.773418 (+   110us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:25.505992 (+732574us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:25.506495 (+   503us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=29,key_file_lookups=29,delta_file_lookups=0,mrs_lookups=58
0709 12:11:25.506545 (+    50us) write_op.cc:312] APPLY: finished
0709 12:11:25.776325 (+269780us) log.cc:844] Serialized 368 byte log entry
0709 12:11:25.993076 (+216751us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:26.008251 (+ 15175us) write_op.cc:454] Released schema lock
0709 12:11:26.008647 (+   396us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:26.069049 (+ 60402us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:26.101171 (+ 32122us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1638567,"reported_tablets":40,"spinlock_wait_cycles":1792,"child_traces":[["op",{"apply.queue_time_us":200411,"apply.run_cpu_time_us":42690,"apply.run_wall_time_us":1285676,"cfile_cache_hit":56,"cfile_cache_hit_bytes":58492,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6216,"cfile_init":1,"lbm_read_time_us":753,"lbm_reads_lt_1ms":8,"num_ops":29,"prepare.queue_time_us":335649,"prepare.run_cpu_time_us":9062,"prepare.run_wall_time_us":683559,"replication_time_us":960662,"thread_start_us":476126,"threads_started":3,"wal-append.queue_time_us":223612}]]}
I20260709 12:11:26.766943 22347 raft_consensus.cc:3060] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:26.736557 22396 raft_consensus.cc:697] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:26.732828 22331 consensus_queue.cc:1048] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 12:11:26.785846 17844 catalog_manager.cc:5697] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 6 to 7, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 7 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:26.765151 22406 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:26.802902 22327 raft_consensus.cc:3060] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:26.812738 18021 raft_consensus.cc:1275] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:26.814481 22062 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:26.815658 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:26.817752 22062 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 13 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:26.822455 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:26.835935 18089 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:26.825613 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:26.775460 21883 raft_consensus.cc:3060] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:26.837371 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 206758us
W20260709 12:11:26.870656 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 238029us
I20260709 12:11:26.877938 17948 raft_consensus.cc:3060] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:26.822178 22322 consensus_queue.cc:1048] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:11:26.895076 18089 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 13.
I20260709 12:11:26.899029 17844 catalog_manager.cc:5697] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 1 to 4, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 4 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:26.906981 18022 raft_consensus.cc:606] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:26.907442 18022 raft_consensus.cc:614] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:26.862879 22452 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:26.908277 22452 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:26.908594 22353 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:26.910322 22452 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:26.910364 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:26.891130 22463 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:26.928153 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:11:26.938510 22488 log.cc:927] Time spent T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
W20260709 12:11:26.947381 22484 log.cc:927] Time spent T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:11:26.949196 22473 leader_election.cc:290] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:26.888788 22396 consensus_queue.cc:237] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:26.960243 17948 raft_consensus.cc:1275] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:11:26.977301 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 53306.4us
I20260709 12:11:26.997386 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e1f5339f9042c5935e082c5f212b35" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:26.998731 18024 raft_consensus.cc:1275] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:26.955781 22463 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:27.008546 18021 raft_consensus.cc:1275] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:27.000141 18018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:27.015758 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:26.999720 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:27.018062 17913 leader_election.cc:304] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:27.021965 22493 raft_consensus.cc:2749] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:11:27.027050 22497 log.cc:927] Time spent T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:11:27.027410 22406 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:27.028345 22495 consensus_queue.cc:1048] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:27.030015 18642 raft_consensus.cc:2393] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 13: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:11:27.031322 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:27.032055 17943 raft_consensus.cc:2393] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 13: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:27.034515 22463 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:27.038615 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:27.042232 17943 raft_consensus.cc:2393] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 7: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:27.046392 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:27.049270 18022 raft_consensus.cc:2468] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
I20260709 12:11:27.052352 18608 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:27.096417 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:11:27.093335 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 55721.4us
I20260709 12:11:27.097270 18636 raft_consensus.cc:2393] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 9: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
W20260709 12:11:27.100180 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 47934.3us
W20260709 12:11:27.097723 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 59985.6us
I20260709 12:11:27.107705 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:27.116653 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:27.117381 18638 raft_consensus.cc:2393] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 13: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:26.992480 22458 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:27.146442 18018 raft_consensus.cc:2393] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 in current term 13: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:27.116195 22409 raft_consensus.cc:2804] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:11:27.152374 22474 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.101450 22493 consensus_queue.cc:1048] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:11:27.155581 22474 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:27.156539 22458 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 13 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:27.152791 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 534611us
I20260709 12:11:27.150341 22409 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:27.139257 22006 raft_consensus.cc:515] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:27.153164 21979 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:27.184047 22406 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:27.191576 22006 leader_election.cc:290] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:27.188918 22409 raft_consensus.cc:3060] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:11:27.188282 21883 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:27.202085 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:27.204933 18090 raft_consensus.cc:1275] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:11:27.210175 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:27.210991 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:27.186663 22347 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:27.222182 21979 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:27.222802 22377 consensus_queue.cc:1048] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:27.225123 17944 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:27.225726 17943 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:27.226778 17941 raft_consensus.cc:1275] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:11:27.228462 17914 leader_election.cc:304] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:27.229478 22381 raft_consensus.cc:2749] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:27.238106 17914 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:27.248739 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:27.249512 18092 raft_consensus.cc:3060] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:27.242537 17944 raft_consensus.cc:1275] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:11:27.255685 18093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:11:27.259862 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 155656us
I20260709 12:11:27.260870 17943 raft_consensus.cc:1275] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:27.271294 18097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:27.271908 18097 raft_consensus.cc:3060] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:27.272091 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:27.273139 18098 raft_consensus.cc:2393] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 13: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
W20260709 12:11:27.289229 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 140931us
W20260709 12:11:27.289377 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 51333.3us
I20260709 12:11:27.289949 17912 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:27.260303 21883 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:27.307780 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:27.308430 18023 raft_consensus.cc:3060] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:11:27.309949 17913 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:27.310361 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:27.312309 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:27.312892 17944 raft_consensus.cc:3060] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:27.323436 18097 raft_consensus.cc:2468] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 11.
I20260709 12:11:27.325599 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:27.328130 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:27.327275 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:27.332760 18644 raft_consensus.cc:3060] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:11:27.333995 17912 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:27.295964 22398 raft_consensus.cc:2749] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:27.349594 17944 raft_consensus.cc:2468] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
I20260709 12:11:27.274868 22399 consensus_queue.cc:1048] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:11:27.282582 22460 consensus_queue.cc:1048] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 12:11:27.358243 18644 raft_consensus.cc:2468] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 10.
I20260709 12:11:27.314934 22347 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:27.325102 22470 raft_consensus.cc:2749] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:27.285955 22403 consensus_queue.cc:1048] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:11:27.328015 21979 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:27.295684 22333 consensus_queue.cc:1048] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 12:11:27.355371 22474 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:27.396454 17943 raft_consensus.cc:2393] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 13: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:27.384366 22409 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:27.385910 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 46579.9us
I20260709 12:11:27.388811 18023 raft_consensus.cc:2468] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 11.
W20260709 12:11:27.410923 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 235969us
W20260709 12:11:27.410461 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 76554.4us
I20260709 12:11:27.386291 22473 raft_consensus.cc:2749] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:27.365043 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 73169.4us
I20260709 12:11:27.416932 17988 leader_election.cc:304] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:27.419271 17912 leader_election.cc:304] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:27.427568 22509 raft_consensus.cc:2804] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:27.428081 22509 raft_consensus.cc:697] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:27.428979 22509 consensus_queue.cc:237] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:27.449819 22409 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:27.451844 21971 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:27.452361 21971 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:27.454355 21971 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:11:27.463130 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 62469.9us
I20260709 12:11:27.442942 22423 raft_consensus.cc:2804] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:27.467124 22423 raft_consensus.cc:697] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:27.468323 22423 consensus_queue.cc:237] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:27.455802 22452 raft_consensus.cc:2749] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:27.496995 18092 raft_consensus.cc:2468] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 10.
I20260709 12:11:27.510473 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:27.511436 18023 raft_consensus.cc:2393] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 13: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:27.511556 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:27.513725 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:27.514984 18019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:27.515698 18019 raft_consensus.cc:2393] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 11: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:27.521073 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:27.521818 18638 raft_consensus.cc:2393] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 13: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:11:27.518725 22463 raft_consensus.cc:493] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:27.522715 22463 raft_consensus.cc:515] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:27.524677 22463 leader_election.cc:290] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:27.532809 18021 raft_consensus.cc:2468] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 7.
I20260709 12:11:27.546583 18021 raft_consensus.cc:1275] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 15 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:27.548524 17940 raft_consensus.cc:1275] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:27.552279 18644 raft_consensus.cc:1275] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:27.560910 18643 raft_consensus.cc:1275] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:11:27.560910 18644 raft_consensus.cc:1275] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:27.563481 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca33c22be72d48f79260f24a00a8f8bb" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:27.564220 18638 raft_consensus.cc:3060] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:27.563344 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:27.564824 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:27.565045 17914 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:11:27.565436 17940 raft_consensus.cc:2468] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 11.
I20260709 12:11:27.568256 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:27.569638 22516 consensus_queue.cc:1048] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:27.571703 17946 raft_consensus.cc:2393] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 7: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:27.573792 18608 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:27.583473 17987 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:27.584304 18608 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:27.563114 22466 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:27.580420 22509 raft_consensus.cc:2804] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:27.625514 18638 raft_consensus.cc:2468] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
I20260709 12:11:27.593950 22520 raft_consensus.cc:2749] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:27.611055 22094 raft_consensus.cc:2749] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:27.580287 22331 consensus_queue.cc:1048] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 12:11:27.635149 22514 raft_consensus.cc:2804] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:11:27.635285 22406 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.690950 22406 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:27.693037 22406 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:27.641067 18608 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:11:27.693934 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 52947.3us
I20260709 12:11:27.642663 21971 consensus_queue.cc:1048] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:27.697328 21971 raft_consensus.cc:2804] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:27.697667 21971 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:27.698011 21971 raft_consensus.cc:3060] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:27.593789 22333 consensus_queue.cc:1048] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 12:11:27.627822 22466 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:27.705643 18644 raft_consensus.cc:1275] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:11:27.595784 22460 consensus_queue.cc:1048] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 12:11:27.646833 22509 raft_consensus.cc:697] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:27.707592 22509 consensus_queue.cc:237] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:27.710140 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:27.713949 18644 raft_consensus.cc:1275] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 15 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:11:27.705682 22466 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:27.715250 18095 raft_consensus.cc:1275] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 12. (term mismatch)
I20260709 12:11:27.715622 18095 pending_rounds.cc:85] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110: Aborting all ops after (but not including) 11
I20260709 12:11:27.715903 18095 pending_rounds.cc:107] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110: Aborting uncommitted NO_OP operation due to leader change: 11.12
I20260709 12:11:27.716200 18095 raft_consensus.cc:2889] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:27.716596 22419 consensus_queue.cc:1048] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:27.721638 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:27.756842 21971 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:27.761176 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:27.768021 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:27.777535 18635 raft_consensus.cc:1275] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:27.780781 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:27.795743 18092 raft_consensus.cc:2393] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 13: Already voted for candidate 63f5bddeebd84e5788d671a176cfa8e1 in this term.
I20260709 12:11:27.797391 18609 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:27.798537 18609 leader_election.cc:304] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:27.780444 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:27.781857 22514 raft_consensus.cc:697] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:27.783723 22328 consensus_queue.cc:1048] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:27.802937 18609 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:11:27.833240 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 94540.2us
I20260709 12:11:27.800135 22445 raft_consensus.cc:2749] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:27.850145 18016 raft_consensus.cc:1275] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:27.832170 22520 raft_consensus.cc:2749] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:27.832044 22474 raft_consensus.cc:2749] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:27.824342 22492 consensus_queue.cc:1048] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:11:27.845595 22458 consensus_queue.cc:1048] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.030s
W20260709 12:11:27.889576 22541 log.cc:927] Time spent T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:11:27.889496 22514 consensus_queue.cc:237] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:27.900384 18090 raft_consensus.cc:1275] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:27.886570 22333 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.882778 22403 consensus_queue.cc:1048] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 12:11:27.909235 22333 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:27.916254 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:27.911314 22353 consensus_queue.cc:1048] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.011s
W20260709 12:11:27.924937 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 66385.6us
W20260709 12:11:27.926738 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 58921.3us
I20260709 12:11:27.928274 22164 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.928719 22164 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:27.931087 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:27.931710 18020 raft_consensus.cc:2468] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 11.
I20260709 12:11:27.933856 17988 leader_election.cc:304] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:27.935019 22458 raft_consensus.cc:2749] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:27.935352 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:27.936074 18638 raft_consensus.cc:2468] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 10.
I20260709 12:11:27.936836 22164 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:27.938310 22508 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:27.938849 22508 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:27.941005 22508 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:27.942512 18062 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:27.943632 22002 raft_consensus.cc:2804] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:27.944020 22002 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:27.944397 22002 raft_consensus.cc:3060] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:27.964300 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:27.946599 21971 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:11:27.981652 17844 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45910 (request call id 353) took 34930 ms (client timeout 15000 ms). Trace:
I20260709 12:11:27.997870 18642 raft_consensus.cc:1275] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:27.999572 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:28.000239 18020 raft_consensus.cc:2468] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 7.
I20260709 12:11:28.005707 17913 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
W20260709 12:11:27.983243 22546 log.cc:927] Time spent T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:11:28.058630 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:11:27.984367 17844 rpcz_store.cc:269] 0709 12:10:53.035650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:10:53.035891 (+   241us) service_pool.cc:224] Handling call
0709 12:10:53.624619 (+588728us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b5400018454. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91c090 00007f7f4c9baf3a 00007f7f52770e9c 00007f7f5286f04e 00007f7f50d302a4 00007f7f50d30232 00007f7f50d30161 00007f7f50d300dc 00007f7f50d2f392 00007f7f4aced48c 00007f7f4acec8c6
0709 12:11:27.966017 (+34341398us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:27.019696 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:27.020268 (+   572us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:27.020303 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:11:27.020323 (+    20us) tablet.cc:662] Decoding operations
0709 12:11:27.020718 (+   395us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:27.020795 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:27.020828 (+    33us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:11:27.021139 (+   311us) tablet.cc:701] Row locks acquired
0709 12:11:27.021161 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:11:27.021303 (+   142us) write_op.cc:270] Start()
0709 12:11:27.021416 (+   113us) write_op.cc:276] Timestamp: P: 1783599087021260 usec, L: 0
0709 12:11:27.021441 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:11:27.022093 (+   652us) log.cc:844] Serialized 929 byte log entry
0709 12:11:27.135048 (+112955us) op_driver.cc:464] REPLICATION: finished
0709 12:11:27.206539 (+ 71491us) write_op.cc:301] APPLY: starting
0709 12:11:27.206660 (+   121us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:27.208545 (+  1885us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:27.208668 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:27.382315 (+173647us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:27.382506 (+   191us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 12:11:27.382550 (+    44us) write_op.cc:312] APPLY: finished
0709 12:11:27.394320 (+ 11770us) log.cc:844] Serialized 33 byte log entry
0709 12:11:27.397674 (+  3354us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:27.397780 (+   106us) write_op.cc:454] Released schema lock
0709 12:11:27.397823 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:27.398234 (+   411us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:27.398262 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":161949,"reported_tablets":45,"spinlock_wait_cycles":28038528,"child_traces":[["op",{"apply.queue_time_us":71191,"apply.run_cpu_time_us":5393,"apply.run_wall_time_us":191669,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12483,"num_ops":2,"prepare.queue_time_us":45226,"prepare.run_cpu_time_us":2822,"prepare.run_wall_time_us":77115,"replication_time_us":113416,"spinlock_wait_cycles":15232,"thread_start_us":73804,"threads_started":2}]]}
I20260709 12:11:28.011489 22509 raft_consensus.cc:2804] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:28.067256 17842 catalog_manager.cc:5697] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 6 to 9, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 9 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:28.074313 22509 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:28.102305 17842 catalog_manager.cc:5697] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 2 to 11, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 11 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } }
I20260709 12:11:28.119266 22463 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.133718 17842 catalog_manager.cc:5697] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 7 to 8, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 8 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } }
I20260709 12:11:28.135886 17946 raft_consensus.cc:1275] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:28.120023 22463 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:28.105611 22509 raft_consensus.cc:3060] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:28.138470 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 65263.3us
I20260709 12:11:28.080083 22062 consensus_queue.cc:1048] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:11:28.145282 17842 catalog_manager.cc:5697] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 8 to 11, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 11 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:28.152048 22542 log.cc:927] Time spent T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 12:11:28.189621 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 225776us
I20260709 12:11:28.194924 17842 catalog_manager.cc:5697] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 7 to 9, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 9 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:28.202137 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 58528.3us
I20260709 12:11:28.203258 22327 consensus_queue.cc:1048] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:28.203859 17842 catalog_manager.cc:5697] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 4 to 5, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 5 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:28.207669 18642 raft_consensus.cc:1275] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:11:28.206080 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 65500.6us
I20260709 12:11:28.225481 22463 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:11:28.217548 22550 log.cc:927] Time spent T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:11:28.229561 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:11:28.214869 22551 log.cc:927] Time spent T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:11:28.239099 17842 catalog_manager.cc:5697] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } }
I20260709 12:11:28.260955 22327 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.261642 22327 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:28.267416 22002 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:28.269455 22002 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:28.270869 18095 raft_consensus.cc:2393] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 12: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:28.272224 22333 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:28.271992 17842 catalog_manager.cc:5697] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 3 to 6, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 6 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:28.274987 17842 catalog_manager.cc:5697] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:28.276619 17842 catalog_manager.cc:5697] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:28.283094 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:28.288275 18638 raft_consensus.cc:2468] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 11.
I20260709 12:11:28.290410 17842 catalog_manager.cc:5697] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:28.300582 17842 catalog_manager.cc:5697] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 6 to 8, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 8 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:28.302700 17842 catalog_manager.cc:5697] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:28.314786 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 121726us
I20260709 12:11:28.315361 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:28.312335 17987 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:28.325067 17987 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:28.263850 22327 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:28.337921 17944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:28.346776 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:28.347133 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:28.347771 18023 raft_consensus.cc:2468] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 11.
I20260709 12:11:28.351924 18636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:28.352514 18636 raft_consensus.cc:2468] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 10.
I20260709 12:11:28.356386 18017 raft_consensus.cc:2393] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 11: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:28.368988 17842 catalog_manager.cc:5697] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 5 to 6, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 6 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:28.333729 22458 raft_consensus.cc:2804] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:28.371025 17842 catalog_manager.cc:5697] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 4 to 6, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 6 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:28.377043 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:28.381891 18640 raft_consensus.cc:3060] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:11:28.398114 22356 raft_consensus.cc:2804] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:28.398589 22356 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:28.398948 22356 raft_consensus.cc:3060] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:28.411819 17941 raft_consensus.cc:2468] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 11.
I20260709 12:11:28.412104 18640 raft_consensus.cc:2468] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 12.
I20260709 12:11:28.417819 18089 raft_consensus.cc:1275] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:28.344300 22512 consensus_queue.cc:1048] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 12:11:28.385712 22458 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:11:28.422122 22562 log.cc:927] Time spent T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 12:11:28.442418 22495 consensus_queue.cc:1048] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:11:28.444303 22458 raft_consensus.cc:3060] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:28.385957 22509 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:28.475560 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 109747us
I20260709 12:11:28.476842 18608 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:28.498764 21971 raft_consensus.cc:2804] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:11:28.500829 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 175829us
W20260709 12:11:28.503998 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 116186us
W20260709 12:11:28.530934 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 198637us
I20260709 12:11:28.499327 21971 raft_consensus.cc:697] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:28.549532 17946 raft_consensus.cc:1240] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:28.552825 18017 raft_consensus.cc:1275] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:11:28.561414 22356 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:28.563500 22509 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:28.564458 21971 consensus_queue.cc:237] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:28.569365 22458 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:28.571183 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
W20260709 12:11:28.572077 22548 log.cc:927] Time spent T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.127s	user 0.002s	sys 0.000s
I20260709 12:11:28.597651 18061 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:28.633962 18608 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:28.636453 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:28.637218 18017 raft_consensus.cc:3060] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:28.632903 22460 raft_consensus.cc:2804] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:28.624581 22331 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:28.648523 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:28.644646 22406 raft_consensus.cc:2804] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:28.641237 22474 consensus_queue.cc:1059] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.103s
W20260709 12:11:28.741832 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 90919.6us
I20260709 12:11:28.741977 22460 raft_consensus.cc:697] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
W20260709 12:11:28.743947 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 92678.1us
I20260709 12:11:28.752561 18017 raft_consensus.cc:2468] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 8.
I20260709 12:11:28.775012 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:28.775722 18020 raft_consensus.cc:2393] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 12: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:28.645320 22473 consensus_queue.cc:1048] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.118s
W20260709 12:11:28.752732 22572 log.cc:927] Time spent T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:11:28.781452 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:28.761129 22460 consensus_queue.cc:237] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:28.752745 22406 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:28.743067 22356 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:28.745903 22458 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:28.792934 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 144622us
I20260709 12:11:28.743543 22331 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:28.795461 22406 raft_consensus.cc:3060] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:28.858394 22536 log.cc:927] Time spent T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 12:11:28.901089 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 117510us
I20260709 12:11:28.902259 17913 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:29.030161 22560 raft_consensus.cc:2804] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:11:29.030697 22560 raft_consensus.cc:697] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:29.031481 22331 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:29.031562 22560 consensus_queue.cc:237] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:29.035723 22578 log.cc:927] Time spent T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
W20260709 12:11:29.034754 22556 log.cc:927] Time spent T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
W20260709 12:11:29.049892 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 147710us
I20260709 12:11:29.056098 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:29.056811 17947 raft_consensus.cc:3060] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:29.071343 17947 raft_consensus.cc:2468] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 12.
I20260709 12:11:29.080322 17988 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:29.085440 22573 raft_consensus.cc:2804] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:29.088784 22573 raft_consensus.cc:697] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:29.047855 22406 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:29.110737 18635 raft_consensus.cc:1240] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Rejecting Update request from peer 4813437da0a74e65b61eb7bd1d18f110 for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:29.114259 22406 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:11:29.125882 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 371499us
I20260709 12:11:29.130906 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
W20260709 12:11:29.141428 22528 log.cc:927] Time spent T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.762s	user 0.003s	sys 0.000s
I20260709 12:11:29.173732 17943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:29.174420 17943 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 13.
I20260709 12:11:29.175271 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:29.175841 18017 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 13.
I20260709 12:11:29.144579 22573 consensus_queue.cc:237] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:29.155827 22589 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:29.181892 22589 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:29.185810 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:29.186686 21971 raft_consensus.cc:3055] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:29.187191 21971 raft_consensus.cc:740] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:29.187952 22589 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:29.188174 21971 consensus_queue.cc:260] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:29.205464 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 68391.5us
W20260709 12:11:29.257108 22541 log.cc:927] Time spent T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.612s	user 0.012s	sys 0.008s
I20260709 12:11:29.266162 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:29.278402 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:29.280699 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:29.281827 18644 raft_consensus.cc:2393] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 12: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:29.391603 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:29.392484 21883 raft_consensus.cc:493] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:29.393162 21883 raft_consensus.cc:515] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:29.284583 22514 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:29.410096 17942 raft_consensus.cc:1240] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:29.414382 17940 raft_consensus.cc:1240] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 12:11:29.416038 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 123059us
I20260709 12:11:29.417217 21883 leader_election.cc:290] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:29.418238 21883 raft_consensus.cc:493] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:29.418926 21883 raft_consensus.cc:515] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:29.419373 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:29.421237 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:29.417462 22514 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:29.432905 22514 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:29.433987 21883 leader_election.cc:290] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:29.396193 22589 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:29.441970 18017 raft_consensus.cc:1240] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 LEADER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 11. Current term is 12. Ops: []
I20260709 12:11:29.442716 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:29.444442 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:29.445171 18642 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 13.
I20260709 12:11:29.448499 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:29.473217 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:29.479393 18061 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:29.482880 17987 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:29.486338 22412 raft_consensus.cc:2804] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:29.497496 18608 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:29.447721 22589 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:29.498775 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 251046us
I20260709 12:11:29.503847 18608 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:29.501075 22520 consensus_queue.cc:1059] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:11:29.499099 22423 raft_consensus.cc:2749] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:29.498775 22412 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:29.503453 22584 raft_consensus.cc:2749] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:29.554005 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 45925us
W20260709 12:11:29.564958 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 59761.8us
I20260709 12:11:29.506000 22593 raft_consensus.cc:2749] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:11:29.501310 22531 consensus_queue.cc:1059] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 12:11:29.511663 22520 consensus_queue.cc:1243] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Peer 63f5bddeebd84e5788d671a176cfa8e1 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:11:29.545724 22412 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:29.576342 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 66421.5us
I20260709 12:11:29.596494 18017 raft_consensus.cc:1275] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:29.601363 18024 raft_consensus.cc:1275] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:11:29.613729 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 102709us
W20260709 12:11:29.601382 22603 log.cc:927] Time spent T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:11:29.614673 18608 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:29.616318 22531 raft_consensus.cc:2749] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:11:29.634230 22599 log.cc:927] Time spent T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:11:29.627075 22359 consensus_queue.cc:1059] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 12:11:29.635228 22359 consensus_queue.cc:1243] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer c5ffa786c8fb43f7864fa8fbe76534cb log is divergent from this leader: its last log entry 12.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:11:29.642253 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:29.643424 22589 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:29.642035 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "993eae98279b413f8c6fed0d4ea79eae" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:29.651319 22333 consensus_queue.cc:1048] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:29.655226 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:29.655858 17914 leader_election.cc:304] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:29.657498 22587 raft_consensus.cc:2749] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:29.663894 18020 raft_consensus.cc:1240] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:29.666280 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53fdd1cc63be4f3b8a533d34af81d0c6" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:29.672887 22412 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:29.673794 18635 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60412 (request call id 1197) took 1027 ms. Trace:
I20260709 12:11:29.681502 18635 rpcz_store.cc:276] 0709 12:11:28.646102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.646237 (+   135us) service_pool.cc:224] Handling call
0709 12:11:28.646508 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:11:29.111132 (+464624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.673588 (+562456us) spinlock_profiling.cc:243] Waited 464 ms on lock 0x7b54005447d4. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9b2e01 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2 00007f7f4aced48c 00007f7f4acec8c6
0709 12:11:29.673742 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1067146112}
I20260709 12:11:29.684470 18608 leader_election.cc:304] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:29.687438 22452 consensus_queue.cc:1048] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:29.687884 22589 raft_consensus.cc:2749] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:29.688827 18642 raft_consensus.cc:3055] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:29.689208 18642 raft_consensus.cc:740] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:29.675483 22377 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:29.689906 22412 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 14 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:29.690390 22377 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:29.697086 22377 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:29.697353 18635 raft_consensus.cc:1275] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:11:29.695256 22604 log.cc:927] Time spent T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.184s	user 0.003s	sys 0.000s
I20260709 12:11:29.702105 22002 consensus_queue.cc:1059] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:29.703234 22002 consensus_queue.cc:1048] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:29.704710 22002 raft_consensus.cc:3055] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:29.705034 22002 raft_consensus.cc:740] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:29.705961 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:29.706569 17940 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:29.706982 21971 raft_consensus.cc:3060] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:29.708201 22002 consensus_queue.cc:260] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:29.709407 22002 raft_consensus.cc:3060] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:29.713644 17940 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 14.
I20260709 12:11:29.717075 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:29.717808 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:29.718381 18639 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:29.689989 18642 consensus_queue.cc:260] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:29.736372 18642 raft_consensus.cc:3060] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:29.741019 18639 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 14.
I20260709 12:11:29.748602 17912 leader_election.cc:304] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:11:29.751863 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 60302us
I20260709 12:11:29.753867 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:29.759471 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:29.769970 18024 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:29.770301 18062 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:29.760150 22508 raft_consensus.cc:2749] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:29.796963 18062 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:29.800127 18642 raft_consensus.cc:1275] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 12. (term mismatch)
I20260709 12:11:29.800765 18642 pending_rounds.cc:85] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db: Aborting all ops after (but not including) 11
I20260709 12:11:29.801163 18642 pending_rounds.cc:107] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db: Aborting uncommitted NO_OP operation due to leader change: 11.12
I20260709 12:11:29.801597 18642 raft_consensus.cc:2889] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:29.813730 18024 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 14.
I20260709 12:11:29.803861 22403 raft_consensus.cc:2804] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:29.806701 21908 raft_consensus.cc:2749] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:29.823009 22463 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 12:11:29.830392 18642 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:52812
I20260709 12:11:29.832897 18642 raft_consensus.cc:606] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:29.833221 18642 raft_consensus.cc:614] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:29.809442 22094 consensus_queue.cc:1048] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 12:11:29.839517 22403 raft_consensus.cc:697] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 14 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:29.840555 22403 consensus_queue.cc:237] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:29.844807 22597 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:29.845431 22597 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:29.866266 18638 raft_consensus.cc:1275] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:11:29.866688 18638 pending_rounds.cc:85] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db: Aborting all ops after (but not including) 7
I20260709 12:11:29.866917 18638 pending_rounds.cc:107] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:11:29.867153 18638 raft_consensus.cc:2889] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:11:29.867815 18639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
mode: GRACEFUL
new_leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:52812
I20260709 12:11:29.868364 18639 raft_consensus.cc:606] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Received request to transfer leadership to TS 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:29.868670 18639 raft_consensus.cc:614] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:29.884519 18020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:44098
I20260709 12:11:29.885156 18020 raft_consensus.cc:606] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 LEADER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
W20260709 12:11:29.886878 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:11:29.894881 17947 raft_consensus.cc:1275] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:11:29.896901 18020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7201987495494cf8a78424cb721d1c88"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
mode: GRACEFUL
new_leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:44098
I20260709 12:11:29.897473 18020 raft_consensus.cc:606] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Received request to transfer leadership to TS 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:29.897802 18020 raft_consensus.cc:614] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:29.896935 22557 raft_consensus.cc:493] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:29.898878 22557 raft_consensus.cc:515] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:29.900924 22557 leader_election.cc:290] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:29.902248 22597 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:29.902870 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:11:29.904762 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:29.905650 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:29.910142 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:29.911073 22559 consensus_queue.cc:1048] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:29.914049 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:29.915627 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:29.922295 22565 consensus_queue.cc:1048] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 12:11:29.957487 17913 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:29.973559 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:29.975569 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:29.976914 17914 leader_election.cc:304] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:29.970366 22353 raft_consensus.cc:2749] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:29.983228 22473 raft_consensus.cc:2749] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:30.130860 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 147564us
W20260709 12:11:30.271589 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 54998.5us
I20260709 12:11:30.282701 18016 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45472 (request call id 2376) took 1507 ms. Trace:
I20260709 12:11:30.283278 18016 rpcz_store.cc:276] 0709 12:11:28.774968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:28.775073 (+   105us) service_pool.cc:224] Handling call
0709 12:11:28.775466 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:28.794805 (+ 19339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:28.794834 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:29.744157 (+949323us) spinlock_profiling.cc:243] Waited 4.66 ms on lock 0x7b2c0005beb8. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4b2aba11 00007f7f4b2bb372 00007f7f4c9eda01 00007f7f4c9b243a 00007f7f4c9b183e 00007f7f51976419 00007f7f4aeedbd4 00007f7f4aeedb62 00007f7f4aeeda91 00007f7f4aeeda0c 00007f7f4aeeccc2
0709 12:11:29.758842 (+ 14685us) log.cc:844] Serialized 26 byte log entry
0709 12:11:29.797600 (+ 38758us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:11:29.797653 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.797757 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:30.271018 (+473261us) raft_consensus.cc:1685] finished
0709 12:11:30.271045 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.282584 (+ 11539us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19004,"raft.queue_time_us":19252,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":58219,"spinlock_wait_cycles":10818304,"thread_start_us":38411,"threads_started":1,"wal-append.queue_time_us":202436}
I20260709 12:11:30.298048 22598 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:30.399137 22598 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:11:30.478978 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 180618us
W20260709 12:11:30.524207 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 216919us
W20260709 12:11:30.522467 18064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:11:30.559279 22617 log.cc:927] Time spent T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
W20260709 12:11:30.828703 22621 log.cc:927] Time spent T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.278s	user 0.000s	sys 0.009s
I20260709 12:11:30.523200 22569 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:30.837330 22598 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:11:30.837927 22619 log.cc:927] Time spent T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.364s	user 0.000s	sys 0.010s
W20260709 12:11:30.838282 22620 log.cc:927] Time spent T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.343s	user 0.003s	sys 0.007s
I20260709 12:11:30.866386 22569 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:30.913707 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:30.927773 18638 raft_consensus.cc:2393] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 12: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:11:30.906579 22569 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:30.922399 22630 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:30.929880 22630 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:30.942575 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:11:30.953299 22612 log.cc:927] Time spent T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.758s	user 0.005s	sys 0.000s
I20260709 12:11:30.954663 18023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45464 (request call id 2267) took 1191 ms. Trace:
I20260709 12:11:30.955037 18023 rpcz_store.cc:276] 0709 12:11:29.763247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.763409 (+   162us) service_pool.cc:224] Handling call
0709 12:11:29.763677 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:29.763982 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:29.764014 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:29.764396 (+   382us) log.cc:844] Serialized 26 byte log entry
0709 12:11:29.924323 (+159927us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:11:29.924359 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:29.924417 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:30.952987 (+1028570us) spinlock_profiling.cc:243] Waited 6.28 ms on lock 0x7b240013ed58. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f4974b9c4 00007f7f49749acb 00007f7f49904dc9 00007f7f49904a55 00007f7f4990409d 00007f7f4c53610e 00007f7f4c54d88c 00007f7f4c54cbb6 00007f7f4c54c7d8 00007f7f4c556221
0709 12:11:30.954369 (+  1382us) raft_consensus.cc:1685] finished
0709 12:11:30.954393 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:30.954589 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4667,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":3981,"spinlock_wait_cycles":14452096,"thread_start_us":159669,"threads_started":1,"wal-append.queue_time_us":364700}
W20260709 12:11:30.957558 18644 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.231s	user 0.011s	sys 0.025s
W20260709 12:11:30.957897 18644 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.232s	user 0.011s	sys 0.025s
I20260709 12:11:30.946239 22630 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:30.981950 22565 raft_consensus.cc:993] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb: : Instructing follower 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:11:30.982635 22565 raft_consensus.cc:1081] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 LEADER]: Signalling peer 4813437da0a74e65b61eb7bd1d18f110 to start an election
W20260709 12:11:30.995553 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 129055us
I20260709 12:11:31.002156 18023 raft_consensus.cc:1275] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:30.992268 22463 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:31.034397 22463 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:31.051218 22463 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:11:31.055291 22613 log.cc:927] Time spent T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.663s	user 0.003s	sys 0.001s
I20260709 12:11:31.061029 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:31.105001 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:31.080613 18644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60412 (request call id 1211) took 1362 ms. Trace:
I20260709 12:11:31.123102 18644 rpcz_store.cc:276] 0709 12:11:29.724689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:29.724815 (+   126us) service_pool.cc:224] Handling call
0709 12:11:29.725095 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:11:29.725433 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:11:29.725460 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:11:29.725882 (+   422us) log.cc:844] Serialized 26 byte log entry
0709 12:11:30.958219 (+1232337us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:11:30.958262 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:11:30.958332 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:11:31.054663 (+ 96331us) spinlock_profiling.cc:243] Waited 5.31 ms on lock 0x7b4400022b4c. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4974ddb1 00007f7f497ebc85 00007f7f497ec6a2 00007f7f4c55e1db 00007f7f4c559aaf 00007f7f4c54d86e 00007f7f4c54cbb6 00007f7f4c54c7d8 00007f7f4c556221 00007f7f4c5561d9 00007f7f4c556169
0709 12:11:31.063698 (+  9035us) raft_consensus.cc:1685] finished
0709 12:11:31.063722 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:11:31.080525 (+ 16803us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9953,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":2730,"spinlock_wait_cycles":12202240,"thread_start_us":1232062,"threads_started":1,"wal-append.queue_time_us":560870}
I20260709 12:11:31.132589 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:31.133255 18095 raft_consensus.cc:2468] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 12.
I20260709 12:11:31.163009 22635 raft_consensus.cc:493] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:31.163758 22635 raft_consensus.cc:515] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:31.166510 22635 leader_election.cc:290] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:31.167249 22505 raft_consensus.cc:493] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:31.167832 22505 raft_consensus.cc:515] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:31.169997 22505 leader_election.cc:290] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:31.171615 18091 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:53954
I20260709 12:11:31.172142 18091 raft_consensus.cc:493] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:31.172467 18091 raft_consensus.cc:3060] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:31.178040 17989 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:31.180851 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:31.186594 22636 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:31.187352 22636 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:31.190052 22636 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:31.190762 22636 raft_consensus.cc:493] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:31.191422 22636 raft_consensus.cc:515] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:31.192515 22396 raft_consensus.cc:2804] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:31.214556 22396 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:31.215001 22396 raft_consensus.cc:3060] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:31.216006 22636 leader_election.cc:290] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:31.203922 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17e56ed7b94d4185a4f7dd88f922e17d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:31.224530 22456 consensus_queue.cc:1048] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:31.226505 22637 raft_consensus.cc:493] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:31.227209 22637 raft_consensus.cc:515] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:31.224305 18091 raft_consensus.cc:515] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:31.230194 22637 leader_election.cc:290] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:31.244093 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:31.244727 18644 raft_consensus.cc:3060] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:31.254030 18644 raft_consensus.cc:2468] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 9.
I20260709 12:11:31.254489 18091 leader_election.cc:290] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:31.261804 21971 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:31.283730 17987 leader_election.cc:304] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:31.285149 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:31.285848 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:31.283049 22505 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:31.288904 22505 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:31.289798 22630 raft_consensus.cc:2749] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:31.290920 22505 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:31.295387 18061 leader_election.cc:304] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:31.295326 21971 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:31.298063 21971 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:31.300194 22473 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:31.300815 22473 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:31.302793 22473 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:11:31.306849 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 61972.7us
I20260709 12:11:31.308527 22396 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:31.317680 22585 raft_consensus.cc:493] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:31.318226 22585 raft_consensus.cc:515] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:31.321774 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:31.324355 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:31.326079 18644 raft_consensus.cc:1275] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:31.328444 22585 leader_election.cc:290] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:31.330797 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:31.333076 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6135c6398c3f4926b6f07433b6f63759" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:31.333590 18022 raft_consensus.cc:3055] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:31.333861 18022 raft_consensus.cc:740] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:31.337579 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:31.344239 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:11:31.346166 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 286824us
I20260709 12:11:31.346467 18022 consensus_queue.cc:260] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:31.357307 18022 raft_consensus.cc:3060] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:31.363060 18609 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:31.347523 22516 consensus_queue.cc:1048] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:11:31.341809 22322 raft_consensus.cc:2804] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:31.390903 22585 raft_consensus.cc:2749] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:31.396697 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 60555.9us
I20260709 12:11:31.403506 22322 raft_consensus.cc:697] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:31.404680 22322 consensus_queue.cc:237] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:31.409192 22396 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:31.417222 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:31.418229 18644 raft_consensus.cc:2393] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c5ffa786c8fb43f7864fa8fbe76534cb in current term 12: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:11:31.420964 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bde4bf25ea49f2b5f4b768cba4cdd0" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:11:31.427331 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 75515.6us
I20260709 12:11:31.428966 22636 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:31.429456 22636 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:31.430073 22283 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
W20260709 12:11:31.430428 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 55892.8us
I20260709 12:11:31.430580 22283 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:31.433261 17942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:31.433842 17942 raft_consensus.cc:2468] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 7.
I20260709 12:11:31.434368 17946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:31.432906 22283 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:31.429478 22638 raft_consensus.cc:493] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:31.436786 22638 raft_consensus.cc:515] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:31.437755 22636 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:31.439595 18022 raft_consensus.cc:2468] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 9.
I20260709 12:11:31.443145 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:31.443830 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:31.451752 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:31.458359 22638 leader_election.cc:290] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:31.459228 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:31.450614 22587 raft_consensus.cc:493] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:31.461045 22587 raft_consensus.cc:515] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:31.463837 22587 leader_election.cc:290] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:31.464789 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:31.465677 22094 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:31.466361 22094 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:31.476159 22094 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:31.479364 22381 raft_consensus.cc:493] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:31.479895 22381 raft_consensus.cc:515] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:31.481976 22381 leader_election.cc:290] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:31.483410 18635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:31.492038 17988 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:31.515146 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:31.530409 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f69f8ad8c84e4f9fdacc0e26cb2bc0" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:31.537772 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158a286025af4eddba6fb641c128cd25" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:31.545742 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:31.546036 18096 raft_consensus.cc:2468] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 12.
I20260709 12:11:31.547442 17989 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:31.551038 18092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:31.552795 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:31.554123 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "374a5fb3dfcf4ad4adf6e172cc1759a4" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:31.559739 17944 raft_consensus.cc:1275] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:31.562043 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:31.565070 18089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c592029696004db48d68a9e4c3f45004" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:31.570501 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:31.571511 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:31.574540 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f6ed08238924344ac4e43e997223ac9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:31.553115 22627 raft_consensus.cc:2804] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:11:31.588359 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:31.579792 22136 raft_consensus.cc:2804] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:31.586133 22627 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Starting leader election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:31.605818 22638 raft_consensus.cc:493] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:31.613379 22627 raft_consensus.cc:3060] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:11:31.646303 17846 catalog_manager.cc:5697] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:31.600086 22456 consensus_queue.cc:1048] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:11:31.613060 22136 raft_consensus.cc:697] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:31.671651 18091 raft_consensus.cc:1240] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 LEADER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 8. Current term is 9. Ops: []
W20260709 12:11:31.675459 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 70874.1us
I20260709 12:11:31.676689 18609 leader_election.cc:304] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:31.710134 18609 leader_election.cc:304] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:31.711784 18096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b8822f4f1de477e8866529047a823b9" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:31.718942 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:31.725617 22463 raft_consensus.cc:2749] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:31.726945 22136 consensus_queue.cc:237] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:31.721396 22558 raft_consensus.cc:493] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:31.732785 22558 raft_consensus.cc:515] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:31.708686 22585 raft_consensus.cc:2749] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:31.655834 22638 raft_consensus.cc:515] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:31.742888 22621 log.cc:927] Time spent T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:11:31.748345 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:31.754172 17846 catalog_manager.cc:5697] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 8 to 9, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 9 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:31.755609 17846 catalog_manager.cc:5697] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 7 to 9, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 9 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:31.756929 17846 catalog_manager.cc:5697] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 11 to 13, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 13 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
W20260709 12:11:31.757427 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 183673us
I20260709 12:11:31.760942 17914 leader_election.cc:304] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:31.758276 17846 catalog_manager.cc:5697] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 6 to 7, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 7 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:31.749900 22558 leader_election.cc:290] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:31.782564 17914 leader_election.cc:304] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:31.794723 22638 leader_election.cc:290] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:31.786021 22531 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:31.802734 22625 raft_consensus.cc:493] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:31.803150 22531 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:31.803445 22625 raft_consensus.cc:515] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:31.805913 22531 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:31.806125 22625 leader_election.cc:290] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:31.772171 22557 raft_consensus.cc:2749] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:31.807317 22456 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:31.808001 22456 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:31.810576 22456 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:31.844515 22531 raft_consensus.cc:493] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:31.845293 22531 raft_consensus.cc:515] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:31.848050 22627 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:31.860119 22531 leader_election.cc:290] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:31.867427 22627 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:31.870774 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 160738us
I20260709 12:11:31.933429 17846 catalog_manager.cc:5697] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 8 to 10, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 10 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:31.946159 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:31.992691 18090 raft_consensus.cc:2468] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 12.
I20260709 12:11:31.945889 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:31.959403 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:31.971300 22591 raft_consensus.cc:2749] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:31.971745 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
W20260709 12:11:31.973647 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 190996us
I20260709 12:11:32.000016 17914 leader_election.cc:304] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:32.003489 22509 raft_consensus.cc:2749] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:32.017593 17914 leader_election.cc:304] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:32.065053 17913 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:32.068135 17846 catalog_manager.cc:5697] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:32.072944 22353 raft_consensus.cc:2749] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:11:32.072153 17913 leader_election.cc:304] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:32.073269 17846 catalog_manager.cc:5697] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 12 to 15, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 15 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:32.065037 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:11:32.079599 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 62289us
I20260709 12:11:32.056273 22509 raft_consensus.cc:2749] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:32.083138 22509 raft_consensus.cc:2749] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:32.090523 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:32.102501 18609 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:32.104401 22531 raft_consensus.cc:2804] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:32.104786 22531 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:32.105103 22531 raft_consensus.cc:3060] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:32.123136 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:32.116163 17913 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:32.127966 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:32.152498 18024 raft_consensus.cc:1275] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:32.154074 17846 catalog_manager.cc:5697] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 5 to 6, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 6 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:32.156010 17846 catalog_manager.cc:5697] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:32.157756 17846 catalog_manager.cc:5697] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:32.177860 22322 consensus_queue.cc:1048] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:32.184010 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0d192cc9cf47c1ba111cde01fad070" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:32.184331 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9b0c864d78846698db31224c547a091" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:32.185716 22597 raft_consensus.cc:2749] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:32.183375 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 69094.1us
I20260709 12:11:32.202556 18023 raft_consensus.cc:1240] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Rejecting Update request from peer e28f77912a9c4ba2b9841f6fedddc2db for earlier term 7. Current term is 8. Ops: []
I20260709 12:11:32.205049 17913 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:32.206113 22591 raft_consensus.cc:2749] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:32.208138 17913 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:32.209122 22591 raft_consensus.cc:2749] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:32.217813 18638 raft_consensus.cc:1275] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:32.224612 17846 catalog_manager.cc:5697] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 8 to 11, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 11 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:32.264240 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 54759.3us
I20260709 12:11:32.263983 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:32.275130 18091 raft_consensus.cc:1275] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:11:32.285168 22623 consensus_queue.cc:1048] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:32.286933 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:32.289530 18062 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:32.292583 17914 leader_election.cc:304] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:32.295508 17988 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:32.305459 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:32.302493 22625 consensus_queue.cc:1048] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 12:11:32.310230 22505 raft_consensus.cc:2749] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:32.302443 22531 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:32.287108 17846 catalog_manager.cc:5697] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 11 to 14, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 14 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:32.314018 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:32.313638 17914 leader_election.cc:304] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1; no voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:32.319764 22558 raft_consensus.cc:2749] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:32.334837 22492 raft_consensus.cc:2749] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:32.325647 22591 raft_consensus.cc:2749] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:32.339737 22531 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:32.340694 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
W20260709 12:11:32.349589 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 60308us
I20260709 12:11:32.351504 17846 catalog_manager.cc:5697] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 8 to 10, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 10 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:32.387903 22505 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:32.388698 22505 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:32.391043 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 50739.5us
I20260709 12:11:32.392577 22505 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:32.396584 17988 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:32.398538 22627 raft_consensus.cc:2749] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:32.415938 17833 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 4ccf0bcc20ae40e79c32530091613e1e with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 4813437da0a74e65b61eb7bd1d18f110 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:32.413071 17846 catalog_manager.cc:5697] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 10 to 11, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 11 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:32.441533 22531 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:32.442469 22531 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:32.443496 17988 leader_election.cc:304] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:32.444828 22531 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:32.445266 22627 raft_consensus.cc:2749] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:32.447578 17842 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45928 (request call id 369) took 16738 ms (client timeout 15000 ms). Trace:
I20260709 12:11:32.450955 17846 catalog_manager.cc:5697] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:32.452375 17846 catalog_manager.cc:5697] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:32.455015 18608 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:32.456815 22653 raft_consensus.cc:2749] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:32.453984 17846 catalog_manager.cc:5697] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 9 to 10, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 10 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:32.481863 17988 leader_election.cc:304] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:32.489068 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:32.495457 22627 raft_consensus.cc:2749] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:32.447975 17842 rpcz_store.cc:269] 0709 12:11:15.708773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.709000 (+   227us) service_pool.cc:224] Handling call
0709 12:11:15.928662 (+219662us) spinlock_profiling.cc:243] Waited 30.4 ms on lock 0x7b5400018454. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91c090 00007f7f4c9baf3a 00007f7f52770e9c 00007f7f5286f04e 00007f7f50d302a4 00007f7f50d30232 00007f7f50d30161 00007f7f50d300dc 00007f7f50d2f392 00007f7f4aced48c 00007f7f4acec8c6
0709 12:11:32.447314 (+16518652us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:28.618963 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:28.619741 (+   778us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:28.619789 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:11:28.619815 (+    26us) tablet.cc:662] Decoding operations
0709 12:11:28.621555 (+  1740us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:28.621660 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:28.621710 (+    50us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:11:28.794471 (+172761us) tablet.cc:701] Row locks acquired
0709 12:11:28.798835 (+  4364us) write_op.cc:260] PREPARE: finished
0709 12:11:28.860248 (+ 61413us) write_op.cc:270] Start()
0709 12:11:28.867496 (+  7248us) write_op.cc:276] Timestamp: P: 1783599088858231 usec, L: 0
0709 12:11:28.868739 (+  1243us) op_driver.cc:348] REPLICATION: starting
0709 12:11:28.981019 (+112280us) log.cc:844] Serialized 5950 byte log entry
0709 12:11:29.687406 (+706387us) op_driver.cc:464] REPLICATION: finished
0709 12:11:29.741788 (+ 54382us) write_op.cc:301] APPLY: starting
0709 12:11:29.741845 (+    57us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:29.875386 (+133541us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:29.875520 (+   134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:30.261343 (+385823us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:30.261731 (+   388us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=0,mrs_lookups=0
0709 12:11:30.261799 (+    68us) write_op.cc:312] APPLY: finished
0709 12:11:30.262275 (+   476us) log.cc:844] Serialized 139 byte log entry
0709 12:11:30.262448 (+   173us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:30.262595 (+   147us) write_op.cc:454] Released schema lock
0709 12:11:30.274285 (+ 11690us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:30.384937 (+110652us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:30.387631 (+  2694us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":14179,"reported_tablets":46,"spinlock_wait_cycles":69992832,"child_traces":[["op",{"apply.queue_time_us":53941,"apply.run_cpu_time_us":26568,"apply.run_wall_time_us":560564,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66797,"num_ops":15,"prepare.queue_time_us":211591,"prepare.run_cpu_time_us":72162,"prepare.run_wall_time_us":784956,"raft.queue_time_us":122334,"raft.run_cpu_time_us":37886,"raft.run_wall_time_us":54283,"replication_time_us":818534,"spinlock_wait_cycles":241664,"thread_start_us":700663,"threads_started":4,"wal-append.queue_time_us":457644,"wal-append.run_cpu_time_us":19145,"wal-append.run_wall_time_us":1759435}]]}
I20260709 12:11:32.507211 17988 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:32.491976 17846 catalog_manager.cc:5697] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 7 to 9, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 9 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:32.519680 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:32.521032 22596 raft_consensus.cc:2749] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:11:32.535998 17846 catalog_manager.cc:5697] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 9 to 10, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 10 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:32.540848 22627 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:32.541872 22531 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:32.541280 17846 catalog_manager.cc:5697] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 10 to 11, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 11 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:32.542462 22531 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:32.544477 22531 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:32.541643 22627 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:32.547600 22627 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:32.552573 17846 catalog_manager.cc:5697] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 7 to 10, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 10 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:32.554126 17846 catalog_manager.cc:5697] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 9 to 12, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 12 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:32.555505 17846 catalog_manager.cc:5697] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:32.556766 17846 catalog_manager.cc:5697] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 9 to 12, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 12 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:32.569111 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:32.579052 17949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:32.558187 17846 catalog_manager.cc:5697] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:32.584003 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:32.585539 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:32.586916 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:32.594359 17940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:32.582526 17846 catalog_manager.cc:5697] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: config changed from index 5 to 7, term changed from 8 to 13, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to <none>, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 13 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:32.615564 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:32.627596 17988 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:32.629113 22627 raft_consensus.cc:2749] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:32.630524 18608 leader_election.cc:304] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:32.631070 22653 consensus_queue.cc:1059] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:32.631992 22663 raft_consensus.cc:2749] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:32.632143 22653 raft_consensus.cc:3055] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:11:32.632532 22653 raft_consensus.cc:740] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:32.633461 22653 consensus_queue.cc:260] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:32.634059 18608 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:32.635607 22653 raft_consensus.cc:3060] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:11:32.652328 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 118214us
I20260709 12:11:32.664705 22663 raft_consensus.cc:2749] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:11:32.677830 18608 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:32.689066 22653 raft_consensus.cc:2749] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:32.691097 18608 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:32.691924 22653 raft_consensus.cc:2749] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:32.702348 18642 raft_consensus.cc:1240] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 12. Current term is 13. Ops: []
I20260709 12:11:32.702536 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:32.710724 22136 consensus_queue.cc:1059] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:32.711911 22668 raft_consensus.cc:3055] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:32.712313 22668 raft_consensus.cc:740] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:32.713254 22668 consensus_queue.cc:260] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:32.717941 22668 raft_consensus.cc:3060] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:32.720052 17987 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:32.756273 22136 raft_consensus.cc:2749] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:32.797328 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 77357.2us
I20260709 12:11:32.909391 18644 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
mode: GRACEFUL
new_leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:52812
I20260709 12:11:32.913555 18644 raft_consensus.cc:606] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Received request to transfer leadership to TS 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:32.913911 18644 raft_consensus.cc:614] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:32.917055 18644 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
mode: GRACEFUL
new_leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
 from {username='slave'} at 127.0.0.1:52812
I20260709 12:11:32.917589 18644 raft_consensus.cc:606] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Received request to transfer leadership to TS c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:32.917903 18644 raft_consensus.cc:614] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:32.920930 18644 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5379a078a5d24d8cba5cb4e56eee5b5f"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:52812
I20260709 12:11:32.921500 18644 raft_consensus.cc:606] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:32.921798 18644 raft_consensus.cc:614] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:32.925163 18020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
mode: GRACEFUL
new_leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:44098
I20260709 12:11:32.925676 18020 raft_consensus.cc:606] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Received request to transfer leadership to TS 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:32.926000 18020 raft_consensus.cc:614] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:32.931288 18644 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92e1586ba70a4331be2a55f4a31dd687"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
mode: GRACEFUL
new_leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:52812
I20260709 12:11:32.931854 18644 raft_consensus.cc:606] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Received request to transfer leadership to TS 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:32.932188 18644 raft_consensus.cc:614] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:11:32.933348 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:32.952034 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:32.958369 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:32.992074 17843 catalog_manager.cc:5697] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } }
I20260709 12:11:32.996374 17843 catalog_manager.cc:5697] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } }
I20260709 12:11:32.998276 17843 catalog_manager.cc:5697] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 6 to 11, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 11 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } }
I20260709 12:11:33.000315 17843 catalog_manager.cc:5697] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } }
I20260709 12:11:33.015208 17846 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40276 (request call id 256) took 5446 ms. Trace:
I20260709 12:11:33.016116 17843 catalog_manager.cc:5697] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 9 to 10, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 10 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:33.018239 17843 catalog_manager.cc:5697] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 6 to 7, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 7 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } }
I20260709 12:11:33.020037 17843 catalog_manager.cc:5697] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 7 to 11, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 11 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:33.022230 17843 catalog_manager.cc:5697] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } }
I20260709 12:11:33.029663 17843 catalog_manager.cc:5697] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 11 to 13, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 13 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:33.032178 17843 catalog_manager.cc:5697] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 8 to 9, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 9 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } }
I20260709 12:11:33.023176 17846 rpcz_store.cc:276] 0709 12:11:27.568697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:27.568894 (+   197us) service_pool.cc:224] Handling call
0709 12:11:33.015128 (+5446234us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:32.645155 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:32.645857 (+   702us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:32.648247 (+  2390us) write_op.cc:435] Acquired schema lock
0709 12:11:32.648267 (+    20us) tablet.cc:662] Decoding operations
0709 12:11:32.650345 (+  2078us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:32.650442 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:32.650475 (+    33us) tablet.cc:685] Acquiring locks for 27 operations
0709 12:11:32.674295 (+ 23820us) tablet.cc:701] Row locks acquired
0709 12:11:32.674345 (+    50us) write_op.cc:260] PREPARE: finished
0709 12:11:32.674525 (+   180us) write_op.cc:270] Start()
0709 12:11:32.674697 (+   172us) write_op.cc:276] Timestamp: P: 1783599092674459 usec, L: 0
0709 12:11:32.674721 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:11:32.675485 (+   764us) log.cc:844] Serialized 10587 byte log entry
0709 12:11:32.745773 (+ 70288us) op_driver.cc:464] REPLICATION: finished
0709 12:11:32.867644 (+121871us) write_op.cc:301] APPLY: starting
0709 12:11:32.868014 (+   370us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:32.874261 (+  6247us) spinlock_profiling.cc:243] Waited 42.9 ms on lock 0x7b5400018454. stack: 00007f7f49893343 00007f7f49893240 00007f7f492221d4 00007f7f52f60304 00007f7f52f60299 00007f7f4c91b571 00007f7f4c9af32a 00007f7f4c934f14 00007f7f4c934ec3 00007f7f4c934e38 00007f7f4c934df3 00007f7f4c9340dc 00007f7f4c95de16 00007f7f4c945cbb 00007f7f4c93039d 00007f7f4c933d75
0709 12:11:32.887822 (+ 13561us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:32.887871 (+    49us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:32.920656 (+ 32785us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:32.921070 (+   414us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=54,key_file_lookups=54,delta_file_lookups=0,mrs_lookups=0
0709 12:11:32.921116 (+    46us) write_op.cc:312] APPLY: finished
0709 12:11:32.921664 (+   548us) log.cc:844] Serialized 236 byte log entry
0709 12:11:32.921838 (+   174us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:32.922054 (+   216us) write_op.cc:454] Released schema lock
0709 12:11:32.922137 (+    83us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:32.922558 (+   421us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:32.922595 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":564320,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":121521,"apply.run_cpu_time_us":31943,"apply.run_wall_time_us":54917,"cfile_cache_hit":110,"cfile_cache_hit_bytes":116933,"num_ops":27,"prepare.queue_time_us":24765,"prepare.run_cpu_time_us":7611,"prepare.run_wall_time_us":59823,"raft.queue_time_us":19703,"raft.run_cpu_time_us":85319,"raft.run_wall_time_us":174576,"replication_time_us":68102,"spinlock_wait_cycles":98623360,"thread_start_us":201470,"threads_started":4,"wal-append.queue_time_us":1077}]]}
W20260709 12:11:33.117039 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 48696.1us
I20260709 12:11:33.178920 17845 catalog_manager.cc:5697] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 4 to 7, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 7 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
W20260709 12:11:33.184937 17843 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45910 (request call id 354) took 13856 ms (client timeout 15000 ms). Trace:
W20260709 12:11:33.186278 17843 rpcz_store.cc:269] 0709 12:11:19.328161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:19.328323 (+   162us) service_pool.cc:224] Handling call
0709 12:11:33.184860 (+13856537us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:33.042885 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:33.043383 (+   498us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:33.043418 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:11:33.043431 (+    13us) tablet.cc:662] Decoding operations
0709 12:11:33.044435 (+  1004us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:33.044492 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:33.044525 (+    33us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:11:33.045414 (+   889us) tablet.cc:701] Row locks acquired
0709 12:11:33.045449 (+    35us) write_op.cc:260] PREPARE: finished
0709 12:11:33.045594 (+   145us) write_op.cc:270] Start()
0709 12:11:33.045705 (+   111us) write_op.cc:276] Timestamp: P: 1783599093045548 usec, L: 0
0709 12:11:33.045730 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:11:33.071090 (+ 25360us) log.cc:844] Serialized 4026 byte log entry
0709 12:11:33.087075 (+ 15985us) op_driver.cc:464] REPLICATION: finished
0709 12:11:33.088113 (+  1038us) write_op.cc:301] APPLY: starting
0709 12:11:33.088199 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:33.093206 (+  5007us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:33.093302 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:33.107624 (+ 14322us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:33.107866 (+   242us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=0,mrs_lookups=0
0709 12:11:33.107920 (+    54us) write_op.cc:312] APPLY: finished
0709 12:11:33.108241 (+   321us) log.cc:844] Serialized 97 byte log entry
0709 12:11:33.115287 (+  7046us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:33.115415 (+   128us) write_op.cc:454] Released schema lock
0709 12:11:33.115457 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:33.115828 (+   371us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:33.115857 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":231444,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":807,"apply.run_cpu_time_us":12952,"apply.run_wall_time_us":27668,"cfile_cache_hit":40,"cfile_cache_hit_bytes":41780,"num_ops":10,"prepare.queue_time_us":4308,"prepare.run_cpu_time_us":4005,"prepare.run_wall_time_us":33198,"replication_time_us":41201}]]}
I20260709 12:11:33.240315 17843 catalog_manager.cc:5697] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 10 to 13, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 13 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:33.248401 17843 catalog_manager.cc:5697] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 12 to 15, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 15 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:33.252733 17843 catalog_manager.cc:5697] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 7 to 9, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 9 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:33.256047 17843 catalog_manager.cc:5697] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 7 to 9, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 9 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:33.257941 17843 catalog_manager.cc:5697] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 10 to 12, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 12 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:33.260522 17843 catalog_manager.cc:5697] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 9 to 12, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 12 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:33.262226 17843 catalog_manager.cc:5697] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 8 to 9, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 9 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:33.264356 17843 catalog_manager.cc:5697] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 7 to 10, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 10 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
W20260709 12:11:33.266713 17845 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45912 (request call id 381) took 17748 ms (client timeout 15000 ms). Trace:
W20260709 12:11:33.282037 17845 rpcz_store.cc:269] 0709 12:11:15.638382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:15.652963 (+ 14581us) service_pool.cc:224] Handling call
0709 12:11:33.266600 (+17613637us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:33.191179 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:33.191811 (+   632us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:33.191853 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:11:33.191877 (+    24us) tablet.cc:662] Decoding operations
0709 12:11:33.192256 (+   379us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:33.192330 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:33.192366 (+    36us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:11:33.192616 (+   250us) tablet.cc:701] Row locks acquired
0709 12:11:33.192640 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:11:33.192798 (+   158us) write_op.cc:270] Start()
0709 12:11:33.192931 (+   133us) write_op.cc:276] Timestamp: P: 1783599093192743 usec, L: 0
0709 12:11:33.192959 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:11:33.193635 (+   676us) log.cc:844] Serialized 536 byte log entry
0709 12:11:33.196060 (+  2425us) op_driver.cc:464] REPLICATION: finished
0709 12:11:33.196522 (+   462us) write_op.cc:301] APPLY: starting
0709 12:11:33.196600 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:33.197399 (+   799us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:33.197512 (+   113us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:33.198240 (+   728us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:33.198404 (+   164us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:11:33.198460 (+    56us) write_op.cc:312] APPLY: finished
0709 12:11:33.223281 (+ 24821us) log.cc:844] Serialized 25 byte log entry
0709 12:11:33.223495 (+   214us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:33.223592 (+    97us) write_op.cc:454] Released schema lock
0709 12:11:33.223634 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:33.223978 (+   344us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:33.224006 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":17808,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":236,"apply.run_cpu_time_us":2827,"apply.run_wall_time_us":27424,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4178,"num_ops":1,"prepare.queue_time_us":141,"prepare.run_cpu_time_us":2746,"prepare.run_wall_time_us":2746,"replication_time_us":2966}]]}
I20260709 12:11:33.282037 17843 catalog_manager.cc:5697] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 10 to 12, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 12 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:33.287846 17843 catalog_manager.cc:5697] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 9 to 12, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 12 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:33.289403 17843 catalog_manager.cc:5697] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:33.290695 17843 catalog_manager.cc:5697] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 10 to 13, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 13 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:33.305289 17843 catalog_manager.cc:5697] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 13 to 14, leader changed from <none> to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 14 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:33.395368 17847 catalog_manager.cc:5697] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 9 to 10, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 10 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } }
I20260709 12:11:33.409659 17847 catalog_manager.cc:5697] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 8 to 11, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 11 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:33.427331 17847 catalog_manager.cc:5697] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 11 to 13, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 13 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } }
I20260709 12:11:33.440716 17847 catalog_manager.cc:5697] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:33.444891 17847 catalog_manager.cc:5697] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 8 to 11, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 11 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } }
I20260709 12:11:33.462947 17847 catalog_manager.cc:5697] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 13 to 15, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 15 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } }
I20260709 12:11:33.479488 17847 catalog_manager.cc:5697] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
W20260709 12:11:33.729779 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 60680.8us
W20260709 12:11:33.746490 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 78425.5us
I20260709 12:11:33.764012 17844 catalog_manager.cc:5697] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:33.754463 17847 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45928 (request call id 370) took 1834 ms. Trace:
I20260709 12:11:33.770088 17847 rpcz_store.cc:276] 0709 12:11:31.920313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.923072 (+  2759us) service_pool.cc:224] Handling call
0709 12:11:33.754380 (+1831308us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:33.504785 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:33.507371 (+  2586us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:33.507410 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:11:33.507428 (+    18us) tablet.cc:662] Decoding operations
0709 12:11:33.508298 (+   870us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:33.508355 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:33.508388 (+    33us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:11:33.509037 (+   649us) tablet.cc:701] Row locks acquired
0709 12:11:33.509057 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:11:33.509210 (+   153us) write_op.cc:270] Start()
0709 12:11:33.509330 (+   120us) write_op.cc:276] Timestamp: P: 1783599093509164 usec, L: 0
0709 12:11:33.509360 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:11:33.511493 (+  2133us) log.cc:844] Serialized 2866 byte log entry
0709 12:11:33.526346 (+ 14853us) op_driver.cc:464] REPLICATION: finished
0709 12:11:33.528808 (+  2462us) write_op.cc:301] APPLY: starting
0709 12:11:33.528885 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:33.534043 (+  5158us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:33.534146 (+   103us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:33.548746 (+ 14600us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:33.548963 (+   217us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=0,mrs_lookups=0
0709 12:11:33.549014 (+    51us) write_op.cc:312] APPLY: finished
0709 12:11:33.549299 (+   285us) log.cc:844] Serialized 73 byte log entry
0709 12:11:33.554714 (+  5415us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:33.554871 (+   157us) write_op.cc:454] Released schema lock
0709 12:11:33.554937 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:33.555345 (+   408us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:33.555384 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":15221,"reported_tablets":46,"spinlock_wait_cycles":41216,"child_traces":[["op",{"apply.queue_time_us":2200,"apply.run_cpu_time_us":9493,"apply.run_wall_time_us":26498,"cfile_cache_hit":28,"cfile_cache_hit_bytes":29246,"num_ops":7,"prepare.queue_time_us":9704,"prepare.run_cpu_time_us":3731,"prepare.run_wall_time_us":11120,"replication_time_us":16772}]]}
I20260709 12:11:33.867693 17847 catalog_manager.cc:5697] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 11 to 12, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 12 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:33.890908 17844 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45912 (request call id 382) took 2857 ms. Trace:
I20260709 12:11:33.891286 17844 rpcz_store.cc:276] 0709 12:11:31.033625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:11:31.036899 (+  3274us) service_pool.cc:224] Handling call
0709 12:11:33.890830 (+2853931us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:11:33.777767 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:11:33.778293 (+   526us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:11:33.778340 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:11:33.778352 (+    12us) tablet.cc:662] Decoding operations
0709 12:11:33.778692 (+   340us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:11:33.778749 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:11:33.778779 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:11:33.778973 (+   194us) tablet.cc:701] Row locks acquired
0709 12:11:33.778986 (+    13us) write_op.cc:260] PREPARE: finished
0709 12:11:33.779122 (+   136us) write_op.cc:270] Start()
0709 12:11:33.779234 (+   112us) write_op.cc:276] Timestamp: P: 1783599093779073 usec, L: 0
0709 12:11:33.779251 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:11:33.779862 (+   611us) log.cc:844] Serialized 536 byte log entry
0709 12:11:33.782130 (+  2268us) op_driver.cc:464] REPLICATION: finished
0709 12:11:33.782824 (+   694us) write_op.cc:301] APPLY: starting
0709 12:11:33.782919 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 12:11:33.783773 (+   854us) tablet.cc:1370] finished BulkCheckPresence
0709 12:11:33.783876 (+   103us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:11:33.784549 (+   673us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:11:33.784724 (+   175us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:11:33.784776 (+    52us) write_op.cc:312] APPLY: finished
0709 12:11:33.784960 (+   184us) log.cc:844] Serialized 25 byte log entry
0709 12:11:33.785143 (+   183us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:33.785228 (+    85us) write_op.cc:454] Released schema lock
0709 12:11:33.785267 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:11:33.785609 (+   342us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:11:33.785638 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":247646,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":479,"apply.run_cpu_time_us":2740,"apply.run_wall_time_us":2741,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4178,"num_ops":1,"prepare.queue_time_us":109,"prepare.run_cpu_time_us":2373,"prepare.run_wall_time_us":2373,"replication_time_us":2750}]]}
I20260709 12:11:33.900115 18095 consensus_queue.cc:237] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:33.922317 18642 raft_consensus.cc:1275] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:33.923964 22677 consensus_queue.cc:1048] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:33.950798 18020 raft_consensus.cc:1275] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:33.957304 22456 consensus_queue.cc:1048] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:34.015148 22677 raft_consensus.cc:2955] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index 7 to 10, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:34.023464 18020 raft_consensus.cc:2955] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 7 to 10, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:34.041841 22456 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:34.042405 22456 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:34.048285 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:34.048969 18023 raft_consensus.cc:2468] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 13.
I20260709 12:11:34.050840 18062 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:34.051708 22623 raft_consensus.cc:2804] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:34.052090 22623 raft_consensus.cc:493] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:34.052457 22623 raft_consensus.cc:3060] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:34.053290 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:34.054008 18642 raft_consensus.cc:2393] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 13: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:11:34.053503 17845 catalog_manager.cc:5697] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: config changed from index 7 to 10, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New cstate: current_term: 14 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:34.061254 22456 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:34.063247 22623 raft_consensus.cc:515] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:34.066697 18020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:34.067253 17933 tablet_service.cc:1558] Processing DeleteTablet for tablet 137ed415b9d242989f28f349c1618c74 with delete_type TABLET_DATA_TOMBSTONED (TS 63f5bddeebd84e5788d671a176cfa8e1 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:50326
I20260709 12:11:34.070133 22623 leader_election.cc:290] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:34.070775 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c6bbfd11044938bb4686693c3544a7" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:34.071774 18642 raft_consensus.cc:2393] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 13: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
I20260709 12:11:34.083357 17833 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 137ed415b9d242989f28f349c1618c74 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:11:34.085659 22683 tablet_replica.cc:333] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:34.090426 22683 raft_consensus.cc:2243] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:34.095860 18642 raft_consensus.cc:2955] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 7 to 10, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:34.116632 22683 raft_consensus.cc:2272] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:34.136806 22683 ts_tablet_manager.cc:1916] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:11:34.164563 22683 ts_tablet_manager.cc:1929] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.9
I20260709 12:11:34.165159 22683 log.cc:1199] T 137ed415b9d242989f28f349c1618c74 P 63f5bddeebd84e5788d671a176cfa8e1: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-0-root/wals/137ed415b9d242989f28f349c1618c74
I20260709 12:11:34.199244 22668 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:34.199883 22668 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:34.201984 22668 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:34.213214 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:34.214321 18642 raft_consensus.cc:2468] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:11:34.215605 17987 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:34.218809 22629 raft_consensus.cc:2804] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:34.219174 22629 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:11:34.219499 22629 raft_consensus.cc:3060] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:34.232980 22675 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e28f77912a9c4ba2b9841f6fedddc2db)
I20260709 12:11:34.233578 22675 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:34.235688 22675 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:34.241757 22629 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:34.245467 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:34.246047 18642 raft_consensus.cc:3060] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:34.246927 17832 catalog_manager.cc:5028] TS 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): tablet 137ed415b9d242989f28f349c1618c74 (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:11:34.248442 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:34.251797 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:34.259254 22629 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:34.358251 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 49952.4us
I20260709 12:11:34.078514 18020 raft_consensus.cc:2468] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 13.
I20260709 12:11:34.446959 18062 leader_election.cc:304] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:34.448722 22322 raft_consensus.cc:2804] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:34.449730 22322 raft_consensus.cc:697] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:34.450752 22322 consensus_queue.cc:237] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:34.437490 18024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:44098
I20260709 12:11:34.475116 18024 raft_consensus.cc:606] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 15 LEADER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:34.478287 18023 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3cdd445b25e5404da2f578c388210925"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
mode: GRACEFUL
new_leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:44098
I20260709 12:11:34.479946 18023 raft_consensus.cc:606] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 LEADER]: Received request to transfer leadership to TS e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:11:34.480046 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 81580.5us
I20260709 12:11:34.490859 18023 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
mode: GRACEFUL
new_leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:44098
I20260709 12:11:34.491400 18023 raft_consensus.cc:606] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 LEADER]: Received request to transfer leadership to TS e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:34.498589 18023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:34.505980 18023 raft_consensus.cc:2368] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 8. Current term is 9.
I20260709 12:11:34.510573 18642 raft_consensus.cc:2468] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
I20260709 12:11:34.601135 17987 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:34.617795 22684 raft_consensus.cc:993] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb: : Instructing follower e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:11:34.618316 22684 raft_consensus.cc:1081] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 LEADER]: Signalling peer e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:11:34.637706 22692 raft_consensus.cc:2804] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:34.645449 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:34.650426 17947 raft_consensus.cc:3060] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Advancing to term 9
W20260709 12:11:34.635775 22689 log.cc:927] Time spent T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:11:34.666090 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28dbc0f2cd704e82b686ffe4c9b9967e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1" is_pre_election: true
I20260709 12:11:34.656853 22692 raft_consensus.cc:697] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
W20260709 12:11:34.671885 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 63683.5us
I20260709 12:11:34.677578 22625 raft_consensus.cc:993] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb: : Instructing follower 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:11:34.678093 22625 raft_consensus.cc:1081] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 15 LEADER]: Signalling peer 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:11:34.691756 17947 raft_consensus.cc:2468] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
I20260709 12:11:34.693640 17913 leader_election.cc:400] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Vote denied by peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297) with higher term. Message: Invalid argument: T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 8. Current term is 9.
I20260709 12:11:34.694017 17913 leader_election.cc:403] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:11:34.683471 22692 consensus_queue.cc:237] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:34.684553 18091 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:53954
I20260709 12:11:34.714040 18091 raft_consensus.cc:493] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:34.714519 18091 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:34.700754 22697 raft_consensus.cc:2749] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297) with higher term. Message: Invalid argument: T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f5bddeebd84e5788d671a176cfa8e1 for earlier term 8. Current term is 9.
I20260709 12:11:34.717228 17847 catalog_manager.cc:5697] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 12 to 13, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 13 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:34.722883 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 111214us
I20260709 12:11:34.724601 18638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3cdd445b25e5404da2f578c388210925"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:60424
I20260709 12:11:34.725111 18638 raft_consensus.cc:493] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:34.725435 18638 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:34.732100 18638 raft_consensus.cc:515] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:34.735277 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:34.735853 18095 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:34.736807 18638 leader_election.cc:290] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:34.738973 18091 raft_consensus.cc:515] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:34.743022 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:34.743825 17947 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:34.751866 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 54708.1us
W20260709 12:11:34.752506 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 63728us
I20260709 12:11:34.743227 18091 leader_election.cc:290] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 16 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:34.757907 17947 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 16.
I20260709 12:11:34.759223 18062 leader_election.cc:304] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:11:34.760610 22676 raft_consensus.cc:2804] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:34.761076 22676 raft_consensus.cc:697] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 16 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:34.761916 22676 consensus_queue.cc:237] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:34.766552 18095 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 13.
I20260709 12:11:34.772927 18609 leader_election.cc:304] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:34.776577 22663 raft_consensus.cc:2804] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:34.777061 22663 raft_consensus.cc:697] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 13 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:34.778008 22663 consensus_queue.cc:237] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:34.779886 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cdd445b25e5404da2f578c388210925" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:34.780704 18017 raft_consensus.cc:3055] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:34.781080 18017 raft_consensus.cc:740] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:34.783589 18017 consensus_queue.cc:260] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:34.788177 18017 raft_consensus.cc:3060] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:34.791384 18091 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
mode: GRACEFUL
new_leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:52196
I20260709 12:11:34.792116 18091 raft_consensus.cc:606] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 LEADER]: Received request to transfer leadership to TS e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:11:34.798717 17912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 117487us
I20260709 12:11:34.800424 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0139f0228a724bb58ab2352ee5195b7a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:34.801013 18022 raft_consensus.cc:3055] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:34.801288 18022 raft_consensus.cc:740] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:34.802039 18022 consensus_queue.cc:260] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:34.802696 22684 raft_consensus.cc:993] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb: : Instructing follower e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:11:34.803208 22684 raft_consensus.cc:1081] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 LEADER]: Signalling peer e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:11:34.803465 18022 raft_consensus.cc:3060] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:34.824218 18638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:60424
I20260709 12:11:34.824872 18638 raft_consensus.cc:493] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:34.825214 18638 raft_consensus.cc:3060] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:34.828925 18017 raft_consensus.cc:2468] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 13.
I20260709 12:11:34.833426 18021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4f794e5675049b284921052a24eea37"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
mode: GRACEFUL
new_leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:44098
I20260709 12:11:34.834025 18021 raft_consensus.cc:606] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 LEADER]: Received request to transfer leadership to TS e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:34.832599 18022 raft_consensus.cc:2468] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 16.
I20260709 12:11:34.847199 18638 raft_consensus.cc:515] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:34.848489 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:11:34.850225 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:34.851308 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:34.852718 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:34.853340 18095 raft_consensus.cc:3060] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:34.855288 18640 raft_consensus.cc:1240] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 10. Current term is 11. Ops: []
I20260709 12:11:34.856925 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f9c84f7e9940ce943e3ad8e2888beb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:34.857594 18022 raft_consensus.cc:3055] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:34.858263 18022 raft_consensus.cc:740] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:34.858446 18638 leader_election.cc:290] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:34.870445 18022 consensus_queue.cc:260] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:34.879496 18095 raft_consensus.cc:2468] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 11.
W20260709 12:11:34.879936 22629 consensus_queue.cc:1175] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" responder_term: 11 status { last_received { term: 10 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c5ffa786c8fb43f7864fa8fbe76534cb for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:11:34.883873 18609 leader_election.cc:304] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:34.887409 18022 raft_consensus.cc:3060] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:34.897699 18022 raft_consensus.cc:2468] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 11.
I20260709 12:11:34.887118 22663 raft_consensus.cc:2804] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:34.902374 22699 raft_consensus.cc:993] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb: : Instructing follower e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:11:34.903036 22699 raft_consensus.cc:1081] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 LEADER]: Signalling peer e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:11:34.904943 18638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4f794e5675049b284921052a24eea37"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:60424
I20260709 12:11:34.905515 18638 raft_consensus.cc:493] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:34.905869 18638 raft_consensus.cc:3060] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:34.907912 22663 raft_consensus.cc:697] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 11 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:34.908965 22663 consensus_queue.cc:237] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:34.917670 17845 catalog_manager.cc:5697] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 12 to 13, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 13 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:34.919304 18644 raft_consensus.cc:1275] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:11:34.919488 17844 catalog_manager.cc:5697] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 7 to 9, leader changed from e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 9 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:34.926824 22687 consensus_queue.cc:1048] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:34.915132 18638 raft_consensus.cc:515] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:34.940340 18021 raft_consensus.cc:1275] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:11:34.943264 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:34.943922 17941 raft_consensus.cc:3060] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:34.948731 17847 catalog_manager.cc:5697] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 15 to 16, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 16 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:34.968875 17941 raft_consensus.cc:2468] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 12.
I20260709 12:11:34.972018 22623 consensus_queue.cc:1048] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:34.979413 18608 leader_election.cc:304] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:34.980268 22663 raft_consensus.cc:2804] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:34.980798 22663 raft_consensus.cc:697] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:34.982671 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4f794e5675049b284921052a24eea37" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:34.983279 18021 raft_consensus.cc:3055] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:34.983568 18021 raft_consensus.cc:740] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:34.984192 18021 consensus_queue.cc:260] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:34.985278 18021 raft_consensus.cc:3060] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:34.981631 18638 leader_election.cc:290] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:34.981694 22663 consensus_queue.cc:237] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:35.039912 18021 raft_consensus.cc:2468] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 12.
I20260709 12:11:35.058949 22676 raft_consensus.cc:993] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110: : Instructing follower e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:11:35.059886 22686 raft_consensus.cc:1081] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 LEADER]: Signalling peer e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:11:35.062036 18638 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:60412
I20260709 12:11:35.062517 18638 raft_consensus.cc:493] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:35.062888 18638 raft_consensus.cc:3060] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:35.070037 18638 raft_consensus.cc:515] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:35.070271 17845 catalog_manager.cc:5697] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 10 to 11, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 11 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:35.072788 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:35.073377 18095 raft_consensus.cc:3055] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:11:35.072546 17845 catalog_manager.cc:5697] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 11 to 12, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 12 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:35.073688 18095 raft_consensus.cc:740] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:35.074442 18095 consensus_queue.cc:260] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:35.075515 18095 raft_consensus.cc:3060] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:35.079259 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49c83fd6efbc4c8a92e2e65890ffafd2" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:35.079815 18022 raft_consensus.cc:3060] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:35.082901 18638 leader_election.cc:290] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:35.096642 18022 raft_consensus.cc:2468] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 13.
I20260709 12:11:35.098129 18608 leader_election.cc:304] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:35.098424 18095 raft_consensus.cc:2468] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 13.
I20260709 12:11:35.105036 22663 raft_consensus.cc:2804] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:35.105777 22663 raft_consensus.cc:697] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 13 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:35.106671 22663 consensus_queue.cc:237] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:35.140210 17845 catalog_manager.cc:5697] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 12 to 13, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 13 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:35.176141 17941 raft_consensus.cc:1275] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:35.179157 22629 consensus_queue.cc:1048] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:35.216547 18638 raft_consensus.cc:1275] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:35.218308 22692 consensus_queue.cc:1048] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:11:35.276876 18119 debug-util.cc:398] Leaking SignalData structure 0x7b08000db9e0 after lost signal to thread 16782
W20260709 12:11:35.278053 18119 debug-util.cc:398] Leaking SignalData structure 0x7b08002eb2c0 after lost signal to thread 17881
W20260709 12:11:35.279253 18119 debug-util.cc:398] Leaking SignalData structure 0x7b08001eed00 after lost signal to thread 17973
W20260709 12:11:35.280248 18119 debug-util.cc:398] Leaking SignalData structure 0x7b0800155720 after lost signal to thread 18048
I20260709 12:11:35.283757 18091 raft_consensus.cc:1275] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:11:35.285356 22663 consensus_queue.cc:1048] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:11:35.292937 18119 debug-util.cc:398] Leaking SignalData structure 0x7b08003f0680 after lost signal to thread 18668
I20260709 12:11:35.311295 18017 raft_consensus.cc:1275] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:11:35.313090 22663 consensus_queue.cc:1048] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:11:35.320461 17947 raft_consensus.cc:1275] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 16 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:11:35.326078 22623 consensus_queue.cc:1048] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:35.363776 18091 raft_consensus.cc:1275] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:11:35.365291 22688 consensus_queue.cc:1048] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:35.378419 18017 raft_consensus.cc:1275] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 16 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:11:35.389693 22623 consensus_queue.cc:1048] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:35.444936 17947 raft_consensus.cc:1275] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:35.450012 22688 consensus_queue.cc:1048] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:35.473119 18017 raft_consensus.cc:1275] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:11:35.476145 22663 consensus_queue.cc:1048] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:35.494876 18021 raft_consensus.cc:1275] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:11:35.505398 22695 consensus_queue.cc:1048] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:35.551419 18098 consensus_queue.cc:237] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
W20260709 12:11:35.620615 18061 consensus_peers.cc:597] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 528748760fc743e3a2bce89e03314aab. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:35.623091 17947 raft_consensus.cc:1275] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:35.629216 22686 consensus_queue.cc:1048] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:35.645358 18021 raft_consensus.cc:1275] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:35.651136 22686 consensus_queue.cc:1048] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:35.671835 22686 raft_consensus.cc:2955] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:11:35.676321 17947 raft_consensus.cc:2955] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:11:35.683284 18021 raft_consensus.cc:1275] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
I20260709 12:11:35.684779 22663 consensus_queue.cc:1048] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:11:35.687791 18017 raft_consensus.cc:2955] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:11:35.717017 18098 consensus_queue.cc:237] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:11:35.721987 18091 raft_consensus.cc:1275] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
I20260709 12:11:35.725279 17844 catalog_manager.cc:5697] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: config changed from index -1 to 9, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 13 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:35.738252 22653 consensus_queue.cc:1048] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:11:35.813814 18061 consensus_peers.cc:597] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 46c726e58f614fbdab58f22a7da00365. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:35.816568 18021 raft_consensus.cc:1275] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:11:35.818178 22687 consensus_queue.cc:1048] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:35.839196 17947 raft_consensus.cc:1275] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:11:35.840984 22687 consensus_queue.cc:1048] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:35.848161 22679 raft_consensus.cc:2955] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:11:35.852378 18021 raft_consensus.cc:2955] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:11:35.895532 17847 catalog_manager.cc:5697] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: config changed from index -1 to 7, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 8 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:11:35.910442 17941 consensus_queue.cc:237] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:11:35.923261 17947 raft_consensus.cc:2955] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
W20260709 12:11:35.969612 17912 consensus_peers.cc:597] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a474344628f842a781e714727d867c3a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:35.972779 18095 raft_consensus.cc:1275] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:35.974778 22697 consensus_queue.cc:1048] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:35.998890 18021 raft_consensus.cc:1275] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:11:36.000607 22697 consensus_queue.cc:1048] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:36.026115 22745 ts_tablet_manager.cc:933] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:36.037005 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:36.036455 22597 raft_consensus.cc:2955] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:11:36.038434 18022 raft_consensus.cc:2955] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:11:36.063061 17847 catalog_manager.cc:5697] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: config changed from index -1 to 9, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 13 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:36.066447 22745 tablet_copy_client.cc:323] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.195:41931
I20260709 12:11:36.069671 18108 tablet_copy_service.cc:140] P 4813437da0a74e65b61eb7bd1d18f110: Received BeginTabletCopySession request for tablet 528748760fc743e3a2bce89e03314aab from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:41818)
I20260709 12:11:36.070254 18108 tablet_copy_service.cc:161] P 4813437da0a74e65b61eb7bd1d18f110: Beginning new tablet copy session on tablet 528748760fc743e3a2bce89e03314aab from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:41818: session id = e28f77912a9c4ba2b9841f6fedddc2db-528748760fc743e3a2bce89e03314aab
I20260709 12:11:36.087759 18108 tablet_copy_source_session.cc:215] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:11:36.099208 18095 raft_consensus.cc:2955] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:11:36.123032 18022 consensus_queue.cc:237] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:11:36.124133 22745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 528748760fc743e3a2bce89e03314aab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:36.176671 18095 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "137ed415b9d242989f28f349c1618c74"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
mode: GRACEFUL
new_leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:52196
I20260709 12:11:36.177294 18095 raft_consensus.cc:606] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 14 LEADER]: Received request to transfer leadership to TS e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:36.180990 18095 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "528748760fc743e3a2bce89e03314aab"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
mode: GRACEFUL
new_leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:52196
I20260709 12:11:36.181519 18095 raft_consensus.cc:606] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 13 LEADER]: Received request to transfer leadership to TS 63f5bddeebd84e5788d671a176cfa8e1
W20260709 12:11:36.182156 17987 consensus_peers.cc:597] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9e2acd40c27e44219e850b489602d01a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:36.183322 18095 raft_consensus.cc:1275] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:36.184306 17947 raft_consensus.cc:1275] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:11:36.189540 22699 consensus_queue.cc:1048] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:36.190690 18022 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:44098
I20260709 12:11:36.191294 18022 raft_consensus.cc:606] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 LEADER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:36.194414 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:11:36.195590 22629 consensus_queue.cc:1048] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:11:36.200913 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:36.201787 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:36.222134 22745 tablet_copy_client.cc:806] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:11:36.231350 22745 tablet_copy_client.cc:670] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:11:36.240527 22629 raft_consensus.cc:993] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb: : Instructing follower 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:11:36.241004 22629 raft_consensus.cc:1081] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 LEADER]: Signalling peer 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:11:36.242146 22745 tablet_copy_client.cc:538] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:11:36.244637 18098 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:53954
I20260709 12:11:36.244740 18095 raft_consensus.cc:2955] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:11:36.241837 22629 raft_consensus.cc:2955] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 LEADER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:11:36.265923 22745 tablet_bootstrap.cc:492] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:11:36.265592 17847 catalog_manager.cc:5697] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: config changed from index -1 to 7, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New cstate: current_term: 9 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:36.267874 18098 raft_consensus.cc:493] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:36.268275 18098 raft_consensus.cc:3060] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:36.277345 18098 raft_consensus.cc:515] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:11:36.294991 17941 raft_consensus.cc:2955] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } } }
I20260709 12:11:36.311697 18098 leader_election.cc:290] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:36.312644 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:36.327526 22751 ts_tablet_manager.cc:933] T 46c726e58f614fbdab58f22a7da00365 P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:36.313179 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2acd40c27e44219e850b489602d01a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:36.329833 18022 raft_consensus.cc:3055] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:11:36.330163 18022 raft_consensus.cc:740] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:36.330946 18022 consensus_queue.cc:260] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:11:36.332497 18022 raft_consensus.cc:3060] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:36.342079 18022 raft_consensus.cc:2468] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 10.
I20260709 12:11:36.344450 18062 leader_election.cc:304] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:36.346698 22745 tablet_bootstrap.cc:492] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:11:36.347640 22745 tablet_bootstrap.cc:492] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:11:36.348081 22687 raft_consensus.cc:2804] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:36.348367 22745 ts_tablet_manager.cc:1403] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.083s	user 0.032s	sys 0.013s
I20260709 12:11:36.348634 22687 raft_consensus.cc:697] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 10 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:36.351219 22687 consensus_queue.cc:237] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:11:36.386497 17845 catalog_manager.cc:5697] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 9 to 10, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 10 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:36.388127 22745 raft_consensus.cc:359] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:11:36.390945 22745 raft_consensus.cc:740] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:11:36.399127 22745 consensus_queue.cc:260] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:11:36.402776 22751 tablet_copy_client.cc:323] T 46c726e58f614fbdab58f22a7da00365 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.195:41931
I20260709 12:11:36.404301 18108 tablet_copy_service.cc:140] P 4813437da0a74e65b61eb7bd1d18f110: Received BeginTabletCopySession request for tablet 46c726e58f614fbdab58f22a7da00365 from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:41818)
I20260709 12:11:36.404769 18108 tablet_copy_service.cc:161] P 4813437da0a74e65b61eb7bd1d18f110: Beginning new tablet copy session on tablet 46c726e58f614fbdab58f22a7da00365 from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:41818: session id = e28f77912a9c4ba2b9841f6fedddc2db-46c726e58f614fbdab58f22a7da00365
I20260709 12:11:36.407379 22745 ts_tablet_manager.cc:1434] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.059s	user 0.004s	sys 0.003s
I20260709 12:11:36.409780 18107 tablet_copy_service.cc:342] P 4813437da0a74e65b61eb7bd1d18f110: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-528748760fc743e3a2bce89e03314aab received from {username='slave'} at 127.0.0.1:41818
I20260709 12:11:36.410889 18107 tablet_copy_service.cc:434] P 4813437da0a74e65b61eb7bd1d18f110: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-528748760fc743e3a2bce89e03314aab on tablet 528748760fc743e3a2bce89e03314aab with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:36.419242 18108 tablet_copy_source_session.cc:215] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:11:36.432196 22745 ts_tablet_manager.cc:933] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123)
I20260709 12:11:36.433770 22751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46c726e58f614fbdab58f22a7da00365. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:36.477969 22687 raft_consensus.cc:993] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110: : Instructing follower e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:11:36.478510 22679 raft_consensus.cc:1081] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 14 LEADER]: Signalling peer e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:11:36.480135 18640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "137ed415b9d242989f28f349c1618c74"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:60412
I20260709 12:11:36.480623 18640 raft_consensus.cc:493] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:36.480957 18640 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:36.488088 22745 tablet_copy_client.cc:323] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.193:39123
I20260709 12:11:36.496528 17959 tablet_copy_service.cc:140] P 63f5bddeebd84e5788d671a176cfa8e1: Received BeginTabletCopySession request for tablet a474344628f842a781e714727d867c3a from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:44668)
I20260709 12:11:36.497123 17959 tablet_copy_service.cc:161] P 63f5bddeebd84e5788d671a176cfa8e1: Beginning new tablet copy session on tablet a474344628f842a781e714727d867c3a from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:44668: session id = e28f77912a9c4ba2b9841f6fedddc2db-a474344628f842a781e714727d867c3a
I20260709 12:11:36.524825 17959 tablet_copy_source_session.cc:215] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:11:36.528265 22745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a474344628f842a781e714727d867c3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:36.531944 22751 tablet_copy_client.cc:806] T 46c726e58f614fbdab58f22a7da00365 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:11:36.551071 22751 tablet_copy_client.cc:670] T 46c726e58f614fbdab58f22a7da00365 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:11:36.546317 18644 raft_consensus.cc:1217] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db [term 13 LEARNER]: Deduplicated request from leader. Original: 13.8->[13.9-13.9]   Dedup: 13.9->[]
I20260709 12:11:36.495363 18640 raft_consensus.cc:515] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:36.553871 18640 leader_election.cc:290] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:36.562783 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:36.563424 18022 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:36.575016 18022 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 15.
I20260709 12:11:36.580672 18608 leader_election.cc:304] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:36.584031 22688 raft_consensus.cc:2804] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:36.584558 22688 raft_consensus.cc:697] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 15 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:36.585388 22688 consensus_queue.cc:237] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:36.629730 17845 catalog_manager.cc:5697] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 14 to 15, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 15 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:36.650290 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "137ed415b9d242989f28f349c1618c74" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:36.650978 18098 raft_consensus.cc:3055] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:11:36.651319 18098 raft_consensus.cc:740] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:36.652136 18098 consensus_queue.cc:260] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:36.653339 18098 raft_consensus.cc:3060] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:36.656417 22751 tablet_copy_client.cc:538] T 46c726e58f614fbdab58f22a7da00365 P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:11:36.674880 22751 tablet_bootstrap.cc:492] T 46c726e58f614fbdab58f22a7da00365 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:11:36.690410 18098 raft_consensus.cc:2468] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 15.
I20260709 12:11:36.699782 22679 raft_consensus.cc:993] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110: : Instructing follower 63f5bddeebd84e5788d671a176cfa8e1 to start an election
I20260709 12:11:36.700251 22679 raft_consensus.cc:1081] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 13 LEADER]: Signalling peer 63f5bddeebd84e5788d671a176cfa8e1 to start an election
I20260709 12:11:36.701903 17944 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "528748760fc743e3a2bce89e03314aab"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
 from {username='slave'} at 127.0.0.1:50336
I20260709 12:11:36.698020 22745 tablet_copy_client.cc:806] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:11:36.702399 17944 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:36.702946 17944 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:36.703048 22745 tablet_copy_client.cc:670] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:11:36.708844 22745 tablet_copy_client.cc:538] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:11:36.718830 17944 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:11:36.735885 17944 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 14 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:36.743010 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:36.743608 18017 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:36.747953 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "63f5bddeebd84e5788d671a176cfa8e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:36.749200 18098 raft_consensus.cc:3055] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:36.749550 18098 raft_consensus.cc:740] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:36.751091 18098 consensus_queue.cc:260] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:11:36.752503 18098 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:36.753247 18017 raft_consensus.cc:2468] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 14.
I20260709 12:11:36.755321 17913 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:36.758852 22597 raft_consensus.cc:2804] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:36.759455 22597 raft_consensus.cc:697] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 LEADER]: Becoming Leader. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:36.764292 22597 consensus_queue.cc:237] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
W20260709 12:11:36.776130 18061 consensus_peers.cc:597] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 -> Peer e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647): Couldn't send request to peer e28f77912a9c4ba2b9841f6fedddc2db. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9e2acd40c27e44219e850b489602d01a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:36.781572 17845 catalog_manager.cc:5697] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: term changed from 13 to 14, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193). New cstate: current_term: 14 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:36.799394 22745 tablet_bootstrap.cc:492] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:11:36.800753 18098 raft_consensus.cc:2468] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f5bddeebd84e5788d671a176cfa8e1 in term 14.
I20260709 12:11:36.852595 22751 tablet_bootstrap.cc:492] T 46c726e58f614fbdab58f22a7da00365 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:11:36.900403 18017 raft_consensus.cc:1275] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:36.901842 22679 consensus_queue.cc:1048] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:36.886850 22751 tablet_bootstrap.cc:492] T 46c726e58f614fbdab58f22a7da00365 P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:11:36.915689 22751 ts_tablet_manager.cc:1403] T 46c726e58f614fbdab58f22a7da00365 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.249s	user 0.033s	sys 0.004s
I20260709 12:11:36.928992 22751 raft_consensus.cc:359] T 46c726e58f614fbdab58f22a7da00365 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:11:36.929845 22751 raft_consensus.cc:740] T 46c726e58f614fbdab58f22a7da00365 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:11:36.930481 22751 consensus_queue.cc:260] T 46c726e58f614fbdab58f22a7da00365 P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:11:36.958730 17947 raft_consensus.cc:3060] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:36.968403 18022 raft_consensus.cc:1275] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 15 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:11:36.971760 17947 raft_consensus.cc:1275] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:11:36.975775 22653 consensus_queue.cc:1048] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:36.979203 22755 consensus_queue.cc:1048] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:36.990255 22751 ts_tablet_manager.cc:1434] T 46c726e58f614fbdab58f22a7da00365 P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.074s	user 0.007s	sys 0.000s
I20260709 12:11:36.992141 18108 tablet_copy_service.cc:342] P 4813437da0a74e65b61eb7bd1d18f110: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-46c726e58f614fbdab58f22a7da00365 received from {username='slave'} at 127.0.0.1:41818
I20260709 12:11:36.992520 18108 tablet_copy_service.cc:434] P 4813437da0a74e65b61eb7bd1d18f110: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-46c726e58f614fbdab58f22a7da00365 on tablet 46c726e58f614fbdab58f22a7da00365 with peer e28f77912a9c4ba2b9841f6fedddc2db
W20260709 12:11:37.082737 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 52710.9us
I20260709 12:11:37.139479 18098 raft_consensus.cc:1275] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 15 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:11:37.142344 22771 consensus_queue.cc:1048] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
W20260709 12:11:37.188550 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 89500.6us
I20260709 12:11:37.198057 22745 tablet_bootstrap.cc:492] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:11:37.238137 22745 tablet_bootstrap.cc:492] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:11:37.238858 22745 ts_tablet_manager.cc:1403] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.440s	user 0.041s	sys 0.012s
I20260709 12:11:37.241524 22745 raft_consensus.cc:359] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:11:37.242273 22745 raft_consensus.cc:740] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:11:37.242849 22745 consensus_queue.cc:260] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:11:37.244618 22751 ts_tablet_manager.cc:933] T 9e2acd40c27e44219e850b489602d01a P e28f77912a9c4ba2b9841f6fedddc2db: Initiating tablet copy from peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:37.249534 18095 raft_consensus.cc:1275] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:37.252885 22763 consensus_queue.cc:1048] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:11:37.262825 22745 ts_tablet_manager.cc:1434] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.002s
I20260709 12:11:37.276803 18017 raft_consensus.cc:1275] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:37.289034 22763 consensus_queue.cc:1048] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:37.296721 17959 tablet_copy_service.cc:342] P 63f5bddeebd84e5788d671a176cfa8e1: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-a474344628f842a781e714727d867c3a received from {username='slave'} at 127.0.0.1:44668
I20260709 12:11:37.297209 17959 tablet_copy_service.cc:434] P 63f5bddeebd84e5788d671a176cfa8e1: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-a474344628f842a781e714727d867c3a on tablet a474344628f842a781e714727d867c3a with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:37.323441 22751 tablet_copy_client.cc:323] T 9e2acd40c27e44219e850b489602d01a P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Beginning tablet copy session from remote peer at address 127.16.98.195:41931
I20260709 12:11:37.325438 18108 tablet_copy_service.cc:140] P 4813437da0a74e65b61eb7bd1d18f110: Received BeginTabletCopySession request for tablet 9e2acd40c27e44219e850b489602d01a from peer e28f77912a9c4ba2b9841f6fedddc2db ({username='slave'} at 127.0.0.1:41818)
I20260709 12:11:37.325990 18108 tablet_copy_service.cc:161] P 4813437da0a74e65b61eb7bd1d18f110: Beginning new tablet copy session on tablet 9e2acd40c27e44219e850b489602d01a from peer e28f77912a9c4ba2b9841f6fedddc2db at {username='slave'} at 127.0.0.1:41818: session id = e28f77912a9c4ba2b9841f6fedddc2db-9e2acd40c27e44219e850b489602d01a
I20260709 12:11:37.333562 18640 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db [term 13 LEARNER]: Advancing to term 14
I20260709 12:11:37.334635 18108 tablet_copy_source_session.cc:215] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:11:37.343757 22751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e2acd40c27e44219e850b489602d01a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:11:37.410212 18642 raft_consensus.cc:1217] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db [term 13 LEARNER]: Deduplicated request from leader. Original: 13.8->[13.9-13.9]   Dedup: 13.9->[]
I20260709 12:11:37.419277 18640 raft_consensus.cc:1275] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db [term 14 LEARNER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:11:37.441934 22751 tablet_copy_client.cc:806] T 9e2acd40c27e44219e850b489602d01a P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 0 data blocks...
I20260709 12:11:37.483584 22751 tablet_copy_client.cc:670] T 9e2acd40c27e44219e850b489602d01a P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Starting download of 1 WAL segments...
I20260709 12:11:37.458935 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:37.490828 22597 consensus_queue.cc:1048] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:37.493902 22751 tablet_copy_client.cc:538] T 9e2acd40c27e44219e850b489602d01a P e28f77912a9c4ba2b9841f6fedddc2db: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:11:37.482710 18642 raft_consensus.cc:1217] T 46c726e58f614fbdab58f22a7da00365 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 LEARNER]: Deduplicated request from leader. Original: 8.6->[8.7-8.7]   Dedup: 8.7->[]
I20260709 12:11:37.537518 22751 tablet_bootstrap.cc:492] T 9e2acd40c27e44219e850b489602d01a P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap starting.
I20260709 12:11:37.564741 22697 raft_consensus.cc:1064] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:11:37.567808 22697 consensus_queue.cc:237] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:37.645578 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 57104.3us
I20260709 12:11:37.665323 18640 raft_consensus.cc:1275] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db [term 14 LEARNER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:37.671159 18098 raft_consensus.cc:1275] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:11:37.665059 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 62814us
I20260709 12:11:37.681759 17941 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f"
dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
mode: GRACEFUL
new_leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:11:37.681850 22763 consensus_queue.cc:1048] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:37.682389 17941 raft_consensus.cc:606] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 LEADER]: Received request to transfer leadership to TS c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:37.694439 18095 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
mode: GRACEFUL
new_leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:52196
I20260709 12:11:37.695013 18095 raft_consensus.cc:606] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 15 LEADER]: Received request to transfer leadership to TS e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:37.696978 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:11:37.698235 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:37.699024 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:37.702401 18017 raft_consensus.cc:1275] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:11:37.707763 22597 raft_consensus.cc:993] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1: : Instructing follower c5ffa786c8fb43f7864fa8fbe76534cb to start an election
I20260709 12:11:37.708182 22597 raft_consensus.cc:1081] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 LEADER]: Signalling peer c5ffa786c8fb43f7864fa8fbe76534cb to start an election
I20260709 12:11:37.711949 22778 consensus_queue.cc:1048] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:37.716056 22763 consensus_queue.cc:1048] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:37.716781 18021 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
 from {username='slave'} at 127.0.0.1:45464
I20260709 12:11:37.717348 18021 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:37.717694 18021 raft_consensus.cc:3060] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:37.724830 18021 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:37.726703 18021 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:37.727836 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:37.728377 18638 raft_consensus.cc:3060] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:37.729626 17941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "320059eb6db148929cae07ba683cfe1f" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:37.730170 17941 raft_consensus.cc:3055] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:11:37.730461 17941 raft_consensus.cc:740] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 63f5bddeebd84e5788d671a176cfa8e1, State: Running, Role: LEADER
I20260709 12:11:37.731150 17941 consensus_queue.cc:260] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:37.732167 17941 raft_consensus.cc:3060] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:37.735266 22597 raft_consensus.cc:2955] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 9 to 11, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:37.744086 18098 raft_consensus.cc:2955] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 9 to 11, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:37.745829 18638 raft_consensus.cc:2468] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 11.
I20260709 12:11:37.747094 17987 leader_election.cc:304] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:37.747947 22777 raft_consensus.cc:2804] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:37.748663 22777 raft_consensus.cc:697] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:37.750685 22777 consensus_queue.cc:237] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:37.752595 17941 raft_consensus.cc:2468] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 11.
I20260709 12:11:37.775597 17847 catalog_manager.cc:5697] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: config changed from index 9 to 11, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:37.852396 22768 raft_consensus.cc:993] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110: : Instructing follower e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:11:37.852949 22768 raft_consensus.cc:1081] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 15 LEADER]: Signalling peer e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:11:37.866051 18638 raft_consensus.cc:2955] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 9 to 11, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:37.871363 18642 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:60412
I20260709 12:11:37.871958 18642 raft_consensus.cc:493] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:37.872278 18642 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:11:37.953126 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 78581.4us
I20260709 12:11:37.950197 18642 raft_consensus.cc:515] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:37.964082 18642 leader_election.cc:290] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 16 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:37.976176 22751 tablet_bootstrap.cc:492] T 9e2acd40c27e44219e850b489602d01a P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=1 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:11:37.977473 22751 tablet_bootstrap.cc:492] T 9e2acd40c27e44219e850b489602d01a P e28f77912a9c4ba2b9841f6fedddc2db: Bootstrap complete.
I20260709 12:11:37.978302 22751 ts_tablet_manager.cc:1403] T 9e2acd40c27e44219e850b489602d01a P e28f77912a9c4ba2b9841f6fedddc2db: Time spent bootstrapping tablet: real 0.441s	user 0.031s	sys 0.006s
I20260709 12:11:37.981130 22751 raft_consensus.cc:359] T 9e2acd40c27e44219e850b489602d01a P e28f77912a9c4ba2b9841f6fedddc2db [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:11:37.981868 22751 raft_consensus.cc:740] T 9e2acd40c27e44219e850b489602d01a P e28f77912a9c4ba2b9841f6fedddc2db [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Initialized, Role: LEARNER
I20260709 12:11:37.982467 22751 consensus_queue.cc:260] T 9e2acd40c27e44219e850b489602d01a P e28f77912a9c4ba2b9841f6fedddc2db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: NON_VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: true } }
I20260709 12:11:37.983173 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:37.984555 18095 raft_consensus.cc:3055] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:11:37.984921 18095 raft_consensus.cc:740] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:37.985067 22751 ts_tablet_manager.cc:1434] T 9e2acd40c27e44219e850b489602d01a P e28f77912a9c4ba2b9841f6fedddc2db: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 12:11:37.986219 18095 consensus_queue.cc:260] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:37.987171 18108 tablet_copy_service.cc:342] P 4813437da0a74e65b61eb7bd1d18f110: Request end of tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-9e2acd40c27e44219e850b489602d01a received from {username='slave'} at 127.0.0.1:41818
I20260709 12:11:37.987726 18108 tablet_copy_service.cc:434] P 4813437da0a74e65b61eb7bd1d18f110: ending tablet copy session e28f77912a9c4ba2b9841f6fedddc2db-9e2acd40c27e44219e850b489602d01a on tablet 9e2acd40c27e44219e850b489602d01a with peer e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:37.989812 18095 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:37.994194 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75c1f6edbec54664bbafbe9c9385ff6c" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:37.994746 18017 raft_consensus.cc:3060] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:11:38.003316 18017 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 16.
I20260709 12:11:38.008107 22785 raft_consensus.cc:1064] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:11:38.010954 22785 consensus_queue.cc:237] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:38.015298 18021 raft_consensus.cc:2955] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 9 to 11, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:38.024516 22767 raft_consensus.cc:1064] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:11:38.027498 22767 consensus_queue.cc:237] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:38.042615 17844 catalog_manager.cc:5697] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 10 to 11, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 11 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:38.051455 18095 raft_consensus.cc:2468] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 16.
I20260709 12:11:38.052704 18609 leader_election.cc:304] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:38.055843 22771 raft_consensus.cc:2804] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:11:38.056331 22771 raft_consensus.cc:697] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 16 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:38.057183 22771 consensus_queue.cc:237] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:38.092062 18642 raft_consensus.cc:1275] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db [term 13 LEARNER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:38.092610 18017 raft_consensus.cc:1275] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:38.093497 17946 raft_consensus.cc:1275] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:38.102843 22784 consensus_queue.cc:1048] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:38.108321 18021 raft_consensus.cc:1275] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:11:38.094290 22623 consensus_queue.cc:1048] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:11:38.116031 22685 consensus_queue.cc:1048] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:11:38.116852 22766 consensus_queue.cc:1048] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:11:38.118994 18095 raft_consensus.cc:1275] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 12:11:38.118304 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 95850.5us
I20260709 12:11:38.137117 18640 raft_consensus.cc:1275] T 46c726e58f614fbdab58f22a7da00365 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 LEARNER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:11:38.140347 22784 consensus_queue.cc:1048] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 12:11:38.148650 22766 consensus_queue.cc:1048] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:11:38.218082 22697 raft_consensus.cc:2955] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 9 to 10, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:38.224611 17843 catalog_manager.cc:5697] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 15 to 16, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 16 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:38.224397 18091 raft_consensus.cc:2955] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:38.297092 22766 raft_consensus.cc:2955] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 7 to 8, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
W20260709 12:11:38.301209 22797 log.cc:927] Time spent T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:11:38.303622 17946 raft_consensus.cc:2955] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:38.315112 17947 consensus_queue.cc:237] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:38.388854 18095 raft_consensus.cc:1275] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:38.391000 18021 raft_consensus.cc:2955] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:38.406419 18642 raft_consensus.cc:1217] T 9e2acd40c27e44219e850b489602d01a P e28f77912a9c4ba2b9841f6fedddc2db [term 10 LEARNER]: Deduplicated request from leader. Original: 9.7->[10.8-10.8]   Dedup: 10.8->[]
I20260709 12:11:38.409703 22597 consensus_queue.cc:1048] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:38.434046 18644 raft_consensus.cc:1275] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:38.432753 18640 raft_consensus.cc:2955] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:38.443667 17947 raft_consensus.cc:1275] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:38.445000 17844 catalog_manager.cc:5697] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: config changed from index 9 to 10, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:38.448411 17844 catalog_manager.cc:5697] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: config changed from index 7 to 8, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:38.474193 18642 raft_consensus.cc:1275] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:38.516479 18643 raft_consensus.cc:2955] T 46c726e58f614fbdab58f22a7da00365 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } attrs { replace: true } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:38.456867 22784 consensus_queue.cc:1048] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
W20260709 12:11:38.527449 22789 log.cc:927] Time spent T 00000000000000000000000000000000 P b852ae4791e4401b8356c71ae33bbc7d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:11:38.530934 17913 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 69095.6us
I20260709 12:11:38.464782 22805 consensus_queue.cc:1048] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 12:11:38.552946 22759 consensus_queue.cc:1048] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:38.570519 22597 raft_consensus.cc:2955] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:38.576805 18640 raft_consensus.cc:2955] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:38.578593 18091 raft_consensus.cc:1275] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 16 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:11:38.580778 18095 raft_consensus.cc:2955] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:38.588563 22771 consensus_queue.cc:1048] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:11:38.602698 18021 raft_consensus.cc:2955] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } attrs { replace: true } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:38.648574 18017 raft_consensus.cc:1275] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 16 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:11:38.655406 17832 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 528748760fc743e3a2bce89e03314aab with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:11:38.657526 22804 consensus_queue.cc:1048] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 12:11:38.667769 22766 raft_consensus.cc:1064] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110: attempting to promote NON_VOTER e28f77912a9c4ba2b9841f6fedddc2db to VOTER
I20260709 12:11:38.677026 22766 consensus_queue.cc:237] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:38.696884 17947 consensus_queue.cc:237] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:38.708431 18643 raft_consensus.cc:1275] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:38.711800 22597 consensus_queue.cc:1048] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:11:38.712122 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 269701us
I20260709 12:11:38.724809 18021 raft_consensus.cc:1275] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Refusing update from remote peer 63f5bddeebd84e5788d671a176cfa8e1: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:38.726372 22597 consensus_queue.cc:1048] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:11:38.750176 22597 raft_consensus.cc:2955] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:38.748234 17844 catalog_manager.cc:5697] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: config changed from index 11 to 12, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New cstate: current_term: 14 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:38.758044 18644 raft_consensus.cc:2955] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:38.783469 18022 raft_consensus.cc:2955] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:38.789868 17832 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a474344628f842a781e714727d867c3a with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:11:38.792268 18643 raft_consensus.cc:1275] T 9e2acd40c27e44219e850b489602d01a P e28f77912a9c4ba2b9841f6fedddc2db [term 10 LEARNER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:38.815655 22767 consensus_queue.cc:1048] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:11:38.820444 18021 raft_consensus.cc:1275] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:38.820429 17946 raft_consensus.cc:1275] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:11:38.878396 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:38.905217 17847 catalog_manager.cc:5697] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 reported cstate change: config changed from index 10 to 11, VOTER 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) evicted. New cstate: current_term: 13 leader_uuid: "63f5bddeebd84e5788d671a176cfa8e1" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:38.951848 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 111454us
W20260709 12:11:38.945612 22789 log.cc:927] Time spent T 00000000000000000000000000000000 P b852ae4791e4401b8356c71ae33bbc7d: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 12:11:38.993963 22796 log.cc:927] Time spent T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:11:38.964753 22686 consensus_queue.cc:1048] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
W20260709 12:11:39.026520 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 60659.4us
I20260709 12:11:39.046165 22623 consensus_queue.cc:1048] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:39.049643 18091 consensus_queue.cc:237] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:39.030515 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 70372.1us
W20260709 12:11:39.068636 22822 log.cc:927] Time spent T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 12:11:39.112624 17989 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 74414.8us
I20260709 12:11:39.124431 18080 tablet_service.cc:1558] Processing DeleteTablet for tablet a474344628f842a781e714727d867c3a with delete_type TABLET_DATA_TOMBSTONED (TS 4813437da0a74e65b61eb7bd1d18f110 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:52190
I20260709 12:11:39.176419 18005 tablet_service.cc:1558] Processing DeleteTablet for tablet 528748760fc743e3a2bce89e03314aab with delete_type TABLET_DATA_TOMBSTONED (TS c5ffa786c8fb43f7864fa8fbe76534cb not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:50904
I20260709 12:11:39.185245 18644 raft_consensus.cc:1275] T 46c726e58f614fbdab58f22a7da00365 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:39.209129 22766 consensus_queue.cc:1048] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:39.247061 17947 raft_consensus.cc:1275] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:11:39.255831 22838 tablet_replica.cc:333] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:39.258159 22838 raft_consensus.cc:2243] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:39.259020 22838 raft_consensus.cc:2272] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:39.266893 22836 tablet_replica.cc:333] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:39.268090 22836 raft_consensus.cc:2243] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:39.268862 22836 raft_consensus.cc:2272] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:39.297545 22838 ts_tablet_manager.cc:1916] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:11:39.300392 22836 ts_tablet_manager.cc:1916] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:11:39.316366 22791 raft_consensus.cc:2955] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index 7 to 9, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:39.333678 22766 consensus_queue.cc:1048] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:11:39.341405 18021 raft_consensus.cc:2955] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 7 to 9, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:39.357060 22623 raft_consensus.cc:2955] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:39.363266 17844 catalog_manager.cc:5697] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: config changed from index 7 to 9, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:39.378588 17947 raft_consensus.cc:2955] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 7 to 9, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:39.419374 17833 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 46c726e58f614fbdab58f22a7da00365 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:11:39.432408 18098 consensus_queue.cc:237] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:39.434921 18644 raft_consensus.cc:2955] T 46c726e58f614fbdab58f22a7da00365 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:39.439277 18643 raft_consensus.cc:2955] T 9e2acd40c27e44219e850b489602d01a P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 7 to 9, e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:39.450325 22836 ts_tablet_manager.cc:1929] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.10
I20260709 12:11:39.450879 22836 log.cc:1199] T a474344628f842a781e714727d867c3a P 4813437da0a74e65b61eb7bd1d18f110: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-2-root/wals/a474344628f842a781e714727d867c3a
I20260709 12:11:39.452451 17833 catalog_manager.cc:5028] TS 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): tablet a474344628f842a781e714727d867c3a (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:11:39.452574 18021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05a4983c833c415a94a4c285b408b305"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:44098
I20260709 12:11:39.453202 18021 raft_consensus.cc:606] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 LEADER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:39.456642 17947 raft_consensus.cc:2955] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:39.459939 18022 raft_consensus.cc:1275] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:39.474110 17847 catalog_manager.cc:5697] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: config changed from index 8 to 9, VOTER c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) evicted. New cstate: current_term: 8 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:39.477092 22623 consensus_queue.cc:1048] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:39.489373 18643 raft_consensus.cc:1275] T 9e2acd40c27e44219e850b489602d01a P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:39.497313 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:11:39.499066 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:39.499884 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:39.506875 22679 consensus_queue.cc:1048] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:39.517997 22791 raft_consensus.cc:2955] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 10 LEADER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:39.529937 18005 tablet_service.cc:1558] Processing DeleteTablet for tablet 46c726e58f614fbdab58f22a7da00365 with delete_type TABLET_DATA_TOMBSTONED (TS c5ffa786c8fb43f7864fa8fbe76534cb not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:50904
I20260709 12:11:39.532598 18021 raft_consensus.cc:2955] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:39.546468 17833 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9e2acd40c27e44219e850b489602d01a with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:11:39.552505 22759 raft_consensus.cc:993] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb: : Instructing follower 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:11:39.553078 22759 raft_consensus.cc:1081] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 LEADER]: Signalling peer 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:11:39.555512 18098 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05a4983c833c415a94a4c285b408b305"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:53954
I20260709 12:11:39.556092 18098 raft_consensus.cc:493] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:39.557219 18098 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:39.552628 18644 raft_consensus.cc:2955] T 9e2acd40c27e44219e850b489602d01a P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Committing config change with OpId 10.10: config changed from index 9 to 10, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } } }
I20260709 12:11:39.575894 22838 ts_tablet_manager.cc:1929] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.11
I20260709 12:11:39.577466 22838 log.cc:1199] T 528748760fc743e3a2bce89e03314aab P c5ffa786c8fb43f7864fa8fbe76534cb: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-1-root/wals/528748760fc743e3a2bce89e03314aab
I20260709 12:11:39.579735 22838 tablet_replica.cc:333] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:39.580848 22838 raft_consensus.cc:2243] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:39.581207 17844 catalog_manager.cc:5697] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: config changed from index 9 to 10, VOTER 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) evicted. New cstate: current_term: 10 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:39.582463 17832 catalog_manager.cc:5028] TS c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): tablet 528748760fc743e3a2bce89e03314aab (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:11:39.588222 22838 raft_consensus.cc:2272] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:39.591334 22838 ts_tablet_manager.cc:1916] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:11:39.595681 18098 raft_consensus.cc:515] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:39.597469 18098 leader_election.cc:290] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 14 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:39.603838 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:39.604132 17933 tablet_service.cc:1558] Processing DeleteTablet for tablet 9e2acd40c27e44219e850b489602d01a with delete_type TABLET_DATA_TOMBSTONED (TS 63f5bddeebd84e5788d671a176cfa8e1 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:50326
I20260709 12:11:39.604411 17947 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:39.603360 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a4983c833c415a94a4c285b408b305" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:39.606194 18022 raft_consensus.cc:3055] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:39.606560 18022 raft_consensus.cc:740] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:39.609126 18022 consensus_queue.cc:260] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:39.614876 18022 raft_consensus.cc:3060] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:39.628360 17947 raft_consensus.cc:2468] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 14.
I20260709 12:11:39.638716 18062 leader_election.cc:304] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:11:39.640081 22766 raft_consensus.cc:2804] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:39.640574 22766 raft_consensus.cc:697] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 14 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:39.641453 22766 consensus_queue.cc:237] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:39.652164 22838 ts_tablet_manager.cc:1929] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.8
I20260709 12:11:39.652648 22838 log.cc:1199] T 46c726e58f614fbdab58f22a7da00365 P c5ffa786c8fb43f7864fa8fbe76534cb: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-1-root/wals/46c726e58f614fbdab58f22a7da00365
I20260709 12:11:39.654078 17832 catalog_manager.cc:5028] TS c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): tablet 46c726e58f614fbdab58f22a7da00365 (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:11:39.666983 17844 catalog_manager.cc:5697] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 13 to 14, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 14 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:39.671749 18022 raft_consensus.cc:2468] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 14.
I20260709 12:11:39.717787 22839 tablet_replica.cc:333] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:39.722074 22839 raft_consensus.cc:2243] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:39.731220 22839 raft_consensus.cc:2272] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:39.748152 22839 ts_tablet_manager.cc:1916] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:11:39.850625 22839 ts_tablet_manager.cc:1929] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.9
I20260709 12:11:39.851142 22839 log.cc:1199] T 9e2acd40c27e44219e850b489602d01a P 63f5bddeebd84e5788d671a176cfa8e1: Deleting WAL directory at /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783598895573690-16779-0/minicluster-data/ts-0-root/wals/9e2acd40c27e44219e850b489602d01a
I20260709 12:11:39.861610 17832 catalog_manager.cc:5028] TS 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): tablet 9e2acd40c27e44219e850b489602d01a (table test-workload [id=d402379e42da44a0bdc237a817409e32]) successfully deleted
I20260709 12:11:40.198267 18022 raft_consensus.cc:1275] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:40.206620 22766 consensus_queue.cc:1048] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:40.210292 17947 raft_consensus.cc:1275] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:11:40.211889 22766 consensus_queue.cc:1048] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:11:40.339020 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 61478.1us
I20260709 12:11:40.714529 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:40.794193 18098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
mode: GRACEFUL
new_leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
 from {username='slave'} at 127.0.0.1:52196
I20260709 12:11:40.794919 18098 raft_consensus.cc:606] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Received request to transfer leadership to TS c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:40.797968 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:11:40.799851 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:40.800719 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:40.814754 22849 raft_consensus.cc:993] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110: : Instructing follower c5ffa786c8fb43f7864fa8fbe76534cb to start an election
I20260709 12:11:40.815284 22847 raft_consensus.cc:1081] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Signalling peer c5ffa786c8fb43f7864fa8fbe76534cb to start an election
I20260709 12:11:40.817390 18021 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
 from {username='slave'} at 127.0.0.1:45472
I20260709 12:11:40.817888 18021 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:40.818218 18021 raft_consensus.cc:3060] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:40.828260 18021 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:40.835248 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:40.835767 17947 raft_consensus.cc:3060] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:40.842968 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3cd916f51d64d5d87b9c504a06a8a1e" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:40.843739 18098 raft_consensus.cc:3055] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:11:40.844525 18098 raft_consensus.cc:740] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:40.845232 18098 consensus_queue.cc:260] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:40.846221 18098 raft_consensus.cc:3060] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:40.863680 17947 raft_consensus.cc:2468] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
I20260709 12:11:40.867410 17988 leader_election.cc:304] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:40.873962 22759 raft_consensus.cc:2804] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:40.874464 22759 raft_consensus.cc:697] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:40.875331 22759 consensus_queue.cc:237] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:40.879745 18021 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:40.880877 18098 raft_consensus.cc:2468] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
I20260709 12:11:40.915518 17847 catalog_manager.cc:5697] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 8 to 9, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 9 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:41.274704 17947 raft_consensus.cc:1275] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:41.276401 22857 consensus_queue.cc:1048] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:11:41.324645 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 44476.9us
I20260709 12:11:41.332257 18098 raft_consensus.cc:1275] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:11:41.334923 22759 consensus_queue.cc:1048] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:11:41.904140 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:41.980386 18021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91"
dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
mode: GRACEFUL
new_leader_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:44098
I20260709 12:11:41.981029 18021 raft_consensus.cc:606] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 LEADER]: Received request to transfer leadership to TS 4813437da0a74e65b61eb7bd1d18f110
I20260709 12:11:41.982360 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:11:41.983952 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:41.984634 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:11:42.355868 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 47733.3us
I20260709 12:11:42.411932 22873 raft_consensus.cc:993] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb: : Instructing follower 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:11:42.413489 22857 raft_consensus.cc:1081] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 LEADER]: Signalling peer 4813437da0a74e65b61eb7bd1d18f110 to start an election
I20260709 12:11:42.444868 18095 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
 from {username='slave'} at 127.0.0.1:53954
I20260709 12:11:42.451159 18095 raft_consensus.cc:493] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:42.451797 18095 raft_consensus.cc:3060] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:42.460527 17914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 65619.8us
I20260709 12:11:42.489792 18095 raft_consensus.cc:515] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:42.521677 18095 leader_election.cc:290] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:42.523207 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:42.523948 18021 raft_consensus.cc:3055] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:11:42.524187 18021 raft_consensus.cc:740] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:42.524981 18021 consensus_queue.cc:260] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:42.529011 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26495f0b11bb4f9b9d118b8b2a43da91" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:42.529620 17947 raft_consensus.cc:3060] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:42.526533 18021 raft_consensus.cc:3060] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:42.541206 17947 raft_consensus.cc:2468] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 12.
I20260709 12:11:42.543690 18062 leader_election.cc:304] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1; no voters: 
I20260709 12:11:42.544615 22868 raft_consensus.cc:2804] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:42.545100 22868 raft_consensus.cc:697] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:42.546496 18021 raft_consensus.cc:2468] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 12.
I20260709 12:11:42.546134 22868 consensus_queue.cc:237] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:42.576366 17847 catalog_manager.cc:5697] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 11 to 12, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 12 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:42.994385 18021 raft_consensus.cc:1275] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:42.996039 22868 consensus_queue.cc:1048] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:43.006157 17947 raft_consensus.cc:1275] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:11:43.008080 22868 consensus_queue.cc:1048] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:43.421098 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:43.535009 18095 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7"
dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
mode: GRACEFUL
new_leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:52196
I20260709 12:11:43.535746 18095 raft_consensus.cc:606] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 LEADER]: Received request to transfer leadership to TS e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:43.537437 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:11:43.539211 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:43.540235 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:43.641412 22866 raft_consensus.cc:993] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110: : Instructing follower e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:11:43.642122 22849 raft_consensus.cc:1081] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 LEADER]: Signalling peer e28f77912a9c4ba2b9841f6fedddc2db to start an election
I20260709 12:11:43.649565 18642 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7"
dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
 from {username='slave'} at 127.0.0.1:60412
I20260709 12:11:43.650130 18642 raft_consensus.cc:493] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:11:43.650492 18642 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:43.688277 18642 raft_consensus.cc:515] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:43.701032 18642 leader_election.cc:290] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 14 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:43.705143 17947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "63f5bddeebd84e5788d671a176cfa8e1"
I20260709 12:11:43.705802 17947 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:43.711197 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c345cb34fc6343e98baf0b21aac6d4d7" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:43.711884 18095 raft_consensus.cc:3055] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:11:43.712242 18095 raft_consensus.cc:740] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:43.713258 18095 consensus_queue.cc:260] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:43.721998 18095 raft_consensus.cc:3060] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:43.735365 17947 raft_consensus.cc:2468] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 14.
I20260709 12:11:43.749297 18608 leader_election.cc:304] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:43.750334 22832 raft_consensus.cc:2804] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:43.751302 22832 raft_consensus.cc:697] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 14 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:43.752233 22832 consensus_queue.cc:237] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:43.758262 18095 raft_consensus.cc:2468] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 14.
I20260709 12:11:43.882990 17844 catalog_manager.cc:5697] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 13 to 14, leader changed from 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 14 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:44.219611 17946 raft_consensus.cc:1275] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:44.224231 22869 consensus_queue.cc:1048] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:11:44.279538 18095 raft_consensus.cc:1275] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:11:44.286938 22832 consensus_queue.cc:1048] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:11:44.666541 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:44.721750 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:11:44.725847 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:11:44.726696 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:44.785080 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:11:44.847826 16779 tablet_server.cc:179] TabletServer@127.16.98.193:0 shutting down...
W20260709 12:11:44.908074 18062 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
W20260709 12:11:44.952499 18608 consensus_peers.cc:597] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:44.960716 18062 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 52674.6us
W20260709 12:11:44.961826 17988 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 51551.2us
W20260709 12:11:44.967533 18608 consensus_peers.cc:597] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:44.967756 17988 consensus_peers.cc:597] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:44.968286 18062 consensus_peers.cc:597] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:44.969246 18062 consensus_peers.cc:597] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:44.968400 17988 consensus_peers.cc:597] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:44.971062 17988 consensus_peers.cc:597] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:44.975028 17988 consensus_peers.cc:597] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:44.981410 17988 consensus_peers.cc:597] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:44.983925 16779 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:11:44.985728 16779 tablet_replica.cc:333] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
W20260709 12:11:44.988422 18062 consensus_peers.cc:597] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:44.987699 17988 consensus_peers.cc:597] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:44.988631 16779 raft_consensus.cc:2243] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:45.002316 16779 raft_consensus.cc:2272] T 05a4983c833c415a94a4c285b408b305 P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:45.005439 16779 tablet_replica.cc:333] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
W20260709 12:11:45.006951 17988 consensus_peers.cc:597] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:45.011190 16779 raft_consensus.cc:2243] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:11:45.013377 16779 raft_consensus.cc:2272] T f5d18fbba7e34ac7810ef1fbf82c3697 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:11:45.024652 17988 consensus_peers.cc:597] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:45.029531 16779 tablet_replica.cc:333] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:45.030694 16779 raft_consensus.cc:2243] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:45.034396 16779 raft_consensus.cc:2272] T 4ccf0bcc20ae40e79c32530091613e1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:45.037649 16779 tablet_replica.cc:333] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:45.038609 16779 raft_consensus.cc:2243] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 12:11:45.040108 17988 consensus_peers.cc:597] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:45.048019 18062 consensus_peers.cc:597] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:45.052270 16779 raft_consensus.cc:2272] T 45c29a91be76451a9328d8cd9e3eecab P 63f5bddeebd84e5788d671a176cfa8e1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:45.059197 16779 tablet_replica.cc:333] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
W20260709 12:11:45.059681 17988 consensus_peers.cc:597] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:45.060199 16779 raft_consensus.cc:2243] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:11:45.061501 16779 raft_consensus.cc:2272] T 2d1876d442ce42248de2b1ad2804234a P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:45.064378 16779 tablet_replica.cc:333] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:45.065245 16779 raft_consensus.cc:2243] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:11:45.070966 16779 raft_consensus.cc:2272] T a8c7e98721a04c9690aef2689338516a P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:45.077880 16779 tablet_replica.cc:333] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:45.078894 16779 raft_consensus.cc:2243] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:11:45.082791 16779 raft_consensus.cc:2272] T 7201987495494cf8a78424cb721d1c88 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:11:45.089789 17988 consensus_peers.cc:597] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:45.091715 18062 consensus_peers.cc:597] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:45.092720 16779 tablet_replica.cc:333] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:45.100392 16779 raft_consensus.cc:2243] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 LEADER]: Raft consensus shutting down.
W20260709 12:11:45.102319 18608 consensus_peers.cc:597] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:45.104377 16779 raft_consensus.cc:2272] T 59c85902a99e4edabb1fa20b800476fc P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:11:45.105772 18608 consensus_peers.cc:597] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:45.108395 18062 consensus_peers.cc:597] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:45.118515 17988 consensus_peers.cc:597] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:45.124109 16779 tablet_replica.cc:333] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:45.131345 16779 raft_consensus.cc:2243] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:11:45.132570 16779 raft_consensus.cc:2272] T 74a818492fb249b0ba39c6bed00cd202 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:45.135883 16779 tablet_replica.cc:333] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:45.137527 16779 raft_consensus.cc:2243] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 LEADER]: Raft consensus shutting down.
W20260709 12:11:45.141296 18608 consensus_peers.cc:597] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:45.153963 16779 raft_consensus.cc:2272] T a474344628f842a781e714727d867c3a P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:45.156708 16779 tablet_replica.cc:333] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:45.157528 16779 raft_consensus.cc:2243] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:11:45.158973 16779 raft_consensus.cc:2272] T 1372b5e0da1c481fb926410510c94341 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:11:45.163285 17988 consensus_peers.cc:597] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:45.163873 16779 tablet_replica.cc:333] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:45.164821 16779 raft_consensus.cc:2243] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:45.165453 16779 raft_consensus.cc:2272] T ffcd5906663d452ca5003ea36d28164f P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:45.182138 16779 tablet_replica.cc:333] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:45.183856 16779 raft_consensus.cc:2243] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:11:45.186013 16779 raft_consensus.cc:2272] T 9bb1ec98e5b847df8a401343514ac12d P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:45.190903 16779 tablet_replica.cc:333] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:45.191828 16779 raft_consensus.cc:2243] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:45.196345 16779 raft_consensus.cc:2272] T 9c0d192cc9cf47c1ba111cde01fad070 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:45.199326 16779 tablet_replica.cc:333] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:45.200165 16779 raft_consensus.cc:2243] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:45.200804 16779 raft_consensus.cc:2272] T 0139f0228a724bb58ab2352ee5195b7a P 63f5bddeebd84e5788d671a176cfa8e1 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:11:45.206395 18608 consensus_peers.cc:597] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:45.208835 16779 tablet_replica.cc:333] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:45.217518 16779 raft_consensus.cc:2243] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:45.218252 16779 raft_consensus.cc:2272] T 1f6ed08238924344ac4e43e997223ac9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:45.221120 16779 tablet_replica.cc:333] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:45.222064 16779 raft_consensus.cc:2243] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:45.222687 16779 raft_consensus.cc:2272] T 92e1586ba70a4331be2a55f4a31dd687 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:45.225366 16779 tablet_replica.cc:333] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:45.226223 16779 raft_consensus.cc:2243] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:45.226907 16779 raft_consensus.cc:2272] T 320059eb6db148929cae07ba683cfe1f P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:45.229583 16779 tablet_replica.cc:333] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:45.230468 16779 raft_consensus.cc:2243] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:45.231176 16779 raft_consensus.cc:2272] T 26495f0b11bb4f9b9d118b8b2a43da91 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:45.233964 16779 tablet_replica.cc:333] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:45.234867 16779 raft_consensus.cc:2243] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:45.235486 16779 raft_consensus.cc:2272] T ee9612b75b8d458dab1e3d254afae227 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:45.238163 16779 tablet_replica.cc:333] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:45.239256 16779 raft_consensus.cc:2243] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:11:45.240402 16779 raft_consensus.cc:2272] T 7829c9fa612b452fb76b1c08f805472d P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:45.250233 16779 tablet_replica.cc:333] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
W20260709 12:11:45.269563 18062 consensus_peers.cc:597] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:45.272825 18608 consensus_peers.cc:597] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:45.251174 16779 raft_consensus.cc:2243] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:45.283718 16779 raft_consensus.cc:2272] T 28dbc0f2cd704e82b686ffe4c9b9967e P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:11:45.297960 18062 consensus_peers.cc:597] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:45.309068 16779 tablet_replica.cc:333] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:45.319684 16779 raft_consensus.cc:2243] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:11:45.320538 16779 raft_consensus.cc:2272] T 57fe00fa09a54eb295024fca83b933ec P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:45.330161 16779 tablet_replica.cc:333] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:45.331743 16779 raft_consensus.cc:2243] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:11:45.334064 16779 raft_consensus.cc:2272] T b03f131254e14da2918c02bf0fcf9c5c P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:45.341945 16779 tablet_replica.cc:333] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
W20260709 12:11:45.344614 18608 consensus_peers.cc:597] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:45.345553 16779 raft_consensus.cc:2243] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:45.346073 16779 raft_consensus.cc:2272] T 993eae98279b413f8c6fed0d4ea79eae P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:45.348395 16779 tablet_replica.cc:333] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:45.349006 16779 raft_consensus.cc:2243] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:45.349596 16779 raft_consensus.cc:2272] T ca33c22be72d48f79260f24a00a8f8bb P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:45.361430 16779 tablet_replica.cc:333] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:45.362444 16779 raft_consensus.cc:2243] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:45.366600 16779 raft_consensus.cc:2272] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:45.374580 16779 tablet_replica.cc:333] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:45.375430 16779 raft_consensus.cc:2243] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:45.376176 16779 raft_consensus.cc:2272] T 5c560710763a42e79b5b8080eff3b58b P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:45.385247 16779 tablet_replica.cc:333] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:45.386196 16779 raft_consensus.cc:2243] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:45.386911 16779 raft_consensus.cc:2272] T c592029696004db48d68a9e4c3f45004 P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:45.389809 16779 tablet_replica.cc:333] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:45.393733 16779 raft_consensus.cc:2243] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:45.397549 16779 raft_consensus.cc:2272] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:45.405308 16779 tablet_replica.cc:333] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:45.406062 16779 raft_consensus.cc:2243] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:45.417177 16779 raft_consensus.cc:2272] T 158a286025af4eddba6fb641c128cd25 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:45.429158 16779 tablet_replica.cc:333] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:45.429955 16779 raft_consensus.cc:2243] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:45.438751 16779 raft_consensus.cc:2272] T c4f794e5675049b284921052a24eea37 P 63f5bddeebd84e5788d671a176cfa8e1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:45.441480 16779 tablet_replica.cc:333] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:45.442266 16779 raft_consensus.cc:2243] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:11:45.443363 16779 raft_consensus.cc:2272] T 528748760fc743e3a2bce89e03314aab P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:45.446033 16779 tablet_replica.cc:333] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:45.460991 16779 raft_consensus.cc:2243] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:45.461637 16779 raft_consensus.cc:2272] T 53fdd1cc63be4f3b8a533d34af81d0c6 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:45.464329 16779 tablet_replica.cc:333] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:45.465186 16779 raft_consensus.cc:2243] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:45.465771 16779 raft_consensus.cc:2272] T c345cb34fc6343e98baf0b21aac6d4d7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:45.468472 16779 tablet_replica.cc:333] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:45.469272 16779 raft_consensus.cc:2243] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:45.469825 16779 raft_consensus.cc:2272] T 7b8822f4f1de477e8866529047a823b9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:45.484417 16779 tablet_replica.cc:333] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:45.485307 16779 raft_consensus.cc:2243] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:45.495071 16779 raft_consensus.cc:2272] T f9b0c864d78846698db31224c547a091 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:45.497057 16779 tablet_replica.cc:333] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:45.497879 16779 raft_consensus.cc:2243] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:45.498925 16779 raft_consensus.cc:2272] T 46c726e58f614fbdab58f22a7da00365 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:45.501634 16779 tablet_replica.cc:333] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:45.502410 16779 raft_consensus.cc:2243] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:11:45.503515 16779 raft_consensus.cc:2272] T ba159d1da5c74efba256a169e746d3d9 P 63f5bddeebd84e5788d671a176cfa8e1 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:45.509053 16779 tablet_replica.cc:333] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:45.509841 16779 raft_consensus.cc:2243] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:45.515057 16779 raft_consensus.cc:2272] T b8e1f5339f9042c5935e082c5f212b35 P 63f5bddeebd84e5788d671a176cfa8e1 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:45.517895 16779 tablet_replica.cc:333] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:45.518632 16779 raft_consensus.cc:2243] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:11:45.523541 16779 raft_consensus.cc:2272] T 924b1f0746ad425bb3e560d8665428c1 P 63f5bddeebd84e5788d671a176cfa8e1 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:45.526670 16779 tablet_replica.cc:333] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:45.531224 16779 raft_consensus.cc:2243] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:45.531869 16779 raft_consensus.cc:2272] T e3cd916f51d64d5d87b9c504a06a8a1e P 63f5bddeebd84e5788d671a176cfa8e1 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:45.534467 16779 tablet_replica.cc:333] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:45.539136 16779 raft_consensus.cc:2243] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:45.539721 16779 raft_consensus.cc:2272] T 48619849881f46989095c1f3642592b7 P 63f5bddeebd84e5788d671a176cfa8e1 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:45.542376 16779 tablet_replica.cc:333] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1: stopping tablet replica
I20260709 12:11:45.559330 16779 raft_consensus.cc:2243] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:45.561548 16779 raft_consensus.cc:2272] T 75266a6e976c41a99e22b9d7d7a2cd65 P 63f5bddeebd84e5788d671a176cfa8e1 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:11:45.663650 18061 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 52479.7us
W20260709 12:11:45.819530 17987 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:43647, user_credentials={real_user=slave}} blocked reactor thread for 88579.5us
I20260709 12:11:45.901554 22925 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:45.902156 22925 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:45.904476 22925 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:45.925001 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
W20260709 12:11:45.932966 18062 leader_election.cc:336] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:45.933480 18062 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:45.935628 22925 raft_consensus.cc:2749] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:46.264402 22928 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.265007 22928 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:46.267246 22928 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:46.268195 22927 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.268752 22927 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:46.273728 22922 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.274297 22922 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:46.276376 22922 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:46.276916 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:46.277923 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:46.279461 22915 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.279989 22915 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:46.282205 22915 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:46.288633 18021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:46.290701 22901 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.291309 22901 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:46.293885 22901 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:46.295567 22927 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:46.295732 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:46.296217 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:46.296403 18095 raft_consensus.cc:2468] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 10.
W20260709 12:11:46.296604 18608 leader_election.cc:336] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:46.297847 17989 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:46.298713 22927 raft_consensus.cc:2804] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:46.299417 22927 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.301681 22927 raft_consensus.cc:3060] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:46.301916 18062 leader_election.cc:336] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:46.302373 18062 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:46.303624 22901 raft_consensus.cc:2749] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:46.307302 17988 leader_election.cc:336] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:46.308568 18608 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:46.307709 17988 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:46.310775 22922 raft_consensus.cc:2749] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:46.312942 22928 raft_consensus.cc:2749] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:46.318178 17988 leader_election.cc:336] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
W20260709 12:11:46.320616 18608 leader_election.cc:336] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:46.325254 22922 raft_consensus.cc:493] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.335088 22922 raft_consensus.cc:515] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:46.336448 22927 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:46.337447 22922 leader_election.cc:290] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:46.338563 18608 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:46.341235 22901 raft_consensus.cc:493] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.343061 22922 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.343420 22901 raft_consensus.cc:515] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:46.343567 22922 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:46.345629 22901 leader_election.cc:290] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:46.346300 22922 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:46.348176 22927 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:11:46.351634 18062 leader_election.cc:336] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:46.353801 22928 raft_consensus.cc:2749] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:46.364670 22928 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.365298 22928 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:46.368031 22928 leader_election.cc:290] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:46.369391 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:11:46.370335 17988 leader_election.cc:336] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:46.374620 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:46.378177 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:46.378756 18642 raft_consensus.cc:2468] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
I20260709 12:11:46.383358 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d18fbba7e34ac7810ef1fbf82c3697" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:46.384011 18090 raft_consensus.cc:3060] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:46.391992 18090 raft_consensus.cc:2468] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 11.
I20260709 12:11:46.394318 17989 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:46.397996 22922 raft_consensus.cc:2804] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:46.398528 22922 raft_consensus.cc:697] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:46.399451 22922 consensus_queue.cc:237] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:46.407341 22901 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.407930 22901 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:46.410140 22901 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:46.414086 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:46.414892 18022 raft_consensus.cc:2468] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 11.
I20260709 12:11:46.417156 22925 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.417685 22925 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:46.421298 22915 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.421897 22915 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:46.423858 18062 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:46.424944 22915 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:46.425784 22925 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:46.429023 22901 raft_consensus.cc:2804] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:46.429417 22901 raft_consensus.cc:493] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.429855 22901 raft_consensus.cc:3060] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:46.431309 22927 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.431880 22927 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:46.434216 22927 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:46.439567 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:39123, user_credentials={real_user=slave}} blocked reactor thread for 58568.3us
I20260709 12:11:46.441615 18061 leader_election.cc:304] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:46.443339 22937 raft_consensus.cc:2749] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:46.447634 18062 leader_election.cc:336] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
W20260709 12:11:46.454620 18062 leader_election.cc:336] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:46.456485 22922 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.457122 22922 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:46.458185 17987 leader_election.cc:304] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:46.459252 22934 raft_consensus.cc:2749] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:11:46.459646 22922 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:46.461624 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:46.462318 18090 raft_consensus.cc:2468] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 11.
I20260709 12:11:46.462831 22901 raft_consensus.cc:515] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:46.463519 17987 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:46.463660 17989 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:46.464744 22934 raft_consensus.cc:2804] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:46.464973 22901 leader_election.cc:290] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:46.465138 22934 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.465633 22934 raft_consensus.cc:3060] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:46.466804 22922 raft_consensus.cc:2804] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:11:46.467219 22922 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.467576 22922 raft_consensus.cc:3060] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:46.467854 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7829c9fa612b452fb76b1c08f805472d" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:46.468408 18022 raft_consensus.cc:3060] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:11:46.472213 17988 leader_election.cc:336] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
W20260709 12:11:46.472923 17988 leader_election.cc:336] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:46.477166 18022 raft_consensus.cc:2468] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 12.
I20260709 12:11:46.477062 17845 catalog_manager.cc:5697] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 10 to 11, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 11 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:46.479310 18062 leader_election.cc:304] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:46.483784 22901 raft_consensus.cc:2804] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:46.484371 22901 raft_consensus.cc:697] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 12 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:46.488523 22901 consensus_queue.cc:237] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:11:46.494100 18062 leader_election.cc:336] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:46.495913 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:46.499184 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:46.506325 22937 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.506964 22937 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:46.519547 22937 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:46.520665 18061 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:46.523614 22832 raft_consensus.cc:493] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.524121 22832 raft_consensus.cc:515] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:46.527693 17988 leader_election.cc:336] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:46.533564 18022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:46.533686 22928 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.534401 22928 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:46.536401 18062 leader_election.cc:336] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:46.538264 22928 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:46.538357 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:46.539569 22925 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.540047 22925 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:11:46.540822 22832 leader_election.cc:290] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:46.542017 22925 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123)
I20260709 12:11:46.539228 22928 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.543586 18017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:46.543358 22928 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:46.526312 22937 raft_consensus.cc:2749] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:46.548313 22928 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:46.548998 18090 raft_consensus.cc:2468] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 14.
W20260709 12:11:46.550570 17988 leader_election.cc:336] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:46.552277 22927 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.552940 22927 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:46.553923 22937 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.554489 22937 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:46.555634 22927 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:46.556555 22937 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:46.556931 18609 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:46.565137 22928 raft_consensus.cc:2804] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:46.564775 22934 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:46.565573 22928 raft_consensus.cc:493] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.565956 22928 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:46.570122 22934 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:46.571101 22922 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:46.573861 22922 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:46.574790 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1876d442ce42248de2b1ad2804234a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
W20260709 12:11:46.595789 17988 leader_election.cc:336] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
W20260709 12:11:46.596424 17988 leader_election.cc:336] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
W20260709 12:11:46.578787 18062 leader_election.cc:336] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:46.582167 22928 raft_consensus.cc:515] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db [term 15 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:46.595973 18090 raft_consensus.cc:3060] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:11:46.576221 22927 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.596948 18062 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:46.603420 22928 leader_election.cc:290] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:46.604732 17844 catalog_manager.cc:5697] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 11 to 12, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 12 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } }
I20260709 12:11:46.611064 22941 raft_consensus.cc:2749] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:46.612689 22927 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:46.614785 22927 leader_election.cc:290] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:46.620606 18090 raft_consensus.cc:2468] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 12.
W20260709 12:11:46.621558 18062 leader_election.cc:336] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
W20260709 12:11:46.622502 17988 leader_election.cc:336] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:46.627274 17989 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:46.622493 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "528748760fc743e3a2bce89e03314aab" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
W20260709 12:11:46.624926 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 101236us
I20260709 12:11:46.628028 22927 raft_consensus.cc:2804] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:11:46.629289 22927 raft_consensus.cc:697] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:46.629729 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:46.630426 18643 raft_consensus.cc:2468] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 10.
I20260709 12:11:46.630265 22927 consensus_queue.cc:237] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:46.632931 18090 raft_consensus.cc:3060] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:11:46.633353 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:46.634112 18642 raft_consensus.cc:2468] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
I20260709 12:11:46.637732 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:46.638324 18644 raft_consensus.cc:2468] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 13.
I20260709 12:11:46.638332 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:46.638934 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:46.639770 18643 raft_consensus.cc:2468] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 13.
I20260709 12:11:46.638998 18638 raft_consensus.cc:2468] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 10.
I20260709 12:11:46.640921 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7201987495494cf8a78424cb721d1c88" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:46.641526 18642 raft_consensus.cc:3060] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:11:46.647122 17988 leader_election.cc:336] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:46.648412 17987 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:46.649047 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:46.649624 18024 raft_consensus.cc:2468] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 8.
I20260709 12:11:46.652673 22922 raft_consensus.cc:2804] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:46.653039 22922 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.653131 22934 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.653434 22922 raft_consensus.cc:3060] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:46.653493 17987 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:46.654065 18642 raft_consensus.cc:2468] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 10.
I20260709 12:11:46.653618 22934 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:46.656512 22934 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:46.659473 22940 raft_consensus.cc:2804] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:46.659840 22940 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.660171 22940 raft_consensus.cc:3060] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:46.662881 22943 raft_consensus.cc:493] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.663415 22943 raft_consensus.cc:515] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:46.665452 22943 leader_election.cc:290] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:46.666960 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:46.666890 17987 leader_election.cc:304] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:46.667588 18095 raft_consensus.cc:2468] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 9.
I20260709 12:11:46.668740 18609 leader_election.cc:304] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:46.670529 18061 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:46.670861 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:46.673146 18061 leader_election.cc:304] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:46.673910 22925 raft_consensus.cc:2804] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:46.674286 22925 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.674675 22925 raft_consensus.cc:3060] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:46.677649 18090 raft_consensus.cc:2468] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 15.
I20260709 12:11:46.678933 18609 leader_election.cc:304] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:46.672045 22934 raft_consensus.cc:2804] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:46.681223 22934 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.681608 22934 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:11:46.682986 17988 leader_election.cc:336] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
W20260709 12:11:46.686193 18608 leader_election.cc:336] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:46.686827 18608 leader_election.cc:304] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:46.687783 22915 raft_consensus.cc:2749] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:11:46.687914 18608 leader_election.cc:336] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:46.691110 18608 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:46.691938 22832 raft_consensus.cc:2749] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:46.690659 22946 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.693215 22946 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:46.694473 17987 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:46.696468 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:46.697110 18642 raft_consensus.cc:2468] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 12.
I20260709 12:11:46.675649 22940 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:46.698032 18608 leader_election.cc:304] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:46.675292 22936 raft_consensus.cc:2804] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:11:46.702768 22832 raft_consensus.cc:2804] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:46.703217 22832 raft_consensus.cc:493] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.703606 22832 raft_consensus.cc:3060] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:46.672288 22928 raft_consensus.cc:2804] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:11:46.682268 22943 raft_consensus.cc:2804] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:11:46.716257 22940 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:46.707091 22936 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.707000 22946 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:46.708024 22928 raft_consensus.cc:493] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.727873 22943 raft_consensus.cc:697] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db [term 15 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:46.729250 22943 consensus_queue.cc:237] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:46.720992 22936 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.724196 22928 raft_consensus.cc:3060] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:46.736982 22922 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:46.743759 18024 raft_consensus.cc:2393] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 11: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:46.746011 22922 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:46.778935 22940 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.779467 22940 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:11:46.781534 22940 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123)
I20260709 12:11:46.783228 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:46.783946 18090 raft_consensus.cc:2468] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 10.
I20260709 12:11:46.785121 17989 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:46.785873 22949 raft_consensus.cc:2804] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:46.786800 22832 raft_consensus.cc:515] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:46.791368 22832 leader_election.cc:290] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:46.786310 22949 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.800386 22934 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:46.800920 22949 raft_consensus.cc:3060] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:46.792578 22945 raft_consensus.cc:2804] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:46.811470 22945 raft_consensus.cc:697] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:46.812441 22945 consensus_queue.cc:237] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:46.813776 16779 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 17970)
I20260709 12:11:46.786271 22925 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:46.802490 22934 leader_election.cc:290] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 14 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:46.819867 18608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:36297, user_credentials={real_user=slave}} blocked reactor thread for 118541us
I20260709 12:11:46.820870 17987 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
W20260709 12:11:46.821230 18608 leader_election.cc:336] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:46.825606 22922 raft_consensus.cc:2804] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:11:46.826056 22922 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.826426 22922 raft_consensus.cc:3060] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:46.806160 22936 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:46.838178 22925 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:46.839179 18062 leader_election.cc:336] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:46.839998 22936 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 14 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
W20260709 12:11:46.844691 18062 leader_election.cc:336] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
W20260709 12:11:46.846077 17988 leader_election.cc:336] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
W20260709 12:11:46.847762 17988 leader_election.cc:336] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
W20260709 12:11:46.848289 17988 leader_election.cc:336] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:46.848549 22949 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:11:46.852352 18090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "924b1f0746ad425bb3e560d8665428c1" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:46.842285 22928 raft_consensus.cc:515] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:46.852908 18090 raft_consensus.cc:3060] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:46.854151 22922 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:46.861184 22928 leader_election.cc:290] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:46.859671 22922 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 13 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:46.862257 18095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1372b5e0da1c481fb926410510c94341" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:46.862901 18095 raft_consensus.cc:3060] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:46.868218 18643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:46.868624 22953 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.869204 22953 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:46.870921 18640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c85902a99e4edabb1fa20b800476fc" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:46.870990 18643 raft_consensus.cc:2468] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 8.
I20260709 12:11:46.871572 18640 raft_consensus.cc:3060] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:11:46.870324 17844 catalog_manager.cc:5697] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 14 to 15, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 15 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:46.885201 17988 leader_election.cc:336] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
W20260709 12:11:46.885861 17988 leader_election.cc:336] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:46.887563 22953 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:46.888650 18098 raft_consensus.cc:1275] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:11:46.890231 22922 consensus_queue.cc:1048] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:11:46.890677 18095 raft_consensus.cc:2468] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 10.
I20260709 12:11:46.891680 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74a818492fb249b0ba39c6bed00cd202" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:46.891842 18609 leader_election.cc:304] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:46.892239 18638 raft_consensus.cc:3060] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:46.892392 22949 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 election: Requested vote from peers 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931), 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123)
I20260709 12:11:46.892758 22953 raft_consensus.cc:2804] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:46.893340 22953 raft_consensus.cc:697] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:46.894416 22953 consensus_queue.cc:237] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:46.894980 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a474344628f842a781e714727d867c3a" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:46.895910 18644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe00fa09a54eb295024fca83b933ec" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:46.896972 18090 raft_consensus.cc:2468] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 11.
I20260709 12:11:46.898356 18644 raft_consensus.cc:3060] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:11:46.897921 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb1ec98e5b847df8a401343514ac12d" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb"
I20260709 12:11:46.899091 18024 raft_consensus.cc:3060] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:11:46.898288 18642 raft_consensus.cc:3060] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.899389 17989 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb; no voters: 
I20260709 12:11:46.890255 18640 raft_consensus.cc:2468] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 10.
I20260709 12:11:46.907120 22949 raft_consensus.cc:2804] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:46.907673 22949 raft_consensus.cc:697] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:46.907824 18644 raft_consensus.cc:2468] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 13.
I20260709 12:11:46.910777 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c7e98721a04c9690aef2689338516a" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:46.911387 18637 raft_consensus.cc:3060] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:11:46.911085 22949 consensus_queue.cc:237] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:11:46.923358 18642 raft_consensus.cc:2468] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 14.
I20260709 12:11:46.927433 18024 raft_consensus.cc:2468] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 9.
I20260709 12:11:46.911455 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03f131254e14da2918c02bf0fcf9c5c" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
I20260709 12:11:46.929908 18639 raft_consensus.cc:3060] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:46.931313 18608 leader_election.cc:336] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
W20260709 12:11:46.932969 18608 leader_election.cc:336] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
W20260709 12:11:46.933626 18608 leader_election.cc:336] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
W20260709 12:11:46.934257 18608 leader_election.cc:336] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:46.934623 18608 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:46.938351 18639 raft_consensus.cc:2468] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 11.
I20260709 12:11:46.941020 17987 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:46.943099 17987 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:46.948402 18638 raft_consensus.cc:2468] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 11.
W20260709 12:11:46.948501 17988 leader_election.cc:336] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:46.949306 17987 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:46.952126 22922 raft_consensus.cc:2804] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:11:46.952782 22922 raft_consensus.cc:697] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:46.953948 22922 consensus_queue.cc:237] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:46.963438 17987 leader_election.cc:304] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:46.962054 18061 leader_election.cc:304] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:46.967571 22946 raft_consensus.cc:2804] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:46.968254 22946 raft_consensus.cc:697] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:46.950750 22915 raft_consensus.cc:2749] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:46.969352 22946 consensus_queue.cc:237] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:46.972544 22950 raft_consensus.cc:2804] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:11:46.973112 22950 raft_consensus.cc:697] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:46.973598 22936 raft_consensus.cc:2804] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:46.974139 22936 raft_consensus.cc:697] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 11 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
I20260709 12:11:46.974009 22950 consensus_queue.cc:237] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:46.976583 22936 consensus_queue.cc:237] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:46.977278 18024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" is_pre_election: true
I20260709 12:11:46.950950 22934 raft_consensus.cc:2804] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:11:46.985265 22934 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 63f5bddeebd84e5788d671a176cfa8e1)
I20260709 12:11:46.985625 18637 raft_consensus.cc:2468] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 14.
I20260709 12:11:46.951128 18608 leader_election.cc:304] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
W20260709 12:11:46.987545 17988 consensus_peers.cc:597] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:46.985693 22934 raft_consensus.cc:3060] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:46.992239 18608 leader_election.cc:336] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
W20260709 12:11:46.994881 18608 leader_election.cc:336] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:46.996469 17987 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:46.996969 18061 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
W20260709 12:11:46.993796 17988 leader_election.cc:336] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:47.001078 22949 raft_consensus.cc:2804] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:47.004283 22949 raft_consensus.cc:697] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:47.001243 22941 raft_consensus.cc:2804] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:11:47.012374 22941 raft_consensus.cc:697] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 14 LEADER]: Becoming Leader. State: Replica: 4813437da0a74e65b61eb7bd1d18f110, State: Running, Role: LEADER
W20260709 12:11:47.012987 18608 leader_election.cc:336] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:47.013322 22941 consensus_queue.cc:237] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:46.997093 22928 raft_consensus.cc:2804] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:47.016956 22928 raft_consensus.cc:697] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 9 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:47.034704 22928 consensus_queue.cc:237] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:47.065016 18017 raft_consensus.cc:1275] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:11:47.066632 22901 consensus_queue.cc:1048] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:11:47.066937 17988 consensus_peers.cc:597] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:11:47.068048 22949 consensus_queue.cc:237] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:47.067487 17988 consensus_peers.cc:597] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:47.095106 17844 catalog_manager.cc:5697] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 10 to 11, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 11 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:47.097983 17844 catalog_manager.cc:5697] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 reported cstate change: term changed from 13 to 14, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195). New cstate: current_term: 14 leader_uuid: "4813437da0a74e65b61eb7bd1d18f110" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:47.112316 22934 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:47.115015 18024 raft_consensus.cc:2393] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 9: Already voted for candidate c5ffa786c8fb43f7864fa8fbe76534cb in this term.
I20260709 12:11:47.128997 18608 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:47.130824 22953 raft_consensus.cc:3060] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:11:47.134016 18062 consensus_peers.cc:597] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:47.143054 17844 catalog_manager.cc:5697] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 9 to 10, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 10 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:47.143630 22934 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Requested vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:47.148295 22953 raft_consensus.cc:2749] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:11:47.149945 18608 consensus_peers.cc:597] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:47.154932 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba159d1da5c74efba256a169e746d3d9" candidate_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
W20260709 12:11:47.174089 17988 leader_election.cc:336] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:47.186764 18638 raft_consensus.cc:2468] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5ffa786c8fb43f7864fa8fbe76534cb in term 9.
I20260709 12:11:47.192534 17987 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:47.194408 22949 raft_consensus.cc:2804] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:11:47.194980 22949 raft_consensus.cc:697] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 LEADER]: Becoming Leader. State: Replica: c5ffa786c8fb43f7864fa8fbe76534cb, State: Running, Role: LEADER
I20260709 12:11:47.196101 22949 consensus_queue.cc:237] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:47.193805 17845 catalog_manager.cc:5697] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 8 to 9, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 9 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:11:47.215644 17988 consensus_peers.cc:597] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:47.242125 18062 consensus_peers.cc:597] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:47.251022 17988 consensus_peers.cc:597] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:47.267285 18090 raft_consensus.cc:1275] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:11:47.269480 22949 consensus_queue.cc:1048] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:11:47.280019 18608 consensus_peers.cc:597] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:11:47.283085 17844 catalog_manager.cc:5697] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 11 to 12, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 12 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:47.284901 17844 catalog_manager.cc:5697] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 9 to 10, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 10 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:47.286460 17844 catalog_manager.cc:5697] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 10 to 11, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 11 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:47.287936 17844 catalog_manager.cc:5697] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 9 to 10, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 10 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:47.292428 18062 consensus_peers.cc:597] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:11:47.299703 18638 raft_consensus.cc:1275] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:47.301342 22949 consensus_queue.cc:1048] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:11:47.306532 17844 catalog_manager.cc:5697] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 13 to 14, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 14 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:47.308342 17844 catalog_manager.cc:5697] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 12 to 13, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 13 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:47.309919 17844 catalog_manager.cc:5697] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 10 to 11, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 11 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:11:47.311980 18062 consensus_peers.cc:597] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:11:47.311905 17844 catalog_manager.cc:5697] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb reported cstate change: term changed from 8 to 9, leader changed from 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193) to c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194). New cstate: current_term: 9 leader_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:11:47.339398 18098 raft_consensus.cc:1275] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 15 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:11:47.340845 22928 consensus_queue.cc:1048] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:11:47.354074 17988 consensus_peers.cc:597] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:47.359452 17988 consensus_peers.cc:597] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:47.364676 18090 raft_consensus.cc:1275] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:11:47.365168 17988 consensus_peers.cc:597] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:11:47.367447 22949 consensus_queue.cc:1048] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:11:47.372614 17988 consensus_peers.cc:597] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:11:47.387343 18638 raft_consensus.cc:1275] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:11:47.389015 22949 consensus_queue.cc:1048] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:11:47.390532 18062 consensus_peers.cc:597] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:47.391405 18638 raft_consensus.cc:1275] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:11:47.393919 22949 consensus_queue.cc:1048] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:11:47.398015 17988 consensus_peers.cc:597] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:47.448259 18095 raft_consensus.cc:1275] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:11:47.451411 18637 raft_consensus.cc:1275] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:11:47.452200 18062 consensus_peers.cc:597] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:47.453449 22953 consensus_queue.cc:1048] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:11:47.464128 18637 raft_consensus.cc:1275] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Refusing update from remote peer 4813437da0a74e65b61eb7bd1d18f110: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:11:47.468580 18017 raft_consensus.cc:1275] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:47.466898 22962 consensus_queue.cc:1048] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
W20260709 12:11:47.471501 18608 consensus_peers.cc:597] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:47.471967 18608 consensus_peers.cc:597] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:47.473990 22951 consensus_queue.cc:1048] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:11:47.500190 22936 consensus_queue.cc:1048] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:11:47.502463 17988 consensus_peers.cc:597] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:47.504514 17988 consensus_peers.cc:597] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:47.507570 17988 consensus_peers.cc:597] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:47.514191 18638 raft_consensus.cc:1275] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:11:47.521126 18608 consensus_peers.cc:597] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:47.529793 22927 consensus_queue.cc:1048] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
W20260709 12:11:47.554481 17988 consensus_peers.cc:597] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:47.559731 18608 consensus_peers.cc:597] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:47.572345 17988 consensus_peers.cc:597] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:47.587677 18062 consensus_peers.cc:597] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:47.619099 18608 consensus_peers.cc:597] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:47.633931 18062 consensus_peers.cc:597] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:47.628373 17988 consensus_peers.cc:597] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:47.634716 17988 consensus_peers.cc:597] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:47.634788 18608 consensus_peers.cc:597] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:47.639679 17988 consensus_peers.cc:597] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:47.659162 17988 consensus_peers.cc:597] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:47.662590 18608 consensus_peers.cc:597] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:11:47.679792 18642 raft_consensus.cc:1275] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:11:47.680619 17988 consensus_peers.cc:597] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:11:47.681393 22950 consensus_queue.cc:1048] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:11:47.718251 18608 consensus_peers.cc:597] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:47.720793 17988 consensus_peers.cc:597] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:47.796100 18637 raft_consensus.cc:1275] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Refusing update from remote peer c5ffa786c8fb43f7864fa8fbe76534cb: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:11:47.798893 22950 consensus_queue.cc:1048] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:11:47.803346 18062 consensus_peers.cc:597] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:47.811636 18062 consensus_peers.cc:597] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:47.819103 16779 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 17970)
W20260709 12:11:47.883311 17988 consensus_peers.cc:597] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:47.913787 18608 consensus_peers.cc:597] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:48.022334 18062 consensus_peers.cc:597] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:48.819811 16779 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 17970)
W20260709 12:11:49.465292 17988 consensus_peers.cc:597] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:49.480818 17988 consensus_peers.cc:597] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:49.559319 18608 consensus_peers.cc:597] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:49.561021 17988 consensus_peers.cc:597] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:49.614602 18062 consensus_peers.cc:597] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:49.617283 17988 consensus_peers.cc:597] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:49.664933 17988 consensus_peers.cc:597] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:49.760222 18608 consensus_peers.cc:597] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:49.767059 17988 consensus_peers.cc:597] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:49.769132 17988 consensus_peers.cc:597] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:49.774081 18608 consensus_peers.cc:597] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:49.787659 17988 consensus_peers.cc:597] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:49.788296 18062 consensus_peers.cc:597] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:49.820628 16779 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 17970)
W20260709 12:11:49.864346 18062 consensus_peers.cc:597] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:49.876080 17988 consensus_peers.cc:597] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:49.900933 18062 consensus_peers.cc:597] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:49.909637 18062 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111) [suppressed 421 similar messages]
W20260709 12:11:49.914745 17988 consensus_peers.cc:597] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:49.925122 18608 consensus_peers.cc:597] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:49.918942 18062 consensus_peers.cc:597] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:49.945151 17988 consensus_peers.cc:597] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:49.978608 17988 consensus_peers.cc:597] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:49.991667 18062 consensus_peers.cc:597] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:50.010836 18608 consensus_peers.cc:597] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:50.047576 18608 consensus_peers.cc:597] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:50.081517 17988 consensus_peers.cc:597] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:50.082060 17988 consensus_peers.cc:597] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:50.103089 18608 consensus_peers.cc:597] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:50.130358 17988 consensus_peers.cc:597] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:50.179930 18062 consensus_peers.cc:597] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:50.200970 18608 consensus_peers.cc:597] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:50.204008 17988 consensus_peers.cc:597] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:50.205157 18062 consensus_peers.cc:597] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:50.237473 17988 consensus_peers.cc:597] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:50.257936 18608 consensus_peers.cc:597] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:50.281708 17988 consensus_peers.cc:597] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:50.321442 17988 consensus_peers.cc:597] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:50.322153 18062 consensus_peers.cc:597] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:50.325182 18608 consensus_peers.cc:597] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:50.328527 17988 consensus_peers.cc:597] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:50.384971 17988 consensus_peers.cc:597] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:50.470502 18608 consensus_peers.cc:597] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:50.509544 18062 consensus_peers.cc:597] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:50.643437 18062 consensus_peers.cc:597] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:50.711669 17988 consensus_peers.cc:597] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:51.801571 17988 consensus_peers.cc:597] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:51.871835 18608 consensus_peers.cc:597] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:51.959151 17988 consensus_peers.cc:597] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:11:51.999910 16779 tablet_server.cc:196] TabletServer@127.16.98.193:0 shutdown complete.
W20260709 12:11:52.010867 17988 consensus_peers.cc:597] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:52.070333 17988 consensus_peers.cc:597] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:11:52.180121 16779 tablet_server.cc:179] TabletServer@127.16.98.194:0 shutting down...
W20260709 12:11:52.206702 17988 consensus_peers.cc:597] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:52.213544 18608 consensus_peers.cc:597] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:52.215392 18608 consensus_peers.cc:597] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:52.223971 18608 consensus_peers.cc:597] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:52.227185 18062 consensus_peers.cc:597] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:52.241942 18062 consensus_peers.cc:597] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:52.247191 17988 consensus_peers.cc:597] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:52.249601 17988 consensus_peers.cc:597] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:52.381568 18608 consensus_peers.cc:597] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:52.385833 17988 consensus_peers.cc:597] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:52.391878 18608 consensus_peers.cc:597] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:52.398943 17988 consensus_peers.cc:597] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:52.414973 18062 consensus_peers.cc:597] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:52.415802 18062 consensus_peers.cc:597] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:52.424747 18062 consensus_peers.cc:597] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:52.447968 18608 consensus_peers.cc:597] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:52.451287 17988 consensus_peers.cc:597] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:52.451967 17988 consensus_peers.cc:597] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:52.444590 18062 consensus_peers.cc:597] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:52.454725 18062 consensus_peers.cc:597] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:52.479956 18608 consensus_peers.cc:597] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:52.492496 18062 consensus_peers.cc:597] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:52.492957 18062 consensus_peers.cc:597] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:52.497751 17988 consensus_peers.cc:597] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:52.498308 17988 consensus_peers.cc:597] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:52.498932 18608 consensus_peers.cc:597] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:52.498987 17988 consensus_peers.cc:597] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:52.505311 18608 consensus_peers.cc:597] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:52.506078 18608 consensus_peers.cc:597] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:52.506918 18062 consensus_peers.cc:597] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:52.515769 18062 consensus_peers.cc:597] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:52.523557 18062 consensus_peers.cc:597] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:52.524271 18062 consensus_peers.cc:597] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:52.524997 18062 consensus_peers.cc:597] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:52.525921 18062 consensus_peers.cc:597] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:52.526664 18062 consensus_peers.cc:597] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:52.515844 17988 consensus_peers.cc:597] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:52.540019 18608 consensus_peers.cc:597] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:52.545974 16779 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:11:52.548130 16779 tablet_replica.cc:333] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.549642 16779 raft_consensus.cc:2243] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:11:52.551585 16779 raft_consensus.cc:2272] T f5d18fbba7e34ac7810ef1fbf82c3697 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:11:52.554097 18608 consensus_peers.cc:597] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:52.555053 16779 tablet_replica.cc:333] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.556265 16779 raft_consensus.cc:2243] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:11:52.558019 16779 raft_consensus.cc:2272] T 4ccf0bcc20ae40e79c32530091613e1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:11:52.561899 18062 consensus_peers.cc:597] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:11:52.562338 16779 tablet_replica.cc:333] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.563575 16779 raft_consensus.cc:2243] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:11:52.565698 16779 raft_consensus.cc:2272] T 2d1876d442ce42248de2b1ad2804234a P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:11:52.568341 18062 consensus_peers.cc:597] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:52.570310 16779 tablet_replica.cc:333] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.571599 16779 raft_consensus.cc:2243] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:52.572578 16779 raft_consensus.cc:2272] T 05a4983c833c415a94a4c285b408b305 P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:52.575774 16779 tablet_replica.cc:333] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.576732 16779 raft_consensus.cc:2243] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:11:52.578944 16779 raft_consensus.cc:2272] T ba159d1da5c74efba256a169e746d3d9 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:52.582109 16779 tablet_replica.cc:333] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.583024 16779 raft_consensus.cc:2243] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:52.584025 16779 raft_consensus.cc:2272] T 5379a078a5d24d8cba5cb4e56eee5b5f P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:11:52.588055 18608 consensus_peers.cc:597] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:52.589303 16779 tablet_replica.cc:333] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.590444 16779 raft_consensus.cc:2243] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:11:52.595124 16779 raft_consensus.cc:2272] T a474344628f842a781e714727d867c3a P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:52.600899 16779 tablet_replica.cc:333] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.601884 16779 raft_consensus.cc:2243] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:11:52.604874 16779 raft_consensus.cc:2272] T 7201987495494cf8a78424cb721d1c88 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:52.608255 16779 tablet_replica.cc:333] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.609195 16779 raft_consensus.cc:2243] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 LEADER]: Raft consensus shutting down.
W20260709 12:11:52.613915 18608 consensus_peers.cc:597] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:11:52.614616 16779 raft_consensus.cc:2272] T 59c85902a99e4edabb1fa20b800476fc P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:52.619148 16779 tablet_replica.cc:333] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.620149 16779 raft_consensus.cc:2243] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:52.620999 16779 raft_consensus.cc:2272] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:11:52.621942 18062 consensus_peers.cc:597] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:52.624897 16779 tablet_replica.cc:333] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.625772 16779 raft_consensus.cc:2243] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:11:52.627954 16779 raft_consensus.cc:2272] T e46c78c4c90c48cd9221b9e9f0a327bc P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:52.631059 16779 tablet_replica.cc:333] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.632530 16779 raft_consensus.cc:2243] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:11:52.634021 16779 raft_consensus.cc:2272] T 74a818492fb249b0ba39c6bed00cd202 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:52.637071 16779 tablet_replica.cc:333] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
W20260709 12:11:52.642287 18062 consensus_peers.cc:597] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:11:52.648656 17988 consensus_peers.cc:597] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:11:52.649989 16779 raft_consensus.cc:2243] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:52.651226 16779 raft_consensus.cc:2272] T 75c1f6edbec54664bbafbe9c9385ff6c P c5ffa786c8fb43f7864fa8fbe76534cb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:52.654271 16779 tablet_replica.cc:333] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.655130 16779 raft_consensus.cc:2243] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:11:52.656906 16779 raft_consensus.cc:2272] T 320059eb6db148929cae07ba683cfe1f P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:52.660816 16779 tablet_replica.cc:333] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.661619 16779 raft_consensus.cc:2243] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:11:52.663671 16779 raft_consensus.cc:2272] T 57fe00fa09a54eb295024fca83b933ec P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:52.666596 16779 tablet_replica.cc:333] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.667600 16779 raft_consensus.cc:2243] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:11:52.669008 16779 raft_consensus.cc:2272] T 16728addc56e43129f085b3bfd185dcb P c5ffa786c8fb43f7864fa8fbe76534cb [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:52.672317 16779 tablet_replica.cc:333] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.673166 16779 raft_consensus.cc:2243] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:11:52.674412 16779 raft_consensus.cc:2272] T ffcd5906663d452ca5003ea36d28164f P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:52.677436 16779 tablet_replica.cc:333] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.679051 16779 raft_consensus.cc:2243] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:52.679780 16779 raft_consensus.cc:2272] T 26495f0b11bb4f9b9d118b8b2a43da91 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:52.683275 16779 tablet_replica.cc:333] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.684046 16779 raft_consensus.cc:2243] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:52.685890 16779 raft_consensus.cc:2272] T 9e2acd40c27e44219e850b489602d01a P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:52.689074 16779 tablet_replica.cc:333] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.689955 16779 raft_consensus.cc:2243] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:52.691726 16779 raft_consensus.cc:2272] T 9bb1ec98e5b847df8a401343514ac12d P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:52.694399 16779 tablet_replica.cc:333] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.695267 16779 raft_consensus.cc:2243] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:52.695911 16779 raft_consensus.cc:2272] T 40f9c84f7e9940ce943e3ad8e2888beb P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:52.698879 16779 tablet_replica.cc:333] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.699661 16779 raft_consensus.cc:2243] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:52.700712 16779 raft_consensus.cc:2272] T 43c6bbfd11044938bb4686693c3544a7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:52.703799 16779 tablet_replica.cc:333] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.704578 16779 raft_consensus.cc:2243] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:52.706308 16779 raft_consensus.cc:2272] T 137ed415b9d242989f28f349c1618c74 P c5ffa786c8fb43f7864fa8fbe76534cb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:52.709338 16779 tablet_replica.cc:333] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.710229 16779 raft_consensus.cc:2243] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:52.711195 16779 raft_consensus.cc:2272] T ee9612b75b8d458dab1e3d254afae227 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:52.714998 16779 tablet_replica.cc:333] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.716971 16779 raft_consensus.cc:2243] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:52.717826 16779 raft_consensus.cc:2272] T 7829c9fa612b452fb76b1c08f805472d P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:11:52.719839 17988 consensus_peers.cc:597] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:11:52.721628 16779 tablet_replica.cc:333] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.722487 16779 raft_consensus.cc:2243] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:11:52.723857 16779 raft_consensus.cc:2272] T 28dbc0f2cd704e82b686ffe4c9b9967e P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:52.726719 16779 tablet_replica.cc:333] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.727481 16779 raft_consensus.cc:2243] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:11:52.728715 16779 raft_consensus.cc:2272] T 48619849881f46989095c1f3642592b7 P c5ffa786c8fb43f7864fa8fbe76534cb [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:52.731361 16779 tablet_replica.cc:333] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.733304 16779 raft_consensus.cc:2243] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:52.734090 16779 raft_consensus.cc:2272] T 3cdd445b25e5404da2f578c388210925 P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:52.736824 16779 tablet_replica.cc:333] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.737630 16779 raft_consensus.cc:2243] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:11:52.740283 16779 raft_consensus.cc:2272] T ca33c22be72d48f79260f24a00a8f8bb P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:52.743317 16779 tablet_replica.cc:333] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.744189 16779 raft_consensus.cc:2243] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:52.745256 16779 raft_consensus.cc:2272] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:52.748220 16779 tablet_replica.cc:333] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.748970 16779 raft_consensus.cc:2243] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:52.749912 16779 raft_consensus.cc:2272] T 2753b334cd624cd290d57dacd79d8edc P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:11:52.749150 18062 consensus_peers.cc:597] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:11:52.752769 16779 tablet_replica.cc:333] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.754688 16779 raft_consensus.cc:2243] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:52.755438 16779 raft_consensus.cc:2272] T 9ae30b26b2734033a87c3e1ba937a39f P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:52.758176 16779 tablet_replica.cc:333] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
W20260709 12:11:52.758179 18608 consensus_peers.cc:597] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:52.760208 16779 raft_consensus.cc:2243] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:11:52.762482 16779 raft_consensus.cc:2272] T 5c560710763a42e79b5b8080eff3b58b P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:11:52.763578 18608 consensus_peers.cc:597] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:52.765828 18608 consensus_peers.cc:597] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:11:52.773239 16779 tablet_replica.cc:333] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.774051 16779 raft_consensus.cc:2243] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:52.774741 16779 raft_consensus.cc:2272] T c4f794e5675049b284921052a24eea37 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:52.778415 16779 tablet_replica.cc:333] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.780953 16779 raft_consensus.cc:2243] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:52.782998 16779 raft_consensus.cc:2272] T 17e56ed7b94d4185a4f7dd88f922e17d P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:52.785630 16779 tablet_replica.cc:333] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.786299 16779 raft_consensus.cc:2243] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:52.791500 16779 raft_consensus.cc:2272] T 0139f0228a724bb58ab2352ee5195b7a P c5ffa786c8fb43f7864fa8fbe76534cb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:52.794231 16779 tablet_replica.cc:333] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.795396 16779 raft_consensus.cc:2243] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:11:52.796617 16779 raft_consensus.cc:2272] T 92e1586ba70a4331be2a55f4a31dd687 P c5ffa786c8fb43f7864fa8fbe76534cb [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:52.799710 16779 tablet_replica.cc:333] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.800453 16779 raft_consensus.cc:2243] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:11:52.801684 16779 raft_consensus.cc:2272] T 924b1f0746ad425bb3e560d8665428c1 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:52.804446 16779 tablet_replica.cc:333] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.805205 16779 raft_consensus.cc:2243] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:11:52.806289 16779 raft_consensus.cc:2272] T 53fdd1cc63be4f3b8a533d34af81d0c6 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:52.809026 16779 tablet_replica.cc:333] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.809780 16779 raft_consensus.cc:2243] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:11:52.811578 16779 raft_consensus.cc:2272] T 75266a6e976c41a99e22b9d7d7a2cd65 P c5ffa786c8fb43f7864fa8fbe76534cb [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:52.814735 16779 tablet_replica.cc:333] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
W20260709 12:11:52.815517 17988 consensus_peers.cc:597] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:11:52.815615 16779 raft_consensus.cc:2243] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:11:52.817198 16779 raft_consensus.cc:2272] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P c5ffa786c8fb43f7864fa8fbe76534cb [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:52.820420 16779 tablet_replica.cc:333] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.821063 16779 raft_consensus.cc:2243] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:11:52.822307 16779 raft_consensus.cc:2272] T e3cd916f51d64d5d87b9c504a06a8a1e P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:52.825127 16779 tablet_replica.cc:333] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.825817 16779 raft_consensus.cc:2243] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:52.826469 16779 raft_consensus.cc:2272] T 49c83fd6efbc4c8a92e2e65890ffafd2 P c5ffa786c8fb43f7864fa8fbe76534cb [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:52.829545 16779 tablet_replica.cc:333] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
W20260709 12:11:52.857952 18608 consensus_peers.cc:597] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:11:52.845096 16779 raft_consensus.cc:2243] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:52.861068 16779 raft_consensus.cc:2272] T 6135c6398c3f4926b6f07433b6f63759 P c5ffa786c8fb43f7864fa8fbe76534cb [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:52.869311 16779 tablet_replica.cc:333] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb: stopping tablet replica
I20260709 12:11:52.869966 16779 raft_consensus.cc:2243] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:11:52.871323 16779 raft_consensus.cc:2272] T b8e1f5339f9042c5935e082c5f212b35 P c5ffa786c8fb43f7864fa8fbe76534cb [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:11:53.047284 18062 consensus_peers.cc:597] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:53.141706 18608 consensus_peers.cc:597] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:53.450115 18062 consensus_peers.cc:597] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:11:53.611150 22995 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:53.611792 22995 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:53.614336 22995 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:11:53.644821 18608 leader_election.cc:336] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
W20260709 12:11:53.648722 18608 leader_election.cc:336] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:53.649137 18608 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:53.650281 22995 raft_consensus.cc:2749] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:53.702163 23009 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:53.702891 23009 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:11:53.719202 18062 leader_election.cc:336] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
W20260709 12:11:53.720041 18062 leader_election.cc:336] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:53.720534 18062 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:53.721534 23002 raft_consensus.cc:2749] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:53.728356 23009 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:11:53.729938 18609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41931, user_credentials={real_user=slave}} blocked reactor thread for 48767.9us
I20260709 12:11:53.739965 22992 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:53.740557 22992 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:53.740777 22995 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:53.741539 22995 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:53.742372 22992 leader_election.cc:290] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:53.742869 22992 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:53.743309 22992 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:53.744489 22995 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:53.748216 22992 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:11:53.777240 18608 leader_election.cc:336] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
W20260709 12:11:53.787098 18608 leader_election.cc:336] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
W20260709 12:11:53.802659 18608 leader_election.cc:336] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:53.803257 18608 leader_election.cc:304] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:53.804370 23015 raft_consensus.cc:2749] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:53.805727 18608 leader_election.cc:336] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:53.806244 18608 leader_election.cc:304] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:53.807288 23015 raft_consensus.cc:2749] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:53.808610 18608 leader_election.cc:336] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
W20260709 12:11:53.815065 18608 leader_election.cc:336] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:53.815585 18608 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:53.816388 23015 raft_consensus.cc:2749] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:53.903429 22992 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:53.904001 22992 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:53.906220 22992 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:53.930289 23015 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:53.930879 23015 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:53.933205 23015 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:11:53.935935 18608 leader_election.cc:336] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
W20260709 12:11:53.942077 18608 leader_election.cc:336] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:53.944552 18608 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:53.946260 22995 raft_consensus.cc:2749] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:53.947273 23009 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:53.947875 23009 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:53.951800 22995 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:53.952945 23002 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:53.953487 23002 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:53.955688 23002 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:53.956228 22995 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:53.959182 23002 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:53.960351 23002 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:53.957056 23009 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:53.963171 23009 raft_consensus.cc:493] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:53.963773 23009 raft_consensus.cc:515] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:53.965909 23009 leader_election.cc:290] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:53.966415 22995 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:53.962734 23002 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:53.981508 18642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:53.982321 18642 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 14.
W20260709 12:11:53.991417 16779 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 18045)
I20260709 12:11:53.996666 22995 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:53.997359 22995 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:54.001360 22995 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:54.006274 23002 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:54.006806 23002 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:54.008757 23002 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:11:54.009888 18608 leader_election.cc:336] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
W20260709 12:11:54.010515 18608 leader_election.cc:336] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
W20260709 12:11:54.011682 18608 leader_election.cc:336] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:54.012138 18608 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:11:54.013216 18608 leader_election.cc:336] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:54.015023 18608 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:54.015285 23002 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:54.015913 23015 raft_consensus.cc:2749] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:54.015820 23002 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:11:54.014446 23017 raft_consensus.cc:493] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:54.016661 22995 raft_consensus.cc:2749] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:54.017856 23002 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123)
I20260709 12:11:54.017560 23017 raft_consensus.cc:515] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:54.019878 23017 leader_election.cc:290] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:54.021198 23016 raft_consensus.cc:493] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:54.024909 23016 raft_consensus.cc:515] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:54.027120 23016 leader_election.cc:290] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:11:54.029377 18608 leader_election.cc:336] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
W20260709 12:11:54.030284 18608 leader_election.cc:336] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:54.030726 18608 leader_election.cc:304] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:54.031404 22995 raft_consensus.cc:2749] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:54.035833 18062 leader_election.cc:336] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:54.036485 23002 raft_consensus.cc:493] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:54.037050 23002 raft_consensus.cc:515] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:54.038478 22995 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:54.039000 22995 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:54.039381 18062 leader_election.cc:336] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
W20260709 12:11:54.039925 18062 leader_election.cc:336] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
W20260709 12:11:54.040357 18062 leader_election.cc:336] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:54.041006 22995 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:11:54.041643 18062 leader_election.cc:336] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:54.042088 18062 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:54.042747 23002 leader_election.cc:290] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:54.043258 23017 raft_consensus.cc:2749] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:54.044566 23002 raft_consensus.cc:493] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:54.045027 23002 raft_consensus.cc:515] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:54.047109 23002 leader_election.cc:290] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:11:54.047472 18062 leader_election.cc:336] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:54.047924 18062 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:54.048288 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:11:54.048707 18062 leader_election.cc:336] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:54.049113 18062 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:54.052690 23017 raft_consensus.cc:2749] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:54.053313 23017 raft_consensus.cc:2749] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:54.054114 18062 leader_election.cc:336] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:54.054490 18062 leader_election.cc:304] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:11:54.055418 18608 leader_election.cc:336] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
W20260709 12:11:54.056139 18608 leader_election.cc:336] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:54.056532 18608 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:54.057243 22995 raft_consensus.cc:2749] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:54.058173 23002 raft_consensus.cc:2749] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:54.062322 23002 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:54.063009 23002 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:54.065447 22995 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:54.066030 22995 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:54.067767 18639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
W20260709 12:11:54.068061 18062 leader_election.cc:336] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:54.068377 18639 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 14.
W20260709 12:11:54.068627 18062 leader_election.cc:336] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
W20260709 12:11:54.069113 18062 leader_election.cc:336] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:54.069963 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:54.070550 18098 raft_consensus.cc:2468] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 14.
I20260709 12:11:54.072021 18609 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:54.065932 23002 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:54.072899 23015 raft_consensus.cc:2804] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:54.073323 23015 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:54.073712 23015 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:54.078042 18062 leader_election.cc:336] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:54.068491 22995 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:54.078504 18062 leader_election.cc:304] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:54.079383 23002 raft_consensus.cc:2749] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:54.080371 18062 leader_election.cc:336] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:54.080768 18062 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:54.081507 23002 raft_consensus.cc:2749] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:54.081679 18062 leader_election.cc:336] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:54.087545 18062 leader_election.cc:304] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:54.088374 23002 raft_consensus.cc:2749] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:54.091128 18061 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:54.092031 23002 raft_consensus.cc:2804] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:11:54.092434 23002 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:54.092854 23002 raft_consensus.cc:3060] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:11:54.093529 18062 leader_election.cc:336] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
W20260709 12:11:54.094293 18062 leader_election.cc:336] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:54.094712 18062 leader_election.cc:304] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:54.101634 23017 raft_consensus.cc:2749] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:54.102595 18062 leader_election.cc:336] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:54.086522 23015 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:54.103681 22995 raft_consensus.cc:493] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:54.104218 22995 raft_consensus.cc:515] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:54.105633 18062 leader_election.cc:336] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:54.106063 18062 leader_election.cc:304] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:54.107048 23016 raft_consensus.cc:2749] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:54.108088 18062 leader_election.cc:336] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:54.108505 18062 leader_election.cc:304] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:54.108772 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110" is_pre_election: true
I20260709 12:11:54.109179 23017 raft_consensus.cc:2749] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:11:54.109457 18098 raft_consensus.cc:2468] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 10.
I20260709 12:11:54.110677 18609 leader_election.cc:304] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
I20260709 12:11:54.111472 22992 raft_consensus.cc:2804] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:11:54.111822 22992 raft_consensus.cc:493] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting leader election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:54.112174 22992 raft_consensus.cc:3060] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:11:54.113071 18062 leader_election.cc:336] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:54.118749 22995 leader_election.cc:290] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:54.120486 22992 raft_consensus.cc:515] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:54.127895 18098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:54.131665 18091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e46c78c4c90c48cd9221b9e9f0a327bc" candidate_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4813437da0a74e65b61eb7bd1d18f110"
I20260709 12:11:54.132382 18091 raft_consensus.cc:3060] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:11:54.134150 23016 raft_consensus.cc:493] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:54.134709 23016 raft_consensus.cc:515] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:54.136621 23016 leader_election.cc:290] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:54.143270 18091 raft_consensus.cc:2468] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e28f77912a9c4ba2b9841f6fedddc2db in term 11.
I20260709 12:11:54.150473 22992 leader_election.cc:290] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:54.151105 23015 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:11:54.156987 18062 leader_election.cc:336] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:54.157179 18609 leader_election.cc:304] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 
W20260709 12:11:54.157721 18062 leader_election.cc:336] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:54.158070 23015 raft_consensus.cc:2804] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:11:54.158143 18062 leader_election.cc:304] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:54.158736 23015 raft_consensus.cc:697] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 11 LEADER]: Becoming Leader. State: Replica: e28f77912a9c4ba2b9841f6fedddc2db, State: Running, Role: LEADER
I20260709 12:11:54.158298 23002 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:54.159767 18098 raft_consensus.cc:2393] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e28f77912a9c4ba2b9841f6fedddc2db in current term 15: Already voted for candidate 4813437da0a74e65b61eb7bd1d18f110 in this term.
I20260709 12:11:54.159829 23015 consensus_queue.cc:237] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:54.165947 18608 leader_election.cc:336] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:54.171945 23016 raft_consensus.cc:2749] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:54.173177 23002 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 15 election: Requested vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:54.179823 18638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16728addc56e43129f085b3bfd185dcb" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db"
W20260709 12:11:54.180625 18608 leader_election.cc:336] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:54.180959 18638 raft_consensus.cc:2393] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4813437da0a74e65b61eb7bd1d18f110 in current term 15: Already voted for candidate e28f77912a9c4ba2b9841f6fedddc2db in this term.
W20260709 12:11:54.181514 18608 leader_election.cc:336] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:54.182017 18608 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:54.182929 23014 raft_consensus.cc:2749] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:11:54.183028 18608 leader_election.cc:336] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:54.211484 23015 raft_consensus.cc:493] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:54.212045 23015 raft_consensus.cc:515] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:54.222575 18608 leader_election.cc:336] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:54.214079 23015 leader_election.cc:290] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:11:54.223248 18608 leader_election.cc:336] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:54.223634 18608 leader_election.cc:304] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:54.214018 17844 catalog_manager.cc:5697] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db reported cstate change: term changed from 10 to 11, leader changed from c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194) to e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196). New cstate: current_term: 11 leader_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:11:54.224313 23015 raft_consensus.cc:2749] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:54.266680 23015 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:54.267236 23015 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:54.269434 23015 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:11:54.281030 18608 leader_election.cc:336] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
W20260709 12:11:54.281791 18608 leader_election.cc:336] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:54.282162 18608 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:54.282889 23015 raft_consensus.cc:2749] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:54.382629 18608 consensus_peers.cc:597] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:54.512243 18608 consensus_peers.cc:597] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:54.601264 18608 consensus_peers.cc:597] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:54.663033 18062 consensus_peers.cc:597] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:11:54.666704 18098 raft_consensus.cc:1275] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Refusing update from remote peer e28f77912a9c4ba2b9841f6fedddc2db: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:11:54.668258 23014 consensus_queue.cc:1048] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [LEADER]: Connected to new peer: Peer: permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:11:54.714354 18608 consensus_peers.cc:597] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:54.717914 18608 consensus_peers.cc:597] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:54.730437 18608 consensus_peers.cc:597] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:54.787952 18062 consensus_peers.cc:597] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:54.792425 18062 consensus_peers.cc:597] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:54.813565 18062 consensus_peers.cc:597] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:54.829232 18608 consensus_peers.cc:597] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:54.853001 18062 consensus_peers.cc:597] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:54.884160 18062 consensus_peers.cc:597] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:54.918838 18608 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111) [suppressed 495 similar messages]
W20260709 12:11:54.922857 18608 consensus_peers.cc:597] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:54.947268 18062 consensus_peers.cc:597] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:54.991940 16779 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 18045)
W20260709 12:11:55.018065 18608 consensus_peers.cc:597] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:55.045487 18608 consensus_peers.cc:597] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:55.085081 18062 consensus_peers.cc:597] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:11:55.130211 18608 consensus_peers.cc:597] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:55.168305 18608 consensus_peers.cc:597] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:55.177240 18608 consensus_peers.cc:597] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:55.198127 18608 consensus_peers.cc:597] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:55.198850 18608 consensus_peers.cc:597] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:55.200940 18062 leader_election.cc:336] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:55.201437 18062 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: c5ffa786c8fb43f7864fa8fbe76534cb, e28f77912a9c4ba2b9841f6fedddc2db
I20260709 12:11:55.202179 23026 raft_consensus.cc:2749] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:11:55.205895 18062 consensus_peers.cc:597] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:55.206427 18062 consensus_peers.cc:597] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:55.206851 18062 consensus_peers.cc:597] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:55.211683 18062 consensus_peers.cc:597] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:55.219724 18062 consensus_peers.cc:597] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:55.245828 18608 consensus_peers.cc:597] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:55.246443 18062 consensus_peers.cc:597] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:55.291093 18062 consensus_peers.cc:597] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:55.345821 18608 consensus_peers.cc:597] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:55.351810 18608 consensus_peers.cc:597] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:55.363677 18608 consensus_peers.cc:597] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:11:55.407181 23015 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:55.407723 23015 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:55.411355 23015 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:11:55.418079 18608 leader_election.cc:336] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
W20260709 12:11:55.418753 18608 leader_election.cc:336] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:55.419124 18608 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:55.425118 22995 raft_consensus.cc:2749] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:55.434930 18062 consensus_peers.cc:597] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:55.446161 18062 consensus_peers.cc:597] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:55.476114 18062 consensus_peers.cc:597] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:55.490662 18608 consensus_peers.cc:597] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:11:55.632634 23026 raft_consensus.cc:493] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:55.633278 23026 raft_consensus.cc:515] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:11:55.639418 18062 leader_election.cc:336] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:55.640499 23026 leader_election.cc:290] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:11:55.644501 18062 leader_election.cc:336] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:55.644865 18062 leader_election.cc:304] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:55.645433 23026 raft_consensus.cc:2749] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:55.657749 23016 raft_consensus.cc:493] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:55.658252 23016 raft_consensus.cc:515] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } }
I20260709 12:11:55.660158 23016 leader_election.cc:290] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123)
W20260709 12:11:55.666287 18062 consensus_peers.cc:597] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:11:55.667479 23016 raft_consensus.cc:493] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:55.667984 23016 raft_consensus.cc:515] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:11:55.670739 18062 leader_election.cc:336] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
W20260709 12:11:55.671494 18062 leader_election.cc:336] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:55.671885 18062 leader_election.cc:304] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:55.672636 23016 leader_election.cc:290] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:55.673369 23016 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:55.673815 23016 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:55.674309 23027 raft_consensus.cc:2749] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:55.676232 23016 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), e28f77912a9c4ba2b9841f6fedddc2db (127.16.98.196:43647)
I20260709 12:11:55.678617 18637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ccf0bcc20ae40e79c32530091613e1e" candidate_uuid: "4813437da0a74e65b61eb7bd1d18f110" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" is_pre_election: true
I20260709 12:11:55.680248 18637 raft_consensus.cc:2468] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4813437da0a74e65b61eb7bd1d18f110 in term 14.
W20260709 12:11:55.687177 18062 leader_election.cc:336] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
W20260709 12:11:55.687680 18062 leader_election.cc:336] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
W20260709 12:11:55.688218 18062 leader_election.cc:336] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:55.688580 18062 leader_election.cc:304] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:55.689280 23026 raft_consensus.cc:2749] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:11:55.690270 18062 leader_election.cc:336] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:55.690713 18062 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110, e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:55.691392 23028 raft_consensus.cc:2749] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:55.695504 18062 consensus_peers.cc:597] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:11:55.696074 23015 raft_consensus.cc:493] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:55.696653 23015 raft_consensus.cc:515] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:55.698820 23015 leader_election.cc:290] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:55.705094 23015 raft_consensus.cc:493] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:55.705565 23015 raft_consensus.cc:515] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:55.707469 23015 leader_election.cc:290] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:11:55.707978 18608 leader_election.cc:336] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:55.708261 23028 raft_consensus.cc:493] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
W20260709 12:11:55.708686 18608 leader_election.cc:336] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:55.708788 23028 raft_consensus.cc:515] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:55.709127 18608 leader_election.cc:304] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:55.710804 23015 raft_consensus.cc:2749] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:11:55.716763 23015 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
W20260709 12:11:55.717921 18062 leader_election.cc:336] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:55.717258 23015 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:55.719785 23015 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:55.721488 23026 raft_consensus.cc:493] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
W20260709 12:11:55.721892 18608 leader_election.cc:336] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:55.722023 23026 raft_consensus.cc:515] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
W20260709 12:11:55.722837 18608 leader_election.cc:336] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:55.723261 18608 leader_election.cc:304] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:55.724040 23026 leader_election.cc:290] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:55.724750 23015 raft_consensus.cc:2749] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:55.726696 23028 leader_election.cc:290] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:11:55.727814 18608 leader_election.cc:336] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
W20260709 12:11:55.720196 18062 leader_election.cc:336] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:55.728417 18062 leader_election.cc:304] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
W20260709 12:11:55.729030 18608 leader_election.cc:336] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:55.729486 18608 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:55.730211 22995 raft_consensus.cc:2749] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:55.730949 23028 raft_consensus.cc:2749] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:11:55.738116 18062 leader_election.cc:336] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
W20260709 12:11:55.738744 18062 leader_election.cc:336] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:55.739106 18062 leader_election.cc:304] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:55.739768 23028 raft_consensus.cc:2749] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:11:55.764066 18062 consensus_peers.cc:597] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:55.841410 18608 consensus_peers.cc:597] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:55.845443 18062 consensus_peers.cc:597] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:11:55.881614 23028 raft_consensus.cc:493] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:55.882231 23028 raft_consensus.cc:515] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:55.884487 23028 leader_election.cc:290] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:11:55.890928 18062 leader_election.cc:336] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
W20260709 12:11:55.891815 18062 leader_election.cc:336] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:55.892222 18062 leader_election.cc:304] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:55.892933 23028 raft_consensus.cc:2749] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:11:55.894346 23028 raft_consensus.cc:493] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:55.894869 23028 raft_consensus.cc:515] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:55.896878 23028 leader_election.cc:290] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:11:55.906791 18062 leader_election.cc:336] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
W20260709 12:11:55.907475 18062 leader_election.cc:336] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:55.907873 18062 leader_election.cc:304] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:55.908550 23028 raft_consensus.cc:2749] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:55.913166 16779 tablet_server.cc:196] TabletServer@127.16.98.194:0 shutdown complete.
I20260709 12:11:55.932116 23028 raft_consensus.cc:493] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:55.932768 23028 raft_consensus.cc:515] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:55.935415 23028 leader_election.cc:290] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:11:55.941839 18062 leader_election.cc:336] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
W20260709 12:11:55.942843 18062 leader_election.cc:336] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:55.943313 18062 leader_election.cc:304] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:55.944132 23026 raft_consensus.cc:2749] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:55.949342 18062 consensus_peers.cc:597] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:11:55.976222 22995 raft_consensus.cc:493] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:55.976954 22995 raft_consensus.cc:515] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:55.979734 22995 leader_election.cc:290] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:11:55.987578 18608 leader_election.cc:336] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
W20260709 12:11:55.988294 18608 leader_election.cc:336] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:55.988747 18608 leader_election.cc:304] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:55.989475 22995 raft_consensus.cc:2749] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:55.996869 23015 raft_consensus.cc:493] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:55.997452 23015 raft_consensus.cc:515] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:55.999795 23015 leader_election.cc:290] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:56.004470 23015 raft_consensus.cc:493] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:56.005362 23015 raft_consensus.cc:515] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:56.008008 23015 leader_election.cc:290] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:11:56.012965 18608 leader_election.cc:336] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:56.016041 23015 raft_consensus.cc:493] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:56.016733 23015 raft_consensus.cc:515] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
W20260709 12:11:56.019040 18608 leader_election.cc:336] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:56.019572 18608 leader_election.cc:304] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:56.020435 22995 raft_consensus.cc:2749] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:11:56.028381 18608 leader_election.cc:336] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:56.027204 23015 leader_election.cc:290] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:11:56.031004 18608 leader_election.cc:336] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:56.031562 18608 leader_election.cc:304] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:56.032351 23015 raft_consensus.cc:2749] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:56.034409 18608 leader_election.cc:336] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
W20260709 12:11:56.035207 18608 leader_election.cc:336] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:56.035671 18608 leader_election.cc:304] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:56.036433 23015 raft_consensus.cc:2749] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:11:56.037981 16779 tablet_server.cc:179] TabletServer@127.16.98.195:0 shutting down...
W20260709 12:11:56.057440 18609 consensus_peers.cc:597] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Couldn't send request to peer 4813437da0a74e65b61eb7bd1d18f110. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:56.060201 22995 raft_consensus.cc:493] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:11:56.060912 22995 raft_consensus.cc:515] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:56.066134 22995 leader_election.cc:290] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:11:56.069753 18609 leader_election.cc:336] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:11:56.076584 18608 leader_election.cc:336] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:56.077101 18608 leader_election.cc:304] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:56.079016 22995 raft_consensus.cc:2749] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:11:56.092489 18609 consensus_peers.cc:597] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Couldn't send request to peer 4813437da0a74e65b61eb7bd1d18f110. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:56.113049 16779 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:11:56.114027 16779 tablet_replica.cc:333] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.114840 16779 raft_consensus.cc:2243] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:56.115417 16779 raft_consensus.cc:2272] T 4ccf0bcc20ae40e79c32530091613e1e P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.117401 16779 tablet_replica.cc:333] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.117976 16779 raft_consensus.cc:2243] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:56.118505 16779 raft_consensus.cc:2272] T f5d18fbba7e34ac7810ef1fbf82c3697 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.118494 23028 raft_consensus.cc:493] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:56.119225 23028 raft_consensus.cc:515] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } }
I20260709 12:11:56.121436 16779 tablet_replica.cc:333] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.122391 23028 leader_election.cc:290] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:56.122391 16779 raft_consensus.cc:2243] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:56.126995 16779 raft_consensus.cc:2272] T 2d1876d442ce42248de2b1ad2804234a P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:11:56.127599 18062 leader_election.cc:336] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
W20260709 12:11:56.128400 18062 leader_election.cc:336] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:56.128822 18062 leader_election.cc:304] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4813437da0a74e65b61eb7bd1d18f110; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:56.129413 16779 tablet_replica.cc:333] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.129516 23028 raft_consensus.cc:2749] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:56.130307 16779 raft_consensus.cc:2243] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:11:56.131313 16779 raft_consensus.cc:2272] T 45c29a91be76451a9328d8cd9e3eecab P 4813437da0a74e65b61eb7bd1d18f110 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.133255 16779 tablet_replica.cc:333] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.133809 16779 raft_consensus.cc:2243] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:11:56.134688 16779 raft_consensus.cc:2272] T a8c7e98721a04c9690aef2689338516a P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.136451 16779 tablet_replica.cc:333] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.136957 16779 raft_consensus.cc:2243] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:11:56.137840 16779 raft_consensus.cc:2272] T 05a4983c833c415a94a4c285b408b305 P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.139863 16779 tablet_replica.cc:333] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.140390 16779 raft_consensus.cc:2243] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:56.140805 16779 raft_consensus.cc:2272] T 75c1f6edbec54664bbafbe9c9385ff6c P 4813437da0a74e65b61eb7bd1d18f110 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.142477 23015 raft_consensus.cc:493] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:56.142887 16779 tablet_replica.cc:333] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.143596 16779 raft_consensus.cc:2243] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:56.143108 23015 raft_consensus.cc:515] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:56.144189 16779 raft_consensus.cc:2272] T 9c0d192cc9cf47c1ba111cde01fad070 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.145970 23015 leader_election.cc:290] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:56.146401 16779 tablet_replica.cc:333] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.147230 16779 raft_consensus.cc:2243] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:56.148452 16779 raft_consensus.cc:2272] T 17e56ed7b94d4185a4f7dd88f922e17d P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:11:56.149667 18608 leader_election.cc:336] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:56.151379 16779 tablet_replica.cc:333] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
W20260709 12:11:56.151818 18608 leader_election.cc:336] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:56.151975 16779 raft_consensus.cc:2243] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:11:56.152273 18608 leader_election.cc:304] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:56.153007 16779 raft_consensus.cc:2272] T 5379a078a5d24d8cba5cb4e56eee5b5f P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.153014 23015 raft_consensus.cc:2749] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:56.155256 16779 tablet_replica.cc:333] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.155797 16779 raft_consensus.cc:2243] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:56.156257 16779 raft_consensus.cc:2272] T 1372b5e0da1c481fb926410510c94341 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.157995 16779 tablet_replica.cc:333] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.158517 16779 raft_consensus.cc:2243] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:56.159013 16779 raft_consensus.cc:2272] T 16728addc56e43129f085b3bfd185dcb P 4813437da0a74e65b61eb7bd1d18f110 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.160907 16779 tablet_replica.cc:333] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.161548 16779 raft_consensus.cc:2243] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:56.161966 16779 raft_consensus.cc:2272] T ffcd5906663d452ca5003ea36d28164f P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.164270 16779 tablet_replica.cc:333] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.165005 16779 raft_consensus.cc:2243] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:11:56.165812 16779 raft_consensus.cc:2272] T ee9612b75b8d458dab1e3d254afae227 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.168174 16779 tablet_replica.cc:333] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.168874 16779 raft_consensus.cc:2243] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:11:56.169934 16779 raft_consensus.cc:2272] T 7829c9fa612b452fb76b1c08f805472d P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.172396 16779 tablet_replica.cc:333] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.173067 16779 raft_consensus.cc:2243] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:11:56.174067 16779 raft_consensus.cc:2272] T 26495f0b11bb4f9b9d118b8b2a43da91 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.176364 16779 tablet_replica.cc:333] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.177279 16779 raft_consensus.cc:2243] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:11:56.178296 16779 raft_consensus.cc:2272] T 9e2acd40c27e44219e850b489602d01a P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:11:56.180136 18609 consensus_peers.cc:597] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Couldn't send request to peer 4813437da0a74e65b61eb7bd1d18f110. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:56.180600 16779 tablet_replica.cc:333] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.181411 16779 raft_consensus.cc:2243] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:11:56.182304 16779 raft_consensus.cc:2272] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P 4813437da0a74e65b61eb7bd1d18f110 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.184480 16779 tablet_replica.cc:333] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.185187 16779 raft_consensus.cc:2243] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:56.185734 16779 raft_consensus.cc:2272] T e46c78c4c90c48cd9221b9e9f0a327bc P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.187748 16779 tablet_replica.cc:333] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.188263 16779 raft_consensus.cc:2243] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:56.188730 16779 raft_consensus.cc:2272] T 40f9c84f7e9940ce943e3ad8e2888beb P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.190500 16779 tablet_replica.cc:333] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.191023 16779 raft_consensus.cc:2243] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:11:56.191835 16779 raft_consensus.cc:2272] T 43c6bbfd11044938bb4686693c3544a7 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.193805 16779 tablet_replica.cc:333] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.194516 16779 raft_consensus.cc:2243] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:56.195108 16779 raft_consensus.cc:2272] T 137ed415b9d242989f28f349c1618c74 P 4813437da0a74e65b61eb7bd1d18f110 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.197995 16779 tablet_replica.cc:333] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.198763 16779 raft_consensus.cc:2243] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:56.199338 16779 raft_consensus.cc:2272] T 48619849881f46989095c1f3642592b7 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 12:11:56.200915 18609 consensus_peers.cc:597] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Couldn't send request to peer 4813437da0a74e65b61eb7bd1d18f110. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:56.201624 23015 raft_consensus.cc:493] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:56.201736 16779 tablet_replica.cc:333] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.202175 23015 raft_consensus.cc:515] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:56.202729 16779 raft_consensus.cc:2243] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:11:56.203985 16779 raft_consensus.cc:2272] T b03f131254e14da2918c02bf0fcf9c5c P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.204378 23015 leader_election.cc:290] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:56.206677 16779 tablet_replica.cc:333] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.207531 16779 raft_consensus.cc:2243] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:56.208218 16779 raft_consensus.cc:2272] T 3cdd445b25e5404da2f578c388210925 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.210757 16779 tablet_replica.cc:333] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.211498 16779 raft_consensus.cc:2243] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:56.212082 16779 raft_consensus.cc:2272] T 993eae98279b413f8c6fed0d4ea79eae P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.214628 16779 tablet_replica.cc:333] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.215174 16779 raft_consensus.cc:2243] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:11:56.215982 16779 raft_consensus.cc:2272] T 2753b334cd624cd290d57dacd79d8edc P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 12:11:56.216715 18608 leader_election.cc:336] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
W20260709 12:11:56.217512 18608 leader_election.cc:336] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:56.218012 16779 tablet_replica.cc:333] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.217933 18608 leader_election.cc:304] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:56.218720 16779 raft_consensus.cc:2243] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:11:56.218724 23015 raft_consensus.cc:2749] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:11:56.219838 16779 raft_consensus.cc:2272] T 46c726e58f614fbdab58f22a7da00365 P 4813437da0a74e65b61eb7bd1d18f110 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.221576 16779 tablet_replica.cc:333] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.222100 16779 raft_consensus.cc:2243] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:56.222529 16779 raft_consensus.cc:2272] T 374a5fb3dfcf4ad4adf6e172cc1759a4 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.224198 16779 tablet_replica.cc:333] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.224707 16779 raft_consensus.cc:2243] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:11:56.225430 16779 raft_consensus.cc:2272] T 0139f0228a724bb58ab2352ee5195b7a P 4813437da0a74e65b61eb7bd1d18f110 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.227187 16779 tablet_replica.cc:333] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.227695 16779 raft_consensus.cc:2243] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:56.228216 16779 raft_consensus.cc:2272] T 1f6ed08238924344ac4e43e997223ac9 P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.229797 16779 tablet_replica.cc:333] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.230312 16779 raft_consensus.cc:2243] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:11:56.231113 16779 raft_consensus.cc:2272] T 9ae30b26b2734033a87c3e1ba937a39f P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.232789 16779 tablet_replica.cc:333] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.233284 16779 raft_consensus.cc:2243] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:56.233696 16779 raft_consensus.cc:2272] T 5c560710763a42e79b5b8080eff3b58b P 4813437da0a74e65b61eb7bd1d18f110 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.235466 16779 tablet_replica.cc:333] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.235981 16779 raft_consensus.cc:2243] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:11:56.236780 16779 raft_consensus.cc:2272] T c592029696004db48d68a9e4c3f45004 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.238583 16779 tablet_replica.cc:333] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.239280 16779 raft_consensus.cc:2243] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:56.239797 16779 raft_consensus.cc:2272] T 158a286025af4eddba6fb641c128cd25 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.241570 16779 tablet_replica.cc:333] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.242084 16779 raft_consensus.cc:2243] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:56.243408 16779 raft_consensus.cc:2272] T 528748760fc743e3a2bce89e03314aab P 4813437da0a74e65b61eb7bd1d18f110 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.246006 16779 tablet_replica.cc:333] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.246719 16779 raft_consensus.cc:2243] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Raft consensus shutting down.
W20260709 12:11:56.247043 18609 consensus_peers.cc:597] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Couldn't send request to peer 4813437da0a74e65b61eb7bd1d18f110. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:56.247270 16779 raft_consensus.cc:2272] T c345cb34fc6343e98baf0b21aac6d4d7 P 4813437da0a74e65b61eb7bd1d18f110 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.249552 16779 tablet_replica.cc:333] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.250082 16779 raft_consensus.cc:2243] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:56.250612 16779 raft_consensus.cc:2272] T 924b1f0746ad425bb3e560d8665428c1 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.252406 16779 tablet_replica.cc:333] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.252900 16779 raft_consensus.cc:2243] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:56.253329 16779 raft_consensus.cc:2272] T f9b0c864d78846698db31224c547a091 P 4813437da0a74e65b61eb7bd1d18f110 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.255340 16779 tablet_replica.cc:333] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.255892 16779 raft_consensus.cc:2243] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:11:56.256726 16779 raft_consensus.cc:2272] T 7b8822f4f1de477e8866529047a823b9 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.259001 16779 tablet_replica.cc:333] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
W20260709 12:11:56.258946 18609 consensus_peers.cc:597] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Couldn't send request to peer 4813437da0a74e65b61eb7bd1d18f110. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:56.259895 16779 raft_consensus.cc:2243] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:56.260468 16779 raft_consensus.cc:2272] T e3cd916f51d64d5d87b9c504a06a8a1e P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.262753 16779 tablet_replica.cc:333] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.263255 16779 raft_consensus.cc:2243] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:56.263717 16779 raft_consensus.cc:2272] T b8e1f5339f9042c5935e082c5f212b35 P 4813437da0a74e65b61eb7bd1d18f110 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.265442 16779 tablet_replica.cc:333] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.265919 16779 raft_consensus.cc:2243] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:56.266373 16779 raft_consensus.cc:2272] T 49c83fd6efbc4c8a92e2e65890ffafd2 P 4813437da0a74e65b61eb7bd1d18f110 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.268082 16779 tablet_replica.cc:333] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.268543 16779 raft_consensus.cc:2243] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:11:56.269279 16779 raft_consensus.cc:2272] T 6135c6398c3f4926b6f07433b6f63759 P 4813437da0a74e65b61eb7bd1d18f110 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:56.271209 16779 tablet_replica.cc:333] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110: stopping tablet replica
I20260709 12:11:56.271667 16779 raft_consensus.cc:2243] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:56.272100 16779 raft_consensus.cc:2272] T 75266a6e976c41a99e22b9d7d7a2cd65 P 4813437da0a74e65b61eb7bd1d18f110 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:11:56.294085 18609 consensus_peers.cc:597] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Couldn't send request to peer 4813437da0a74e65b61eb7bd1d18f110. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:56.301915 18609 consensus_peers.cc:597] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Couldn't send request to peer 4813437da0a74e65b61eb7bd1d18f110. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:56.314810 18609 consensus_peers.cc:597] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Couldn't send request to peer 4813437da0a74e65b61eb7bd1d18f110. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:56.366876 18609 consensus_peers.cc:597] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Couldn't send request to peer 4813437da0a74e65b61eb7bd1d18f110. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.195:41931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:56.394685 18609 consensus_peers.cc:597] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Couldn't send request to peer 4813437da0a74e65b61eb7bd1d18f110. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.195:41931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:56.407773 18609 consensus_peers.cc:597] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Couldn't send request to peer 4813437da0a74e65b61eb7bd1d18f110. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.195:41931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:56.431980 18609 consensus_peers.cc:597] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Couldn't send request to peer 4813437da0a74e65b61eb7bd1d18f110. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.195:41931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:11:56.438762 22995 raft_consensus.cc:493] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:56.439235 22995 raft_consensus.cc:515] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:56.441192 22995 leader_election.cc:290] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:11:56.454487 18609 consensus_peers.cc:597] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Couldn't send request to peer 4813437da0a74e65b61eb7bd1d18f110. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.195:41931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:56.466904 18608 leader_election.cc:336] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
W20260709 12:11:56.467552 18608 leader_election.cc:336] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:56.485169 18608 leader_election.cc:304] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:56.488955 22995 raft_consensus.cc:2749] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:11:56.651763 18609 consensus_peers.cc:597] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Couldn't send request to peer 4813437da0a74e65b61eb7bd1d18f110. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.195:41931: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:11:56.795365 18608 consensus_peers.cc:597] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:11:56.909466 18608 consensus_peers.cc:597] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:11:56.916119 18608 consensus_peers.cc:597] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:11:56.949185 18608 consensus_peers.cc:597] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:11:57.041025 23029 raft_consensus.cc:493] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:57.041599 23029 raft_consensus.cc:515] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:57.044030 23029 leader_election.cc:290] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
W20260709 12:11:57.050377 18608 leader_election.cc:336] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
W20260709 12:11:57.052351 18608 leader_election.cc:336] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:57.052799 18608 leader_election.cc:304] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:57.054055 23029 raft_consensus.cc:2749] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:11:57.198267 16779 tablet_server.cc:196] TabletServer@127.16.98.195:0 shutdown complete.
I20260709 12:11:57.213550 23029 raft_consensus.cc:493] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:57.214330 23029 raft_consensus.cc:515] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } attrs { replace: true } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:57.217517 23029 leader_election.cc:290] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:11:57.224323 18609 leader_election.cc:336] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Network error: Client connection negotiation failed: client connection to 127.16.98.195:41931: connect: Connection refused (error 111)
W20260709 12:11:57.229260 18608 leader_election.cc:336] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:57.230425 18608 leader_election.cc:304] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
W20260709 12:11:57.233979 18608 leader_election.cc:336] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:57.234462 23029 raft_consensus.cc:2749] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:11:57.253624 18608 consensus_peers.cc:597] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db -> Peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Couldn't send request to peer c5ffa786c8fb43f7864fa8fbe76534cb. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:11:57.300318 16779 tablet_server.cc:179] TabletServer@127.16.98.196:0 shutting down...
W20260709 12:11:57.345943 18608 consensus_peers.cc:597] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db -> Peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Couldn't send request to peer 63f5bddeebd84e5788d671a176cfa8e1. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:11:57.348765 16779 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:11:57.349689 16779 tablet_replica.cc:333] T 9e2acd40c27e44219e850b489602d01a P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.350886 16779 raft_consensus.cc:2243] T 9e2acd40c27e44219e850b489602d01a P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:57.351627 16779 raft_consensus.cc:2272] T 9e2acd40c27e44219e850b489602d01a P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.354100 16779 tablet_replica.cc:333] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.354730 16779 raft_consensus.cc:2243] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:57.355340 16779 raft_consensus.cc:2272] T a474344628f842a781e714727d867c3a P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.357854 16779 tablet_replica.cc:333] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.358548 16779 raft_consensus.cc:2243] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:11:57.359668 16779 raft_consensus.cc:2272] T 528748760fc743e3a2bce89e03314aab P e28f77912a9c4ba2b9841f6fedddc2db [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.362349 16779 tablet_replica.cc:333] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.363029 16779 raft_consensus.cc:2243] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:11:57.363912 16779 raft_consensus.cc:2272] T 137ed415b9d242989f28f349c1618c74 P e28f77912a9c4ba2b9841f6fedddc2db [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.366325 16779 tablet_replica.cc:333] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.367126 16779 raft_consensus.cc:2243] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:11:57.367933 16779 raft_consensus.cc:2272] T c4f794e5675049b284921052a24eea37 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.370103 16779 tablet_replica.cc:333] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.370841 16779 raft_consensus.cc:2243] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:57.371402 16779 raft_consensus.cc:2272] T 9ae30b26b2734033a87c3e1ba937a39f P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.373775 16779 tablet_replica.cc:333] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.374389 16779 raft_consensus.cc:2243] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:11:57.375218 16779 raft_consensus.cc:2272] T 158a286025af4eddba6fb641c128cd25 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.377388 16779 tablet_replica.cc:333] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.378186 16779 raft_consensus.cc:2243] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:57.378963 16779 raft_consensus.cc:2272] T 45c29a91be76451a9328d8cd9e3eecab P e28f77912a9c4ba2b9841f6fedddc2db [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.381783 16779 tablet_replica.cc:333] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.382779 16779 raft_consensus.cc:2243] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:57.383713 16779 raft_consensus.cc:2272] T 66bde4bf25ea49f2b5f4b768cba4cdd0 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.386273 16779 tablet_replica.cc:333] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.387001 16779 raft_consensus.cc:2243] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:57.387465 16779 raft_consensus.cc:2272] T 5379a078a5d24d8cba5cb4e56eee5b5f P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.389647 16779 tablet_replica.cc:333] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.390202 16779 raft_consensus.cc:2243] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:11:57.391059 16779 raft_consensus.cc:2272] T 17e56ed7b94d4185a4f7dd88f922e17d P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.394474 16779 tablet_replica.cc:333] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.395007 16779 raft_consensus.cc:2243] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:11:57.395814 16779 raft_consensus.cc:2272] T 9bb1ec98e5b847df8a401343514ac12d P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.398039 16779 tablet_replica.cc:333] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.398901 16779 raft_consensus.cc:2243] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:57.399379 16779 raft_consensus.cc:2272] T 28dbc0f2cd704e82b686ffe4c9b9967e P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.401729 16779 tablet_replica.cc:333] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.402386 16779 raft_consensus.cc:2243] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:57.402891 16779 raft_consensus.cc:2272] T 6135c6398c3f4926b6f07433b6f63759 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.404708 16779 tablet_replica.cc:333] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.405234 16779 raft_consensus.cc:2243] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:57.405720 16779 raft_consensus.cc:2272] T 7b8822f4f1de477e8866529047a823b9 P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.407981 16779 tablet_replica.cc:333] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.408563 16779 raft_consensus.cc:2243] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:11:57.409505 16779 raft_consensus.cc:2272] T f9b0c864d78846698db31224c547a091 P e28f77912a9c4ba2b9841f6fedddc2db [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.411969 16779 tablet_replica.cc:333] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.412513 16779 raft_consensus.cc:2243] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:57.413008 16779 raft_consensus.cc:2272] T 53fdd1cc63be4f3b8a533d34af81d0c6 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.413040 23015 raft_consensus.cc:493] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:57.413564 23015 raft_consensus.cc:515] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:57.415649 23015 leader_election.cc:290] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
I20260709 12:11:57.415876 16779 tablet_replica.cc:333] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.416795 16779 raft_consensus.cc:2243] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:57.417392 16779 raft_consensus.cc:2272] T 59c85902a99e4edabb1fa20b800476fc P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.420074 16779 tablet_replica.cc:333] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
W20260709 12:11:57.420173 18608 leader_election.cc:336] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
W20260709 12:11:57.420763 18609 leader_election.cc:336] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Network error: Client connection negotiation failed: client connection to 127.16.98.195:41931: connect: Connection refused (error 111)
I20260709 12:11:57.420977 16779 raft_consensus.cc:2243] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:11:57.421190 18609 leader_election.cc:304] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
I20260709 12:11:57.421885 23015 raft_consensus.cc:2749] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:11:57.422133 16779 raft_consensus.cc:2272] T 1372b5e0da1c481fb926410510c94341 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.424683 16779 tablet_replica.cc:333] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.425431 16779 raft_consensus.cc:2243] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:57.426316 16779 raft_consensus.cc:2272] T 16728addc56e43129f085b3bfd185dcb P e28f77912a9c4ba2b9841f6fedddc2db [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.428800 16779 tablet_replica.cc:333] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.429368 16779 raft_consensus.cc:2243] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:57.429888 16779 raft_consensus.cc:2272] T ba159d1da5c74efba256a169e746d3d9 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.432138 16779 tablet_replica.cc:333] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.432838 16779 raft_consensus.cc:2243] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:11:57.433758 16779 raft_consensus.cc:2272] T 40f9c84f7e9940ce943e3ad8e2888beb P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.436141 16779 tablet_replica.cc:333] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.436856 16779 raft_consensus.cc:2243] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:57.437397 16779 raft_consensus.cc:2272] T 320059eb6db148929cae07ba683cfe1f P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.439782 16779 tablet_replica.cc:333] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.440488 16779 raft_consensus.cc:2243] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:57.441104 16779 raft_consensus.cc:2272] T 4ccf0bcc20ae40e79c32530091613e1e P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.443647 16779 tablet_replica.cc:333] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.444367 16779 raft_consensus.cc:2243] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:11:57.445353 16779 raft_consensus.cc:2272] T 9c0d192cc9cf47c1ba111cde01fad070 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.447675 16779 tablet_replica.cc:333] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.448359 16779 raft_consensus.cc:2243] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:11:57.449311 16779 raft_consensus.cc:2272] T 1f6ed08238924344ac4e43e997223ac9 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.451727 16779 tablet_replica.cc:333] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.452477 16779 raft_consensus.cc:2243] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:57.453023 16779 raft_consensus.cc:2272] T 2753b334cd624cd290d57dacd79d8edc P e28f77912a9c4ba2b9841f6fedddc2db [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.455286 16779 tablet_replica.cc:333] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.455950 16779 raft_consensus.cc:2243] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:57.456472 16779 raft_consensus.cc:2272] T c592029696004db48d68a9e4c3f45004 P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.458788 16779 tablet_replica.cc:333] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.459513 16779 raft_consensus.cc:2243] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:11:57.460403 16779 raft_consensus.cc:2272] T 75c1f6edbec54664bbafbe9c9385ff6c P e28f77912a9c4ba2b9841f6fedddc2db [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.462687 16779 tablet_replica.cc:333] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.463363 16779 raft_consensus.cc:2243] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:11:57.464265 16779 raft_consensus.cc:2272] T c345cb34fc6343e98baf0b21aac6d4d7 P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.467130 16779 tablet_replica.cc:333] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.467813 16779 raft_consensus.cc:2243] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:57.468329 23015 raft_consensus.cc:493] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c5ffa786c8fb43f7864fa8fbe76534cb)
I20260709 12:11:57.468466 16779 raft_consensus.cc:2272] T 7201987495494cf8a78424cb721d1c88 P e28f77912a9c4ba2b9841f6fedddc2db [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.468756 23015 raft_consensus.cc:515] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "c5ffa786c8fb43f7864fa8fbe76534cb" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36297 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:57.470489 23015 leader_election.cc:290] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297)
I20260709 12:11:57.471100 16779 tablet_replica.cc:333] T 46c726e58f614fbdab58f22a7da00365 P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.471871 16779 raft_consensus.cc:2243] T 46c726e58f614fbdab58f22a7da00365 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:57.472590 16779 raft_consensus.cc:2272] T 46c726e58f614fbdab58f22a7da00365 P e28f77912a9c4ba2b9841f6fedddc2db [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:11:57.475055 18608 leader_election.cc:336] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:57.475324 16779 tablet_replica.cc:333] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.476120 16779 raft_consensus.cc:2243] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 LEADER]: Raft consensus shutting down.
W20260709 12:11:57.476861 18608 leader_election.cc:336] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:11:57.477077 16779 raft_consensus.cc:2272] T 13f69f8ad8c84e4f9fdacc0e26cb2bc0 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.477263 18608 leader_election.cc:304] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 63f5bddeebd84e5788d671a176cfa8e1, c5ffa786c8fb43f7864fa8fbe76534cb
I20260709 12:11:57.477955 23015 raft_consensus.cc:2749] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:11:57.479660 16779 tablet_replica.cc:333] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.480381 16779 raft_consensus.cc:2243] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:11:57.481276 16779 raft_consensus.cc:2272] T 49c83fd6efbc4c8a92e2e65890ffafd2 P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.483548 16779 tablet_replica.cc:333] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.484223 16779 raft_consensus.cc:2243] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:11:57.485188 16779 raft_consensus.cc:2272] T e46c78c4c90c48cd9221b9e9f0a327bc P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.487394 16779 tablet_replica.cc:333] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.488041 16779 raft_consensus.cc:2243] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:57.488596 16779 raft_consensus.cc:2272] T a8c7e98721a04c9690aef2689338516a P e28f77912a9c4ba2b9841f6fedddc2db [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.490924 16779 tablet_replica.cc:333] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.491597 16779 raft_consensus.cc:2243] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:57.492172 16779 raft_consensus.cc:2272] T 43c6bbfd11044938bb4686693c3544a7 P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.494468 16779 tablet_replica.cc:333] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.495167 16779 raft_consensus.cc:2243] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:57.495805 16779 raft_consensus.cc:2272] T 74a818492fb249b0ba39c6bed00cd202 P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.498298 16779 tablet_replica.cc:333] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.498958 16779 raft_consensus.cc:2243] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:11:57.499755 16779 raft_consensus.cc:2272] T 3cdd445b25e5404da2f578c388210925 P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.502298 16779 tablet_replica.cc:333] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.502966 16779 raft_consensus.cc:2243] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:57.503494 16779 raft_consensus.cc:2272] T ca33c22be72d48f79260f24a00a8f8bb P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.505729 16779 tablet_replica.cc:333] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.506713 16779 raft_consensus.cc:2243] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:11:57.507927 16779 raft_consensus.cc:2272] T 993eae98279b413f8c6fed0d4ea79eae P e28f77912a9c4ba2b9841f6fedddc2db [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.510428 16779 tablet_replica.cc:333] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.511129 16779 raft_consensus.cc:2243] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:57.511814 16779 raft_consensus.cc:2272] T 92e1586ba70a4331be2a55f4a31dd687 P e28f77912a9c4ba2b9841f6fedddc2db [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.514371 16779 tablet_replica.cc:333] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.514824 23015 raft_consensus.cc:493] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4813437da0a74e65b61eb7bd1d18f110)
I20260709 12:11:57.515336 23015 raft_consensus.cc:515] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "63f5bddeebd84e5788d671a176cfa8e1" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 39123 } } peers { permanent_uuid: "4813437da0a74e65b61eb7bd1d18f110" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41931 } } peers { permanent_uuid: "e28f77912a9c4ba2b9841f6fedddc2db" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 43647 } attrs { promote: false } }
I20260709 12:11:57.515952 16779 raft_consensus.cc:2243] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:11:57.516572 16779 raft_consensus.cc:2272] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.516965 23015 leader_election.cc:290] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123), 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931)
W20260709 12:11:57.520504 18608 leader_election.cc:336] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 63f5bddeebd84e5788d671a176cfa8e1 (127.16.98.193:39123): Network error: Client connection negotiation failed: client connection to 127.16.98.193:39123: connect: Connection refused (error 111)
I20260709 12:11:57.520939 16779 tablet_replica.cc:333] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db: stopping tablet replica
I20260709 12:11:57.521587 16779 raft_consensus.cc:2243] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 12:11:57.521770 18609 leader_election.cc:336] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 4813437da0a74e65b61eb7bd1d18f110 (127.16.98.195:41931): Network error: Client connection negotiation failed: client connection to 127.16.98.195:41931: connect: Connection refused (error 111)
I20260709 12:11:57.522205 16779 raft_consensus.cc:2272] T 57fe00fa09a54eb295024fca83b933ec P e28f77912a9c4ba2b9841f6fedddc2db [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:11:57.522192 18609 leader_election.cc:304] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e28f77912a9c4ba2b9841f6fedddc2db; no voters: 4813437da0a74e65b61eb7bd1d18f110, 63f5bddeebd84e5788d671a176cfa8e1
W20260709 12:11:57.522887 18609 raft_consensus.cc:2686] T b03f131254e14da2918c02bf0fcf9c5c P e28f77912a9c4ba2b9841f6fedddc2db: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:11:57.541705 17878 debug-util.cc:398] Leaking SignalData structure 0x7b08003b0020 after lost signal to thread 16782
W20260709 12:11:57.542809 17878 debug-util.cc:398] Leaking SignalData structure 0x7b0800308460 after lost signal to thread 17881
W20260709 12:11:57.544482 17878 debug-util.cc:398] Leaking SignalData structure 0x7b08002bb460 after lost signal to thread 18668
I20260709 12:11:58.507490 16779 tablet_server.cc:196] TabletServer@127.16.98.196:0 shutdown complete.
I20260709 12:11:58.571249 16779 master.cc:562] Master@127.16.98.254:38823 shutting down...
W20260709 12:12:01.529222 17878 debug-util.cc:398] Leaking SignalData structure 0x7b0800394a00 after lost signal to thread 16782
W20260709 12:12:01.529608 17878 debug-util.cc:398] Leaking SignalData structure 0x7b08002017e0 after lost signal to thread 17881
W20260709 12:12:05.223272 17832 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111) [suppressed 259 similar messages]
W20260709 12:12:05.226825 17832 catalog_manager.cc:4755] TS c5ffa786c8fb43f7864fa8fbe76534cb (127.16.98.194:36297): ChangeConfig:REMOVE_PEER RPC failed for tablet 4ccf0bcc20ae40e79c32530091613e1e: Network error: Client connection negotiation failed: client connection to 127.16.98.194:36297: connect: Connection refused (error 111)
I20260709 12:12:05.611696 16779 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b852ae4791e4401b8356c71ae33bbc7d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:05.612741 16779 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b852ae4791e4401b8356c71ae33bbc7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:05.613098 16779 tablet_replica.cc:333] T 00000000000000000000000000000000 P b852ae4791e4401b8356c71ae33bbc7d: stopping tablet replica
I20260709 12:12:05.822434 16779 master.cc:584] Master@127.16.98.254:38823 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (169720 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:12:05.933784 16779 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.98.254:44847
I20260709 12:12:05.934942 16779 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:05.940426 23035 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:05.940521 23034 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:05.941663 23037 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:05.943137 16779 server_base.cc:1061] running on GCE node
I20260709 12:12:05.945996 16779 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:05.946192 16779 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:05.946400 16779 hybrid_clock.cc:648] HybridClock initialized: now 1783599125946363 us; error 0 us; skew 500 ppm
I20260709 12:12:05.947046 16779 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:05.949527 16779 webserver.cc:533] Webserver started at http://127.16.98.254:41973/ using document root <none> and password file <none>
I20260709 12:12:05.950074 16779 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:05.950246 16779 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:05.950596 16779 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:05.952050 16779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895573690-16779-0/minicluster-data/master-0-root/instance:
uuid: "45f78d5d7b2d427b81472bf434f46b33"
format_stamp: "Formatted at 2026-07-09 12:12:05 on dist-test-slave-9bv4"
I20260709 12:12:05.956820 16779 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:12:05.960080 23042 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:05.960938 16779 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:12:05.961287 16779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895573690-16779-0/minicluster-data/master-0-root
uuid: "45f78d5d7b2d427b81472bf434f46b33"
format_stamp: "Formatted at 2026-07-09 12:12:05 on dist-test-slave-9bv4"
I20260709 12:12:05.961673 16779 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895573690-16779-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895573690-16779-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895573690-16779-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:05.985107 16779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:05.986294 16779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:06.023929 16779 rpc_server.cc:307] RPC server started. Bound to: 127.16.98.254:44847
I20260709 12:12:06.023967 23093 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.98.254:44847 every 8 connection(s)
I20260709 12:12:06.028079 23094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:06.038625 23094 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45f78d5d7b2d427b81472bf434f46b33: Bootstrap starting.
I20260709 12:12:06.043406 23094 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 45f78d5d7b2d427b81472bf434f46b33: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:06.047501 23094 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45f78d5d7b2d427b81472bf434f46b33: No bootstrap required, opened a new log
I20260709 12:12:06.049639 23094 raft_consensus.cc:359] T 00000000000000000000000000000000 P 45f78d5d7b2d427b81472bf434f46b33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45f78d5d7b2d427b81472bf434f46b33" member_type: VOTER }
I20260709 12:12:06.050092 23094 raft_consensus.cc:385] T 00000000000000000000000000000000 P 45f78d5d7b2d427b81472bf434f46b33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:06.050325 23094 raft_consensus.cc:740] T 00000000000000000000000000000000 P 45f78d5d7b2d427b81472bf434f46b33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f78d5d7b2d427b81472bf434f46b33, State: Initialized, Role: FOLLOWER
I20260709 12:12:06.050992 23094 consensus_queue.cc:260] T 00000000000000000000000000000000 P 45f78d5d7b2d427b81472bf434f46b33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45f78d5d7b2d427b81472bf434f46b33" member_type: VOTER }
I20260709 12:12:06.051468 23094 raft_consensus.cc:399] T 00000000000000000000000000000000 P 45f78d5d7b2d427b81472bf434f46b33 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:12:06.051715 23094 raft_consensus.cc:493] T 00000000000000000000000000000000 P 45f78d5d7b2d427b81472bf434f46b33 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:12:06.052007 23094 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 45f78d5d7b2d427b81472bf434f46b33 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:06.056267 23094 raft_consensus.cc:515] T 00000000000000000000000000000000 P 45f78d5d7b2d427b81472bf434f46b33 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45f78d5d7b2d427b81472bf434f46b33" member_type: VOTER }
I20260709 12:12:06.056777 23094 leader_election.cc:304] T 00000000000000000000000000000000 P 45f78d5d7b2d427b81472bf434f46b33 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 45f78d5d7b2d427b81472bf434f46b33; no voters: 
I20260709 12:12:06.057893 23094 leader_election.cc:290] T 00000000000000000000000000000000 P 45f78d5d7b2d427b81472bf434f46b33 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:12:06.058192 23097 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 45f78d5d7b2d427b81472bf434f46b33 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:06.059528 23097 raft_consensus.cc:697] T 00000000000000000000000000000000 P 45f78d5d7b2d427b81472bf434f46b33 [term 1 LEADER]: Becoming Leader. State: Replica: 45f78d5d7b2d427b81472bf434f46b33, State: Running, Role: LEADER
I20260709 12:12:06.060227 23097 consensus_queue.cc:237] T 00000000000000000000000000000000 P 45f78d5d7b2d427b81472bf434f46b33 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45f78d5d7b2d427b81472bf434f46b33" member_type: VOTER }
I20260709 12:12:06.060909 23094 sys_catalog.cc:565] T 00000000000000000000000000000000 P 45f78d5d7b2d427b81472bf434f46b33 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:12:06.069535 23098 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45f78d5d7b2d427b81472bf434f46b33 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "45f78d5d7b2d427b81472bf434f46b33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45f78d5d7b2d427b81472bf434f46b33" member_type: VOTER } }
I20260709 12:12:06.069741 23099 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45f78d5d7b2d427b81472bf434f46b33 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 45f78d5d7b2d427b81472bf434f46b33. Latest consensus state: current_term: 1 leader_uuid: "45f78d5d7b2d427b81472bf434f46b33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45f78d5d7b2d427b81472bf434f46b33" member_type: VOTER } }
I20260709 12:12:06.070088 23098 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45f78d5d7b2d427b81472bf434f46b33 [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:06.070330 23099 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45f78d5d7b2d427b81472bf434f46b33 [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:06.072016 23107 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:12:06.077890 23107 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:12:06.078890 16779 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:12:06.086479 23107 catalog_manager.cc:1383] Generated new cluster ID: 252e67ad8efb4a968b5f0bcb35464322
I20260709 12:12:06.086786 23107 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:12:06.100090 23107 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:12:06.101936 23107 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:12:06.112690 23107 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 45f78d5d7b2d427b81472bf434f46b33: Generated new TSK 0
I20260709 12:12:06.113276 23107 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:12:06.145686 16779 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:06.152094 23115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:06.152827 23116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:06.154518 23118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:06.155563 16779 server_base.cc:1061] running on GCE node
I20260709 12:12:06.157266 16779 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:06.157447 16779 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:06.157575 16779 hybrid_clock.cc:648] HybridClock initialized: now 1783599126157556 us; error 0 us; skew 500 ppm
I20260709 12:12:06.158051 16779 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:06.160665 16779 webserver.cc:533] Webserver started at http://127.16.98.193:40489/ using document root <none> and password file <none>
I20260709 12:12:06.161087 16779 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:06.161248 16779 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:06.161478 16779 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:06.162866 16779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895573690-16779-0/minicluster-data/ts-0-root/instance:
uuid: "3824bca1df8e4020b18c7989f7758391"
format_stamp: "Formatted at 2026-07-09 12:12:06 on dist-test-slave-9bv4"
I20260709 12:12:06.167423 16779 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:12:06.170688 23123 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:06.171439 16779 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:12:06.171746 16779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895573690-16779-0/minicluster-data/ts-0-root
uuid: "3824bca1df8e4020b18c7989f7758391"
format_stamp: "Formatted at 2026-07-09 12:12:06 on dist-test-slave-9bv4"
I20260709 12:12:06.172016 16779 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895573690-16779-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895573690-16779-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895573690-16779-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:06.189318 16779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:06.190488 16779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:06.191974 16779 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:06.194236 16779 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:06.194460 16779 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:06.194733 16779 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:06.194921 16779 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:06.240365 16779 rpc_server.cc:307] RPC server started. Bound to: 127.16.98.193:42187
I20260709 12:12:06.240465 23185 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.98.193:42187 every 8 connection(s)
I20260709 12:12:06.245704 16779 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:06.253168 23190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:06.253400 23191 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:06.256419 23193 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:06.257354 16779 server_base.cc:1061] running on GCE node
I20260709 12:12:06.259651 23186 heartbeater.cc:344] Connected to a master server at 127.16.98.254:44847
I20260709 12:12:06.259696 16779 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:06.260125 16779 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:06.260179 23186 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:06.260310 16779 hybrid_clock.cc:648] HybridClock initialized: now 1783599126260293 us; error 0 us; skew 500 ppm
I20260709 12:12:06.261042 16779 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:06.261116 23186 heartbeater.cc:507] Master 127.16.98.254:44847 requested a full tablet report, sending...
I20260709 12:12:06.263630 23059 ts_manager.cc:194] Registered new tserver with Master: 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:06.264079 16779 webserver.cc:533] Webserver started at http://127.16.98.194:38819/ using document root <none> and password file <none>
I20260709 12:12:06.264616 16779 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:06.264801 16779 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:06.265092 16779 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:06.265578 23059 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55156
I20260709 12:12:06.266465 16779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895573690-16779-0/minicluster-data/ts-1-root/instance:
uuid: "abe65f4962e147ac841608b6c30f7e1b"
format_stamp: "Formatted at 2026-07-09 12:12:06 on dist-test-slave-9bv4"
I20260709 12:12:06.270977 16779 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:12:06.274688 23198 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:06.275537 16779 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:12:06.275847 16779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895573690-16779-0/minicluster-data/ts-1-root
uuid: "abe65f4962e147ac841608b6c30f7e1b"
format_stamp: "Formatted at 2026-07-09 12:12:06 on dist-test-slave-9bv4"
I20260709 12:12:06.276085 16779 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895573690-16779-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895573690-16779-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895573690-16779-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:06.301048 16779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:06.302518 16779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:06.304029 16779 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:06.306260 16779 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:06.306481 16779 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:06.306746 16779 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:06.306917 16779 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:06.354847 16779 rpc_server.cc:307] RPC server started. Bound to: 127.16.98.194:41907
I20260709 12:12:06.354898 23260 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.98.194:41907 every 8 connection(s)
I20260709 12:12:06.361241 16779 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:06.369093 23264 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:06.370067 23265 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:06.373636 16779 server_base.cc:1061] running on GCE node
W20260709 12:12:06.374127 23267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:06.375372 16779 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:12:06.375564 23261 heartbeater.cc:344] Connected to a master server at 127.16.98.254:44847
I20260709 12:12:06.376240 23261 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:06.377301 23261 heartbeater.cc:507] Master 127.16.98.254:44847 requested a full tablet report, sending...
W20260709 12:12:06.375635 16779 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:06.378445 16779 hybrid_clock.cc:648] HybridClock initialized: now 1783599126378421 us; error 0 us; skew 500 ppm
I20260709 12:12:06.379463 16779 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:06.379603 23059 ts_manager.cc:194] Registered new tserver with Master: abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:06.381295 23059 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55158
I20260709 12:12:06.382902 16779 webserver.cc:533] Webserver started at http://127.16.98.195:41643/ using document root <none> and password file <none>
I20260709 12:12:06.383697 16779 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:06.383982 16779 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:06.384352 16779 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:06.386102 16779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895573690-16779-0/minicluster-data/ts-2-root/instance:
uuid: "a9d87b20401744c7bd0c491f60cf0689"
format_stamp: "Formatted at 2026-07-09 12:12:06 on dist-test-slave-9bv4"
I20260709 12:12:06.390460 16779 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 12:12:06.393958 23272 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:06.394793 16779 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:12:06.395090 16779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895573690-16779-0/minicluster-data/ts-2-root
uuid: "a9d87b20401744c7bd0c491f60cf0689"
format_stamp: "Formatted at 2026-07-09 12:12:06 on dist-test-slave-9bv4"
I20260709 12:12:06.395344 16779 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895573690-16779-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895573690-16779-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895573690-16779-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:06.416213 16779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:06.417474 16779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:06.418998 16779 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:06.421154 16779 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:06.421386 16779 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:06.421653 16779 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:06.421833 16779 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:06.461634 16779 rpc_server.cc:307] RPC server started. Bound to: 127.16.98.195:41253
I20260709 12:12:06.461755 23334 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.98.195:41253 every 8 connection(s)
I20260709 12:12:06.467208 16779 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:06.475009 23338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:06.476672 23339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:06.478708 16779 server_base.cc:1061] running on GCE node
I20260709 12:12:06.479238 23335 heartbeater.cc:344] Connected to a master server at 127.16.98.254:44847
W20260709 12:12:06.479609 23341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:06.479677 23335 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:06.480741 16779 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:12:06.480826 23335 heartbeater.cc:507] Master 127.16.98.254:44847 requested a full tablet report, sending...
W20260709 12:12:06.481107 16779 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:06.481329 16779 hybrid_clock.cc:648] HybridClock initialized: now 1783599126481312 us; error 0 us; skew 500 ppm
I20260709 12:12:06.482076 16779 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:06.483295 23059 ts_manager.cc:194] Registered new tserver with Master: a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:06.484830 16779 webserver.cc:533] Webserver started at http://127.16.98.196:41915/ using document root <none> and password file <none>
I20260709 12:12:06.485131 23059 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55170
I20260709 12:12:06.485463 16779 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:06.485754 16779 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:06.486083 16779 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:06.487268 16779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895573690-16779-0/minicluster-data/ts-3-root/instance:
uuid: "48bc58ace75f40e995efc1edcefe79fa"
format_stamp: "Formatted at 2026-07-09 12:12:06 on dist-test-slave-9bv4"
I20260709 12:12:06.491567 16779 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:12:06.494719 23346 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:06.495401 16779 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:12:06.495718 16779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895573690-16779-0/minicluster-data/ts-3-root
uuid: "48bc58ace75f40e995efc1edcefe79fa"
format_stamp: "Formatted at 2026-07-09 12:12:06 on dist-test-slave-9bv4"
I20260709 12:12:06.496001 16779 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895573690-16779-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895573690-16779-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895573690-16779-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:06.510951 16779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:06.512141 16779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:06.513628 16779 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:06.515868 16779 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:06.516125 16779 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:06.516371 16779 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:06.516558 16779 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:06.558930 16779 rpc_server.cc:307] RPC server started. Bound to: 127.16.98.196:37599
I20260709 12:12:06.559017 23408 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.98.196:37599 every 8 connection(s)
I20260709 12:12:06.574095 23409 heartbeater.cc:344] Connected to a master server at 127.16.98.254:44847
I20260709 12:12:06.574452 23409 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:06.575243 23409 heartbeater.cc:507] Master 127.16.98.254:44847 requested a full tablet report, sending...
I20260709 12:12:06.577057 23059 ts_manager.cc:194] Registered new tserver with Master: 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:06.577771 16779 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.014988643s
I20260709 12:12:06.578866 23059 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55184
I20260709 12:12:06.603820 23059 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55194:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:12:06.853857 23374 tablet_service.cc:1511] Processing CreateTablet for tablet 1a2d000d8737420cbb2ee80189092814 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:12:06.855419 23374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a2d000d8737420cbb2ee80189092814. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:06.857079 23151 tablet_service.cc:1511] Processing CreateTablet for tablet 3243e85ef0e741d696af414124ca96bd (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:12:06.858448 23151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3243e85ef0e741d696af414124ca96bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:06.859858 23373 tablet_service.cc:1511] Processing CreateTablet for tablet 7193dd2dee9c4d1c9992ad4eff434b59 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:12:06.860447 23300 tablet_service.cc:1511] Processing CreateTablet for tablet 1a2d000d8737420cbb2ee80189092814 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:12:06.861255 23373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7193dd2dee9c4d1c9992ad4eff434b59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:06.861299 23296 tablet_service.cc:1511] Processing CreateTablet for tablet 923f193f1d2d4e61ae30850183122635 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:12:06.861850 23300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a2d000d8737420cbb2ee80189092814. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:06.862828 23296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 923f193f1d2d4e61ae30850183122635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:06.863245 23295 tablet_service.cc:1511] Processing CreateTablet for tablet ec1028a2affb45679aede72149f857f5 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:12:06.863871 23299 tablet_service.cc:1511] Processing CreateTablet for tablet 3243e85ef0e741d696af414124ca96bd (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:12:06.863983 23371 tablet_service.cc:1511] Processing CreateTablet for tablet d53aaedd982440259b3ef5d84cddcbed (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:12:06.864697 23295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec1028a2affb45679aede72149f857f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:06.865489 23371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53aaedd982440259b3ef5d84cddcbed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:06.866269 23297 tablet_service.cc:1511] Processing CreateTablet for tablet 2954a8837137444496d21a25638b3f2a (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:12:06.867750 23297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2954a8837137444496d21a25638b3f2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:06.867951 23372 tablet_service.cc:1511] Processing CreateTablet for tablet 9d57b510cd3745fabb0748a6f9008fca (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:12:06.869329 23372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d57b510cd3745fabb0748a6f9008fca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:06.872081 23298 tablet_service.cc:1511] Processing CreateTablet for tablet 9d57b510cd3745fabb0748a6f9008fca (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:12:06.873539 23298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d57b510cd3745fabb0748a6f9008fca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:06.872090 23370 tablet_service.cc:1511] Processing CreateTablet for tablet 923f193f1d2d4e61ae30850183122635 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:12:06.876119 23370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 923f193f1d2d4e61ae30850183122635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:06.876965 23369 tablet_service.cc:1511] Processing CreateTablet for tablet ec1028a2affb45679aede72149f857f5 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:12:06.878353 23369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec1028a2affb45679aede72149f857f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:06.879084 23299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3243e85ef0e741d696af414124ca96bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:06.883181 23222 tablet_service.cc:1511] Processing CreateTablet for tablet d53aaedd982440259b3ef5d84cddcbed (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:12:06.884582 23222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53aaedd982440259b3ef5d84cddcbed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:06.884670 23294 tablet_service.cc:1511] Processing CreateTablet for tablet 8ac0ace3682c4f29b9e5ecad75f783f7 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:12:06.886142 23294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ac0ace3682c4f29b9e5ecad75f783f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:06.887863 23221 tablet_service.cc:1511] Processing CreateTablet for tablet ec1028a2affb45679aede72149f857f5 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:12:06.889549 23221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec1028a2affb45679aede72149f857f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:06.892279 23224 tablet_service.cc:1511] Processing CreateTablet for tablet 7193dd2dee9c4d1c9992ad4eff434b59 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:12:06.895119 23225 tablet_service.cc:1511] Processing CreateTablet for tablet 3243e85ef0e741d696af414124ca96bd (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:12:06.897895 23226 tablet_service.cc:1511] Processing CreateTablet for tablet 1a2d000d8737420cbb2ee80189092814 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:12:06.898753 23150 tablet_service.cc:1511] Processing CreateTablet for tablet 7193dd2dee9c4d1c9992ad4eff434b59 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:12:06.900377 23150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7193dd2dee9c4d1c9992ad4eff434b59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:06.900007 23223 tablet_service.cc:1511] Processing CreateTablet for tablet 2954a8837137444496d21a25638b3f2a (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:12:06.903374 23220 tablet_service.cc:1511] Processing CreateTablet for tablet 8ac0ace3682c4f29b9e5ecad75f783f7 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:12:06.903894 23149 tablet_service.cc:1511] Processing CreateTablet for tablet 9d57b510cd3745fabb0748a6f9008fca (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:12:06.905419 23149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d57b510cd3745fabb0748a6f9008fca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:06.905542 23145 tablet_service.cc:1511] Processing CreateTablet for tablet 8ac0ace3682c4f29b9e5ecad75f783f7 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:12:06.907092 23145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ac0ace3682c4f29b9e5ecad75f783f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:06.907828 23148 tablet_service.cc:1511] Processing CreateTablet for tablet 2954a8837137444496d21a25638b3f2a (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:12:06.909214 23148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2954a8837137444496d21a25638b3f2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:06.911839 23147 tablet_service.cc:1511] Processing CreateTablet for tablet d53aaedd982440259b3ef5d84cddcbed (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:12:06.913288 23147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d53aaedd982440259b3ef5d84cddcbed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:06.915891 23146 tablet_service.cc:1511] Processing CreateTablet for tablet 923f193f1d2d4e61ae30850183122635 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:12:06.917299 23146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 923f193f1d2d4e61ae30850183122635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:06.920585 23368 tablet_service.cc:1511] Processing CreateTablet for tablet e53f580024c14b33b72266b89a1ab8e3 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:12:06.922020 23368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e53f580024c14b33b72266b89a1ab8e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:06.928681 23226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a2d000d8737420cbb2ee80189092814. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:06.931556 23144 tablet_service.cc:1511] Processing CreateTablet for tablet e53f580024c14b33b72266b89a1ab8e3 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:12:06.932992 23224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7193dd2dee9c4d1c9992ad4eff434b59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:06.933090 23144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e53f580024c14b33b72266b89a1ab8e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:06.932823 23219 tablet_service.cc:1511] Processing CreateTablet for tablet e53f580024c14b33b72266b89a1ab8e3 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:12:06.935390 23220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ac0ace3682c4f29b9e5ecad75f783f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:06.937193 23219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e53f580024c14b33b72266b89a1ab8e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:06.938568 23293 tablet_service.cc:1511] Processing CreateTablet for tablet 11b1c6ca5b8b4d61a6e200744c543ede (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:12:06.941040 23293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11b1c6ca5b8b4d61a6e200744c543ede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:06.943060 23223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2954a8837137444496d21a25638b3f2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:06.947094 23225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3243e85ef0e741d696af414124ca96bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:06.947552 23367 tablet_service.cc:1511] Processing CreateTablet for tablet 11b1c6ca5b8b4d61a6e200744c543ede (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:12:06.948964 23367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11b1c6ca5b8b4d61a6e200744c543ede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:06.948774 23143 tablet_service.cc:1511] Processing CreateTablet for tablet 11b1c6ca5b8b4d61a6e200744c543ede (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:12:06.953523 23218 tablet_service.cc:1511] Processing CreateTablet for tablet 9be6b80356b0415ba28a56482e13d24f (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:12:06.956054 23430 tablet_bootstrap.cc:492] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:06.956321 23218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9be6b80356b0415ba28a56482e13d24f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:06.963467 23142 tablet_service.cc:1511] Processing CreateTablet for tablet 2693b48366d0430b9db7d8cc90d9667c (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:12:06.966118 23217 tablet_service.cc:1511] Processing CreateTablet for tablet 2693b48366d0430b9db7d8cc90d9667c (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:12:06.967552 23217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2693b48366d0430b9db7d8cc90d9667c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:06.973114 23295 tablet_service.cc:1511] Processing CreateTablet for tablet 2693b48366d0430b9db7d8cc90d9667c (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:12:06.973698 23143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11b1c6ca5b8b4d61a6e200744c543ede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:06.974545 23295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2693b48366d0430b9db7d8cc90d9667c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:06.976348 23366 tablet_service.cc:1511] Processing CreateTablet for tablet 5d0efec949fc4455838db7fb01259d69 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:12:06.977681 23366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d0efec949fc4455838db7fb01259d69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:06.978242 23142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2693b48366d0430b9db7d8cc90d9667c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:06.987454 23430 tablet_bootstrap.cc:654] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:07.001116 23292 tablet_service.cc:1511] Processing CreateTablet for tablet 3fb3705cd5724f208798f30d9ab01bda (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:12:07.002620 23292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fb3705cd5724f208798f30d9ab01bda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.011809 23365 tablet_service.cc:1511] Processing CreateTablet for tablet 3fb3705cd5724f208798f30d9ab01bda (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:12:07.013309 23365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fb3705cd5724f208798f30d9ab01bda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.013443 23299 tablet_service.cc:1511] Processing CreateTablet for tablet 9be6b80356b0415ba28a56482e13d24f (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:12:07.014698 23299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9be6b80356b0415ba28a56482e13d24f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.011695 23370 tablet_service.cc:1511] Processing CreateTablet for tablet 9be6b80356b0415ba28a56482e13d24f (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:12:07.031606 23370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9be6b80356b0415ba28a56482e13d24f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.053841 23151 tablet_service.cc:1511] Processing CreateTablet for tablet 3fb3705cd5724f208798f30d9ab01bda (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:12:07.057503 23151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fb3705cd5724f208798f30d9ab01bda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.081830 23431 tablet_bootstrap.cc:492] T 3243e85ef0e741d696af414124ca96bd P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:07.095986 23292 tablet_service.cc:1511] Processing CreateTablet for tablet b4c15adbbcbc4dbb9162ef9af4e14477 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:12:07.097379 23292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4c15adbbcbc4dbb9162ef9af4e14477. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.099388 23218 tablet_service.cc:1511] Processing CreateTablet for tablet 5d0efec949fc4455838db7fb01259d69 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
W20260709 12:12:07.110821 23106 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:07.115032 23429 tablet_bootstrap.cc:492] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:07.115777 23295 tablet_service.cc:1511] Processing CreateTablet for tablet 1f5cfd203dcc43d4a86864c2eaaf234c (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:12:07.117051 23295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f5cfd203dcc43d4a86864c2eaaf234c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.114058 23148 tablet_service.cc:1511] Processing CreateTablet for tablet 1f5cfd203dcc43d4a86864c2eaaf234c (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:12:07.119414 23148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f5cfd203dcc43d4a86864c2eaaf234c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.111070 23430 tablet_bootstrap.cc:492] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:07.119572 23367 tablet_service.cc:1511] Processing CreateTablet for tablet b4c15adbbcbc4dbb9162ef9af4e14477 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:12:07.120330 23430 ts_tablet_manager.cc:1403] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.165s	user 0.022s	sys 0.000s
I20260709 12:12:07.123946 23218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d0efec949fc4455838db7fb01259d69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.121078 23367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4c15adbbcbc4dbb9162ef9af4e14477. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.125578 23226 tablet_service.cc:1511] Processing CreateTablet for tablet 1f5cfd203dcc43d4a86864c2eaaf234c (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:12:07.126926 23226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f5cfd203dcc43d4a86864c2eaaf234c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.133293 23429 tablet_bootstrap.cc:654] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:07.133980 23431 tablet_bootstrap.cc:654] T 3243e85ef0e741d696af414124ca96bd P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:07.136035 23433 tablet_bootstrap.cc:492] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:07.145774 23370 tablet_service.cc:1511] Processing CreateTablet for tablet 162d91be31a64ad688b7b433392ed1a2 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:12:07.147212 23370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 162d91be31a64ad688b7b433392ed1a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.152316 23294 tablet_service.cc:1511] Processing CreateTablet for tablet a7d44e74deb341179f886489282ced2f (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:12:07.154423 23369 tablet_service.cc:1511] Processing CreateTablet for tablet a7d44e74deb341179f886489282ced2f (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:12:07.155794 23369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7d44e74deb341179f886489282ced2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.155601 23143 tablet_service.cc:1511] Processing CreateTablet for tablet 162d91be31a64ad688b7b433392ed1a2 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:12:07.156899 23143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 162d91be31a64ad688b7b433392ed1a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.155467 23430 raft_consensus.cc:359] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:07.163249 23430 raft_consensus.cc:385] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:07.163633 23430 raft_consensus.cc:740] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:07.164640 23430 consensus_queue.cc:260] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:07.162709 23294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7d44e74deb341179f886489282ced2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.167233 23147 tablet_service.cc:1511] Processing CreateTablet for tablet 5d0efec949fc4455838db7fb01259d69 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:12:07.168505 23147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d0efec949fc4455838db7fb01259d69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.175633 23217 tablet_service.cc:1511] Processing CreateTablet for tablet b4c15adbbcbc4dbb9162ef9af4e14477 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:12:07.176962 23217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4c15adbbcbc4dbb9162ef9af4e14477. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.181056 23151 tablet_service.cc:1511] Processing CreateTablet for tablet a7d44e74deb341179f886489282ced2f (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:12:07.187564 23225 tablet_service.cc:1511] Processing CreateTablet for tablet 2d308deadcb9416c9b0b16ef4891e6eb (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:12:07.187479 23293 tablet_service.cc:1511] Processing CreateTablet for tablet 2d308deadcb9416c9b0b16ef4891e6eb (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:12:07.189142 23373 tablet_service.cc:1511] Processing CreateTablet for tablet 2d308deadcb9416c9b0b16ef4891e6eb (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:12:07.195084 23222 tablet_service.cc:1511] Processing CreateTablet for tablet 162d91be31a64ad688b7b433392ed1a2 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:12:07.205092 23433 tablet_bootstrap.cc:654] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:07.210131 23293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d308deadcb9416c9b0b16ef4891e6eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.210414 23409 heartbeater.cc:499] Master 127.16.98.254:44847 was elected leader, sending a full tablet report...
I20260709 12:12:07.210726 23373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d308deadcb9416c9b0b16ef4891e6eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.210131 23225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d308deadcb9416c9b0b16ef4891e6eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.215431 23222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 162d91be31a64ad688b7b433392ed1a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.216956 23219 tablet_service.cc:1511] Processing CreateTablet for tablet c880cf7f327c4b709c29dd91c8645c18 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:12:07.218199 23219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c880cf7f327c4b709c29dd91c8645c18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.221937 23299 tablet_service.cc:1511] Processing CreateTablet for tablet c880cf7f327c4b709c29dd91c8645c18 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:12:07.223433 23150 tablet_service.cc:1511] Processing CreateTablet for tablet c880cf7f327c4b709c29dd91c8645c18 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:12:07.224257 23299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c880cf7f327c4b709c29dd91c8645c18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.227599 23298 tablet_service.cc:1511] Processing CreateTablet for tablet 1b4285f9faa34fc595e0b7db3f7f0946 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:12:07.228847 23298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b4285f9faa34fc595e0b7db3f7f0946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.231644 23148 tablet_service.cc:1511] Processing CreateTablet for tablet 7f25493a942c4d96ad5fed839ad58386 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:12:07.234241 23429 tablet_bootstrap.cc:492] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:07.234817 23429 ts_tablet_manager.cc:1403] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.127s	user 0.006s	sys 0.014s
I20260709 12:12:07.236267 23431 tablet_bootstrap.cc:492] T 3243e85ef0e741d696af414124ca96bd P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:07.236783 23431 ts_tablet_manager.cc:1403] T 3243e85ef0e741d696af414124ca96bd P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.155s	user 0.012s	sys 0.000s
I20260709 12:12:07.237901 23429 raft_consensus.cc:359] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:07.238716 23150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c880cf7f327c4b709c29dd91c8645c18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.240069 23226 tablet_service.cc:1511] Processing CreateTablet for tablet 7f25493a942c4d96ad5fed839ad58386 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:12:07.246946 23148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f25493a942c4d96ad5fed839ad58386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.248149 23430 ts_tablet_manager.cc:1434] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.127s	user 0.007s	sys 0.000s
I20260709 12:12:07.245504 23226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f25493a942c4d96ad5fed839ad58386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.250418 23430 tablet_bootstrap.cc:492] T 5d0efec949fc4455838db7fb01259d69 P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:07.241884 23429 raft_consensus.cc:385] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:07.261632 23429 raft_consensus.cc:740] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:07.256160 23431 raft_consensus.cc:359] T 3243e85ef0e741d696af414124ca96bd P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:07.262164 23431 raft_consensus.cc:385] T 3243e85ef0e741d696af414124ca96bd P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:07.255800 23151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7d44e74deb341179f886489282ced2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.262466 23431 raft_consensus.cc:740] T 3243e85ef0e741d696af414124ca96bd P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:07.263298 23431 consensus_queue.cc:260] T 3243e85ef0e741d696af414124ca96bd P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:07.265355 23429 consensus_queue.cc:260] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:07.265797 23369 tablet_service.cc:1511] Processing CreateTablet for tablet 7f25493a942c4d96ad5fed839ad58386 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:12:07.268313 23186 heartbeater.cc:499] Master 127.16.98.254:44847 was elected leader, sending a full tablet report...
I20260709 12:12:07.269075 23373 tablet_service.cc:1511] Processing CreateTablet for tablet 1b4285f9faa34fc595e0b7db3f7f0946 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:12:07.270380 23373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b4285f9faa34fc595e0b7db3f7f0946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.276886 23143 tablet_service.cc:1511] Processing CreateTablet for tablet 1b4285f9faa34fc595e0b7db3f7f0946 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:12:07.279233 23143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b4285f9faa34fc595e0b7db3f7f0946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.292889 23431 ts_tablet_manager.cc:1434] T 3243e85ef0e741d696af414124ca96bd P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.005s
I20260709 12:12:07.294474 23431 tablet_bootstrap.cc:492] T d53aaedd982440259b3ef5d84cddcbed P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:07.295430 23369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f25493a942c4d96ad5fed839ad58386. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:07.315430 23410 tablet.cc:2406] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:12:07.315888 23293 tablet_service.cc:1511] Processing CreateTablet for tablet af6b6c7f82544d968d77f359f1a34403 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:12:07.317191 23293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af6b6c7f82544d968d77f359f1a34403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.329524 23219 tablet_service.cc:1511] Processing CreateTablet for tablet af6b6c7f82544d968d77f359f1a34403 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:12:07.336279 23219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af6b6c7f82544d968d77f359f1a34403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.347579 23147 tablet_service.cc:1511] Processing CreateTablet for tablet a51c8a6c6cfe460fadc0694a71805ba6 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:12:07.348853 23147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a51c8a6c6cfe460fadc0694a71805ba6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.346091 23371 tablet_service.cc:1511] Processing CreateTablet for tablet af6b6c7f82544d968d77f359f1a34403 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:12:07.350956 23430 tablet_bootstrap.cc:654] T 5d0efec949fc4455838db7fb01259d69 P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:07.351683 23371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af6b6c7f82544d968d77f359f1a34403. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.335280 23433 tablet_bootstrap.cc:492] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:07.366082 23433 ts_tablet_manager.cc:1403] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.230s	user 0.011s	sys 0.010s
I20260709 12:12:07.375311 23217 tablet_service.cc:1511] Processing CreateTablet for tablet a51c8a6c6cfe460fadc0694a71805ba6 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:12:07.376655 23217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a51c8a6c6cfe460fadc0694a71805ba6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.376748 23431 tablet_bootstrap.cc:654] T d53aaedd982440259b3ef5d84cddcbed P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:07.384030 23261 heartbeater.cc:499] Master 127.16.98.254:44847 was elected leader, sending a full tablet report...
I20260709 12:12:07.384217 23433 raft_consensus.cc:359] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:07.386483 23437 raft_consensus.cc:493] T 3243e85ef0e741d696af414124ca96bd P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.386906 23433 raft_consensus.cc:385] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:07.390959 23335 heartbeater.cc:499] Master 127.16.98.254:44847 was elected leader, sending a full tablet report...
I20260709 12:12:07.396895 23440 raft_consensus.cc:493] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.397454 23440 raft_consensus.cc:515] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:07.393740 23298 tablet_service.cc:1511] Processing CreateTablet for tablet a51c8a6c6cfe460fadc0694a71805ba6 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:12:07.399526 23298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a51c8a6c6cfe460fadc0694a71805ba6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.402717 23373 tablet_service.cc:1511] Processing CreateTablet for tablet da47bda397e2471388bcab5069dd7edc (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:12:07.404089 23373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da47bda397e2471388bcab5069dd7edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.405040 23430 tablet_bootstrap.cc:492] T 5d0efec949fc4455838db7fb01259d69 P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:07.407188 23430 ts_tablet_manager.cc:1403] T 5d0efec949fc4455838db7fb01259d69 P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.157s	user 0.017s	sys 0.005s
I20260709 12:12:07.408931 23440 leader_election.cc:290] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:07.402719 23437 raft_consensus.cc:515] T 3243e85ef0e741d696af414124ca96bd P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:07.411427 23437 leader_election.cc:290] T 3243e85ef0e741d696af414124ca96bd P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:07.413640 23430 raft_consensus.cc:359] T 5d0efec949fc4455838db7fb01259d69 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:07.391924 23433 raft_consensus.cc:740] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:07.425323 23429 ts_tablet_manager.cc:1434] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.190s	user 0.034s	sys 0.048s
I20260709 12:12:07.430404 23429 tablet_bootstrap.cc:492] T ec1028a2affb45679aede72149f857f5 P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:07.431200 23433 consensus_queue.cc:260] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:07.422389 23430 raft_consensus.cc:385] T 5d0efec949fc4455838db7fb01259d69 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:07.448938 23226 tablet_service.cc:1511] Processing CreateTablet for tablet da47bda397e2471388bcab5069dd7edc (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:12:07.450297 23226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da47bda397e2471388bcab5069dd7edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.452339 23371 tablet_service.cc:1511] Processing CreateTablet for tablet e3b19b20feb045058cd1cfbd684ff05f (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:12:07.454034 23371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3b19b20feb045058cd1cfbd684ff05f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.439786 23430 raft_consensus.cc:740] T 5d0efec949fc4455838db7fb01259d69 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:07.461967 23430 consensus_queue.cc:260] T 5d0efec949fc4455838db7fb01259d69 P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:07.464288 23430 ts_tablet_manager.cc:1434] T 5d0efec949fc4455838db7fb01259d69 P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.057s	user 0.002s	sys 0.005s
I20260709 12:12:07.484985 23429 tablet_bootstrap.cc:654] T ec1028a2affb45679aede72149f857f5 P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:07.485528 23151 tablet_service.cc:1511] Processing CreateTablet for tablet da47bda397e2471388bcab5069dd7edc (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:12:07.487033 23151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da47bda397e2471388bcab5069dd7edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.499692 23147 tablet_service.cc:1511] Processing CreateTablet for tablet e3b19b20feb045058cd1cfbd684ff05f (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:12:07.501405 23431 tablet_bootstrap.cc:492] T d53aaedd982440259b3ef5d84cddcbed P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:07.501942 23431 ts_tablet_manager.cc:1403] T d53aaedd982440259b3ef5d84cddcbed P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.208s	user 0.011s	sys 0.003s
I20260709 12:12:07.502327 23147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3b19b20feb045058cd1cfbd684ff05f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.505054 23431 raft_consensus.cc:359] T d53aaedd982440259b3ef5d84cddcbed P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:07.505806 23431 raft_consensus.cc:385] T d53aaedd982440259b3ef5d84cddcbed P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:07.506095 23431 raft_consensus.cc:740] T d53aaedd982440259b3ef5d84cddcbed P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:07.508767 23293 tablet_service.cc:1511] Processing CreateTablet for tablet e3b19b20feb045058cd1cfbd684ff05f (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:12:07.510083 23293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3b19b20feb045058cd1cfbd684ff05f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.515056 23430 tablet_bootstrap.cc:492] T 3fb3705cd5724f208798f30d9ab01bda P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:07.519176 23384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923f193f1d2d4e61ae30850183122635" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:07.520174 23384 raft_consensus.cc:2468] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 0.
I20260709 12:12:07.524394 23273 leader_election.cc:304] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689; no voters: 
I20260709 12:12:07.525596 23440 raft_consensus.cc:2804] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:07.526059 23440 raft_consensus.cc:493] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:07.526470 23440 raft_consensus.cc:3060] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:07.534868 23431 consensus_queue.cc:260] T d53aaedd982440259b3ef5d84cddcbed P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:07.536700 23440 raft_consensus.cc:515] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:07.540022 23384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923f193f1d2d4e61ae30850183122635" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:07.540782 23384 raft_consensus.cc:3060] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:07.549382 23384 raft_consensus.cc:2468] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 1.
I20260709 12:12:07.551800 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3243e85ef0e741d696af414124ca96bd" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:07.553063 23431 ts_tablet_manager.cc:1434] T d53aaedd982440259b3ef5d84cddcbed P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.051s	user 0.004s	sys 0.004s
W20260709 12:12:07.553361 23126 leader_election.cc:343] T 3243e85ef0e741d696af414124ca96bd P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:07.554066 23431 tablet_bootstrap.cc:492] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:07.556669 23440 leader_election.cc:290] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Requested vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:07.559863 23273 leader_election.cc:304] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689; no voters: 
I20260709 12:12:07.560778 23433 ts_tablet_manager.cc:1434] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.190s	user 0.049s	sys 0.068s
I20260709 12:12:07.561949 23433 tablet_bootstrap.cc:492] T 1a2d000d8737420cbb2ee80189092814 P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:07.565654 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3243e85ef0e741d696af414124ca96bd" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
W20260709 12:12:07.571611 23127 leader_election.cc:343] T 3243e85ef0e741d696af414124ca96bd P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:07.572098 23127 leader_election.cc:304] T 3243e85ef0e741d696af414124ca96bd P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391; no voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:07.573524 23437 raft_consensus.cc:2749] T 3243e85ef0e741d696af414124ca96bd P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:07.573904 23431 tablet_bootstrap.cc:654] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:07.566402 23440 raft_consensus.cc:2804] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:07.568589 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923f193f1d2d4e61ae30850183122635" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:07.569628 23160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923f193f1d2d4e61ae30850183122635" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:07.579113 23440 raft_consensus.cc:697] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Becoming Leader. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Running, Role: LEADER
W20260709 12:12:07.579310 23274 leader_election.cc:343] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:07.579736 23430 tablet_bootstrap.cc:654] T 3fb3705cd5724f208798f30d9ab01bda P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:07.580289 23440 consensus_queue.cc:237] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
W20260709 12:12:07.580624 23274 leader_election.cc:343] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:07.589973 23219 tablet_service.cc:1511] Processing CreateTablet for tablet 024ae14c007f4c469b22ad43f153b12e (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:12:07.591984 23219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 024ae14c007f4c469b22ad43f153b12e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.593241 23429 tablet_bootstrap.cc:492] T ec1028a2affb45679aede72149f857f5 P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:07.593776 23429 ts_tablet_manager.cc:1403] T ec1028a2affb45679aede72149f857f5 P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.164s	user 0.014s	sys 0.003s
I20260709 12:12:07.595012 23373 tablet_service.cc:1511] Processing CreateTablet for tablet 024ae14c007f4c469b22ad43f153b12e (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:12:07.596269 23373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 024ae14c007f4c469b22ad43f153b12e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.593433 23298 tablet_service.cc:1511] Processing CreateTablet for tablet 024ae14c007f4c469b22ad43f153b12e (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:12:07.598712 23298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 024ae14c007f4c469b22ad43f153b12e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.608156 23299 tablet_service.cc:1511] Processing CreateTablet for tablet 89d4b46113284ecc9db8b0e3c2b46f89 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:12:07.609581 23299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89d4b46113284ecc9db8b0e3c2b46f89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.610069 23429 raft_consensus.cc:359] T ec1028a2affb45679aede72149f857f5 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:07.611104 23429 raft_consensus.cc:385] T ec1028a2affb45679aede72149f857f5 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:07.611479 23429 raft_consensus.cc:740] T ec1028a2affb45679aede72149f857f5 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:07.613812 23429 consensus_queue.cc:260] T ec1028a2affb45679aede72149f857f5 P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:07.615558 23371 tablet_service.cc:1511] Processing CreateTablet for tablet d12a070001934296ba81c85f9ba61e27 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:12:07.616909 23371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d12a070001934296ba81c85f9ba61e27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.618975 23433 tablet_bootstrap.cc:654] T 1a2d000d8737420cbb2ee80189092814 P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:07.627885 23226 tablet_service.cc:1511] Processing CreateTablet for tablet 89d4b46113284ecc9db8b0e3c2b46f89 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:12:07.629185 23226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89d4b46113284ecc9db8b0e3c2b46f89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.632006 23151 tablet_service.cc:1511] Processing CreateTablet for tablet 89d4b46113284ecc9db8b0e3c2b46f89 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:12:07.633709 23151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89d4b46113284ecc9db8b0e3c2b46f89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.640321 23429 ts_tablet_manager.cc:1434] T ec1028a2affb45679aede72149f857f5 P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.000s
I20260709 12:12:07.641701 23429 tablet_bootstrap.cc:492] T 3243e85ef0e741d696af414124ca96bd P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:07.650460 23150 tablet_service.cc:1511] Processing CreateTablet for tablet d12a070001934296ba81c85f9ba61e27 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:12:07.650992 23431 tablet_bootstrap.cc:492] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:07.651528 23431 ts_tablet_manager.cc:1403] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.098s	user 0.012s	sys 0.007s
I20260709 12:12:07.651557 23430 tablet_bootstrap.cc:492] T 3fb3705cd5724f208798f30d9ab01bda P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:07.652221 23430 ts_tablet_manager.cc:1403] T 3fb3705cd5724f208798f30d9ab01bda P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.137s	user 0.019s	sys 0.051s
I20260709 12:12:07.654680 23431 raft_consensus.cc:359] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:07.655539 23431 raft_consensus.cc:385] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:07.655836 23431 raft_consensus.cc:740] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:07.656621 23431 consensus_queue.cc:260] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:07.657778 23217 tablet_service.cc:1511] Processing CreateTablet for tablet d12a070001934296ba81c85f9ba61e27 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:12:07.659117 23217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d12a070001934296ba81c85f9ba61e27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.658941 23292 tablet_service.cc:1511] Processing CreateTablet for tablet bda09a1e5c59409c96c419b65061c1dc (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:12:07.660194 23292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bda09a1e5c59409c96c419b65061c1dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.660146 23430 raft_consensus.cc:359] T 3fb3705cd5724f208798f30d9ab01bda P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:07.663286 23430 raft_consensus.cc:385] T 3fb3705cd5724f208798f30d9ab01bda P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:07.666751 23430 raft_consensus.cc:740] T 3fb3705cd5724f208798f30d9ab01bda P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:07.665060 23371 tablet_service.cc:1511] Processing CreateTablet for tablet bda09a1e5c59409c96c419b65061c1dc (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:12:07.670747 23371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bda09a1e5c59409c96c419b65061c1dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.669705 23059 catalog_manager.cc:5697] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "a9d87b20401744c7bd0c491f60cf0689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:07.659145 23431 ts_tablet_manager.cc:1434] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:12:07.673966 23431 tablet_bootstrap.cc:492] T e53f580024c14b33b72266b89a1ab8e3 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:07.651791 23150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d12a070001934296ba81c85f9ba61e27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.678546 23147 tablet_service.cc:1511] Processing CreateTablet for tablet bda09a1e5c59409c96c419b65061c1dc (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:12:07.679973 23147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bda09a1e5c59409c96c419b65061c1dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.670210 23430 consensus_queue.cc:260] T 3fb3705cd5724f208798f30d9ab01bda P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:07.682092 23431 tablet_bootstrap.cc:654] T e53f580024c14b33b72266b89a1ab8e3 P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:07.683878 23433 tablet_bootstrap.cc:492] T 1a2d000d8737420cbb2ee80189092814 P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:07.684409 23433 ts_tablet_manager.cc:1403] T 1a2d000d8737420cbb2ee80189092814 P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.123s	user 0.009s	sys 0.005s
I20260709 12:12:07.684464 23222 tablet_service.cc:1511] Processing CreateTablet for tablet 7db21ddd040d409a9154cbe649864397 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:12:07.685835 23222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7db21ddd040d409a9154cbe649864397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.686548 23430 ts_tablet_manager.cc:1434] T 3fb3705cd5724f208798f30d9ab01bda P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 12:12:07.689644 23430 tablet_bootstrap.cc:492] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:07.692554 23436 raft_consensus.cc:493] T 3fb3705cd5724f208798f30d9ab01bda P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.693114 23436 raft_consensus.cc:515] T 3fb3705cd5724f208798f30d9ab01bda P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:07.702353 23430 tablet_bootstrap.cc:654] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:07.715050 23436 leader_election.cc:290] T 3fb3705cd5724f208798f30d9ab01bda P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:07.727191 23293 tablet_service.cc:1511] Processing CreateTablet for tablet 7db21ddd040d409a9154cbe649864397 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:12:07.729121 23293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7db21ddd040d409a9154cbe649864397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.739634 23148 tablet_service.cc:1511] Processing CreateTablet for tablet 6c03bbe73aee42039c1f868590838eaf (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:12:07.741504 23148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c03bbe73aee42039c1f868590838eaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.743466 23299 tablet_service.cc:1511] Processing CreateTablet for tablet 6c03bbe73aee42039c1f868590838eaf (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:12:07.744766 23299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c03bbe73aee42039c1f868590838eaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.753647 23429 tablet_bootstrap.cc:654] T 3243e85ef0e741d696af414124ca96bd P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:07.755378 23436 raft_consensus.cc:493] T 5d0efec949fc4455838db7fb01259d69 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.755853 23436 raft_consensus.cc:515] T 5d0efec949fc4455838db7fb01259d69 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:07.758165 23436 leader_election.cc:290] T 5d0efec949fc4455838db7fb01259d69 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:07.767799 23433 raft_consensus.cc:359] T 1a2d000d8737420cbb2ee80189092814 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:07.768782 23433 raft_consensus.cc:385] T 1a2d000d8737420cbb2ee80189092814 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:07.777256 23371 tablet_service.cc:1511] Processing CreateTablet for tablet 7db21ddd040d409a9154cbe649864397 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:12:07.769166 23433 raft_consensus.cc:740] T 1a2d000d8737420cbb2ee80189092814 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:07.779536 23433 consensus_queue.cc:260] T 1a2d000d8737420cbb2ee80189092814 P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:07.783885 23143 tablet_service.cc:1511] Processing CreateTablet for tablet 77c07af998424a59b0e3cb3d0b63579a (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:12:07.785147 23143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77c07af998424a59b0e3cb3d0b63579a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.786868 23440 raft_consensus.cc:493] T ec1028a2affb45679aede72149f857f5 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.787357 23440 raft_consensus.cc:515] T ec1028a2affb45679aede72149f857f5 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:07.789547 23440 leader_election.cc:290] T ec1028a2affb45679aede72149f857f5 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:07.793766 23433 ts_tablet_manager.cc:1434] T 1a2d000d8737420cbb2ee80189092814 P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.109s	user 0.007s	sys 0.003s
I20260709 12:12:07.779886 23217 tablet_service.cc:1511] Processing CreateTablet for tablet 6c03bbe73aee42039c1f868590838eaf (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:12:07.803510 23384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1028a2affb45679aede72149f857f5" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:07.805873 23373 tablet_service.cc:1511] Processing CreateTablet for tablet 77c07af998424a59b0e3cb3d0b63579a (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
W20260709 12:12:07.808765 23273 leader_election.cc:343] T ec1028a2affb45679aede72149f857f5 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:07.811158 23369 tablet_service.cc:1511] Processing CreateTablet for tablet 5002a306b4474c909091a65333c74939 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:12:07.807528 23371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7db21ddd040d409a9154cbe649864397. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.816898 23373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77c07af998424a59b0e3cb3d0b63579a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.822882 23433 tablet_bootstrap.cc:492] T 2693b48366d0430b9db7d8cc90d9667c P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:07.823449 23369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5002a306b4474c909091a65333c74939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.817598 23431 tablet_bootstrap.cc:492] T e53f580024c14b33b72266b89a1ab8e3 P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:07.824122 23431 ts_tablet_manager.cc:1403] T e53f580024c14b33b72266b89a1ab8e3 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.150s	user 0.032s	sys 0.025s
I20260709 12:12:07.823910 23151 tablet_service.cc:1511] Processing CreateTablet for tablet 6b891c5848b248d8a1830e801c7dce9a (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:12:07.827484 23431 raft_consensus.cc:359] T e53f580024c14b33b72266b89a1ab8e3 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:07.818459 23222 tablet_service.cc:1511] Processing CreateTablet for tablet 77c07af998424a59b0e3cb3d0b63579a (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:12:07.818602 23226 tablet_service.cc:1511] Processing CreateTablet for tablet cd128874f9674cb7802ec50ad0b65026 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:12:07.828245 23431 raft_consensus.cc:385] T e53f580024c14b33b72266b89a1ab8e3 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:07.821647 23299 tablet_service.cc:1511] Processing CreateTablet for tablet cd128874f9674cb7802ec50ad0b65026 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:12:07.821095 23430 tablet_bootstrap.cc:492] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:07.829023 23430 ts_tablet_manager.cc:1403] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.140s	user 0.012s	sys 0.005s
I20260709 12:12:07.829507 23299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd128874f9674cb7802ec50ad0b65026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.832788 23217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c03bbe73aee42039c1f868590838eaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.832357 23430 raft_consensus.cc:359] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:07.833320 23430 raft_consensus.cc:385] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:07.833686 23430 raft_consensus.cc:740] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:07.835356 23226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd128874f9674cb7802ec50ad0b65026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.838301 23367 tablet_service.cc:1511] Processing CreateTablet for tablet cd128874f9674cb7802ec50ad0b65026 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:12:07.838899 23151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b891c5848b248d8a1830e801c7dce9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.839694 23367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd128874f9674cb7802ec50ad0b65026. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.843214 23222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77c07af998424a59b0e3cb3d0b63579a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.843710 23293 tablet_service.cc:1511] Processing CreateTablet for tablet 5002a306b4474c909091a65333c74939 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:12:07.845094 23293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5002a306b4474c909091a65333c74939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.846805 23431 raft_consensus.cc:740] T e53f580024c14b33b72266b89a1ab8e3 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:07.847640 23431 consensus_queue.cc:260] T e53f580024c14b33b72266b89a1ab8e3 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:07.847806 23147 tablet_service.cc:1511] Processing CreateTablet for tablet 5002a306b4474c909091a65333c74939 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:12:07.849188 23147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5002a306b4474c909091a65333c74939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.864676 23219 tablet_service.cc:1511] Processing CreateTablet for tablet 6b891c5848b248d8a1830e801c7dce9a (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:12:07.866091 23219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b891c5848b248d8a1830e801c7dce9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.834519 23430 consensus_queue.cc:260] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:07.868705 23430 ts_tablet_manager.cc:1434] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 12:12:07.869647 23430 tablet_bootstrap.cc:492] T 11b1c6ca5b8b4d61a6e200744c543ede P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:07.876025 23431 ts_tablet_manager.cc:1434] T e53f580024c14b33b72266b89a1ab8e3 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.051s	user 0.002s	sys 0.005s
I20260709 12:12:07.875820 23370 tablet_service.cc:1511] Processing CreateTablet for tablet 9ffb43b95dbe424d89c123a2179445ec (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:12:07.877091 23431 tablet_bootstrap.cc:492] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:07.877264 23370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ffb43b95dbe424d89c123a2179445ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.878749 23160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb3705cd5724f208798f30d9ab01bda" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:07.880051 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0efec949fc4455838db7fb01259d69" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
W20260709 12:12:07.881896 23348 leader_election.cc:343] T 3fb3705cd5724f208798f30d9ab01bda P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:07.882364 23433 tablet_bootstrap.cc:654] T 2693b48366d0430b9db7d8cc90d9667c P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:07.882683 23348 leader_election.cc:343] T 5d0efec949fc4455838db7fb01259d69 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:07.883558 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb3705cd5724f208798f30d9ab01bda" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:07.883942 23437 raft_consensus.cc:493] T d53aaedd982440259b3ef5d84cddcbed P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.884456 23437 raft_consensus.cc:515] T d53aaedd982440259b3ef5d84cddcbed P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:07.887257 23437 leader_election.cc:290] T d53aaedd982440259b3ef5d84cddcbed P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:07.890151 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53aaedd982440259b3ef5d84cddcbed" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
W20260709 12:12:07.895305 23127 leader_election.cc:343] T d53aaedd982440259b3ef5d84cddcbed P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:07.905673 23450 raft_consensus.cc:493] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:07.905580 23225 tablet_service.cc:1511] Processing CreateTablet for tablet 9ffb43b95dbe424d89c123a2179445ec (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:12:07.906268 23450 raft_consensus.cc:515] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:07.907042 23225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ffb43b95dbe424d89c123a2179445ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.919243 23450 leader_election.cc:290] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
W20260709 12:12:07.932387 23349 leader_election.cc:343] T 3fb3705cd5724f208798f30d9ab01bda P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:07.932958 23349 leader_election.cc:304] T 3fb3705cd5724f208798f30d9ab01bda P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa; no voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689
I20260709 12:12:07.935060 23436 raft_consensus.cc:2749] T 3fb3705cd5724f208798f30d9ab01bda P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:07.938969 23292 tablet_service.cc:1511] Processing CreateTablet for tablet 6b891c5848b248d8a1830e801c7dce9a (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:12:07.939134 23298 tablet_service.cc:1511] Processing CreateTablet for tablet fba757d381304cc0bcbb4f9dbcfc812c (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:12:07.940357 23292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b891c5848b248d8a1830e801c7dce9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.941412 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1028a2affb45679aede72149f857f5" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
W20260709 12:12:07.943866 23276 leader_election.cc:343] T ec1028a2affb45679aede72149f857f5 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:07.944335 23276 leader_election.cc:304] T ec1028a2affb45679aede72149f857f5 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689; no voters: 48bc58ace75f40e995efc1edcefe79fa, abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:07.945425 23440 raft_consensus.cc:2749] T ec1028a2affb45679aede72149f857f5 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:07.947188 23148 tablet_service.cc:1511] Processing CreateTablet for tablet 9ffb43b95dbe424d89c123a2179445ec (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:12:07.948020 23384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53aaedd982440259b3ef5d84cddcbed" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:07.948511 23148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ffb43b95dbe424d89c123a2179445ec. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:07.949656 23124 leader_election.cc:343] T d53aaedd982440259b3ef5d84cddcbed P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:07.950152 23124 leader_election.cc:304] T d53aaedd982440259b3ef5d84cddcbed P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391; no voters: 48bc58ace75f40e995efc1edcefe79fa, abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:07.950934 23437 raft_consensus.cc:2749] T d53aaedd982440259b3ef5d84cddcbed P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:12:07.951649 23349 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41253, user_credentials={real_user=slave}} blocked reactor thread for 60656.5us
I20260709 12:12:07.956099 23429 tablet_bootstrap.cc:492] T 3243e85ef0e741d696af414124ca96bd P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:07.963147 23429 ts_tablet_manager.cc:1403] T 3243e85ef0e741d696af414124ca96bd P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.322s	user 0.012s	sys 0.012s
I20260709 12:12:07.966595 23430 tablet_bootstrap.cc:654] T 11b1c6ca5b8b4d61a6e200744c543ede P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:07.969484 23433 tablet_bootstrap.cc:492] T 2693b48366d0430b9db7d8cc90d9667c P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:07.977527 23433 ts_tablet_manager.cc:1403] T 2693b48366d0430b9db7d8cc90d9667c P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.162s	user 0.026s	sys 0.005s
I20260709 12:12:07.977903 23298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fba757d381304cc0bcbb4f9dbcfc812c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:07.981292 23433 raft_consensus.cc:359] T 2693b48366d0430b9db7d8cc90d9667c P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:07.982285 23433 raft_consensus.cc:385] T 2693b48366d0430b9db7d8cc90d9667c P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:07.982604 23433 raft_consensus.cc:740] T 2693b48366d0430b9db7d8cc90d9667c P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:07.983358 23433 consensus_queue.cc:260] T 2693b48366d0430b9db7d8cc90d9667c P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:07.992553 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0efec949fc4455838db7fb01259d69" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
W20260709 12:12:07.994104 23350 leader_election.cc:343] T 5d0efec949fc4455838db7fb01259d69 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:07.994585 23350 leader_election.cc:304] T 5d0efec949fc4455838db7fb01259d69 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa; no voters: 3824bca1df8e4020b18c7989f7758391, abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:07.995738 23436 raft_consensus.cc:2749] T 5d0efec949fc4455838db7fb01259d69 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:08.000802 23433 ts_tablet_manager.cc:1434] T 2693b48366d0430b9db7d8cc90d9667c P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 12:12:08.001796 23433 tablet_bootstrap.cc:492] T d53aaedd982440259b3ef5d84cddcbed P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:08.007611 23433 tablet_bootstrap.cc:654] T d53aaedd982440259b3ef5d84cddcbed P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:08.008188 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be6b80356b0415ba28a56482e13d24f" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
W20260709 12:12:08.009794 23201 leader_election.cc:343] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:08.012001 23431 tablet_bootstrap.cc:654] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:08.012691 23161 raft_consensus.cc:3060] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:07.966631 23429 raft_consensus.cc:359] T 3243e85ef0e741d696af414124ca96bd P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:08.023669 23437 raft_consensus.cc:493] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.024374 23437 raft_consensus.cc:515] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:08.016793 23429 raft_consensus.cc:385] T 3243e85ef0e741d696af414124ca96bd P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:08.027331 23429 raft_consensus.cc:740] T 3243e85ef0e741d696af414124ca96bd P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:08.026609 23148 tablet_service.cc:1511] Processing CreateTablet for tablet fba757d381304cc0bcbb4f9dbcfc812c (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:12:08.028120 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923f193f1d2d4e61ae30850183122635" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:08.028090 23429 consensus_queue.cc:260] T 3243e85ef0e741d696af414124ca96bd P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:08.029342 23370 tablet_service.cc:1511] Processing CreateTablet for tablet fba757d381304cc0bcbb4f9dbcfc812c (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:12:08.029757 23439 consensus_queue.cc:1048] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:08.030368 23429 ts_tablet_manager.cc:1434] T 3243e85ef0e741d696af414124ca96bd P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.067s	user 0.002s	sys 0.002s
I20260709 12:12:08.030591 23370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fba757d381304cc0bcbb4f9dbcfc812c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.031433 23429 tablet_bootstrap.cc:492] T 1a2d000d8737420cbb2ee80189092814 P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:08.033896 23437 leader_election.cc:290] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:08.028569 23148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fba757d381304cc0bcbb4f9dbcfc812c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.034495 23384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923f193f1d2d4e61ae30850183122635" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:08.035174 23384 raft_consensus.cc:2468] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 1.
I20260709 12:12:08.036697 23124 leader_election.cc:304] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, 48bc58ace75f40e995efc1edcefe79fa; no voters: a9d87b20401744c7bd0c491f60cf0689
I20260709 12:12:08.040868 23384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be6b80356b0415ba28a56482e13d24f" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:08.044813 23293 tablet_service.cc:1511] Processing CreateTablet for tablet 07201eb1b13e4b54af9c1c18752a9edf (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
W20260709 12:12:08.045127 23199 leader_election.cc:343] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:08.045745 23199 leader_election.cc:304] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abe65f4962e147ac841608b6c30f7e1b; no voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689
I20260709 12:12:08.047212 23450 raft_consensus.cc:2749] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:08.046113 23293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07201eb1b13e4b54af9c1c18752a9edf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.050221 23373 tablet_service.cc:1511] Processing CreateTablet for tablet 07201eb1b13e4b54af9c1c18752a9edf (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:12:08.051476 23373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07201eb1b13e4b54af9c1c18752a9edf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.053584 23440 consensus_queue.cc:1048] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:08.047220 23219 tablet_service.cc:1511] Processing CreateTablet for tablet 07201eb1b13e4b54af9c1c18752a9edf (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:12:08.061241 23429 tablet_bootstrap.cc:654] T 1a2d000d8737420cbb2ee80189092814 P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:08.061576 23143 tablet_service.cc:1511] Processing CreateTablet for tablet 50bd92608bfe43d784e7596be01b388e (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:12:08.061587 23219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07201eb1b13e4b54af9c1c18752a9edf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.067983 23143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50bd92608bfe43d784e7596be01b388e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.069275 23217 tablet_service.cc:1511] Processing CreateTablet for tablet 50bd92608bfe43d784e7596be01b388e (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:12:08.072184 23299 tablet_service.cc:1511] Processing CreateTablet for tablet 50bd92608bfe43d784e7596be01b388e (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:12:08.073586 23299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50bd92608bfe43d784e7596be01b388e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.074844 23151 tablet_service.cc:1511] Processing CreateTablet for tablet c113311e527c47578f8c136d335aa87f (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:12:08.076892 23371 tablet_service.cc:1511] Processing CreateTablet for tablet c113311e527c47578f8c136d335aa87f (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:12:08.078238 23371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c113311e527c47578f8c136d335aa87f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.080796 23151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c113311e527c47578f8c136d335aa87f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.081809 23292 tablet_service.cc:1511] Processing CreateTablet for tablet 9aa8c90489d54dc6b2684d1970165a8a (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:12:08.083371 23292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9aa8c90489d54dc6b2684d1970165a8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.090240 23217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50bd92608bfe43d784e7596be01b388e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.096343 23369 tablet_service.cc:1511] Processing CreateTablet for tablet 9aa8c90489d54dc6b2684d1970165a8a (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:12:08.097620 23369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9aa8c90489d54dc6b2684d1970165a8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.093014 23430 tablet_bootstrap.cc:492] T 11b1c6ca5b8b4d61a6e200744c543ede P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:08.103130 23430 ts_tablet_manager.cc:1403] T 11b1c6ca5b8b4d61a6e200744c543ede P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.234s	user 0.013s	sys 0.013s
I20260709 12:12:08.090320 23225 tablet_service.cc:1511] Processing CreateTablet for tablet c113311e527c47578f8c136d335aa87f (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:12:08.110524 23433 tablet_bootstrap.cc:492] T d53aaedd982440259b3ef5d84cddcbed P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:08.111100 23433 ts_tablet_manager.cc:1403] T d53aaedd982440259b3ef5d84cddcbed P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.109s	user 0.019s	sys 0.005s
I20260709 12:12:08.113303 23431 tablet_bootstrap.cc:492] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:08.106094 23430 raft_consensus.cc:359] T 11b1c6ca5b8b4d61a6e200744c543ede P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
W20260709 12:12:08.113499 23106 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:08.115345 23225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c113311e527c47578f8c136d335aa87f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.116632 23436 raft_consensus.cc:493] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.117147 23436 raft_consensus.cc:515] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:08.118000 23431 ts_tablet_manager.cc:1403] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.241s	user 0.013s	sys 0.008s
I20260709 12:12:08.119398 23436 leader_election.cc:290] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:08.121599 23222 tablet_service.cc:1511] Processing CreateTablet for tablet b0348215bfbf4d0bb5ffd2ddc86a4279 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:12:08.124859 23147 tablet_service.cc:1511] Processing CreateTablet for tablet 9aa8c90489d54dc6b2684d1970165a8a (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:12:08.126143 23147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9aa8c90489d54dc6b2684d1970165a8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.125988 23431 raft_consensus.cc:359] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:08.114955 23430 raft_consensus.cc:385] T 11b1c6ca5b8b4d61a6e200744c543ede P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:08.128388 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e53f580024c14b33b72266b89a1ab8e3" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
W20260709 12:12:08.143941 23350 leader_election.cc:343] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:08.130668 23226 tablet_service.cc:1511] Processing CreateTablet for tablet 64daa90835844e619fa313a9d91a83cc (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:12:08.131009 23160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e53f580024c14b33b72266b89a1ab8e3" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:08.145324 23160 raft_consensus.cc:2468] T e53f580024c14b33b72266b89a1ab8e3 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 0.
I20260709 12:12:08.135766 23222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0348215bfbf4d0bb5ffd2ddc86a4279. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.145908 23450 raft_consensus.cc:493] T 1a2d000d8737420cbb2ee80189092814 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.146418 23450 raft_consensus.cc:515] T 1a2d000d8737420cbb2ee80189092814 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:08.147289 23348 leader_election.cc:304] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, 48bc58ace75f40e995efc1edcefe79fa; no voters: abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:08.148486 23450 leader_election.cc:290] T 1a2d000d8737420cbb2ee80189092814 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:08.150863 23436 raft_consensus.cc:2804] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:08.151355 23436 raft_consensus.cc:493] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:08.151399 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d000d8737420cbb2ee80189092814" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:08.151876 23436 raft_consensus.cc:3060] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:08.153017 23199 leader_election.cc:343] T 1a2d000d8737420cbb2ee80189092814 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:08.135644 23150 tablet_service.cc:1511] Processing CreateTablet for tablet 64daa90835844e619fa313a9d91a83cc (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:12:08.155138 23431 raft_consensus.cc:385] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:08.161329 23226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64daa90835844e619fa313a9d91a83cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.163864 23150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64daa90835844e619fa313a9d91a83cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.164379 23298 tablet_service.cc:1511] Processing CreateTablet for tablet 64daa90835844e619fa313a9d91a83cc (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:12:08.165686 23298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64daa90835844e619fa313a9d91a83cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.150919 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d000d8737420cbb2ee80189092814" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:08.155019 23430 raft_consensus.cc:740] T 11b1c6ca5b8b4d61a6e200744c543ede P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
W20260709 12:12:08.170095 23201 leader_election.cc:343] T 1a2d000d8737420cbb2ee80189092814 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:08.184849 23149 tablet_service.cc:1511] Processing CreateTablet for tablet f55cb07c30bc42a0930276baefc1d4b7 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:12:08.188284 23225 tablet_service.cc:1511] Processing CreateTablet for tablet f55cb07c30bc42a0930276baefc1d4b7 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:12:08.163242 23431 raft_consensus.cc:740] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:08.189504 23433 raft_consensus.cc:359] T d53aaedd982440259b3ef5d84cddcbed P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:08.190454 23295 tablet_service.cc:1511] Processing CreateTablet for tablet d8c320c6212b4bb187e8d32cb79479a8 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:12:08.196219 23225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f55cb07c30bc42a0930276baefc1d4b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.196267 23149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f55cb07c30bc42a0930276baefc1d4b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.196687 23201 leader_election.cc:304] T 1a2d000d8737420cbb2ee80189092814 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abe65f4962e147ac841608b6c30f7e1b; no voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689
I20260709 12:12:08.203713 23295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8c320c6212b4bb187e8d32cb79479a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.199493 23371 tablet_service.cc:1511] Processing CreateTablet for tablet d8c320c6212b4bb187e8d32cb79479a8 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:12:08.207069 23371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8c320c6212b4bb187e8d32cb79479a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.206857 23430 consensus_queue.cc:260] T 11b1c6ca5b8b4d61a6e200744c543ede P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:08.208945 23369 tablet_service.cc:1511] Processing CreateTablet for tablet b0348215bfbf4d0bb5ffd2ddc86a4279 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:12:08.208972 23450 raft_consensus.cc:2749] T 1a2d000d8737420cbb2ee80189092814 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:08.210304 23369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0348215bfbf4d0bb5ffd2ddc86a4279. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.228222 23429 tablet_bootstrap.cc:492] T 1a2d000d8737420cbb2ee80189092814 P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:08.228727 23429 ts_tablet_manager.cc:1403] T 1a2d000d8737420cbb2ee80189092814 P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.198s	user 0.016s	sys 0.032s
I20260709 12:12:08.231462 23429 raft_consensus.cc:359] T 1a2d000d8737420cbb2ee80189092814 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:08.232024 23429 raft_consensus.cc:385] T 1a2d000d8737420cbb2ee80189092814 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:08.232282 23429 raft_consensus.cc:740] T 1a2d000d8737420cbb2ee80189092814 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:08.232959 23429 consensus_queue.cc:260] T 1a2d000d8737420cbb2ee80189092814 P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:08.239478 23370 tablet_service.cc:1511] Processing CreateTablet for tablet f55cb07c30bc42a0930276baefc1d4b7 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:12:08.240842 23370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f55cb07c30bc42a0930276baefc1d4b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.199905 23433 raft_consensus.cc:385] T d53aaedd982440259b3ef5d84cddcbed P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:08.247809 23433 raft_consensus.cc:740] T d53aaedd982440259b3ef5d84cddcbed P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:08.248620 23433 consensus_queue.cc:260] T d53aaedd982440259b3ef5d84cddcbed P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:08.243237 23299 tablet_service.cc:1511] Processing CreateTablet for tablet b0348215bfbf4d0bb5ffd2ddc86a4279 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:12:08.244391 23219 tablet_service.cc:1511] Processing CreateTablet for tablet b71f710147be434e8d790a50e145def8 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:12:08.265661 23219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b71f710147be434e8d790a50e145def8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.266774 23433 ts_tablet_manager.cc:1434] T d53aaedd982440259b3ef5d84cddcbed P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.155s	user 0.008s	sys 0.000s
I20260709 12:12:08.267812 23433 tablet_bootstrap.cc:492] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:08.262984 23440 raft_consensus.cc:493] T 3243e85ef0e741d696af414124ca96bd P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.271111 23440 raft_consensus.cc:515] T 3243e85ef0e741d696af414124ca96bd P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:08.273276 23440 leader_election.cc:290] T 3243e85ef0e741d696af414124ca96bd P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:08.275134 23292 tablet_service.cc:1511] Processing CreateTablet for tablet b71f710147be434e8d790a50e145def8 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:12:08.275955 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3243e85ef0e741d696af414124ca96bd" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:08.276340 23160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3243e85ef0e741d696af414124ca96bd" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:08.276389 23373 tablet_service.cc:1511] Processing CreateTablet for tablet b71f710147be434e8d790a50e145def8 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:12:08.277136 23160 raft_consensus.cc:2468] T 3243e85ef0e741d696af414124ca96bd P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 0.
W20260709 12:12:08.277390 23276 leader_election.cc:343] T 3243e85ef0e741d696af414124ca96bd P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:08.277792 23373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b71f710147be434e8d790a50e145def8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.278609 23274 leader_election.cc:304] T 3243e85ef0e741d696af414124ca96bd P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689; no voters: abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:08.279206 23299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0348215bfbf4d0bb5ffd2ddc86a4279. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.280407 23292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b71f710147be434e8d790a50e145def8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.282023 23440 raft_consensus.cc:2804] T 3243e85ef0e741d696af414124ca96bd P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:08.282487 23440 raft_consensus.cc:493] T 3243e85ef0e741d696af414124ca96bd P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:08.282903 23440 raft_consensus.cc:3060] T 3243e85ef0e741d696af414124ca96bd P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:08.297134 23440 raft_consensus.cc:515] T 3243e85ef0e741d696af414124ca96bd P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:08.301308 23439 raft_consensus.cc:493] T 1a2d000d8737420cbb2ee80189092814 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.301882 23439 raft_consensus.cc:515] T 1a2d000d8737420cbb2ee80189092814 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:08.302237 23160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3243e85ef0e741d696af414124ca96bd" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:08.303048 23160 raft_consensus.cc:3060] T 3243e85ef0e741d696af414124ca96bd P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:08.303985 23439 leader_election.cc:290] T 1a2d000d8737420cbb2ee80189092814 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:08.305588 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d000d8737420cbb2ee80189092814" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:08.306232 23236 raft_consensus.cc:2468] T 1a2d000d8737420cbb2ee80189092814 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 0.
I20260709 12:12:08.306367 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d000d8737420cbb2ee80189092814" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:08.307576 23276 leader_election.cc:304] T 1a2d000d8737420cbb2ee80189092814 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b; no voters: 
W20260709 12:12:08.308151 23273 leader_election.cc:343] T 1a2d000d8737420cbb2ee80189092814 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:08.283003 23436 raft_consensus.cc:515] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:08.285068 23147 tablet_service.cc:1511] Processing CreateTablet for tablet d8c320c6212b4bb187e8d32cb79479a8 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:12:08.311038 23439 raft_consensus.cc:2804] T 1a2d000d8737420cbb2ee80189092814 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:08.312217 23439 raft_consensus.cc:493] T 1a2d000d8737420cbb2ee80189092814 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:08.312510 23147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8c320c6212b4bb187e8d32cb79479a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.312561 23439 raft_consensus.cc:3060] T 1a2d000d8737420cbb2ee80189092814 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:08.258926 23431 consensus_queue.cc:260] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:08.316340 23431 ts_tablet_manager.cc:1434] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.198s	user 0.005s	sys 0.002s
I20260709 12:12:08.317342 23431 tablet_bootstrap.cc:492] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:08.318181 23436 leader_election.cc:290] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Requested vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:08.319085 23159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e53f580024c14b33b72266b89a1ab8e3" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:08.319720 23159 raft_consensus.cc:3060] T e53f580024c14b33b72266b89a1ab8e3 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:08.321029 23440 leader_election.cc:290] T 3243e85ef0e741d696af414124ca96bd P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Requested vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:08.322675 23235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3243e85ef0e741d696af414124ca96bd" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
W20260709 12:12:08.324085 23276 leader_election.cc:343] T 3243e85ef0e741d696af414124ca96bd P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:08.327430 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e53f580024c14b33b72266b89a1ab8e3" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
W20260709 12:12:08.328799 23350 leader_election.cc:343] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:08.331806 23439 raft_consensus.cc:515] T 1a2d000d8737420cbb2ee80189092814 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:08.336079 23159 raft_consensus.cc:2468] T e53f580024c14b33b72266b89a1ab8e3 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 1.
I20260709 12:12:08.336781 23433 tablet_bootstrap.cc:654] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:08.341760 23160 raft_consensus.cc:2468] T 3243e85ef0e741d696af414124ca96bd P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 1.
I20260709 12:12:08.342309 23431 tablet_bootstrap.cc:654] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:08.343689 23149 tablet_service.cc:1511] Processing CreateTablet for tablet 72855efda9164489afb0f46a7f8da834 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:12:08.350895 23298 tablet_service.cc:1511] Processing CreateTablet for tablet 72855efda9164489afb0f46a7f8da834 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:12:08.354317 23429 ts_tablet_manager.cc:1434] T 1a2d000d8737420cbb2ee80189092814 P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.125s	user 0.009s	sys 0.000s
I20260709 12:12:08.353223 23437 raft_consensus.cc:2804] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:08.367550 23348 leader_election.cc:304] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, 48bc58ace75f40e995efc1edcefe79fa; no voters: abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:08.368029 23274 leader_election.cc:304] T 3243e85ef0e741d696af414124ca96bd P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689; no voters: abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:08.368542 23436 raft_consensus.cc:2804] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:08.368993 23436 raft_consensus.cc:697] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Becoming Leader. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Running, Role: LEADER
I20260709 12:12:08.369244 23440 raft_consensus.cc:2804] T 3243e85ef0e741d696af414124ca96bd P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:08.369431 23149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72855efda9164489afb0f46a7f8da834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.369863 23436 consensus_queue.cc:237] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:08.371299 23429 tablet_bootstrap.cc:492] T 2954a8837137444496d21a25638b3f2a P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:08.369882 23437 raft_consensus.cc:493] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a9d87b20401744c7bd0c491f60cf0689)
I20260709 12:12:08.373548 23437 raft_consensus.cc:3060] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:08.375450 23147 tablet_service.cc:1511] Processing CreateTablet for tablet 36d2201b0b3d4f07abf9c901453cda82 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:12:08.376590 23147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36d2201b0b3d4f07abf9c901453cda82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.376961 23298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72855efda9164489afb0f46a7f8da834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.382997 23299 tablet_service.cc:1511] Processing CreateTablet for tablet 85dca37fe4fc46b792220de05fc68749 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:12:08.384186 23299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85dca37fe4fc46b792220de05fc68749. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.384559 23219 tablet_service.cc:1511] Processing CreateTablet for tablet 36d2201b0b3d4f07abf9c901453cda82 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:12:08.385890 23219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36d2201b0b3d4f07abf9c901453cda82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.359658 23222 tablet_service.cc:1511] Processing CreateTablet for tablet 72855efda9164489afb0f46a7f8da834 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:12:08.387670 23222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72855efda9164489afb0f46a7f8da834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.390175 23369 tablet_service.cc:1511] Processing CreateTablet for tablet 85dca37fe4fc46b792220de05fc68749 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:12:08.391510 23369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85dca37fe4fc46b792220de05fc68749. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.408895 23430 ts_tablet_manager.cc:1434] T 11b1c6ca5b8b4d61a6e200744c543ede P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.305s	user 0.021s	sys 0.057s
I20260709 12:12:08.410377 23430 tablet_bootstrap.cc:492] T ec1028a2affb45679aede72149f857f5 P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:08.413609 23148 tablet_service.cc:1511] Processing CreateTablet for tablet 85dca37fe4fc46b792220de05fc68749 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:12:08.414951 23148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85dca37fe4fc46b792220de05fc68749. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.424328 23293 tablet_service.cc:1511] Processing CreateTablet for tablet ae5efc2770bb4bc7a09585a220a45131 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:12:08.447252 23430 tablet_bootstrap.cc:654] T ec1028a2affb45679aede72149f857f5 P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:08.448045 23293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae5efc2770bb4bc7a09585a220a45131. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.426077 23371 tablet_service.cc:1511] Processing CreateTablet for tablet 36d2201b0b3d4f07abf9c901453cda82 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:12:08.451869 23371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36d2201b0b3d4f07abf9c901453cda82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.431969 23439 leader_election.cc:290] T 1a2d000d8737420cbb2ee80189092814 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Requested vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:08.432783 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d000d8737420cbb2ee80189092814" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:08.455358 23477 raft_consensus.cc:493] T 11b1c6ca5b8b4d61a6e200744c543ede P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.455873 23477 raft_consensus.cc:515] T 11b1c6ca5b8b4d61a6e200744c543ede P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:08.474484 23450 raft_consensus.cc:493] T 2693b48366d0430b9db7d8cc90d9667c P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.464377 23477 leader_election.cc:290] T 11b1c6ca5b8b4d61a6e200744c543ede P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:08.475001 23450 raft_consensus.cc:515] T 2693b48366d0430b9db7d8cc90d9667c P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:08.442255 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d000d8737420cbb2ee80189092814" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:08.476202 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11b1c6ca5b8b4d61a6e200744c543ede" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:08.478878 23429 tablet_bootstrap.cc:700] T 2954a8837137444496d21a25638b3f2a P a9d87b20401744c7bd0c491f60cf0689: Time spent opening tablet: real 0.102s	user 0.004s	sys 0.006s
I20260709 12:12:08.465294 23440 raft_consensus.cc:697] T 3243e85ef0e741d696af414124ca96bd P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Becoming Leader. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Running, Role: LEADER
I20260709 12:12:08.441020 23437 raft_consensus.cc:515] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:08.490964 23236 raft_consensus.cc:3060] T 1a2d000d8737420cbb2ee80189092814 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:08.499388 23348 leader_election.cc:343] T 11b1c6ca5b8b4d61a6e200744c543ede P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:08.500020 23429 tablet_bootstrap.cc:654] T 2954a8837137444496d21a25638b3f2a P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:08.423065 23217 tablet_service.cc:1511] Processing CreateTablet for tablet ae5efc2770bb4bc7a09585a220a45131 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:12:08.505952 23370 tablet_service.cc:1511] Processing CreateTablet for tablet ae5efc2770bb4bc7a09585a220a45131 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:12:08.507297 23450 leader_election.cc:290] T 2693b48366d0430b9db7d8cc90d9667c P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:08.507505 23373 tablet_service.cc:1511] Processing CreateTablet for tablet 98439efe5217407d95ff24969e5b4083 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:12:08.527802 23373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98439efe5217407d95ff24969e5b4083. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.509685 23147 tablet_service.cc:1511] Processing CreateTablet for tablet d2d3a5114a7842179f9957c7f5660f7e (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:12:08.529146 23147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2d3a5114a7842179f9957c7f5660f7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.535518 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923f193f1d2d4e61ae30850183122635" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:08.537243 23370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae5efc2770bb4bc7a09585a220a45131. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.537798 23440 consensus_queue.cc:237] T 3243e85ef0e741d696af414124ca96bd P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:08.538709 23150 tablet_service.cc:1511] Processing CreateTablet for tablet 98439efe5217407d95ff24969e5b4083 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:12:08.539999 23150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98439efe5217407d95ff24969e5b4083. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.541754 23437 leader_election.cc:290] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 2 election: Requested vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:08.506083 23057 catalog_manager.cc:5697] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196). New cstate: current_term: 1 leader_uuid: "48bc58ace75f40e995efc1edcefe79fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:08.498807 23273 leader_election.cc:343] T 1a2d000d8737420cbb2ee80189092814 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:08.583103 23273 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.196:37599, user_credentials={real_user=slave}} blocked reactor thread for 85232.1us
I20260709 12:12:08.604993 23217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae5efc2770bb4bc7a09585a220a45131. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:08.598088 23274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:42187, user_credentials={real_user=slave}} blocked reactor thread for 158927us
I20260709 12:12:08.616335 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2693b48366d0430b9db7d8cc90d9667c" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:08.620596 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923f193f1d2d4e61ae30850183122635" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:08.621429 23431 tablet_bootstrap.cc:492] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:08.621944 23431 ts_tablet_manager.cc:1403] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.305s	user 0.011s	sys 0.010s
W20260709 12:12:08.623311 23201 leader_election.cc:343] T 2693b48366d0430b9db7d8cc90d9667c P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:08.625474 23293 tablet_service.cc:1511] Processing CreateTablet for tablet d2d3a5114a7842179f9957c7f5660f7e (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:12:08.626606 23293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2d3a5114a7842179f9957c7f5660f7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.617595 23433 tablet_bootstrap.cc:492] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:08.630995 23433 ts_tablet_manager.cc:1403] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.363s	user 0.021s	sys 0.026s
I20260709 12:12:08.632571 23429 tablet_bootstrap.cc:492] T 2954a8837137444496d21a25638b3f2a P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:08.633188 23429 ts_tablet_manager.cc:1403] T 2954a8837137444496d21a25638b3f2a P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.262s	user 0.015s	sys 0.013s
I20260709 12:12:08.634019 23433 raft_consensus.cc:359] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:08.634768 23433 raft_consensus.cc:385] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:08.635066 23433 raft_consensus.cc:740] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:08.635103 23298 tablet_service.cc:1511] Processing CreateTablet for tablet 8fb0ec62373d4b39bd83ded02981c6dc (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:12:08.635912 23433 consensus_queue.cc:260] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:08.636413 23298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fb0ec62373d4b39bd83ded02981c6dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.637343 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11b1c6ca5b8b4d61a6e200744c543ede" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
W20260709 12:12:08.639671 23349 leader_election.cc:343] T 11b1c6ca5b8b4d61a6e200744c543ede P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:08.640123 23349 leader_election.cc:304] T 11b1c6ca5b8b4d61a6e200744c543ede P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa; no voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689
I20260709 12:12:08.640198 23371 tablet_service.cc:1511] Processing CreateTablet for tablet 4bffc92cd6c84709bd0335a988eeef96 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:12:08.641371 23371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bffc92cd6c84709bd0335a988eeef96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.641681 23161 raft_consensus.cc:1240] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Rejecting Update request from peer a9d87b20401744c7bd0c491f60cf0689 for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:08.642729 23436 raft_consensus.cc:2749] T 11b1c6ca5b8b4d61a6e200744c543ede P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:08.644539 23147 tablet_service.cc:1511] Processing CreateTablet for tablet 8fb0ec62373d4b39bd83ded02981c6dc (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:12:08.645663 23147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fb0ec62373d4b39bd83ded02981c6dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.646063 23437 raft_consensus.cc:493] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.646667 23430 tablet_bootstrap.cc:492] T ec1028a2affb45679aede72149f857f5 P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:08.647188 23430 ts_tablet_manager.cc:1403] T ec1028a2affb45679aede72149f857f5 P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.237s	user 0.005s	sys 0.031s
I20260709 12:12:08.649000 23148 tablet_service.cc:1511] Processing CreateTablet for tablet d8c6d6433d204aa3b5fa3a304e66dd7e (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:12:08.650250 23148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8c6d6433d204aa3b5fa3a304e66dd7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.649984 23430 raft_consensus.cc:359] T ec1028a2affb45679aede72149f857f5 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:08.650765 23430 raft_consensus.cc:385] T ec1028a2affb45679aede72149f857f5 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:08.651168 23430 raft_consensus.cc:740] T ec1028a2affb45679aede72149f857f5 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:08.652107 23059 catalog_manager.cc:5697] T 3243e85ef0e741d696af414124ca96bd P a9d87b20401744c7bd0c491f60cf0689 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "a9d87b20401744c7bd0c491f60cf0689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:08.619637 23236 raft_consensus.cc:2468] T 1a2d000d8737420cbb2ee80189092814 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 1.
I20260709 12:12:08.654989 23124 leader_election.cc:304] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391; no voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689
I20260709 12:12:08.655779 23276 leader_election.cc:304] T 1a2d000d8737420cbb2ee80189092814 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b; no voters: 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:08.655932 23474 raft_consensus.cc:2749] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:08.657051 23430 consensus_queue.cc:260] T ec1028a2affb45679aede72149f857f5 P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:08.659215 23369 tablet_service.cc:1511] Processing CreateTablet for tablet 058e9aef198f48b8956a676b6f12b2e1 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:12:08.662467 23149 tablet_service.cc:1511] Processing CreateTablet for tablet 058e9aef198f48b8956a676b6f12b2e1 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:12:08.663049 23299 tablet_service.cc:1511] Processing CreateTablet for tablet 4bffc92cd6c84709bd0335a988eeef96 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:12:08.646575 23437 raft_consensus.cc:515] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:08.664201 23299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bffc92cd6c84709bd0335a988eeef96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.664801 23370 tablet_service.cc:1511] Processing CreateTablet for tablet 541dc3e21d4e461b8c299d0186a42e7f (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:12:08.665874 23437 leader_election.cc:290] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:08.668036 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2954a8837137444496d21a25638b3f2a" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
W20260709 12:12:08.669346 23126 leader_election.cc:343] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:08.670720 23143 tablet_service.cc:1511] Processing CreateTablet for tablet 541dc3e21d4e461b8c299d0186a42e7f (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:12:08.671835 23143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 541dc3e21d4e461b8c299d0186a42e7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.674490 23149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 058e9aef198f48b8956a676b6f12b2e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.676028 23370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 541dc3e21d4e461b8c299d0186a42e7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.679333 23295 tablet_service.cc:1511] Processing CreateTablet for tablet d8c6d6433d204aa3b5fa3a304e66dd7e (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:12:08.679570 23217 tablet_service.cc:1511] Processing CreateTablet for tablet d2d3a5114a7842179f9957c7f5660f7e (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:12:08.679330 23219 tablet_service.cc:1511] Processing CreateTablet for tablet 98439efe5217407d95ff24969e5b4083 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:12:08.681299 23373 tablet_service.cc:1511] Processing CreateTablet for tablet 8fb0ec62373d4b39bd83ded02981c6dc (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:12:08.669379 23433 ts_tablet_manager.cc:1434] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.001s
I20260709 12:12:08.682380 23295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8c6d6433d204aa3b5fa3a304e66dd7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.682786 23369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 058e9aef198f48b8956a676b6f12b2e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.683516 23292 tablet_service.cc:1511] Processing CreateTablet for tablet 541dc3e21d4e461b8c299d0186a42e7f (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:12:08.684698 23292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 541dc3e21d4e461b8c299d0186a42e7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.688174 23429 raft_consensus.cc:359] T 2954a8837137444496d21a25638b3f2a P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:08.688905 23429 raft_consensus.cc:385] T 2954a8837137444496d21a25638b3f2a P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:08.689205 23429 raft_consensus.cc:740] T 2954a8837137444496d21a25638b3f2a P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:08.694180 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2954a8837137444496d21a25638b3f2a" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:08.660118 23431 raft_consensus.cc:359] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:08.703034 23431 raft_consensus.cc:385] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:08.703370 23431 raft_consensus.cc:740] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:08.703773 23373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fb0ec62373d4b39bd83ded02981c6dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.704118 23431 consensus_queue.cc:260] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
W20260709 12:12:08.705824 23127 leader_election.cc:343] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:08.706316 23127 leader_election.cc:304] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391; no voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:08.695211 23440 raft_consensus.cc:2804] T 1a2d000d8737420cbb2ee80189092814 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:08.706980 23450 raft_consensus.cc:493] T d53aaedd982440259b3ef5d84cddcbed P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.690022 23429 consensus_queue.cc:260] T 2954a8837137444496d21a25638b3f2a P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:08.707480 23450 raft_consensus.cc:515] T d53aaedd982440259b3ef5d84cddcbed P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:08.709290 23429 ts_tablet_manager.cc:1434] T 2954a8837137444496d21a25638b3f2a P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.076s	user 0.007s	sys 0.000s
I20260709 12:12:08.709617 23450 leader_election.cc:290] T d53aaedd982440259b3ef5d84cddcbed P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:08.710325 23429 tablet_bootstrap.cc:492] T 3fb3705cd5724f208798f30d9ab01bda P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:08.699997 23217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2d3a5114a7842179f9957c7f5660f7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.711241 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53aaedd982440259b3ef5d84cddcbed" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
W20260709 12:12:08.712664 23199 leader_election.cc:343] T d53aaedd982440259b3ef5d84cddcbed P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:08.707438 23440 raft_consensus.cc:697] T 1a2d000d8737420cbb2ee80189092814 P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Becoming Leader. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Running, Role: LEADER
I20260709 12:12:08.714923 23219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98439efe5217407d95ff24969e5b4083. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.718816 23474 raft_consensus.cc:2749] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:08.719272 23433 tablet_bootstrap.cc:492] T 3243e85ef0e741d696af414124ca96bd P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:08.724149 23429 tablet_bootstrap.cc:654] T 3fb3705cd5724f208798f30d9ab01bda P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:08.715823 23440 consensus_queue.cc:237] T 1a2d000d8737420cbb2ee80189092814 P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:08.732271 23431 ts_tablet_manager.cc:1434] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.110s	user 0.004s	sys 0.004s
I20260709 12:12:08.733696 23225 tablet_service.cc:1511] Processing CreateTablet for tablet 4bffc92cd6c84709bd0335a988eeef96 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:12:08.733979 23222 tablet_service.cc:1511] Processing CreateTablet for tablet d8c6d6433d204aa3b5fa3a304e66dd7e (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:12:08.735018 23225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bffc92cd6c84709bd0335a988eeef96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.735636 23222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8c6d6433d204aa3b5fa3a304e66dd7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:08.735752 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2693b48366d0430b9db7d8cc90d9667c" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:08.737078 23160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53aaedd982440259b3ef5d84cddcbed" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:08.737702 23160 raft_consensus.cc:2468] T d53aaedd982440259b3ef5d84cddcbed P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 0.
I20260709 12:12:08.739559 23431 tablet_bootstrap.cc:492] T 11b1c6ca5b8b4d61a6e200744c543ede P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:08.734349 23226 tablet_service.cc:1511] Processing CreateTablet for tablet 058e9aef198f48b8956a676b6f12b2e1 (DEFAULT_TABLE table=test-workload [id=e3bca6d8f2ef460184411655505b1b8f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:12:08.742758 23226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 058e9aef198f48b8956a676b6f12b2e1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:12:08.754612 23200 leader_election.cc:343] T 2693b48366d0430b9db7d8cc90d9667c P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:08.761569 23200 leader_election.cc:304] T 2693b48366d0430b9db7d8cc90d9667c P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abe65f4962e147ac841608b6c30f7e1b; no voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689
I20260709 12:12:08.761868 23482 consensus_queue.cc:1059] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:12:08.763625 23450 raft_consensus.cc:2749] T 2693b48366d0430b9db7d8cc90d9667c P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:08.764266 23482 raft_consensus.cc:3055] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:08.764608 23482 raft_consensus.cc:740] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Running, Role: LEADER
I20260709 12:12:08.766387 23482 consensus_queue.cc:260] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:08.771337 23482 raft_consensus.cc:3060] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:08.764933 23200 leader_election.cc:304] T d53aaedd982440259b3ef5d84cddcbed P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, abe65f4962e147ac841608b6c30f7e1b; no voters: 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:08.776108 23431 tablet_bootstrap.cc:654] T 11b1c6ca5b8b4d61a6e200744c543ede P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:08.776432 23450 raft_consensus.cc:2804] T d53aaedd982440259b3ef5d84cddcbed P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:08.776847 23450 raft_consensus.cc:493] T d53aaedd982440259b3ef5d84cddcbed P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:08.777225 23450 raft_consensus.cc:3060] T d53aaedd982440259b3ef5d84cddcbed P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:08.775882 23430 ts_tablet_manager.cc:1434] T ec1028a2affb45679aede72149f857f5 P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.128s	user 0.002s	sys 0.006s
I20260709 12:12:08.790156 23430 tablet_bootstrap.cc:492] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:08.792778 23450 raft_consensus.cc:515] T d53aaedd982440259b3ef5d84cddcbed P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:08.796607 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53aaedd982440259b3ef5d84cddcbed" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
W20260709 12:12:08.798834 23199 leader_election.cc:343] T d53aaedd982440259b3ef5d84cddcbed P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:08.796931 23429 tablet_bootstrap.cc:492] T 3fb3705cd5724f208798f30d9ab01bda P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:08.800470 23429 ts_tablet_manager.cc:1403] T 3fb3705cd5724f208798f30d9ab01bda P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.090s	user 0.002s	sys 0.031s
I20260709 12:12:08.801442 23437 raft_consensus.cc:493] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.802295 23160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53aaedd982440259b3ef5d84cddcbed" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:08.802110 23437 raft_consensus.cc:515] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:08.802953 23160 raft_consensus.cc:3060] T d53aaedd982440259b3ef5d84cddcbed P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:08.803753 23429 raft_consensus.cc:359] T 3fb3705cd5724f208798f30d9ab01bda P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:08.804453 23429 raft_consensus.cc:385] T 3fb3705cd5724f208798f30d9ab01bda P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:08.801026 23450 leader_election.cc:290] T d53aaedd982440259b3ef5d84cddcbed P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 election: Requested vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:08.804730 23429 raft_consensus.cc:740] T 3fb3705cd5724f208798f30d9ab01bda P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:08.805806 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac0ace3682c4f29b9e5ecad75f783f7" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:08.805541 23429 consensus_queue.cc:260] T 3fb3705cd5724f208798f30d9ab01bda P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:08.807037 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac0ace3682c4f29b9e5ecad75f783f7" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:08.808125 23429 ts_tablet_manager.cc:1434] T 3fb3705cd5724f208798f30d9ab01bda P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
W20260709 12:12:08.808544 23127 leader_election.cc:343] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:08.808768 23433 tablet_bootstrap.cc:654] T 3243e85ef0e741d696af414124ca96bd P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:08.809170 23429 tablet_bootstrap.cc:492] T 2693b48366d0430b9db7d8cc90d9667c P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
W20260709 12:12:08.809666 23126 leader_election.cc:343] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:08.810127 23126 leader_election.cc:304] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391; no voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:08.811019 23474 raft_consensus.cc:2749] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:08.804785 23437 leader_election.cc:290] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:08.816593 23429 tablet_bootstrap.cc:654] T 2693b48366d0430b9db7d8cc90d9667c P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:08.824397 23430 tablet_bootstrap.cc:654] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:08.828713 23160 raft_consensus.cc:2468] T d53aaedd982440259b3ef5d84cddcbed P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 1.
I20260709 12:12:08.830312 23200 leader_election.cc:304] T d53aaedd982440259b3ef5d84cddcbed P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, abe65f4962e147ac841608b6c30f7e1b; no voters: 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:08.831969 23431 tablet_bootstrap.cc:492] T 11b1c6ca5b8b4d61a6e200744c543ede P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:08.832479 23431 ts_tablet_manager.cc:1403] T 11b1c6ca5b8b4d61a6e200744c543ede P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.093s	user 0.035s	sys 0.013s
I20260709 12:12:08.833293 23450 raft_consensus.cc:2804] T d53aaedd982440259b3ef5d84cddcbed P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:08.837182 23431 raft_consensus.cc:359] T 11b1c6ca5b8b4d61a6e200744c543ede P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:08.837966 23431 raft_consensus.cc:385] T 11b1c6ca5b8b4d61a6e200744c543ede P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:08.838267 23431 raft_consensus.cc:740] T 11b1c6ca5b8b4d61a6e200744c543ede P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:08.840492 23059 catalog_manager.cc:5697] T 1a2d000d8737420cbb2ee80189092814 P a9d87b20401744c7bd0c491f60cf0689 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "a9d87b20401744c7bd0c491f60cf0689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:08.856307 23450 raft_consensus.cc:697] T d53aaedd982440259b3ef5d84cddcbed P abe65f4962e147ac841608b6c30f7e1b [term 1 LEADER]: Becoming Leader. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Running, Role: LEADER
I20260709 12:12:08.856818 23430 tablet_bootstrap.cc:492] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:08.857391 23430 ts_tablet_manager.cc:1403] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.068s	user 0.020s	sys 0.001s
I20260709 12:12:08.857610 23433 tablet_bootstrap.cc:492] T 3243e85ef0e741d696af414124ca96bd P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:08.857302 23450 consensus_queue.cc:237] T d53aaedd982440259b3ef5d84cddcbed P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:08.858178 23433 ts_tablet_manager.cc:1403] T 3243e85ef0e741d696af414124ca96bd P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.139s	user 0.021s	sys 0.010s
I20260709 12:12:08.860687 23433 raft_consensus.cc:359] T 3243e85ef0e741d696af414124ca96bd P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:08.861219 23433 raft_consensus.cc:385] T 3243e85ef0e741d696af414124ca96bd P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:08.861277 23429 tablet_bootstrap.cc:492] T 2693b48366d0430b9db7d8cc90d9667c P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:08.861536 23433 raft_consensus.cc:740] T 3243e85ef0e741d696af414124ca96bd P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:08.861871 23429 ts_tablet_manager.cc:1403] T 2693b48366d0430b9db7d8cc90d9667c P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.053s	user 0.017s	sys 0.013s
I20260709 12:12:08.861644 23430 raft_consensus.cc:359] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:08.862267 23433 consensus_queue.cc:260] T 3243e85ef0e741d696af414124ca96bd P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:08.862944 23430 raft_consensus.cc:385] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:08.863392 23430 raft_consensus.cc:740] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:08.863600 23431 consensus_queue.cc:260] T 11b1c6ca5b8b4d61a6e200744c543ede P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:08.864295 23430 consensus_queue.cc:260] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:08.865507 23429 raft_consensus.cc:359] T 2693b48366d0430b9db7d8cc90d9667c P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:08.866230 23429 raft_consensus.cc:385] T 2693b48366d0430b9db7d8cc90d9667c P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:08.866477 23431 ts_tablet_manager.cc:1434] T 11b1c6ca5b8b4d61a6e200744c543ede P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.034s	user 0.003s	sys 0.004s
I20260709 12:12:08.866513 23429 raft_consensus.cc:740] T 2693b48366d0430b9db7d8cc90d9667c P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:08.867676 23433 ts_tablet_manager.cc:1434] T 3243e85ef0e741d696af414124ca96bd P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 12:12:08.868691 23433 tablet_bootstrap.cc:492] T 2954a8837137444496d21a25638b3f2a P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:08.869242 23430 ts_tablet_manager.cc:1434] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
I20260709 12:12:08.869949 23431 tablet_bootstrap.cc:492] T 2693b48366d0430b9db7d8cc90d9667c P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:08.870432 23430 tablet_bootstrap.cc:492] T 1a2d000d8737420cbb2ee80189092814 P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:08.867437 23429 consensus_queue.cc:260] T 2693b48366d0430b9db7d8cc90d9667c P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:08.875267 23433 tablet_bootstrap.cc:654] T 2954a8837137444496d21a25638b3f2a P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:08.876856 23429 ts_tablet_manager.cc:1434] T 2693b48366d0430b9db7d8cc90d9667c P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:12:08.880231 23429 tablet_bootstrap.cc:492] T 11b1c6ca5b8b4d61a6e200744c543ede P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:08.886835 23429 tablet_bootstrap.cc:654] T 11b1c6ca5b8b4d61a6e200744c543ede P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:08.890836 23350 consensus_peers.cc:597] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa -> Peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Couldn't send request to peer abe65f4962e147ac841608b6c30f7e1b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:08.896646 23431 tablet_bootstrap.cc:654] T 2693b48366d0430b9db7d8cc90d9667c P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:08.899928 23429 tablet_bootstrap.cc:492] T 11b1c6ca5b8b4d61a6e200744c543ede P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:08.900552 23429 ts_tablet_manager.cc:1403] T 11b1c6ca5b8b4d61a6e200744c543ede P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.006s
I20260709 12:12:08.904090 23429 raft_consensus.cc:359] T 11b1c6ca5b8b4d61a6e200744c543ede P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:08.904999 23429 raft_consensus.cc:385] T 11b1c6ca5b8b4d61a6e200744c543ede P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:08.905341 23429 raft_consensus.cc:740] T 11b1c6ca5b8b4d61a6e200744c543ede P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:08.915696 23429 consensus_queue.cc:260] T 11b1c6ca5b8b4d61a6e200744c543ede P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:08.916405 23059 catalog_manager.cc:5697] T d53aaedd982440259b3ef5d84cddcbed P abe65f4962e147ac841608b6c30f7e1b reported cstate change: term changed from 0 to 1, leader changed from <none> to abe65f4962e147ac841608b6c30f7e1b (127.16.98.194). New cstate: current_term: 1 leader_uuid: "abe65f4962e147ac841608b6c30f7e1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:08.919085 23430 tablet_bootstrap.cc:654] T 1a2d000d8737420cbb2ee80189092814 P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:08.924324 23429 ts_tablet_manager.cc:1434] T 11b1c6ca5b8b4d61a6e200744c543ede P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.004s
I20260709 12:12:08.925282 23429 tablet_bootstrap.cc:492] T 8ac0ace3682c4f29b9e5ecad75f783f7 P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:08.925890 23431 tablet_bootstrap.cc:492] T 2693b48366d0430b9db7d8cc90d9667c P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:08.926371 23431 ts_tablet_manager.cc:1403] T 2693b48366d0430b9db7d8cc90d9667c P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.057s	user 0.014s	sys 0.021s
I20260709 12:12:08.926972 23436 raft_consensus.cc:493] T ec1028a2affb45679aede72149f857f5 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.927481 23436 raft_consensus.cc:515] T ec1028a2affb45679aede72149f857f5 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:08.929692 23436 leader_election.cc:290] T ec1028a2affb45679aede72149f857f5 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:08.930271 23433 tablet_bootstrap.cc:492] T 2954a8837137444496d21a25638b3f2a P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:08.930842 23433 ts_tablet_manager.cc:1403] T 2954a8837137444496d21a25638b3f2a P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.062s	user 0.028s	sys 0.009s
I20260709 12:12:08.931108 23429 tablet_bootstrap.cc:654] T 8ac0ace3682c4f29b9e5ecad75f783f7 P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:08.932113 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1028a2affb45679aede72149f857f5" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:08.933343 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1028a2affb45679aede72149f857f5" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:08.933903 23433 raft_consensus.cc:359] T 2954a8837137444496d21a25638b3f2a P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:08.934690 23433 raft_consensus.cc:385] T 2954a8837137444496d21a25638b3f2a P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:08.935009 23433 raft_consensus.cc:740] T 2954a8837137444496d21a25638b3f2a P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
W20260709 12:12:08.935489 23350 leader_election.cc:343] T ec1028a2affb45679aede72149f857f5 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:08.934063 23310 raft_consensus.cc:2468] T ec1028a2affb45679aede72149f857f5 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 0.
I20260709 12:12:08.937566 23349 leader_election.cc:304] T ec1028a2affb45679aede72149f857f5 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689; no voters: abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:08.938266 23433 consensus_queue.cc:260] T 2954a8837137444496d21a25638b3f2a P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:08.939103 23450 raft_consensus.cc:493] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.939754 23450 raft_consensus.cc:515] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:08.940917 23433 ts_tablet_manager.cc:1434] T 2954a8837137444496d21a25638b3f2a P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:12:08.941849 23450 leader_election.cc:290] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:08.942320 23429 tablet_bootstrap.cc:492] T 8ac0ace3682c4f29b9e5ecad75f783f7 P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:08.942809 23429 ts_tablet_manager.cc:1403] T 8ac0ace3682c4f29b9e5ecad75f783f7 P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.003s
I20260709 12:12:08.941944 23433 tablet_bootstrap.cc:492] T 7193dd2dee9c4d1c9992ad4eff434b59 P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:08.943477 23160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0efec949fc4455838db7fb01259d69" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:08.943725 23436 raft_consensus.cc:2804] T ec1028a2affb45679aede72149f857f5 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:08.944278 23436 raft_consensus.cc:493] T ec1028a2affb45679aede72149f857f5 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:08.943480 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0efec949fc4455838db7fb01259d69" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:08.945268 23383 raft_consensus.cc:2468] T 5d0efec949fc4455838db7fb01259d69 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 0.
I20260709 12:12:08.945503 23429 raft_consensus.cc:359] T 8ac0ace3682c4f29b9e5ecad75f783f7 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:08.946220 23429 raft_consensus.cc:385] T 8ac0ace3682c4f29b9e5ecad75f783f7 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:08.946498 23199 leader_election.cc:304] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:08.944628 23436 raft_consensus.cc:3060] T ec1028a2affb45679aede72149f857f5 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:08.947319 23200 leader_election.cc:343] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:08.947517 23431 raft_consensus.cc:359] T 2693b48366d0430b9db7d8cc90d9667c P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:08.948175 23431 raft_consensus.cc:385] T 2693b48366d0430b9db7d8cc90d9667c P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:08.948292 23450 raft_consensus.cc:2804] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:08.948472 23431 raft_consensus.cc:740] T 2693b48366d0430b9db7d8cc90d9667c P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:08.948717 23450 raft_consensus.cc:493] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:08.949093 23450 raft_consensus.cc:3060] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:08.949301 23431 consensus_queue.cc:260] T 2693b48366d0430b9db7d8cc90d9667c P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:08.954373 23430 tablet_bootstrap.cc:492] T 1a2d000d8737420cbb2ee80189092814 P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:08.954854 23430 ts_tablet_manager.cc:1403] T 1a2d000d8737420cbb2ee80189092814 P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.085s	user 0.021s	sys 0.000s
I20260709 12:12:08.955488 23436 raft_consensus.cc:515] T ec1028a2affb45679aede72149f857f5 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:08.956271 23450 raft_consensus.cc:515] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:08.946487 23429 raft_consensus.cc:740] T 8ac0ace3682c4f29b9e5ecad75f783f7 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:08.957616 23430 raft_consensus.cc:359] T 1a2d000d8737420cbb2ee80189092814 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:08.960567 23436 leader_election.cc:290] T ec1028a2affb45679aede72149f857f5 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Requested vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:08.960853 23430 raft_consensus.cc:385] T 1a2d000d8737420cbb2ee80189092814 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:08.960907 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1028a2affb45679aede72149f857f5" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:08.961336 23430 raft_consensus.cc:740] T 1a2d000d8737420cbb2ee80189092814 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:08.961555 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0efec949fc4455838db7fb01259d69" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:08.962175 23383 raft_consensus.cc:3060] T 5d0efec949fc4455838db7fb01259d69 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:08.962078 23430 consensus_queue.cc:260] T 1a2d000d8737420cbb2ee80189092814 P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:08.963018 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1028a2affb45679aede72149f857f5" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
W20260709 12:12:08.963151 23350 leader_election.cc:343] T ec1028a2affb45679aede72149f857f5 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:08.963594 23310 raft_consensus.cc:3060] T ec1028a2affb45679aede72149f857f5 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:08.964299 23430 ts_tablet_manager.cc:1434] T 1a2d000d8737420cbb2ee80189092814 P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:12:08.965220 23430 tablet_bootstrap.cc:492] T 9d57b510cd3745fabb0748a6f9008fca P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:08.971040 23310 raft_consensus.cc:2468] T ec1028a2affb45679aede72149f857f5 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 1.
I20260709 12:12:08.958245 23431 ts_tablet_manager.cc:1434] T 2693b48366d0430b9db7d8cc90d9667c P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:12:08.970680 23429 consensus_queue.cc:260] T 8ac0ace3682c4f29b9e5ecad75f783f7 P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:08.972172 23349 leader_election.cc:304] T ec1028a2affb45679aede72149f857f5 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689; no voters: abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:08.972549 23450 leader_election.cc:290] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 election: Requested vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:08.972599 23160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0efec949fc4455838db7fb01259d69" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:08.973614 23477 raft_consensus.cc:2804] T ec1028a2affb45679aede72149f857f5 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:08.974092 23477 raft_consensus.cc:697] T ec1028a2affb45679aede72149f857f5 P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Becoming Leader. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Running, Role: LEADER
I20260709 12:12:08.974766 23429 ts_tablet_manager.cc:1434] T 8ac0ace3682c4f29b9e5ecad75f783f7 P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:12:08.974902 23477 consensus_queue.cc:237] T ec1028a2affb45679aede72149f857f5 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:08.975894 23430 tablet_bootstrap.cc:654] T 9d57b510cd3745fabb0748a6f9008fca P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:08.976488 23431 tablet_bootstrap.cc:492] T 9d57b510cd3745fabb0748a6f9008fca P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
W20260709 12:12:08.977167 23200 leader_election.cc:343] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:08.977635 23482 raft_consensus.cc:493] T 2693b48366d0430b9db7d8cc90d9667c P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:08.978099 23482 raft_consensus.cc:515] T 2693b48366d0430b9db7d8cc90d9667c P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:08.980154 23482 leader_election.cc:290] T 2693b48366d0430b9db7d8cc90d9667c P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:08.981137 23429 tablet_bootstrap.cc:492] T 9d57b510cd3745fabb0748a6f9008fca P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:08.982455 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2693b48366d0430b9db7d8cc90d9667c" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:08.987150 23236 raft_consensus.cc:2468] T 2693b48366d0430b9db7d8cc90d9667c P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 0.
I20260709 12:12:08.958336 23433 tablet_bootstrap.cc:654] T 7193dd2dee9c4d1c9992ad4eff434b59 P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:08.991372 23276 leader_election.cc:304] T 2693b48366d0430b9db7d8cc90d9667c P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:08.983673 23160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2693b48366d0430b9db7d8cc90d9667c" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:08.992390 23482 raft_consensus.cc:2804] T 2693b48366d0430b9db7d8cc90d9667c P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:08.992697 23160 raft_consensus.cc:2468] T 2693b48366d0430b9db7d8cc90d9667c P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 0.
I20260709 12:12:08.992769 23482 raft_consensus.cc:493] T 2693b48366d0430b9db7d8cc90d9667c P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:08.993234 23482 raft_consensus.cc:3060] T 2693b48366d0430b9db7d8cc90d9667c P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:08.997466 23431 tablet_bootstrap.cc:654] T 9d57b510cd3745fabb0748a6f9008fca P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:09.000248 23429 tablet_bootstrap.cc:654] T 9d57b510cd3745fabb0748a6f9008fca P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:09.005766 23430 tablet_bootstrap.cc:492] T 9d57b510cd3745fabb0748a6f9008fca P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:09.007162 23057 catalog_manager.cc:5697] T ec1028a2affb45679aede72149f857f5 P 48bc58ace75f40e995efc1edcefe79fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196). New cstate: current_term: 1 leader_uuid: "48bc58ace75f40e995efc1edcefe79fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:09.006232 23430 ts_tablet_manager.cc:1403] T 9d57b510cd3745fabb0748a6f9008fca P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.018s
I20260709 12:12:09.015816 23482 raft_consensus.cc:515] T 2693b48366d0430b9db7d8cc90d9667c P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:09.006196 23383 raft_consensus.cc:2468] T 5d0efec949fc4455838db7fb01259d69 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 1.
I20260709 12:12:09.019547 23160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2693b48366d0430b9db7d8cc90d9667c" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:09.020100 23160 raft_consensus.cc:3060] T 2693b48366d0430b9db7d8cc90d9667c P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:09.020246 23199 leader_election.cc:304] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, abe65f4962e147ac841608b6c30f7e1b; no voters: 3824bca1df8e4020b18c7989f7758391
I20260709 12:12:09.021414 23450 raft_consensus.cc:2804] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:09.021915 23450 raft_consensus.cc:697] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b [term 1 LEADER]: Becoming Leader. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Running, Role: LEADER
I20260709 12:12:09.022733 23450 consensus_queue.cc:237] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:09.023113 23430 raft_consensus.cc:359] T 9d57b510cd3745fabb0748a6f9008fca P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:09.023799 23430 raft_consensus.cc:385] T 9d57b510cd3745fabb0748a6f9008fca P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:09.024092 23430 raft_consensus.cc:740] T 9d57b510cd3745fabb0748a6f9008fca P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:09.025616 23433 tablet_bootstrap.cc:492] T 7193dd2dee9c4d1c9992ad4eff434b59 P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:09.026187 23433 ts_tablet_manager.cc:1403] T 7193dd2dee9c4d1c9992ad4eff434b59 P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.084s	user 0.008s	sys 0.005s
I20260709 12:12:09.027937 23160 raft_consensus.cc:2468] T 2693b48366d0430b9db7d8cc90d9667c P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 1.
I20260709 12:12:09.029312 23274 leader_election.cc:304] T 2693b48366d0430b9db7d8cc90d9667c P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689; no voters: 
I20260709 12:12:09.029460 23509 consensus_queue.cc:1048] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:09.029654 23433 raft_consensus.cc:359] T 7193dd2dee9c4d1c9992ad4eff434b59 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:09.030198 23440 raft_consensus.cc:2804] T 2693b48366d0430b9db7d8cc90d9667c P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:09.030544 23433 raft_consensus.cc:385] T 7193dd2dee9c4d1c9992ad4eff434b59 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:09.030821 23440 raft_consensus.cc:697] T 2693b48366d0430b9db7d8cc90d9667c P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Becoming Leader. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Running, Role: LEADER
I20260709 12:12:09.030975 23433 raft_consensus.cc:740] T 7193dd2dee9c4d1c9992ad4eff434b59 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:09.031284 23430 consensus_queue.cc:260] T 9d57b510cd3745fabb0748a6f9008fca P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:09.031702 23440 consensus_queue.cc:237] T 2693b48366d0430b9db7d8cc90d9667c P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:09.031864 23433 consensus_queue.cc:260] T 7193dd2dee9c4d1c9992ad4eff434b59 P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:09.032711 23482 leader_election.cc:290] T 2693b48366d0430b9db7d8cc90d9667c P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Requested vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:09.034880 23430 ts_tablet_manager.cc:1434] T 9d57b510cd3745fabb0748a6f9008fca P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 12:12:09.034979 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2693b48366d0430b9db7d8cc90d9667c" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:09.035581 23236 raft_consensus.cc:3060] T 2693b48366d0430b9db7d8cc90d9667c P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:09.036212 23433 ts_tablet_manager.cc:1434] T 7193dd2dee9c4d1c9992ad4eff434b59 P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:12:09.038276 23430 tablet_bootstrap.cc:492] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:09.041579 23433 tablet_bootstrap.cc:492] T 8ac0ace3682c4f29b9e5ecad75f783f7 P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:09.043650 23439 raft_consensus.cc:493] T 2954a8837137444496d21a25638b3f2a P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.043152 23058 catalog_manager.cc:5697] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b reported cstate change: term changed from 0 to 1, leader changed from <none> to abe65f4962e147ac841608b6c30f7e1b (127.16.98.194). New cstate: current_term: 1 leader_uuid: "abe65f4962e147ac841608b6c30f7e1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:09.044131 23439 raft_consensus.cc:515] T 2954a8837137444496d21a25638b3f2a P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:09.044718 23430 tablet_bootstrap.cc:654] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:09.046342 23439 leader_election.cc:290] T 2954a8837137444496d21a25638b3f2a P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:09.047942 23235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2954a8837137444496d21a25638b3f2a" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:09.056744 23235 raft_consensus.cc:2468] T 2954a8837137444496d21a25638b3f2a P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 0.
I20260709 12:12:09.051605 23482 raft_consensus.cc:493] T 11b1c6ca5b8b4d61a6e200744c543ede P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.057881 23482 raft_consensus.cc:515] T 11b1c6ca5b8b4d61a6e200744c543ede P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:09.059801 23431 tablet_bootstrap.cc:492] T 9d57b510cd3745fabb0748a6f9008fca P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:09.059942 23482 leader_election.cc:290] T 11b1c6ca5b8b4d61a6e200744c543ede P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:09.060268 23431 ts_tablet_manager.cc:1403] T 9d57b510cd3745fabb0748a6f9008fca P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.084s	user 0.007s	sys 0.021s
I20260709 12:12:09.061004 23509 raft_consensus.cc:493] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.061408 23158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11b1c6ca5b8b4d61a6e200744c543ede" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:09.061635 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11b1c6ca5b8b4d61a6e200744c543ede" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:09.061538 23509 raft_consensus.cc:515] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:09.062180 23158 raft_consensus.cc:2468] T 11b1c6ca5b8b4d61a6e200744c543ede P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 0.
I20260709 12:12:09.062362 23383 raft_consensus.cc:2468] T 11b1c6ca5b8b4d61a6e200744c543ede P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 0.
I20260709 12:12:09.054636 23159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2954a8837137444496d21a25638b3f2a" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:09.063263 23431 raft_consensus.cc:359] T 9d57b510cd3745fabb0748a6f9008fca P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:09.063581 23274 leader_election.cc:304] T 11b1c6ca5b8b4d61a6e200744c543ede P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689; no voters: 
I20260709 12:12:09.063839 23509 leader_election.cc:290] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:09.064049 23431 raft_consensus.cc:385] T 9d57b510cd3745fabb0748a6f9008fca P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:09.064146 23159 raft_consensus.cc:2468] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 0.
I20260709 12:12:09.064424 23431 raft_consensus.cc:740] T 9d57b510cd3745fabb0748a6f9008fca P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:09.064468 23482 raft_consensus.cc:2804] T 11b1c6ca5b8b4d61a6e200744c543ede P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:09.064985 23482 raft_consensus.cc:493] T 11b1c6ca5b8b4d61a6e200744c543ede P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:09.065321 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be6b80356b0415ba28a56482e13d24f" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:09.065210 23431 consensus_queue.cc:260] T 9d57b510cd3745fabb0748a6f9008fca P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:09.065361 23482 raft_consensus.cc:3060] T 11b1c6ca5b8b4d61a6e200744c543ede P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:09.067579 23431 ts_tablet_manager.cc:1434] T 9d57b510cd3745fabb0748a6f9008fca P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:12:09.068473 23431 tablet_bootstrap.cc:492] T 3fb3705cd5724f208798f30d9ab01bda P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
W20260709 12:12:09.071036 23349 leader_election.cc:343] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:09.071105 23276 leader_election.cc:304] T 2954a8837137444496d21a25638b3f2a P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:09.072312 23436 raft_consensus.cc:493] T 1a2d000d8737420cbb2ee80189092814 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.072826 23436 raft_consensus.cc:515] T 1a2d000d8737420cbb2ee80189092814 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:09.074167 23431 tablet_bootstrap.cc:654] T 3fb3705cd5724f208798f30d9ab01bda P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:09.074429 23429 tablet_bootstrap.cc:492] T 9d57b510cd3745fabb0748a6f9008fca P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:09.074929 23429 ts_tablet_manager.cc:1403] T 9d57b510cd3745fabb0748a6f9008fca P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.094s	user 0.019s	sys 0.006s
I20260709 12:12:09.075659 23235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be6b80356b0415ba28a56482e13d24f" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:09.076323 23235 raft_consensus.cc:2468] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 0.
I20260709 12:12:09.076594 23482 raft_consensus.cc:515] T 11b1c6ca5b8b4d61a6e200744c543ede P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:09.078476 23350 leader_election.cc:304] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, abe65f4962e147ac841608b6c30f7e1b; no voters: a9d87b20401744c7bd0c491f60cf0689
I20260709 12:12:09.079594 23509 raft_consensus.cc:2804] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:09.080085 23509 raft_consensus.cc:493] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:09.080613 23509 raft_consensus.cc:3060] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:09.081272 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11b1c6ca5b8b4d61a6e200744c543ede" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:09.081878 23383 raft_consensus.cc:3060] T 11b1c6ca5b8b4d61a6e200744c543ede P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:09.087272 23436 leader_election.cc:290] T 1a2d000d8737420cbb2ee80189092814 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:09.088129 23439 raft_consensus.cc:2804] T 2954a8837137444496d21a25638b3f2a P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:09.088668 23439 raft_consensus.cc:493] T 2954a8837137444496d21a25638b3f2a P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:09.089123 23439 raft_consensus.cc:3060] T 2954a8837137444496d21a25638b3f2a P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:09.089462 23236 raft_consensus.cc:2468] T 2693b48366d0430b9db7d8cc90d9667c P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 1.
I20260709 12:12:09.091017 23509 raft_consensus.cc:515] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:09.094394 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d000d8737420cbb2ee80189092814" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:09.093631 23482 leader_election.cc:290] T 11b1c6ca5b8b4d61a6e200744c543ede P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Requested vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:09.098891 23509 leader_election.cc:290] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Requested vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:09.099764 23235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be6b80356b0415ba28a56482e13d24f" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:09.100661 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be6b80356b0415ba28a56482e13d24f" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:09.100673 23160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11b1c6ca5b8b4d61a6e200744c543ede" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:09.102541 23160 raft_consensus.cc:3060] T 11b1c6ca5b8b4d61a6e200744c543ede P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:09.103147 23235 raft_consensus.cc:3060] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:09.107062 23349 leader_election.cc:343] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:09.109786 23160 raft_consensus.cc:2468] T 11b1c6ca5b8b4d61a6e200744c543ede P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 1.
I20260709 12:12:09.100114 23482 consensus_queue.cc:1048] T 3243e85ef0e741d696af414124ca96bd P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:09.119765 23274 leader_election.cc:304] T 11b1c6ca5b8b4d61a6e200744c543ede P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689; no voters: 
I20260709 12:12:09.120697 23482 raft_consensus.cc:2804] T 11b1c6ca5b8b4d61a6e200744c543ede P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:09.120803 23439 raft_consensus.cc:515] T 2954a8837137444496d21a25638b3f2a P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:09.047286 23433 tablet_bootstrap.cc:654] T 8ac0ace3682c4f29b9e5ecad75f783f7 P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:09.124056 23106 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:09.130141 23235 raft_consensus.cc:2468] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 1.
I20260709 12:12:09.131213 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a2d000d8737420cbb2ee80189092814" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:09.135394 23236 raft_consensus.cc:2393] T 1a2d000d8737420cbb2ee80189092814 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48bc58ace75f40e995efc1edcefe79fa in current term 1: Already voted for candidate a9d87b20401744c7bd0c491f60cf0689 in this term.
I20260709 12:12:09.133407 23509 raft_consensus.cc:493] T 9d57b510cd3745fabb0748a6f9008fca P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.135869 23509 raft_consensus.cc:515] T 9d57b510cd3745fabb0748a6f9008fca P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:09.136648 23433 tablet_bootstrap.cc:492] T 8ac0ace3682c4f29b9e5ecad75f783f7 P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:09.137108 23433 ts_tablet_manager.cc:1403] T 8ac0ace3682c4f29b9e5ecad75f783f7 P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.100s	user 0.010s	sys 0.000s
I20260709 12:12:09.139891 23433 raft_consensus.cc:359] T 8ac0ace3682c4f29b9e5ecad75f783f7 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:09.140534 23433 raft_consensus.cc:385] T 8ac0ace3682c4f29b9e5ecad75f783f7 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:09.140829 23433 raft_consensus.cc:740] T 8ac0ace3682c4f29b9e5ecad75f783f7 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:09.141290 23509 leader_election.cc:290] T 9d57b510cd3745fabb0748a6f9008fca P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:09.116056 23383 raft_consensus.cc:2468] T 11b1c6ca5b8b4d61a6e200744c543ede P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 1.
I20260709 12:12:09.141893 23160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d57b510cd3745fabb0748a6f9008fca" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:09.143286 23160 raft_consensus.cc:2468] T 9d57b510cd3745fabb0748a6f9008fca P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 0.
I20260709 12:12:09.143828 23350 leader_election.cc:304] T 1a2d000d8737420cbb2ee80189092814 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa; no voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:09.144459 23348 leader_election.cc:304] T 9d57b510cd3745fabb0748a6f9008fca P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, 48bc58ace75f40e995efc1edcefe79fa; no voters: 
I20260709 12:12:09.145402 23436 raft_consensus.cc:3060] T 1a2d000d8737420cbb2ee80189092814 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:09.141695 23433 consensus_queue.cc:260] T 8ac0ace3682c4f29b9e5ecad75f783f7 P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:09.142336 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d57b510cd3745fabb0748a6f9008fca" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:09.150863 23509 raft_consensus.cc:2804] T 9d57b510cd3745fabb0748a6f9008fca P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:09.154822 23509 raft_consensus.cc:493] T 9d57b510cd3745fabb0748a6f9008fca P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:09.155437 23433 ts_tablet_manager.cc:1434] T 8ac0ace3682c4f29b9e5ecad75f783f7 P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 12:12:09.155408 23509 raft_consensus.cc:3060] T 9d57b510cd3745fabb0748a6f9008fca P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:09.156445 23433 tablet_bootstrap.cc:492] T 1f5cfd203dcc43d4a86864c2eaaf234c P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:09.164301 23350 leader_election.cc:304] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, abe65f4962e147ac841608b6c30f7e1b; no voters: a9d87b20401744c7bd0c491f60cf0689
I20260709 12:12:09.165508 23477 raft_consensus.cc:2804] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:09.178999 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2954a8837137444496d21a25638b3f2a" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:09.180095 23433 tablet_bootstrap.cc:654] T 1f5cfd203dcc43d4a86864c2eaaf234c P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:09.180040 23236 raft_consensus.cc:3060] T 2954a8837137444496d21a25638b3f2a P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:09.187393 23235 raft_consensus.cc:3060] T 3243e85ef0e741d696af414124ca96bd P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:09.193630 23515 log.cc:927] Time spent T 2693b48366d0430b9db7d8cc90d9667c P a9d87b20401744c7bd0c491f60cf0689: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:12:09.173568 23436 raft_consensus.cc:2749] T 1a2d000d8737420cbb2ee80189092814 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:09.196880 23477 raft_consensus.cc:697] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Becoming Leader. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Running, Role: LEADER
I20260709 12:12:09.198521 23477 consensus_queue.cc:237] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:09.194454 23439 leader_election.cc:290] T 2954a8837137444496d21a25638b3f2a P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Requested vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:09.201050 23439 consensus_queue.cc:1048] T 1a2d000d8737420cbb2ee80189092814 P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:09.205878 23433 tablet_bootstrap.cc:492] T 1f5cfd203dcc43d4a86864c2eaaf234c P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:09.206369 23433 ts_tablet_manager.cc:1403] T 1f5cfd203dcc43d4a86864c2eaaf234c P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.002s
I20260709 12:12:09.207567 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2954a8837137444496d21a25638b3f2a" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:09.077641 23429 raft_consensus.cc:359] T 9d57b510cd3745fabb0748a6f9008fca P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:09.208249 23161 raft_consensus.cc:3060] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:09.210937 23429 raft_consensus.cc:385] T 9d57b510cd3745fabb0748a6f9008fca P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:09.211390 23429 raft_consensus.cc:740] T 9d57b510cd3745fabb0748a6f9008fca P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:09.214421 23429 consensus_queue.cc:260] T 9d57b510cd3745fabb0748a6f9008fca P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:09.220566 23433 raft_consensus.cc:359] T 1f5cfd203dcc43d4a86864c2eaaf234c P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:09.221504 23433 raft_consensus.cc:385] T 1f5cfd203dcc43d4a86864c2eaaf234c P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:09.221837 23433 raft_consensus.cc:740] T 1f5cfd203dcc43d4a86864c2eaaf234c P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:09.220100 23310 raft_consensus.cc:2468] T 9d57b510cd3745fabb0748a6f9008fca P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 0.
I20260709 12:12:09.223989 23482 raft_consensus.cc:697] T 11b1c6ca5b8b4d61a6e200744c543ede P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Becoming Leader. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Running, Role: LEADER
I20260709 12:12:09.233850 23433 consensus_queue.cc:260] T 1f5cfd203dcc43d4a86864c2eaaf234c P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:09.242573 23430 tablet_bootstrap.cc:492] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:09.243255 23430 ts_tablet_manager.cc:1403] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.205s	user 0.029s	sys 0.038s
I20260709 12:12:09.250191 23433 ts_tablet_manager.cc:1434] T 1f5cfd203dcc43d4a86864c2eaaf234c P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.001s
I20260709 12:12:09.245747 23439 raft_consensus.cc:493] T 3fb3705cd5724f208798f30d9ab01bda P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.251191 23433 tablet_bootstrap.cc:492] T ec1028a2affb45679aede72149f857f5 P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:09.251479 23439 raft_consensus.cc:515] T 3fb3705cd5724f208798f30d9ab01bda P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:09.251099 23482 consensus_queue.cc:237] T 11b1c6ca5b8b4d61a6e200744c543ede P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:09.253736 23439 leader_election.cc:290] T 3fb3705cd5724f208798f30d9ab01bda P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:09.262194 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb3705cd5724f208798f30d9ab01bda" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:09.264283 23430 raft_consensus.cc:359] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:09.264983 23430 raft_consensus.cc:385] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:09.265241 23430 raft_consensus.cc:740] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:09.265890 23430 consensus_queue.cc:260] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:09.267900 23430 ts_tablet_manager.cc:1434] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.024s	user 0.000s	sys 0.005s
I20260709 12:12:09.268817 23430 tablet_bootstrap.cc:492] T 162d91be31a64ad688b7b433392ed1a2 P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:09.275239 23430 tablet_bootstrap.cc:654] T 162d91be31a64ad688b7b433392ed1a2 P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:09.276276 23433 tablet_bootstrap.cc:654] T ec1028a2affb45679aede72149f857f5 P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:09.279422 23383 raft_consensus.cc:2468] T 3fb3705cd5724f208798f30d9ab01bda P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 0.
I20260709 12:12:09.190377 23058 catalog_manager.cc:5697] T 2693b48366d0430b9db7d8cc90d9667c P a9d87b20401744c7bd0c491f60cf0689 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "a9d87b20401744c7bd0c491f60cf0689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:09.283033 23273 leader_election.cc:304] T 3fb3705cd5724f208798f30d9ab01bda P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689; no voters: 
I20260709 12:12:09.295408 23429 ts_tablet_manager.cc:1434] T 9d57b510cd3745fabb0748a6f9008fca P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.220s	user 0.010s	sys 0.000s
W20260709 12:12:09.300652 23199 consensus_peers.cc:597] T d53aaedd982440259b3ef5d84cddcbed P abe65f4962e147ac841608b6c30f7e1b -> Peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Couldn't send request to peer 48bc58ace75f40e995efc1edcefe79fa. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:09.301999 23160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb3705cd5724f208798f30d9ab01bda" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:09.306169 23525 raft_consensus.cc:493] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.306915 23525 raft_consensus.cc:515] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:09.310730 23160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7193dd2dee9c4d1c9992ad4eff434b59" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
W20260709 12:12:09.312143 23348 leader_election.cc:343] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:09.313653 23236 raft_consensus.cc:2468] T 2954a8837137444496d21a25638b3f2a P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 1.
I20260709 12:12:09.316812 23525 leader_election.cc:290] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:09.317993 23234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7193dd2dee9c4d1c9992ad4eff434b59" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:09.318847 23234 raft_consensus.cc:2468] T 7193dd2dee9c4d1c9992ad4eff434b59 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 0.
I20260709 12:12:09.319203 23276 leader_election.cc:304] T 2954a8837137444496d21a25638b3f2a P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:09.323652 23429 tablet_bootstrap.cc:492] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:09.320655 23439 raft_consensus.cc:493] T 8ac0ace3682c4f29b9e5ecad75f783f7 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.328154 23439 raft_consensus.cc:515] T 8ac0ace3682c4f29b9e5ecad75f783f7 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:09.326979 23518 raft_consensus.cc:2804] T 2954a8837137444496d21a25638b3f2a P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:09.286675 23509 raft_consensus.cc:515] T 9d57b510cd3745fabb0748a6f9008fca P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:09.322412 23350 leader_election.cc:304] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, abe65f4962e147ac841608b6c30f7e1b; no voters: 3824bca1df8e4020b18c7989f7758391
I20260709 12:12:09.334141 23522 consensus_queue.cc:1048] T 1a2d000d8737420cbb2ee80189092814 P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:12:09.335012 23525 raft_consensus.cc:2804] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:09.335881 23520 raft_consensus.cc:2804] T 3fb3705cd5724f208798f30d9ab01bda P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:09.336318 23520 raft_consensus.cc:493] T 3fb3705cd5724f208798f30d9ab01bda P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:09.336633 23520 raft_consensus.cc:3060] T 3fb3705cd5724f208798f30d9ab01bda P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:09.332018 23057 catalog_manager.cc:5697] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196). New cstate: current_term: 1 leader_uuid: "48bc58ace75f40e995efc1edcefe79fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:09.338243 23439 leader_election.cc:290] T 8ac0ace3682c4f29b9e5ecad75f783f7 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:09.335482 23525 raft_consensus.cc:493] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:09.338871 23525 raft_consensus.cc:3060] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:09.343321 23518 raft_consensus.cc:697] T 2954a8837137444496d21a25638b3f2a P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Becoming Leader. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Running, Role: LEADER
I20260709 12:12:09.344519 23518 consensus_queue.cc:237] T 2954a8837137444496d21a25638b3f2a P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:09.347851 23161 raft_consensus.cc:2468] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 1.
I20260709 12:12:09.348351 23431 tablet_bootstrap.cc:492] T 3fb3705cd5724f208798f30d9ab01bda P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:09.349020 23431 ts_tablet_manager.cc:1403] T 3fb3705cd5724f208798f30d9ab01bda P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.281s	user 0.063s	sys 0.086s
I20260709 12:12:09.363042 23431 raft_consensus.cc:359] T 3fb3705cd5724f208798f30d9ab01bda P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:09.363982 23431 raft_consensus.cc:385] T 3fb3705cd5724f208798f30d9ab01bda P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:09.364300 23431 raft_consensus.cc:740] T 3fb3705cd5724f208798f30d9ab01bda P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:09.366444 23509 leader_election.cc:290] T 9d57b510cd3745fabb0748a6f9008fca P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Requested vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:09.366166 23525 raft_consensus.cc:515] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:09.367985 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d57b510cd3745fabb0748a6f9008fca" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:09.368184 23431 consensus_queue.cc:260] T 3fb3705cd5724f208798f30d9ab01bda P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:09.368652 23161 raft_consensus.cc:3060] T 9d57b510cd3745fabb0748a6f9008fca P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:09.371153 23431 ts_tablet_manager.cc:1434] T 3fb3705cd5724f208798f30d9ab01bda P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.006s
I20260709 12:12:09.371101 23235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7193dd2dee9c4d1c9992ad4eff434b59" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:09.351136 23450 raft_consensus.cc:493] T 3243e85ef0e741d696af414124ca96bd P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.374241 23431 tablet_bootstrap.cc:492] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:09.372073 23525 leader_election.cc:290] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Requested vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:09.405633 23430 tablet_bootstrap.cc:492] T 162d91be31a64ad688b7b433392ed1a2 P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:09.394011 23429 tablet_bootstrap.cc:654] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:09.431497 23430 ts_tablet_manager.cc:1403] T 162d91be31a64ad688b7b433392ed1a2 P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.163s	user 0.016s	sys 0.020s
I20260709 12:12:09.374207 23235 raft_consensus.cc:3060] T 7193dd2dee9c4d1c9992ad4eff434b59 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:09.437424 23540 raft_consensus.cc:493] T 1f5cfd203dcc43d4a86864c2eaaf234c P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.407491 23161 raft_consensus.cc:2468] T 9d57b510cd3745fabb0748a6f9008fca P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 1.
I20260709 12:12:09.443801 23540 raft_consensus.cc:515] T 1f5cfd203dcc43d4a86864c2eaaf234c P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:09.444934 23348 leader_election.cc:304] T 9d57b510cd3745fabb0748a6f9008fca P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, 48bc58ace75f40e995efc1edcefe79fa; no voters: 
W20260709 12:12:09.373543 23276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:41907, user_credentials={real_user=slave}} blocked reactor thread for 54430.4us
I20260709 12:12:09.446899 23159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5cfd203dcc43d4a86864c2eaaf234c" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
W20260709 12:12:09.448271 23200 leader_election.cc:343] T 1f5cfd203dcc43d4a86864c2eaaf234c P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:09.379420 23160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7193dd2dee9c4d1c9992ad4eff434b59" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:09.451972 23540 leader_election.cc:290] T 1f5cfd203dcc43d4a86864c2eaaf234c P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
W20260709 12:12:09.452595 23348 leader_election.cc:343] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:09.374392 23274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:42187, user_credentials={real_user=slave}} blocked reactor thread for 72191.4us
I20260709 12:12:09.453132 23429 tablet_bootstrap.cc:492] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:09.453653 23429 ts_tablet_manager.cc:1403] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.130s	user 0.009s	sys 0.009s
I20260709 12:12:09.400022 23499 consensus_queue.cc:1048] T d53aaedd982440259b3ef5d84cddcbed P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.054s
I20260709 12:12:09.453864 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac0ace3682c4f29b9e5ecad75f783f7" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:09.454346 23159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac0ace3682c4f29b9e5ecad75f783f7" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:09.454530 23236 raft_consensus.cc:2468] T 8ac0ace3682c4f29b9e5ecad75f783f7 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 0.
I20260709 12:12:09.455010 23159 raft_consensus.cc:2468] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 0.
I20260709 12:12:09.456388 23429 raft_consensus.cc:359] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:09.456738 23536 consensus_queue.cc:1048] T 3243e85ef0e741d696af414124ca96bd P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:09.457098 23429 raft_consensus.cc:385] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:09.457446 23429 raft_consensus.cc:740] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:09.451047 23525 raft_consensus.cc:2804] T 9d57b510cd3745fabb0748a6f9008fca P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:09.458309 23429 consensus_queue.cc:260] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:09.459638 23430 raft_consensus.cc:359] T 162d91be31a64ad688b7b433392ed1a2 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:09.374132 23450 raft_consensus.cc:515] T 3243e85ef0e741d696af414124ca96bd P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:09.461673 23430 raft_consensus.cc:385] T 162d91be31a64ad688b7b433392ed1a2 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:09.394331 23520 raft_consensus.cc:515] T 3fb3705cd5724f208798f30d9ab01bda P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:09.462754 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d57b510cd3745fabb0748a6f9008fca" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
W20260709 12:12:09.457167 23200 consensus_peers.cc:597] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:09.472719 23310 raft_consensus.cc:3060] T 9d57b510cd3745fabb0748a6f9008fca P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:09.470718 23276 leader_election.cc:304] T 8ac0ace3682c4f29b9e5ecad75f783f7 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:09.473943 23433 tablet_bootstrap.cc:492] T ec1028a2affb45679aede72149f857f5 P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:09.474291 23536 raft_consensus.cc:2804] T 8ac0ace3682c4f29b9e5ecad75f783f7 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:09.474421 23433 ts_tablet_manager.cc:1403] T ec1028a2affb45679aede72149f857f5 P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.223s	user 0.010s	sys 0.006s
I20260709 12:12:09.474740 23536 raft_consensus.cc:493] T 8ac0ace3682c4f29b9e5ecad75f783f7 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:09.475099 23536 raft_consensus.cc:3060] T 8ac0ace3682c4f29b9e5ecad75f783f7 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:09.475925 23429 ts_tablet_manager.cc:1434] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:12:09.476882 23429 tablet_bootstrap.cc:492] T a7d44e74deb341179f886489282ced2f P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:09.477200 23433 raft_consensus.cc:359] T ec1028a2affb45679aede72149f857f5 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:09.477890 23433 raft_consensus.cc:385] T ec1028a2affb45679aede72149f857f5 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:09.478153 23433 raft_consensus.cc:740] T ec1028a2affb45679aede72149f857f5 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:09.479266 23433 consensus_queue.cc:260] T ec1028a2affb45679aede72149f857f5 P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:09.480633 23450 leader_election.cc:290] T 3243e85ef0e741d696af414124ca96bd P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:09.484627 23310 raft_consensus.cc:2468] T 9d57b510cd3745fabb0748a6f9008fca P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 1.
I20260709 12:12:09.486876 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3243e85ef0e741d696af414124ca96bd" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:09.471936 23525 raft_consensus.cc:697] T 9d57b510cd3745fabb0748a6f9008fca P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Becoming Leader. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Running, Role: LEADER
I20260709 12:12:09.481685 23433 ts_tablet_manager.cc:1434] T ec1028a2affb45679aede72149f857f5 P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:12:09.495609 23384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb3705cd5724f208798f30d9ab01bda" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:09.496307 23384 raft_consensus.cc:3060] T 3fb3705cd5724f208798f30d9ab01bda P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:09.496455 23433 tablet_bootstrap.cc:492] T e53f580024c14b33b72266b89a1ab8e3 P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:09.489967 23232 raft_consensus.cc:3060] T ec1028a2affb45679aede72149f857f5 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:09.497898 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5cfd203dcc43d4a86864c2eaaf234c" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:09.485739 23437 raft_consensus.cc:493] T 3fb3705cd5724f208798f30d9ab01bda P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.502416 23437 raft_consensus.cc:515] T 3fb3705cd5724f208798f30d9ab01bda P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:09.486315 23429 tablet_bootstrap.cc:654] T a7d44e74deb341179f886489282ced2f P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:09.491849 23309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3243e85ef0e741d696af414124ca96bd" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
W20260709 12:12:09.462707 23274 leader_election.cc:343] T 3fb3705cd5724f208798f30d9ab01bda P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:09.471916 23430 raft_consensus.cc:740] T 162d91be31a64ad688b7b433392ed1a2 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:09.505596 23437 leader_election.cc:290] T 3fb3705cd5724f208798f30d9ab01bda P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:09.471442 23431 tablet_bootstrap.cc:654] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:09.508194 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb3705cd5724f208798f30d9ab01bda" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:09.520545 23430 consensus_queue.cc:260] T 162d91be31a64ad688b7b433392ed1a2 P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:09.522481 23429 tablet_bootstrap.cc:492] T a7d44e74deb341179f886489282ced2f P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:09.522707 23430 ts_tablet_manager.cc:1434] T 162d91be31a64ad688b7b433392ed1a2 P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.091s	user 0.005s	sys 0.003s
I20260709 12:12:09.523185 23429 ts_tablet_manager.cc:1403] T a7d44e74deb341179f886489282ced2f P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.046s	user 0.007s	sys 0.014s
I20260709 12:12:09.523706 23430 tablet_bootstrap.cc:492] T b4c15adbbcbc4dbb9162ef9af4e14477 P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:09.511247 23520 leader_election.cc:290] T 3fb3705cd5724f208798f30d9ab01bda P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Requested vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:09.512415 23384 raft_consensus.cc:2468] T 3fb3705cd5724f208798f30d9ab01bda P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 1.
I20260709 12:12:09.500594 23057 catalog_manager.cc:5697] T 2954a8837137444496d21a25638b3f2a P a9d87b20401744c7bd0c491f60cf0689 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "a9d87b20401744c7bd0c491f60cf0689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:09.526069 23509 consensus_queue.cc:1048] T ec1028a2affb45679aede72149f857f5 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:09.529757 23433 tablet_bootstrap.cc:654] T e53f580024c14b33b72266b89a1ab8e3 P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:09.528407 23201 leader_election.cc:343] T 1f5cfd203dcc43d4a86864c2eaaf234c P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:09.527913 23273 leader_election.cc:304] T 3fb3705cd5724f208798f30d9ab01bda P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689; no voters: 
I20260709 12:12:09.531338 23201 leader_election.cc:304] T 1f5cfd203dcc43d4a86864c2eaaf234c P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abe65f4962e147ac841608b6c30f7e1b; no voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689
I20260709 12:12:09.529754 23429 raft_consensus.cc:359] T a7d44e74deb341179f886489282ced2f P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:09.532352 23429 raft_consensus.cc:385] T a7d44e74deb341179f886489282ced2f P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:09.527254 23057 catalog_manager.cc:5697] T 11b1c6ca5b8b4d61a6e200744c543ede P a9d87b20401744c7bd0c491f60cf0689 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "a9d87b20401744c7bd0c491f60cf0689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:09.532769 23429 raft_consensus.cc:740] T a7d44e74deb341179f886489282ced2f P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:09.533308 23450 raft_consensus.cc:2749] T 1f5cfd203dcc43d4a86864c2eaaf234c P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:09.532586 23201 leader_election.cc:304] T 3243e85ef0e741d696af414124ca96bd P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abe65f4962e147ac841608b6c30f7e1b; no voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689
I20260709 12:12:09.533738 23429 consensus_queue.cc:260] T a7d44e74deb341179f886489282ced2f P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:09.535261 23450 raft_consensus.cc:2749] T 3243e85ef0e741d696af414124ca96bd P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:09.502974 23525 consensus_queue.cc:237] T 9d57b510cd3745fabb0748a6f9008fca P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:09.541103 23518 raft_consensus.cc:2804] T 3fb3705cd5724f208798f30d9ab01bda P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:09.542616 23518 raft_consensus.cc:697] T 3fb3705cd5724f208798f30d9ab01bda P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Becoming Leader. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Running, Role: LEADER
I20260709 12:12:09.543635 23518 consensus_queue.cc:237] T 3fb3705cd5724f208798f30d9ab01bda P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:09.544454 23536 raft_consensus.cc:515] T 8ac0ace3682c4f29b9e5ecad75f783f7 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
W20260709 12:12:09.540791 23274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:42187, user_credentials={real_user=slave}} blocked reactor thread for 78156.8us
I20260709 12:12:09.514575 23235 raft_consensus.cc:2468] T 7193dd2dee9c4d1c9992ad4eff434b59 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 1.
I20260709 12:12:09.549577 23430 tablet_bootstrap.cc:654] T b4c15adbbcbc4dbb9162ef9af4e14477 P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:09.546633 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb3705cd5724f208798f30d9ab01bda" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:09.550879 23429 ts_tablet_manager.cc:1434] T a7d44e74deb341179f886489282ced2f P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.001s
I20260709 12:12:09.552759 23429 tablet_bootstrap.cc:492] T 1f5cfd203dcc43d4a86864c2eaaf234c P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:09.547326 23536 leader_election.cc:290] T 8ac0ace3682c4f29b9e5ecad75f783f7 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Requested vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:09.553361 23350 leader_election.cc:304] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, abe65f4962e147ac841608b6c30f7e1b; no voters: 3824bca1df8e4020b18c7989f7758391
I20260709 12:12:09.554139 23509 raft_consensus.cc:2804] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:09.554670 23509 raft_consensus.cc:697] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Becoming Leader. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Running, Role: LEADER
I20260709 12:12:09.557436 23509 consensus_queue.cc:237] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:09.547817 23520 consensus_queue.cc:1048] T 2693b48366d0430b9db7d8cc90d9667c P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:12:09.574385 23126 leader_election.cc:304] T 3fb3705cd5724f208798f30d9ab01bda P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391; no voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689
I20260709 12:12:09.583614 23545 raft_consensus.cc:2749] T 3fb3705cd5724f208798f30d9ab01bda P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:09.573967 23235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac0ace3682c4f29b9e5ecad75f783f7" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:09.586900 23235 raft_consensus.cc:3060] T 8ac0ace3682c4f29b9e5ecad75f783f7 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:09.596287 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fb3705cd5724f208798f30d9ab01bda" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:09.596933 23161 raft_consensus.cc:3060] T 3fb3705cd5724f208798f30d9ab01bda P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:09.598310 23429 tablet_bootstrap.cc:654] T 1f5cfd203dcc43d4a86864c2eaaf234c P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:09.617643 23429 tablet_bootstrap.cc:492] T 1f5cfd203dcc43d4a86864c2eaaf234c P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:09.618152 23429 ts_tablet_manager.cc:1403] T 1f5cfd203dcc43d4a86864c2eaaf234c P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.066s	user 0.014s	sys 0.000s
I20260709 12:12:09.621513 23059 catalog_manager.cc:5697] T 9d57b510cd3745fabb0748a6f9008fca P 48bc58ace75f40e995efc1edcefe79fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196). New cstate: current_term: 1 leader_uuid: "48bc58ace75f40e995efc1edcefe79fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:09.625480 23161 raft_consensus.cc:2468] T 3fb3705cd5724f208798f30d9ab01bda P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 1.
I20260709 12:12:09.626873 23159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac0ace3682c4f29b9e5ecad75f783f7" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:09.627480 23159 raft_consensus.cc:3060] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:09.628019 23429 raft_consensus.cc:359] T 1f5cfd203dcc43d4a86864c2eaaf234c P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:09.628700 23429 raft_consensus.cc:385] T 1f5cfd203dcc43d4a86864c2eaaf234c P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:09.628948 23429 raft_consensus.cc:740] T 1f5cfd203dcc43d4a86864c2eaaf234c P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:09.629596 23429 consensus_queue.cc:260] T 1f5cfd203dcc43d4a86864c2eaaf234c P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:09.631737 23429 ts_tablet_manager.cc:1434] T 1f5cfd203dcc43d4a86864c2eaaf234c P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:12:09.632680 23429 tablet_bootstrap.cc:492] T b4c15adbbcbc4dbb9162ef9af4e14477 P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:09.634871 23433 tablet_bootstrap.cc:492] T e53f580024c14b33b72266b89a1ab8e3 P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:09.635388 23433 ts_tablet_manager.cc:1403] T e53f580024c14b33b72266b89a1ab8e3 P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.139s	user 0.043s	sys 0.021s
I20260709 12:12:09.636765 23235 raft_consensus.cc:2468] T 8ac0ace3682c4f29b9e5ecad75f783f7 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 1.
I20260709 12:12:09.638329 23433 raft_consensus.cc:359] T e53f580024c14b33b72266b89a1ab8e3 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:09.638576 23276 leader_election.cc:304] T 8ac0ace3682c4f29b9e5ecad75f783f7 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:09.639549 23159 raft_consensus.cc:2468] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 1.
I20260709 12:12:09.639768 23518 raft_consensus.cc:2804] T 8ac0ace3682c4f29b9e5ecad75f783f7 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:09.648623 23518 raft_consensus.cc:697] T 8ac0ace3682c4f29b9e5ecad75f783f7 P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Becoming Leader. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Running, Role: LEADER
I20260709 12:12:09.649513 23518 consensus_queue.cc:237] T 8ac0ace3682c4f29b9e5ecad75f783f7 P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:09.641716 23541 consensus_queue.cc:1048] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:09.642828 23431 tablet_bootstrap.cc:492] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:09.658617 23431 ts_tablet_manager.cc:1403] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.285s	user 0.015s	sys 0.021s
I20260709 12:12:09.668143 23429 tablet_bootstrap.cc:654] T b4c15adbbcbc4dbb9162ef9af4e14477 P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:09.658911 23477 consensus_queue.cc:1048] T ec1028a2affb45679aede72149f857f5 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 12:12:09.667375 23520 consensus_queue.cc:1048] T 2693b48366d0430b9db7d8cc90d9667c P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:12:09.680339 23431 raft_consensus.cc:359] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:09.680999 23431 raft_consensus.cc:385] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:09.681263 23431 raft_consensus.cc:740] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:09.682055 23431 consensus_queue.cc:260] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:09.685087 23431 ts_tablet_manager.cc:1434] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:12:09.685972 23431 tablet_bootstrap.cc:492] T 7193dd2dee9c4d1c9992ad4eff434b59 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:09.691731 23431 tablet_bootstrap.cc:654] T 7193dd2dee9c4d1c9992ad4eff434b59 P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:09.698632 23057 catalog_manager.cc:5697] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196). New cstate: current_term: 1 leader_uuid: "48bc58ace75f40e995efc1edcefe79fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:09.639065 23433 raft_consensus.cc:385] T e53f580024c14b33b72266b89a1ab8e3 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:09.647608 23310 raft_consensus.cc:3060] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:09.703312 23431 tablet_bootstrap.cc:492] T 7193dd2dee9c4d1c9992ad4eff434b59 P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:09.703806 23431 ts_tablet_manager.cc:1403] T 7193dd2dee9c4d1c9992ad4eff434b59 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.007s
I20260709 12:12:09.706717 23431 raft_consensus.cc:359] T 7193dd2dee9c4d1c9992ad4eff434b59 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:09.707386 23431 raft_consensus.cc:385] T 7193dd2dee9c4d1c9992ad4eff434b59 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:09.707666 23431 raft_consensus.cc:740] T 7193dd2dee9c4d1c9992ad4eff434b59 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:09.710232 23482 raft_consensus.cc:493] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.710172 23431 consensus_queue.cc:260] T 7193dd2dee9c4d1c9992ad4eff434b59 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:09.710846 23433 raft_consensus.cc:740] T e53f580024c14b33b72266b89a1ab8e3 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:09.710820 23482 raft_consensus.cc:515] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:09.712728 23431 ts_tablet_manager.cc:1434] T 7193dd2dee9c4d1c9992ad4eff434b59 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:12:09.712584 23433 consensus_queue.cc:260] T e53f580024c14b33b72266b89a1ab8e3 P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:09.713636 23431 tablet_bootstrap.cc:492] T 1f5cfd203dcc43d4a86864c2eaaf234c P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:09.714283 23430 tablet_bootstrap.cc:492] T b4c15adbbcbc4dbb9162ef9af4e14477 P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:09.714775 23430 ts_tablet_manager.cc:1403] T b4c15adbbcbc4dbb9162ef9af4e14477 P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.191s	user 0.012s	sys 0.004s
I20260709 12:12:09.717921 23482 leader_election.cc:290] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:09.718160 23384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be6b80356b0415ba28a56482e13d24f" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:09.718502 23477 consensus_queue.cc:1048] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:09.719720 23431 tablet_bootstrap.cc:654] T 1f5cfd203dcc43d4a86864c2eaaf234c P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:09.720062 23433 ts_tablet_manager.cc:1434] T e53f580024c14b33b72266b89a1ab8e3 P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.084s	user 0.007s	sys 0.000s
I20260709 12:12:09.721680 23430 raft_consensus.cc:359] T b4c15adbbcbc4dbb9162ef9af4e14477 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:09.722357 23430 raft_consensus.cc:385] T b4c15adbbcbc4dbb9162ef9af4e14477 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:09.722675 23430 raft_consensus.cc:740] T b4c15adbbcbc4dbb9162ef9af4e14477 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:09.723722 23482 consensus_queue.cc:1048] T 11b1c6ca5b8b4d61a6e200744c543ede P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:09.733973 23430 consensus_queue.cc:260] T b4c15adbbcbc4dbb9162ef9af4e14477 P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:09.736744 23429 tablet_bootstrap.cc:492] T b4c15adbbcbc4dbb9162ef9af4e14477 P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:09.737315 23429 ts_tablet_manager.cc:1403] T b4c15adbbcbc4dbb9162ef9af4e14477 P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.105s	user 0.013s	sys 0.004s
I20260709 12:12:09.737797 23430 ts_tablet_manager.cc:1434] T b4c15adbbcbc4dbb9162ef9af4e14477 P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:12:09.738772 23430 tablet_bootstrap.cc:492] T d53aaedd982440259b3ef5d84cddcbed P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:09.740427 23429 raft_consensus.cc:359] T b4c15adbbcbc4dbb9162ef9af4e14477 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:09.743477 23429 raft_consensus.cc:385] T b4c15adbbcbc4dbb9162ef9af4e14477 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:09.745707 23429 raft_consensus.cc:740] T b4c15adbbcbc4dbb9162ef9af4e14477 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:09.746678 23429 consensus_queue.cc:260] T b4c15adbbcbc4dbb9162ef9af4e14477 P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:09.751377 23430 tablet_bootstrap.cc:654] T d53aaedd982440259b3ef5d84cddcbed P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:09.751164 23518 consensus_queue.cc:1048] T 2954a8837137444496d21a25638b3f2a P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:09.753094 23235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be6b80356b0415ba28a56482e13d24f" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:09.757351 23235 raft_consensus.cc:2468] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 1.
I20260709 12:12:09.754711 23433 tablet_bootstrap.cc:492] T 2d308deadcb9416c9b0b16ef4891e6eb P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:09.756713 23429 ts_tablet_manager.cc:1434] T b4c15adbbcbc4dbb9162ef9af4e14477 P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:12:09.763002 23540 raft_consensus.cc:493] T e53f580024c14b33b72266b89a1ab8e3 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.763501 23540 raft_consensus.cc:515] T e53f580024c14b33b72266b89a1ab8e3 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:09.765580 23540 leader_election.cc:290] T e53f580024c14b33b72266b89a1ab8e3 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:09.759074 23276 leader_election.cc:304] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b; no voters: 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:09.767015 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e53f580024c14b33b72266b89a1ab8e3" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:09.768020 23518 raft_consensus.cc:2804] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:09.768401 23518 raft_consensus.cc:493] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 48bc58ace75f40e995efc1edcefe79fa)
I20260709 12:12:09.768772 23518 raft_consensus.cc:3060] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:09.772292 23384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e53f580024c14b33b72266b89a1ab8e3" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:09.770709 23429 tablet_bootstrap.cc:492] T 2d308deadcb9416c9b0b16ef4891e6eb P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:09.774315 23199 leader_election.cc:304] T e53f580024c14b33b72266b89a1ab8e3 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abe65f4962e147ac841608b6c30f7e1b; no voters: 3824bca1df8e4020b18c7989f7758391, 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:09.775535 23540 raft_consensus.cc:2749] T e53f580024c14b33b72266b89a1ab8e3 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:09.785101 23436 consensus_queue.cc:1048] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:09.781325 23518 raft_consensus.cc:515] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:09.787473 23520 consensus_queue.cc:1048] T 11b1c6ca5b8b4d61a6e200744c543ede P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:09.787137 23058 catalog_manager.cc:5697] T 3fb3705cd5724f208798f30d9ab01bda P a9d87b20401744c7bd0c491f60cf0689 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "a9d87b20401744c7bd0c491f60cf0689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:09.789112 23429 tablet_bootstrap.cc:654] T 2d308deadcb9416c9b0b16ef4891e6eb P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:09.789191 23058 catalog_manager.cc:5697] T 8ac0ace3682c4f29b9e5ecad75f783f7 P a9d87b20401744c7bd0c491f60cf0689 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "a9d87b20401744c7bd0c491f60cf0689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:09.792425 23433 tablet_bootstrap.cc:654] T 2d308deadcb9416c9b0b16ef4891e6eb P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:09.794986 23518 leader_election.cc:290] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 2 election: Requested vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:09.796039 23384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be6b80356b0415ba28a56482e13d24f" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:09.798961 23431 tablet_bootstrap.cc:492] T 1f5cfd203dcc43d4a86864c2eaaf234c P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:09.799450 23431 ts_tablet_manager.cc:1403] T 1f5cfd203dcc43d4a86864c2eaaf234c P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.086s	user 0.028s	sys 0.007s
I20260709 12:12:09.799850 23310 raft_consensus.cc:1240] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Rejecting Update request from peer 48bc58ace75f40e995efc1edcefe79fa for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:09.802094 23431 raft_consensus.cc:359] T 1f5cfd203dcc43d4a86864c2eaaf234c P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:09.802297 23477 consensus_queue.cc:1059] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:09.802811 23431 raft_consensus.cc:385] T 1f5cfd203dcc43d4a86864c2eaaf234c P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:09.803181 23477 raft_consensus.cc:3055] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:09.803604 23477 raft_consensus.cc:740] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Running, Role: LEADER
I20260709 12:12:09.804450 23477 consensus_queue.cc:260] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:09.805557 23477 raft_consensus.cc:3060] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:09.808493 23482 consensus_queue.cc:1048] T 2954a8837137444496d21a25638b3f2a P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:09.812693 23429 tablet_bootstrap.cc:492] T 2d308deadcb9416c9b0b16ef4891e6eb P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:09.813197 23429 ts_tablet_manager.cc:1403] T 2d308deadcb9416c9b0b16ef4891e6eb P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.000s
I20260709 12:12:09.803162 23431 raft_consensus.cc:740] T 1f5cfd203dcc43d4a86864c2eaaf234c P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:09.813978 23235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be6b80356b0415ba28a56482e13d24f" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:09.814817 23431 consensus_queue.cc:260] T 1f5cfd203dcc43d4a86864c2eaaf234c P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:09.815557 23276 leader_election.cc:304] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689; no voters: 48bc58ace75f40e995efc1edcefe79fa, abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:09.817174 23433 tablet_bootstrap.cc:492] T 2d308deadcb9416c9b0b16ef4891e6eb P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:09.817396 23518 raft_consensus.cc:2749] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:09.817641 23433 ts_tablet_manager.cc:1403] T 2d308deadcb9416c9b0b16ef4891e6eb P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.063s	user 0.011s	sys 0.000s
I20260709 12:12:09.818421 23431 ts_tablet_manager.cc:1434] T 1f5cfd203dcc43d4a86864c2eaaf234c P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:12:09.821789 23431 tablet_bootstrap.cc:492] T 5d0efec949fc4455838db7fb01259d69 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:09.822414 23429 raft_consensus.cc:359] T 2d308deadcb9416c9b0b16ef4891e6eb P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:09.823117 23429 raft_consensus.cc:385] T 2d308deadcb9416c9b0b16ef4891e6eb P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:09.823378 23429 raft_consensus.cc:740] T 2d308deadcb9416c9b0b16ef4891e6eb P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:09.824152 23518 raft_consensus.cc:493] T a7d44e74deb341179f886489282ced2f P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.824119 23429 consensus_queue.cc:260] T 2d308deadcb9416c9b0b16ef4891e6eb P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:09.824746 23518 raft_consensus.cc:515] T a7d44e74deb341179f886489282ced2f P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:09.820396 23433 raft_consensus.cc:359] T 2d308deadcb9416c9b0b16ef4891e6eb P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:09.826536 23429 ts_tablet_manager.cc:1434] T 2d308deadcb9416c9b0b16ef4891e6eb P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:12:09.826799 23433 raft_consensus.cc:385] T 2d308deadcb9416c9b0b16ef4891e6eb P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:09.827018 23518 leader_election.cc:290] T a7d44e74deb341179f886489282ced2f P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:09.827131 23433 raft_consensus.cc:740] T 2d308deadcb9416c9b0b16ef4891e6eb P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:09.827855 23429 tablet_bootstrap.cc:492] T c880cf7f327c4b709c29dd91c8645c18 P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:09.828029 23433 consensus_queue.cc:260] T 2d308deadcb9416c9b0b16ef4891e6eb P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:09.830188 23433 ts_tablet_manager.cc:1434] T 2d308deadcb9416c9b0b16ef4891e6eb P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:12:09.830971 23433 tablet_bootstrap.cc:492] T c880cf7f327c4b709c29dd91c8645c18 P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:09.831003 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d44e74deb341179f886489282ced2f" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
W20260709 12:12:09.832248 23274 leader_election.cc:343] T a7d44e74deb341179f886489282ced2f P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:09.832376 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d44e74deb341179f886489282ced2f" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
W20260709 12:12:09.833880 23273 leader_election.cc:343] T a7d44e74deb341179f886489282ced2f P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:09.834412 23273 leader_election.cc:304] T a7d44e74deb341179f886489282ced2f P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689; no voters: 3824bca1df8e4020b18c7989f7758391, 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:09.835628 23437 raft_consensus.cc:493] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.835686 23518 raft_consensus.cc:2749] T a7d44e74deb341179f886489282ced2f P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:09.836229 23437 raft_consensus.cc:515] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:09.838188 23437 leader_election.cc:290] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:09.835713 23477 raft_consensus.cc:493] T b4c15adbbcbc4dbb9162ef9af4e14477 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.839187 23477 raft_consensus.cc:515] T b4c15adbbcbc4dbb9162ef9af4e14477 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:09.839854 23235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162d91be31a64ad688b7b433392ed1a2" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:09.840197 23429 tablet_bootstrap.cc:654] T c880cf7f327c4b709c29dd91c8645c18 P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:09.841199 23127 leader_election.cc:343] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:09.841373 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162d91be31a64ad688b7b433392ed1a2" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:09.842080 23383 raft_consensus.cc:2468] T 162d91be31a64ad688b7b433392ed1a2 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 0.
I20260709 12:12:09.844555 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4c15adbbcbc4dbb9162ef9af4e14477" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:09.845276 23310 raft_consensus.cc:2468] T b4c15adbbcbc4dbb9162ef9af4e14477 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 0.
I20260709 12:12:09.846588 23349 leader_election.cc:304] T b4c15adbbcbc4dbb9162ef9af4e14477 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689; no voters: 
I20260709 12:12:09.842525 23235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4c15adbbcbc4dbb9162ef9af4e14477" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:09.847862 23436 raft_consensus.cc:2804] T b4c15adbbcbc4dbb9162ef9af4e14477 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:09.848255 23436 raft_consensus.cc:493] T b4c15adbbcbc4dbb9162ef9af4e14477 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:09.843663 23431 tablet_bootstrap.cc:654] T 5d0efec949fc4455838db7fb01259d69 P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:09.848600 23350 leader_election.cc:343] T b4c15adbbcbc4dbb9162ef9af4e14477 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:09.848585 23436 raft_consensus.cc:3060] T b4c15adbbcbc4dbb9162ef9af4e14477 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:09.845162 23124 leader_election.cc:304] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, 48bc58ace75f40e995efc1edcefe79fa; no voters: abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:09.850906 23437 raft_consensus.cc:2804] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:09.851256 23437 raft_consensus.cc:493] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:09.851336 23429 tablet_bootstrap.cc:492] T c880cf7f327c4b709c29dd91c8645c18 P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:09.851646 23437 raft_consensus.cc:3060] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:09.851939 23429 ts_tablet_manager.cc:1403] T c880cf7f327c4b709c29dd91c8645c18 P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.002s
I20260709 12:12:09.852731 23430 tablet_bootstrap.cc:492] T d53aaedd982440259b3ef5d84cddcbed P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:09.853161 23430 ts_tablet_manager.cc:1403] T d53aaedd982440259b3ef5d84cddcbed P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.115s	user 0.024s	sys 0.008s
I20260709 12:12:09.854682 23429 raft_consensus.cc:359] T c880cf7f327c4b709c29dd91c8645c18 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:09.855940 23429 raft_consensus.cc:385] T c880cf7f327c4b709c29dd91c8645c18 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:09.856300 23429 raft_consensus.cc:740] T c880cf7f327c4b709c29dd91c8645c18 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:09.843436 23477 leader_election.cc:290] T b4c15adbbcbc4dbb9162ef9af4e14477 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:09.857172 23429 consensus_queue.cc:260] T c880cf7f327c4b709c29dd91c8645c18 P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:09.856541 23436 raft_consensus.cc:515] T b4c15adbbcbc4dbb9162ef9af4e14477 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:09.860889 23429 ts_tablet_manager.cc:1434] T c880cf7f327c4b709c29dd91c8645c18 P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:12:09.861907 23232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4c15adbbcbc4dbb9162ef9af4e14477" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:09.861793 23437 raft_consensus.cc:515] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:09.862447 23431 tablet_bootstrap.cc:492] T 5d0efec949fc4455838db7fb01259d69 P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:09.861855 23429 tablet_bootstrap.cc:492] T 1b4285f9faa34fc595e0b7db3f7f0946 P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
W20260709 12:12:09.863950 23350 leader_election.cc:343] T b4c15adbbcbc4dbb9162ef9af4e14477 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:09.865432 23430 raft_consensus.cc:359] T d53aaedd982440259b3ef5d84cddcbed P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:09.866223 23430 raft_consensus.cc:385] T d53aaedd982440259b3ef5d84cddcbed P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:09.866496 23430 raft_consensus.cc:740] T d53aaedd982440259b3ef5d84cddcbed P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:09.867250 23437 leader_election.cc:290] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 election: Requested vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:09.865361 23433 tablet_bootstrap.cc:654] T c880cf7f327c4b709c29dd91c8645c18 P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:09.868023 23431 ts_tablet_manager.cc:1403] T 5d0efec949fc4455838db7fb01259d69 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.002s
I20260709 12:12:09.868870 23429 tablet_bootstrap.cc:654] T 1b4285f9faa34fc595e0b7db3f7f0946 P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:09.868754 23232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162d91be31a64ad688b7b433392ed1a2" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:09.869621 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4c15adbbcbc4dbb9162ef9af4e14477" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:09.872169 23310 raft_consensus.cc:3060] T b4c15adbbcbc4dbb9162ef9af4e14477 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:09.872745 23127 leader_election.cc:343] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:09.869556 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162d91be31a64ad688b7b433392ed1a2" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:09.873684 23431 raft_consensus.cc:359] T 5d0efec949fc4455838db7fb01259d69 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:09.874289 23383 raft_consensus.cc:3060] T 162d91be31a64ad688b7b433392ed1a2 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:09.874370 23431 raft_consensus.cc:385] T 5d0efec949fc4455838db7fb01259d69 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:09.874845 23431 raft_consensus.cc:740] T 5d0efec949fc4455838db7fb01259d69 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:09.875563 23431 consensus_queue.cc:260] T 5d0efec949fc4455838db7fb01259d69 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:09.877574 23431 ts_tablet_manager.cc:1434] T 5d0efec949fc4455838db7fb01259d69 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:12:09.878422 23431 tablet_bootstrap.cc:492] T 1b4285f9faa34fc595e0b7db3f7f0946 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:09.879002 23310 raft_consensus.cc:2468] T b4c15adbbcbc4dbb9162ef9af4e14477 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 1.
I20260709 12:12:09.880147 23349 leader_election.cc:304] T b4c15adbbcbc4dbb9162ef9af4e14477 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689; no voters: abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:09.881003 23477 raft_consensus.cc:2804] T b4c15adbbcbc4dbb9162ef9af4e14477 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:09.881539 23477 raft_consensus.cc:697] T b4c15adbbcbc4dbb9162ef9af4e14477 P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Becoming Leader. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Running, Role: LEADER
I20260709 12:12:09.882457 23159 raft_consensus.cc:3060] T 5d0efec949fc4455838db7fb01259d69 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:09.882392 23477 consensus_queue.cc:237] T b4c15adbbcbc4dbb9162ef9af4e14477 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:09.884550 23431 tablet_bootstrap.cc:654] T 1b4285f9faa34fc595e0b7db3f7f0946 P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:09.886051 23383 raft_consensus.cc:2468] T 162d91be31a64ad688b7b433392ed1a2 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 1.
I20260709 12:12:09.887238 23124 leader_election.cc:304] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, 48bc58ace75f40e995efc1edcefe79fa; no voters: abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:09.888620 23545 raft_consensus.cc:2804] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:09.889074 23545 raft_consensus.cc:697] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391 [term 1 LEADER]: Becoming Leader. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Running, Role: LEADER
I20260709 12:12:09.889950 23545 consensus_queue.cc:237] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:09.870842 23436 leader_election.cc:290] T b4c15adbbcbc4dbb9162ef9af4e14477 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Requested vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:09.867193 23430 consensus_queue.cc:260] T d53aaedd982440259b3ef5d84cddcbed P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:09.895282 23430 ts_tablet_manager.cc:1434] T d53aaedd982440259b3ef5d84cddcbed P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 12:12:09.896232 23430 tablet_bootstrap.cc:492] T a7d44e74deb341179f886489282ced2f P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:09.910594 23433 tablet_bootstrap.cc:492] T c880cf7f327c4b709c29dd91c8645c18 P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:09.911129 23433 ts_tablet_manager.cc:1403] T c880cf7f327c4b709c29dd91c8645c18 P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.080s	user 0.011s	sys 0.000s
I20260709 12:12:09.915652 23433 raft_consensus.cc:359] T c880cf7f327c4b709c29dd91c8645c18 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:09.916312 23433 raft_consensus.cc:385] T c880cf7f327c4b709c29dd91c8645c18 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:09.916595 23433 raft_consensus.cc:740] T c880cf7f327c4b709c29dd91c8645c18 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:09.920783 23059 catalog_manager.cc:5697] T b4c15adbbcbc4dbb9162ef9af4e14477 P 48bc58ace75f40e995efc1edcefe79fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196). New cstate: current_term: 1 leader_uuid: "48bc58ace75f40e995efc1edcefe79fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:09.925796 23429 tablet_bootstrap.cc:492] T 1b4285f9faa34fc595e0b7db3f7f0946 P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:09.926347 23429 ts_tablet_manager.cc:1403] T 1b4285f9faa34fc595e0b7db3f7f0946 P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.065s	user 0.007s	sys 0.023s
I20260709 12:12:09.927465 23433 consensus_queue.cc:260] T c880cf7f327c4b709c29dd91c8645c18 P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:09.930224 23430 tablet_bootstrap.cc:654] T a7d44e74deb341179f886489282ced2f P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:09.938210 23433 ts_tablet_manager.cc:1434] T c880cf7f327c4b709c29dd91c8645c18 P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:12:09.939203 23433 tablet_bootstrap.cc:492] T 162d91be31a64ad688b7b433392ed1a2 P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:09.939901 23545 raft_consensus.cc:493] T 5d0efec949fc4455838db7fb01259d69 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader abe65f4962e147ac841608b6c30f7e1b)
I20260709 12:12:09.940407 23545 raft_consensus.cc:515] T 5d0efec949fc4455838db7fb01259d69 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:09.943992 23518 raft_consensus.cc:493] T 1f5cfd203dcc43d4a86864c2eaaf234c P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:09.944679 23518 raft_consensus.cc:515] T 1f5cfd203dcc43d4a86864c2eaaf234c P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:09.945600 23232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0efec949fc4455838db7fb01259d69" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:09.947325 23545 leader_election.cc:290] T 5d0efec949fc4455838db7fb01259d69 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:09.929576 23429 raft_consensus.cc:359] T 1b4285f9faa34fc595e0b7db3f7f0946 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:09.944001 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0efec949fc4455838db7fb01259d69" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:09.948133 23429 raft_consensus.cc:385] T 1b4285f9faa34fc595e0b7db3f7f0946 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:09.948482 23429 raft_consensus.cc:740] T 1b4285f9faa34fc595e0b7db3f7f0946 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:09.949206 23429 consensus_queue.cc:260] T 1b4285f9faa34fc595e0b7db3f7f0946 P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:09.951380 23429 ts_tablet_manager.cc:1434] T 1b4285f9faa34fc595e0b7db3f7f0946 P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:12:09.954142 23431 tablet_bootstrap.cc:492] T 1b4285f9faa34fc595e0b7db3f7f0946 P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:09.954617 23431 ts_tablet_manager.cc:1403] T 1b4285f9faa34fc595e0b7db3f7f0946 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.076s	user 0.037s	sys 0.034s
I20260709 12:12:09.953714 23055 catalog_manager.cc:5697] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3824bca1df8e4020b18c7989f7758391 (127.16.98.193). New cstate: current_term: 1 leader_uuid: "3824bca1df8e4020b18c7989f7758391" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:09.956707 23124 leader_election.cc:304] T 5d0efec949fc4455838db7fb01259d69 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391; no voters: 48bc58ace75f40e995efc1edcefe79fa, abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:09.957290 23431 raft_consensus.cc:359] T 1b4285f9faa34fc595e0b7db3f7f0946 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:09.957953 23431 raft_consensus.cc:385] T 1b4285f9faa34fc595e0b7db3f7f0946 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:09.958214 23431 raft_consensus.cc:740] T 1b4285f9faa34fc595e0b7db3f7f0946 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:09.958303 23433 tablet_bootstrap.cc:654] T 162d91be31a64ad688b7b433392ed1a2 P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:09.958952 23431 consensus_queue.cc:260] T 1b4285f9faa34fc595e0b7db3f7f0946 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:09.959311 23545 raft_consensus.cc:2749] T 5d0efec949fc4455838db7fb01259d69 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:09.961021 23431 ts_tablet_manager.cc:1434] T 1b4285f9faa34fc595e0b7db3f7f0946 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 12:12:09.961988 23431 tablet_bootstrap.cc:492] T 7f25493a942c4d96ad5fed839ad58386 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:09.963331 23429 tablet_bootstrap.cc:492] T af6b6c7f82544d968d77f359f1a34403 P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:09.964324 23159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5cfd203dcc43d4a86864c2eaaf234c" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:09.965104 23159 raft_consensus.cc:2468] T 1f5cfd203dcc43d4a86864c2eaaf234c P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 0.
I20260709 12:12:09.966300 23274 leader_election.cc:304] T 1f5cfd203dcc43d4a86864c2eaaf234c P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689; no voters: 
I20260709 12:12:09.967135 23520 raft_consensus.cc:2804] T 1f5cfd203dcc43d4a86864c2eaaf234c P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:09.967490 23520 raft_consensus.cc:493] T 1f5cfd203dcc43d4a86864c2eaaf234c P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:09.967816 23431 tablet_bootstrap.cc:654] T 7f25493a942c4d96ad5fed839ad58386 P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:09.969259 23232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5cfd203dcc43d4a86864c2eaaf234c" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:09.969938 23232 raft_consensus.cc:2468] T 1f5cfd203dcc43d4a86864c2eaaf234c P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 0.
I20260709 12:12:09.970355 23430 tablet_bootstrap.cc:492] T a7d44e74deb341179f886489282ced2f P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:09.970835 23430 ts_tablet_manager.cc:1403] T a7d44e74deb341179f886489282ced2f P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.075s	user 0.012s	sys 0.000s
I20260709 12:12:09.967834 23520 raft_consensus.cc:3060] T 1f5cfd203dcc43d4a86864c2eaaf234c P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:09.974604 23430 raft_consensus.cc:359] T a7d44e74deb341179f886489282ced2f P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:09.980485 23430 raft_consensus.cc:385] T a7d44e74deb341179f886489282ced2f P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:09.980762 23430 raft_consensus.cc:740] T a7d44e74deb341179f886489282ced2f P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:09.981452 23430 consensus_queue.cc:260] T a7d44e74deb341179f886489282ced2f P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:09.983560 23430 ts_tablet_manager.cc:1434] T a7d44e74deb341179f886489282ced2f P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:12:09.969540 23429 tablet_bootstrap.cc:654] T af6b6c7f82544d968d77f359f1a34403 P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:09.987385 23430 tablet_bootstrap.cc:492] T 2d308deadcb9416c9b0b16ef4891e6eb P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:09.987452 23482 consensus_queue.cc:1048] T 3fb3705cd5724f208798f30d9ab01bda P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:09.987923 23477 consensus_queue.cc:1048] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:09.992501 23232 raft_consensus.cc:3060] T e53f580024c14b33b72266b89a1ab8e3 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:09.991673 23518 leader_election.cc:290] T 1f5cfd203dcc43d4a86864c2eaaf234c P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:10.003297 23520 raft_consensus.cc:515] T 1f5cfd203dcc43d4a86864c2eaaf234c P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:10.004238 23431 tablet_bootstrap.cc:492] T 7f25493a942c4d96ad5fed839ad58386 P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:10.004904 23431 ts_tablet_manager.cc:1403] T 7f25493a942c4d96ad5fed839ad58386 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.043s	user 0.016s	sys 0.015s
I20260709 12:12:10.006417 23159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5cfd203dcc43d4a86864c2eaaf234c" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:10.007048 23159 raft_consensus.cc:3060] T 1f5cfd203dcc43d4a86864c2eaaf234c P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:10.015674 23431 raft_consensus.cc:359] T 7f25493a942c4d96ad5fed839ad58386 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:10.016408 23431 raft_consensus.cc:385] T 7f25493a942c4d96ad5fed839ad58386 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:10.016712 23431 raft_consensus.cc:740] T 7f25493a942c4d96ad5fed839ad58386 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:10.017481 23430 tablet_bootstrap.cc:654] T 2d308deadcb9416c9b0b16ef4891e6eb P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:10.017467 23431 consensus_queue.cc:260] T 7f25493a942c4d96ad5fed839ad58386 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:10.016536 23159 raft_consensus.cc:2468] T 1f5cfd203dcc43d4a86864c2eaaf234c P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 1.
I20260709 12:12:10.019311 23274 leader_election.cc:304] T 1f5cfd203dcc43d4a86864c2eaaf234c P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689; no voters: 
I20260709 12:12:10.028244 23433 tablet_bootstrap.cc:492] T 162d91be31a64ad688b7b433392ed1a2 P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:10.028812 23433 ts_tablet_manager.cc:1403] T 162d91be31a64ad688b7b433392ed1a2 P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.090s	user 0.013s	sys 0.005s
I20260709 12:12:10.023927 23518 raft_consensus.cc:2804] T 1f5cfd203dcc43d4a86864c2eaaf234c P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:10.031704 23518 raft_consensus.cc:697] T 1f5cfd203dcc43d4a86864c2eaaf234c P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Becoming Leader. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Running, Role: LEADER
I20260709 12:12:10.033072 23477 consensus_queue.cc:1048] T 9d57b510cd3745fabb0748a6f9008fca P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:10.032903 23518 consensus_queue.cc:237] T 1f5cfd203dcc43d4a86864c2eaaf234c P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:10.034591 23520 leader_election.cc:290] T 1f5cfd203dcc43d4a86864c2eaaf234c P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Requested vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:10.032891 23431 ts_tablet_manager.cc:1434] T 7f25493a942c4d96ad5fed839ad58386 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.001s
I20260709 12:12:10.037065 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5cfd203dcc43d4a86864c2eaaf234c" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:10.037770 23236 raft_consensus.cc:3060] T 1f5cfd203dcc43d4a86864c2eaaf234c P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:10.038975 23431 tablet_bootstrap.cc:492] T c880cf7f327c4b709c29dd91c8645c18 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:10.035993 23433 raft_consensus.cc:359] T 162d91be31a64ad688b7b433392ed1a2 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:10.047514 23431 tablet_bootstrap.cc:654] T c880cf7f327c4b709c29dd91c8645c18 P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:10.042491 23433 raft_consensus.cc:385] T 162d91be31a64ad688b7b433392ed1a2 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:10.052102 23433 raft_consensus.cc:740] T 162d91be31a64ad688b7b433392ed1a2 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:10.058684 23433 consensus_queue.cc:260] T 162d91be31a64ad688b7b433392ed1a2 P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:10.059130 23236 raft_consensus.cc:2468] T 1f5cfd203dcc43d4a86864c2eaaf234c P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 1.
I20260709 12:12:10.060945 23433 ts_tablet_manager.cc:1434] T 162d91be31a64ad688b7b433392ed1a2 P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 12:12:10.061893 23433 tablet_bootstrap.cc:492] T b4c15adbbcbc4dbb9162ef9af4e14477 P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:10.065616 23429 tablet_bootstrap.cc:492] T af6b6c7f82544d968d77f359f1a34403 P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:10.066933 23437 raft_consensus.cc:493] T 7f25493a942c4d96ad5fed839ad58386 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.068638 23433 tablet_bootstrap.cc:654] T b4c15adbbcbc4dbb9162ef9af4e14477 P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:10.069065 23536 consensus_queue.cc:1048] T 3fb3705cd5724f208798f30d9ab01bda P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:10.068774 23429 ts_tablet_manager.cc:1403] T af6b6c7f82544d968d77f359f1a34403 P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.106s	user 0.003s	sys 0.016s
I20260709 12:12:10.073292 23437 raft_consensus.cc:515] T 7f25493a942c4d96ad5fed839ad58386 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:10.079229 23437 leader_election.cc:290] T 7f25493a942c4d96ad5fed839ad58386 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:10.080608 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25493a942c4d96ad5fed839ad58386" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:10.081357 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25493a942c4d96ad5fed839ad58386" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:10.086562 23545 raft_consensus.cc:493] T 7193dd2dee9c4d1c9992ad4eff434b59 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.086918 23430 tablet_bootstrap.cc:492] T 2d308deadcb9416c9b0b16ef4891e6eb P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:10.087412 23430 ts_tablet_manager.cc:1403] T 2d308deadcb9416c9b0b16ef4891e6eb P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.100s	user 0.011s	sys 0.010s
I20260709 12:12:10.087297 23545 raft_consensus.cc:515] T 7193dd2dee9c4d1c9992ad4eff434b59 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:10.094260 23545 leader_election.cc:290] T 7193dd2dee9c4d1c9992ad4eff434b59 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
W20260709 12:12:10.085558 23124 leader_election.cc:343] T 7f25493a942c4d96ad5fed839ad58386 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:10.100075 23127 leader_election.cc:343] T 7f25493a942c4d96ad5fed839ad58386 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:10.100493 23161 raft_consensus.cc:3060] T 7193dd2dee9c4d1c9992ad4eff434b59 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:10.107323 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7193dd2dee9c4d1c9992ad4eff434b59" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:10.117787 23518 consensus_queue.cc:1048] T 8ac0ace3682c4f29b9e5ecad75f783f7 P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:12:10.120085 23127 leader_election.cc:304] T 7f25493a942c4d96ad5fed839ad58386 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391; no voters: 48bc58ace75f40e995efc1edcefe79fa, abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:10.123443 23431 tablet_bootstrap.cc:492] T c880cf7f327c4b709c29dd91c8645c18 P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:10.123916 23431 ts_tablet_manager.cc:1403] T c880cf7f327c4b709c29dd91c8645c18 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.088s	user 0.016s	sys 0.008s
I20260709 12:12:10.124430 23232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7193dd2dee9c4d1c9992ad4eff434b59" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:10.125545 23430 raft_consensus.cc:359] T 2d308deadcb9416c9b0b16ef4891e6eb P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:10.125924 23545 raft_consensus.cc:2749] T 7f25493a942c4d96ad5fed839ad58386 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:10.126222 23430 raft_consensus.cc:385] T 2d308deadcb9416c9b0b16ef4891e6eb P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:10.126677 23430 raft_consensus.cc:740] T 2d308deadcb9416c9b0b16ef4891e6eb P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:10.126287 23431 raft_consensus.cc:359] T c880cf7f327c4b709c29dd91c8645c18 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:10.128034 23431 raft_consensus.cc:385] T c880cf7f327c4b709c29dd91c8645c18 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:10.128317 23431 raft_consensus.cc:740] T c880cf7f327c4b709c29dd91c8645c18 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:10.128361 23430 consensus_queue.cc:260] T 2d308deadcb9416c9b0b16ef4891e6eb P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:10.129125 23431 consensus_queue.cc:260] T c880cf7f327c4b709c29dd91c8645c18 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:10.129439 23509 consensus_queue.cc:1048] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:10.131167 23431 ts_tablet_manager.cc:1434] T c880cf7f327c4b709c29dd91c8645c18 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:12:10.119951 23477 consensus_queue.cc:1048] T 9d57b510cd3745fabb0748a6f9008fca P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:10.132022 23430 ts_tablet_manager.cc:1434] T 2d308deadcb9416c9b0b16ef4891e6eb P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 12:12:10.133301 23431 tablet_bootstrap.cc:492] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:10.135633 23430 tablet_bootstrap.cc:492] T 1b4285f9faa34fc595e0b7db3f7f0946 P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:10.135387 23429 raft_consensus.cc:359] T af6b6c7f82544d968d77f359f1a34403 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:10.136190 23429 raft_consensus.cc:385] T af6b6c7f82544d968d77f359f1a34403 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:10.136570 23429 raft_consensus.cc:740] T af6b6c7f82544d968d77f359f1a34403 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:10.138998 23127 leader_election.cc:304] T 7193dd2dee9c4d1c9992ad4eff434b59 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391; no voters: 48bc58ace75f40e995efc1edcefe79fa, abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:10.143744 23429 consensus_queue.cc:260] T af6b6c7f82544d968d77f359f1a34403 P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:10.146898 23499 raft_consensus.cc:493] T 2d308deadcb9416c9b0b16ef4891e6eb P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.147125 23429 ts_tablet_manager.cc:1434] T af6b6c7f82544d968d77f359f1a34403 P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.075s	user 0.006s	sys 0.001s
I20260709 12:12:10.147394 23499 raft_consensus.cc:515] T 2d308deadcb9416c9b0b16ef4891e6eb P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:10.148000 23429 tablet_bootstrap.cc:492] T a51c8a6c6cfe460fadc0694a71805ba6 P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:10.149427 23499 leader_election.cc:290] T 2d308deadcb9416c9b0b16ef4891e6eb P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:10.150230 23309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d308deadcb9416c9b0b16ef4891e6eb" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:10.150884 23309 raft_consensus.cc:2468] T 2d308deadcb9416c9b0b16ef4891e6eb P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 0.
I20260709 12:12:10.151278 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d308deadcb9416c9b0b16ef4891e6eb" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:10.152149 23383 raft_consensus.cc:2468] T 2d308deadcb9416c9b0b16ef4891e6eb P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 0.
I20260709 12:12:10.152282 23201 leader_election.cc:304] T 2d308deadcb9416c9b0b16ef4891e6eb P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:10.153366 23499 raft_consensus.cc:2804] T 2d308deadcb9416c9b0b16ef4891e6eb P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:10.153771 23499 raft_consensus.cc:493] T 2d308deadcb9416c9b0b16ef4891e6eb P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:10.154167 23499 raft_consensus.cc:3060] T 2d308deadcb9416c9b0b16ef4891e6eb P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:10.155947 23059 catalog_manager.cc:5697] T 1f5cfd203dcc43d4a86864c2eaaf234c P a9d87b20401744c7bd0c491f60cf0689 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "a9d87b20401744c7bd0c491f60cf0689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:10.166508 23499 raft_consensus.cc:515] T 2d308deadcb9416c9b0b16ef4891e6eb P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:10.173218 23309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d308deadcb9416c9b0b16ef4891e6eb" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:10.173799 23309 raft_consensus.cc:3060] T 2d308deadcb9416c9b0b16ef4891e6eb P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:10.179863 23433 tablet_bootstrap.cc:492] T b4c15adbbcbc4dbb9162ef9af4e14477 P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:10.182678 23430 tablet_bootstrap.cc:654] T 1b4285f9faa34fc595e0b7db3f7f0946 P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:10.181943 23433 ts_tablet_manager.cc:1403] T b4c15adbbcbc4dbb9162ef9af4e14477 P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.120s	user 0.016s	sys 0.012s
I20260709 12:12:10.184362 23518 raft_consensus.cc:493] T c880cf7f327c4b709c29dd91c8645c18 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.184940 23518 raft_consensus.cc:515] T c880cf7f327c4b709c29dd91c8645c18 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:10.186560 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d308deadcb9416c9b0b16ef4891e6eb" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:10.187245 23383 raft_consensus.cc:3060] T 2d308deadcb9416c9b0b16ef4891e6eb P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:10.189311 23545 raft_consensus.cc:2749] T 7193dd2dee9c4d1c9992ad4eff434b59 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:12:10.191695 23106 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:10.183271 23499 leader_election.cc:290] T 2d308deadcb9416c9b0b16ef4891e6eb P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 election: Requested vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:10.199427 23159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880cf7f327c4b709c29dd91c8645c18" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:10.209875 23383 raft_consensus.cc:2468] T 2d308deadcb9416c9b0b16ef4891e6eb P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 1.
I20260709 12:12:10.201077 23433 raft_consensus.cc:359] T b4c15adbbcbc4dbb9162ef9af4e14477 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:10.215135 23433 raft_consensus.cc:385] T b4c15adbbcbc4dbb9162ef9af4e14477 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:10.215432 23433 raft_consensus.cc:740] T b4c15adbbcbc4dbb9162ef9af4e14477 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:10.202200 23518 leader_election.cc:290] T c880cf7f327c4b709c29dd91c8645c18 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:10.204749 23431 tablet_bootstrap.cc:654] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:10.205432 23309 raft_consensus.cc:2468] T 2d308deadcb9416c9b0b16ef4891e6eb P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 1.
I20260709 12:12:10.205811 23522 raft_consensus.cc:493] T af6b6c7f82544d968d77f359f1a34403 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.229347 23522 raft_consensus.cc:515] T af6b6c7f82544d968d77f359f1a34403 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:10.201220 23429 tablet_bootstrap.cc:654] T a51c8a6c6cfe460fadc0694a71805ba6 P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:10.210232 23436 raft_consensus.cc:493] T d53aaedd982440259b3ef5d84cddcbed P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.230492 23436 raft_consensus.cc:515] T d53aaedd982440259b3ef5d84cddcbed P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:10.231508 23522 leader_election.cc:290] T af6b6c7f82544d968d77f359f1a34403 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:10.232458 23436 leader_election.cc:290] T d53aaedd982440259b3ef5d84cddcbed P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:10.217332 23199 leader_election.cc:304] T 2d308deadcb9416c9b0b16ef4891e6eb P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:10.218437 23509 raft_consensus.cc:493] T a7d44e74deb341179f886489282ced2f P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.233070 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af6b6c7f82544d968d77f359f1a34403" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:10.233460 23509 raft_consensus.cc:515] T a7d44e74deb341179f886489282ced2f P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:10.233947 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53aaedd982440259b3ef5d84cddcbed" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:10.234172 23499 raft_consensus.cc:493] T 162d91be31a64ad688b7b433392ed1a2 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:10.234710 23273 leader_election.cc:343] T af6b6c7f82544d968d77f359f1a34403 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:10.235584 23509 leader_election.cc:290] T a7d44e74deb341179f886489282ced2f P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:10.236145 23540 raft_consensus.cc:2804] T 2d308deadcb9416c9b0b16ef4891e6eb P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:10.234714 23499 raft_consensus.cc:515] T 162d91be31a64ad688b7b433392ed1a2 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:10.239784 23499 leader_election.cc:290] T 162d91be31a64ad688b7b433392ed1a2 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:10.241024 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d44e74deb341179f886489282ced2f" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:10.241686 23310 raft_consensus.cc:2468] T a7d44e74deb341179f886489282ced2f P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 0.
I20260709 12:12:10.242755 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162d91be31a64ad688b7b433392ed1a2" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:10.242964 23349 leader_election.cc:304] T a7d44e74deb341179f886489282ced2f P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689; no voters: 
I20260709 12:12:10.243526 23383 raft_consensus.cc:2393] T 162d91be31a64ad688b7b433392ed1a2 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abe65f4962e147ac841608b6c30f7e1b in current term 1: Already voted for candidate 3824bca1df8e4020b18c7989f7758391 in this term.
I20260709 12:12:10.243685 23431 tablet_bootstrap.cc:492] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:10.215994 23159 raft_consensus.cc:2468] T c880cf7f327c4b709c29dd91c8645c18 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 0.
I20260709 12:12:10.244122 23431 ts_tablet_manager.cc:1403] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.111s	user 0.001s	sys 0.012s
I20260709 12:12:10.222060 23232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880cf7f327c4b709c29dd91c8645c18" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:10.244879 23232 raft_consensus.cc:2468] T c880cf7f327c4b709c29dd91c8645c18 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 0.
I20260709 12:12:10.223733 23482 consensus_queue.cc:1048] T 8ac0ace3682c4f29b9e5ecad75f783f7 P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:10.226472 23433 consensus_queue.cc:260] T b4c15adbbcbc4dbb9162ef9af4e14477 P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:10.246806 23431 raft_consensus.cc:359] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:10.247493 23431 raft_consensus.cc:385] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:10.247771 23431 raft_consensus.cc:740] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:10.248049 23274 leader_election.cc:304] T c880cf7f327c4b709c29dd91c8645c18 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689; no voters: 
I20260709 12:12:10.248724 23431 consensus_queue.cc:260] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:10.249349 23482 raft_consensus.cc:2804] T c880cf7f327c4b709c29dd91c8645c18 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:10.245398 23525 raft_consensus.cc:2804] T a7d44e74deb341179f886489282ced2f P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:10.249694 23232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af6b6c7f82544d968d77f359f1a34403" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:10.249768 23482 raft_consensus.cc:493] T c880cf7f327c4b709c29dd91c8645c18 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:10.250511 23482 raft_consensus.cc:3060] T c880cf7f327c4b709c29dd91c8645c18 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:10.250830 23431 ts_tablet_manager.cc:1434] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 12:12:10.251293 23509 raft_consensus.cc:493] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9d87b20401744c7bd0c491f60cf0689)
I20260709 12:12:10.251655 23509 raft_consensus.cc:515] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
W20260709 12:12:10.252329 23276 leader_election.cc:343] T af6b6c7f82544d968d77f359f1a34403 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:10.252696 23276 leader_election.cc:304] T af6b6c7f82544d968d77f359f1a34403 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689; no voters: 48bc58ace75f40e995efc1edcefe79fa, abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:10.253253 23522 raft_consensus.cc:2749] T af6b6c7f82544d968d77f359f1a34403 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:10.253931 23509 leader_election.cc:290] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:10.255432 23309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923f193f1d2d4e61ae30850183122635" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:10.256114 23309 raft_consensus.cc:2468] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 2.
I20260709 12:12:10.250133 23525 raft_consensus.cc:493] T a7d44e74deb341179f886489282ced2f P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:10.257009 23525 raft_consensus.cc:3060] T a7d44e74deb341179f886489282ced2f P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:10.247749 23433 ts_tablet_manager.cc:1434] T b4c15adbbcbc4dbb9162ef9af4e14477 P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.000s
I20260709 12:12:10.259297 23349 leader_election.cc:304] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689; no voters: 
I20260709 12:12:10.259310 23433 tablet_bootstrap.cc:492] T 7f25493a942c4d96ad5fed839ad58386 P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:10.251647 23430 tablet_bootstrap.cc:492] T 1b4285f9faa34fc595e0b7db3f7f0946 P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:10.263101 23509 raft_consensus.cc:2804] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:10.263497 23509 raft_consensus.cc:493] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting leader election (detected failure of leader a9d87b20401744c7bd0c491f60cf0689)
I20260709 12:12:10.263862 23509 raft_consensus.cc:3060] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:10.264021 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162d91be31a64ad688b7b433392ed1a2" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:10.265666 23200 leader_election.cc:304] T 162d91be31a64ad688b7b433392ed1a2 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abe65f4962e147ac841608b6c30f7e1b; no voters: 3824bca1df8e4020b18c7989f7758391, 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:10.268290 23499 raft_consensus.cc:3060] T 162d91be31a64ad688b7b433392ed1a2 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:10.269109 23433 tablet_bootstrap.cc:654] T 7f25493a942c4d96ad5fed839ad58386 P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:10.269533 23160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d53aaedd982440259b3ef5d84cddcbed" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:10.270013 23482 raft_consensus.cc:515] T c880cf7f327c4b709c29dd91c8645c18 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:10.262080 23430 ts_tablet_manager.cc:1403] T 1b4285f9faa34fc595e0b7db3f7f0946 P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.127s	user 0.020s	sys 0.010s
I20260709 12:12:10.271039 23158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d44e74deb341179f886489282ced2f" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:10.272383 23156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923f193f1d2d4e61ae30850183122635" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:10.273165 23156 raft_consensus.cc:2393] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48bc58ace75f40e995efc1edcefe79fa in current term 2: Already voted for candidate 3824bca1df8e4020b18c7989f7758391 in this term.
I20260709 12:12:10.273669 23430 raft_consensus.cc:359] T 1b4285f9faa34fc595e0b7db3f7f0946 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:10.274492 23430 raft_consensus.cc:385] T 1b4285f9faa34fc595e0b7db3f7f0946 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:10.274761 23430 raft_consensus.cc:740] T 1b4285f9faa34fc595e0b7db3f7f0946 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:10.275236 23348 leader_election.cc:304] T d53aaedd982440259b3ef5d84cddcbed P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa; no voters: 3824bca1df8e4020b18c7989f7758391, abe65f4962e147ac841608b6c30f7e1b
W20260709 12:12:10.276729 23348 leader_election.cc:343] T a7d44e74deb341179f886489282ced2f P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:10.280090 23477 raft_consensus.cc:2749] T d53aaedd982440259b3ef5d84cddcbed P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:10.282800 23482 leader_election.cc:290] T c880cf7f327c4b709c29dd91c8645c18 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Requested vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:10.283509 23158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880cf7f327c4b709c29dd91c8645c18" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:10.284109 23158 raft_consensus.cc:3060] T c880cf7f327c4b709c29dd91c8645c18 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:10.284363 23232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c880cf7f327c4b709c29dd91c8645c18" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:10.284912 23232 raft_consensus.cc:3060] T c880cf7f327c4b709c29dd91c8645c18 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:10.285808 23430 consensus_queue.cc:260] T 1b4285f9faa34fc595e0b7db3f7f0946 P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:10.288209 23430 ts_tablet_manager.cc:1434] T 1b4285f9faa34fc595e0b7db3f7f0946 P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:12:10.289219 23509 raft_consensus.cc:515] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:10.292037 23309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923f193f1d2d4e61ae30850183122635" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:10.292933 23499 raft_consensus.cc:2749] T 162d91be31a64ad688b7b433392ed1a2 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:10.293850 23232 raft_consensus.cc:2468] T c880cf7f327c4b709c29dd91c8645c18 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 1.
I20260709 12:12:10.295054 23276 leader_election.cc:304] T c880cf7f327c4b709c29dd91c8645c18 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:10.296245 23536 raft_consensus.cc:2804] T c880cf7f327c4b709c29dd91c8645c18 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:10.296716 23536 raft_consensus.cc:697] T c880cf7f327c4b709c29dd91c8645c18 P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Becoming Leader. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Running, Role: LEADER
I20260709 12:12:10.297947 23536 consensus_queue.cc:237] T c880cf7f327c4b709c29dd91c8645c18 P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:10.300796 23156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923f193f1d2d4e61ae30850183122635" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:10.301641 23156 raft_consensus.cc:2393] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 48bc58ace75f40e995efc1edcefe79fa in current term 2: Already voted for candidate 3824bca1df8e4020b18c7989f7758391 in this term.
I20260709 12:12:10.303241 23383 raft_consensus.cc:3060] T d53aaedd982440259b3ef5d84cddcbed P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:10.304862 23158 raft_consensus.cc:2468] T c880cf7f327c4b709c29dd91c8645c18 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 1.
I20260709 12:12:10.306779 23430 tablet_bootstrap.cc:492] T af6b6c7f82544d968d77f359f1a34403 P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:10.306798 23540 raft_consensus.cc:697] T 2d308deadcb9416c9b0b16ef4891e6eb P abe65f4962e147ac841608b6c30f7e1b [term 1 LEADER]: Becoming Leader. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Running, Role: LEADER
I20260709 12:12:10.306833 23509 leader_election.cc:290] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 2 election: Requested vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:10.326697 23431 tablet_bootstrap.cc:492] T a7d44e74deb341179f886489282ced2f P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:10.320133 23545 consensus_queue.cc:1048] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:12:10.331286 23525 raft_consensus.cc:515] T a7d44e74deb341179f886489282ced2f P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:10.333627 23540 consensus_queue.cc:237] T 2d308deadcb9416c9b0b16ef4891e6eb P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:10.334434 23309 raft_consensus.cc:2468] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 2.
I20260709 12:12:10.344997 23158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d44e74deb341179f886489282ced2f" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
W20260709 12:12:10.346659 23348 leader_election.cc:343] T a7d44e74deb341179f886489282ced2f P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:10.347426 23525 leader_election.cc:290] T a7d44e74deb341179f886489282ced2f P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Requested vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:10.352834 23431 tablet_bootstrap.cc:654] T a7d44e74deb341179f886489282ced2f P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:10.355019 23349 leader_election.cc:304] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689; no voters: 3824bca1df8e4020b18c7989f7758391
I20260709 12:12:10.356421 23509 raft_consensus.cc:2804] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:10.357071 23509 raft_consensus.cc:697] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa [term 2 LEADER]: Becoming Leader. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Running, Role: LEADER
I20260709 12:12:10.353752 23536 raft_consensus.cc:493] T 1b4285f9faa34fc595e0b7db3f7f0946 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.358944 23536 raft_consensus.cc:515] T 1b4285f9faa34fc595e0b7db3f7f0946 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:10.361661 23536 leader_election.cc:290] T 1b4285f9faa34fc595e0b7db3f7f0946 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:10.358129 23509 consensus_queue.cc:237] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:10.364140 23430 tablet_bootstrap.cc:654] T af6b6c7f82544d968d77f359f1a34403 P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:10.369464 23433 tablet_bootstrap.cc:492] T 7f25493a942c4d96ad5fed839ad58386 P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:10.369966 23433 ts_tablet_manager.cc:1403] T 7f25493a942c4d96ad5fed839ad58386 P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.111s	user 0.018s	sys 0.006s
I20260709 12:12:10.371870 23384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4285f9faa34fc595e0b7db3f7f0946" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:10.372753 23384 raft_consensus.cc:2468] T 1b4285f9faa34fc595e0b7db3f7f0946 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 0.
I20260709 12:12:10.372790 23433 raft_consensus.cc:359] T 7f25493a942c4d96ad5fed839ad58386 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:10.373680 23433 raft_consensus.cc:385] T 7f25493a942c4d96ad5fed839ad58386 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:10.373945 23433 raft_consensus.cc:740] T 7f25493a942c4d96ad5fed839ad58386 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:10.374806 23273 leader_election.cc:304] T 1b4285f9faa34fc595e0b7db3f7f0946 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689; no voters: 
I20260709 12:12:10.374688 23433 consensus_queue.cc:260] T 7f25493a942c4d96ad5fed839ad58386 P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:10.375643 23482 raft_consensus.cc:2804] T 1b4285f9faa34fc595e0b7db3f7f0946 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:10.375996 23482 raft_consensus.cc:493] T 1b4285f9faa34fc595e0b7db3f7f0946 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:10.376329 23482 raft_consensus.cc:3060] T 1b4285f9faa34fc595e0b7db3f7f0946 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:10.377080 23433 ts_tablet_manager.cc:1434] T 7f25493a942c4d96ad5fed839ad58386 P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 12:12:10.378191 23433 tablet_bootstrap.cc:492] T a51c8a6c6cfe460fadc0694a71805ba6 P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:10.378819 23309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d44e74deb341179f886489282ced2f" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:10.379488 23158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4285f9faa34fc595e0b7db3f7f0946" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:10.380122 23158 raft_consensus.cc:2468] T 1b4285f9faa34fc595e0b7db3f7f0946 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 0.
I20260709 12:12:10.379427 23309 raft_consensus.cc:3060] T a7d44e74deb341179f886489282ced2f P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:10.386188 23433 tablet_bootstrap.cc:654] T a51c8a6c6cfe460fadc0694a71805ba6 P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:10.387432 23482 raft_consensus.cc:515] T 1b4285f9faa34fc595e0b7db3f7f0946 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:10.389192 23059 catalog_manager.cc:5697] T c880cf7f327c4b709c29dd91c8645c18 P a9d87b20401744c7bd0c491f60cf0689 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "a9d87b20401744c7bd0c491f60cf0689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:10.391134 23384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4285f9faa34fc595e0b7db3f7f0946" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:10.397965 23384 raft_consensus.cc:3060] T 1b4285f9faa34fc595e0b7db3f7f0946 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:10.402290 23309 raft_consensus.cc:2468] T a7d44e74deb341179f886489282ced2f P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 1.
I20260709 12:12:10.414558 23429 tablet_bootstrap.cc:492] T a51c8a6c6cfe460fadc0694a71805ba6 P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:10.415102 23429 ts_tablet_manager.cc:1403] T a51c8a6c6cfe460fadc0694a71805ba6 P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.267s	user 0.014s	sys 0.022s
I20260709 12:12:10.418073 23433 tablet_bootstrap.cc:492] T a51c8a6c6cfe460fadc0694a71805ba6 P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:10.419070 23433 ts_tablet_manager.cc:1403] T a51c8a6c6cfe460fadc0694a71805ba6 P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.041s	user 0.020s	sys 0.004s
I20260709 12:12:10.420919 23159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4285f9faa34fc595e0b7db3f7f0946" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:10.421556 23159 raft_consensus.cc:3060] T 1b4285f9faa34fc595e0b7db3f7f0946 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:10.425369 23349 leader_election.cc:304] T a7d44e74deb341179f886489282ced2f P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689; no voters: 3824bca1df8e4020b18c7989f7758391
I20260709 12:12:10.426730 23433 raft_consensus.cc:359] T a51c8a6c6cfe460fadc0694a71805ba6 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:10.427412 23433 raft_consensus.cc:385] T a51c8a6c6cfe460fadc0694a71805ba6 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:10.427695 23433 raft_consensus.cc:740] T a51c8a6c6cfe460fadc0694a71805ba6 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:10.428352 23433 consensus_queue.cc:260] T a51c8a6c6cfe460fadc0694a71805ba6 P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:10.421571 23058 catalog_manager.cc:5697] T 2d308deadcb9416c9b0b16ef4891e6eb P abe65f4962e147ac841608b6c30f7e1b reported cstate change: term changed from 0 to 1, leader changed from <none> to abe65f4962e147ac841608b6c30f7e1b (127.16.98.194). New cstate: current_term: 1 leader_uuid: "abe65f4962e147ac841608b6c30f7e1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:10.414803 23482 leader_election.cc:290] T 1b4285f9faa34fc595e0b7db3f7f0946 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Requested vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:10.434031 23437 consensus_queue.cc:1048] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:10.436810 23430 tablet_bootstrap.cc:492] T af6b6c7f82544d968d77f359f1a34403 P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:10.436978 23482 consensus_queue.cc:1048] T 1f5cfd203dcc43d4a86864c2eaaf234c P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:10.437371 23430 ts_tablet_manager.cc:1403] T af6b6c7f82544d968d77f359f1a34403 P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.131s	user 0.010s	sys 0.018s
I20260709 12:12:10.439471 23437 raft_consensus.cc:493] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.439936 23437 raft_consensus.cc:515] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:10.440270 23235 raft_consensus.cc:3060] T b4c15adbbcbc4dbb9162ef9af4e14477 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:10.436837 23431 tablet_bootstrap.cc:492] T a7d44e74deb341179f886489282ced2f P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:10.441561 23431 ts_tablet_manager.cc:1403] T a7d44e74deb341179f886489282ced2f P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.123s	user 0.013s	sys 0.009s
I20260709 12:12:10.442572 23437 leader_election.cc:290] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:10.443225 23381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923f193f1d2d4e61ae30850183122635" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:10.443563 23309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923f193f1d2d4e61ae30850183122635" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:10.444206 23309 raft_consensus.cc:2468] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 2.
I20260709 12:12:10.445164 23126 leader_election.cc:304] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689; no voters: 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:10.445537 23429 raft_consensus.cc:359] T a51c8a6c6cfe460fadc0694a71805ba6 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:10.446226 23429 raft_consensus.cc:385] T a51c8a6c6cfe460fadc0694a71805ba6 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:10.446326 23437 raft_consensus.cc:2804] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:10.446913 23437 raft_consensus.cc:493] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:10.447288 23437 raft_consensus.cc:3060] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:10.446533 23429 raft_consensus.cc:740] T a51c8a6c6cfe460fadc0694a71805ba6 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:10.447288 23431 raft_consensus.cc:359] T a7d44e74deb341179f886489282ced2f P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:10.455875 23431 raft_consensus.cc:385] T a7d44e74deb341179f886489282ced2f P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:10.456146 23431 raft_consensus.cc:740] T a7d44e74deb341179f886489282ced2f P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:10.431758 23509 raft_consensus.cc:2804] T a7d44e74deb341179f886489282ced2f P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:10.453962 23429 consensus_queue.cc:260] T a51c8a6c6cfe460fadc0694a71805ba6 P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:10.457886 23433 ts_tablet_manager.cc:1434] T a51c8a6c6cfe460fadc0694a71805ba6 P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.000s
I20260709 12:12:10.459074 23431 consensus_queue.cc:260] T a7d44e74deb341179f886489282ced2f P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:10.464506 23433 tablet_bootstrap.cc:492] T af6b6c7f82544d968d77f359f1a34403 P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:10.466890 23430 raft_consensus.cc:359] T af6b6c7f82544d968d77f359f1a34403 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:10.469590 23430 raft_consensus.cc:385] T af6b6c7f82544d968d77f359f1a34403 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:10.469947 23430 raft_consensus.cc:740] T af6b6c7f82544d968d77f359f1a34403 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:10.471230 23430 consensus_queue.cc:260] T af6b6c7f82544d968d77f359f1a34403 P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:10.452750 23159 raft_consensus.cc:2468] T 1b4285f9faa34fc595e0b7db3f7f0946 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 1.
I20260709 12:12:10.474375 23431 ts_tablet_manager.cc:1434] T a7d44e74deb341179f886489282ced2f P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.001s
I20260709 12:12:10.476704 23431 tablet_bootstrap.cc:492] T da47bda397e2471388bcab5069dd7edc P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:10.477289 23429 ts_tablet_manager.cc:1434] T a51c8a6c6cfe460fadc0694a71805ba6 P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.062s	user 0.008s	sys 0.000s
I20260709 12:12:10.465628 23509 raft_consensus.cc:697] T a7d44e74deb341179f886489282ced2f P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Becoming Leader. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Running, Role: LEADER
I20260709 12:12:10.481441 23509 consensus_queue.cc:237] T a7d44e74deb341179f886489282ced2f P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:10.479085 23429 tablet_bootstrap.cc:492] T e3b19b20feb045058cd1cfbd684ff05f P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:10.485630 23431 tablet_bootstrap.cc:654] T da47bda397e2471388bcab5069dd7edc P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:10.488466 23436 consensus_queue.cc:1048] T b4c15adbbcbc4dbb9162ef9af4e14477 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:10.488788 23384 raft_consensus.cc:2468] T 1b4285f9faa34fc595e0b7db3f7f0946 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 1.
I20260709 12:12:10.491442 23273 leader_election.cc:304] T 1b4285f9faa34fc595e0b7db3f7f0946 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689; no voters: 
I20260709 12:12:10.492909 23430 ts_tablet_manager.cc:1434] T af6b6c7f82544d968d77f359f1a34403 P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.000s
I20260709 12:12:10.494800 23430 tablet_bootstrap.cc:492] T 7f25493a942c4d96ad5fed839ad58386 P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:10.496526 23536 raft_consensus.cc:2804] T 1b4285f9faa34fc595e0b7db3f7f0946 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:10.497064 23536 raft_consensus.cc:697] T 1b4285f9faa34fc595e0b7db3f7f0946 P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Becoming Leader. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Running, Role: LEADER
I20260709 12:12:10.497798 23431 tablet_bootstrap.cc:492] T da47bda397e2471388bcab5069dd7edc P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:10.498363 23431 ts_tablet_manager.cc:1403] T da47bda397e2471388bcab5069dd7edc P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.002s
I20260709 12:12:10.497927 23536 consensus_queue.cc:237] T 1b4285f9faa34fc595e0b7db3f7f0946 P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:10.501048 23430 tablet_bootstrap.cc:654] T 7f25493a942c4d96ad5fed839ad58386 P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:10.500937 23431 raft_consensus.cc:359] T da47bda397e2471388bcab5069dd7edc P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:10.501610 23431 raft_consensus.cc:385] T da47bda397e2471388bcab5069dd7edc P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:10.501878 23431 raft_consensus.cc:740] T da47bda397e2471388bcab5069dd7edc P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:10.493074 23436 consensus_queue.cc:1048] T b4c15adbbcbc4dbb9162ef9af4e14477 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:12:10.502862 23431 consensus_queue.cc:260] T da47bda397e2471388bcab5069dd7edc P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:10.515928 23525 raft_consensus.cc:493] T af6b6c7f82544d968d77f359f1a34403 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.516574 23525 raft_consensus.cc:515] T af6b6c7f82544d968d77f359f1a34403 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:10.519726 23545 raft_consensus.cc:493] T a7d44e74deb341179f886489282ced2f P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.520329 23545 raft_consensus.cc:515] T a7d44e74deb341179f886489282ced2f P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:10.524128 23309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d44e74deb341179f886489282ced2f" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:10.525249 23309 raft_consensus.cc:2393] T a7d44e74deb341179f886489282ced2f P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3824bca1df8e4020b18c7989f7758391 in current term 1: Already voted for candidate 48bc58ace75f40e995efc1edcefe79fa in this term.
I20260709 12:12:10.526948 23431 ts_tablet_manager.cc:1434] T da47bda397e2471388bcab5069dd7edc P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:12:10.528246 23431 tablet_bootstrap.cc:492] T e3b19b20feb045058cd1cfbd684ff05f P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:10.528759 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af6b6c7f82544d968d77f359f1a34403" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:10.526948 23525 leader_election.cc:290] T af6b6c7f82544d968d77f359f1a34403 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:10.548518 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af6b6c7f82544d968d77f359f1a34403" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:10.549259 23310 raft_consensus.cc:2468] T af6b6c7f82544d968d77f359f1a34403 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 0.
I20260709 12:12:10.550516 23349 leader_election.cc:304] T af6b6c7f82544d968d77f359f1a34403 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689; no voters: 
I20260709 12:12:10.551415 23436 raft_consensus.cc:2804] T af6b6c7f82544d968d77f359f1a34403 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:12:10.551545 23350 leader_election.cc:343] T af6b6c7f82544d968d77f359f1a34403 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:10.551826 23436 raft_consensus.cc:493] T af6b6c7f82544d968d77f359f1a34403 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:10.552217 23436 raft_consensus.cc:3060] T af6b6c7f82544d968d77f359f1a34403 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:10.545085 23545 leader_election.cc:290] T a7d44e74deb341179f886489282ced2f P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:10.553714 23382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7d44e74deb341179f886489282ced2f" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:10.558327 23536 consensus_queue.cc:1048] T 1f5cfd203dcc43d4a86864c2eaaf234c P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:10.560326 23429 tablet_bootstrap.cc:654] T e3b19b20feb045058cd1cfbd684ff05f P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:10.536269 23437 raft_consensus.cc:515] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:10.575503 23124 leader_election.cc:304] T a7d44e74deb341179f886489282ced2f P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391; no voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689
I20260709 12:12:10.577525 23619 raft_consensus.cc:3060] T a7d44e74deb341179f886489282ced2f P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:10.587194 23433 tablet_bootstrap.cc:654] T af6b6c7f82544d968d77f359f1a34403 P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:10.597883 23436 raft_consensus.cc:515] T af6b6c7f82544d968d77f359f1a34403 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:10.600780 23436 leader_election.cc:290] T af6b6c7f82544d968d77f359f1a34403 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Requested vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:10.607676 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af6b6c7f82544d968d77f359f1a34403" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:10.608304 23310 raft_consensus.cc:3060] T af6b6c7f82544d968d77f359f1a34403 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:10.610411 23235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af6b6c7f82544d968d77f359f1a34403" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
W20260709 12:12:10.618270 23350 leader_election.cc:343] T af6b6c7f82544d968d77f359f1a34403 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:10.628432 23430 tablet_bootstrap.cc:492] T 7f25493a942c4d96ad5fed839ad58386 P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:10.628913 23430 ts_tablet_manager.cc:1403] T 7f25493a942c4d96ad5fed839ad58386 P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.135s	user 0.027s	sys 0.012s
I20260709 12:12:10.633679 23059 catalog_manager.cc:5697] T 1b4285f9faa34fc595e0b7db3f7f0946 P a9d87b20401744c7bd0c491f60cf0689 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "a9d87b20401744c7bd0c491f60cf0689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:10.635377 23431 tablet_bootstrap.cc:654] T e3b19b20feb045058cd1cfbd684ff05f P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:10.631672 23057 catalog_manager.cc:5697] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa reported cstate change: term changed from 1 to 2, leader changed from a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195) to 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196). New cstate: current_term: 2 leader_uuid: "48bc58ace75f40e995efc1edcefe79fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:10.649637 23499 raft_consensus.cc:493] T 7f25493a942c4d96ad5fed839ad58386 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.650276 23499 raft_consensus.cc:515] T 7f25493a942c4d96ad5fed839ad58386 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:10.646657 23308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923f193f1d2d4e61ae30850183122635" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:10.657593 23382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923f193f1d2d4e61ae30850183122635" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:10.657747 23308 raft_consensus.cc:3060] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:10.648396 23437 leader_election.cc:290] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 3 election: Requested vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:10.662485 23499 leader_election.cc:290] T 7f25493a942c4d96ad5fed839ad58386 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:10.671028 23430 raft_consensus.cc:359] T 7f25493a942c4d96ad5fed839ad58386 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:10.671975 23430 raft_consensus.cc:385] T 7f25493a942c4d96ad5fed839ad58386 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:10.672287 23430 raft_consensus.cc:740] T 7f25493a942c4d96ad5fed839ad58386 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:10.662942 23545 raft_consensus.cc:493] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.673470 23430 consensus_queue.cc:260] T 7f25493a942c4d96ad5fed839ad58386 P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:10.671669 23619 raft_consensus.cc:2749] T a7d44e74deb341179f886489282ced2f P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:10.676899 23545 raft_consensus.cc:515] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
W20260709 12:12:10.678864 23616 log.cc:927] Time spent T 1b4285f9faa34fc595e0b7db3f7f0946 P a9d87b20401744c7bd0c491f60cf0689: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:12:10.670867 23310 raft_consensus.cc:2468] T af6b6c7f82544d968d77f359f1a34403 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 1.
I20260709 12:12:10.687704 23430 ts_tablet_manager.cc:1434] T 7f25493a942c4d96ad5fed839ad58386 P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
I20260709 12:12:10.688545 23430 tablet_bootstrap.cc:492] T e3b19b20feb045058cd1cfbd684ff05f P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:10.690544 23159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25493a942c4d96ad5fed839ad58386" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:10.691287 23159 raft_consensus.cc:2468] T 7f25493a942c4d96ad5fed839ad58386 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 0.
I20260709 12:12:10.685709 23382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25493a942c4d96ad5fed839ad58386" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:10.700021 23200 leader_election.cc:304] T 7f25493a942c4d96ad5fed839ad58386 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:10.706375 23499 raft_consensus.cc:2804] T 7f25493a942c4d96ad5fed839ad58386 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:10.706772 23499 raft_consensus.cc:493] T 7f25493a942c4d96ad5fed839ad58386 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:10.707085 23499 raft_consensus.cc:3060] T 7f25493a942c4d96ad5fed839ad58386 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:10.707638 23349 leader_election.cc:304] T af6b6c7f82544d968d77f359f1a34403 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689; no voters: abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:10.711480 23623 raft_consensus.cc:2804] T af6b6c7f82544d968d77f359f1a34403 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:10.719007 23429 tablet_bootstrap.cc:492] T e3b19b20feb045058cd1cfbd684ff05f P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:10.719497 23429 ts_tablet_manager.cc:1403] T e3b19b20feb045058cd1cfbd684ff05f P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.241s	user 0.015s	sys 0.018s
I20260709 12:12:10.720283 23433 tablet_bootstrap.cc:492] T af6b6c7f82544d968d77f359f1a34403 P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:10.705302 23382 raft_consensus.cc:2468] T 7f25493a942c4d96ad5fed839ad58386 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 0.
I20260709 12:12:10.712153 23623 raft_consensus.cc:697] T af6b6c7f82544d968d77f359f1a34403 P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Becoming Leader. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Running, Role: LEADER
I20260709 12:12:10.720880 23433 ts_tablet_manager.cc:1403] T af6b6c7f82544d968d77f359f1a34403 P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.257s	user 0.022s	sys 0.013s
I20260709 12:12:10.726491 23623 consensus_queue.cc:237] T af6b6c7f82544d968d77f359f1a34403 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:10.727438 23235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51c8a6c6cfe460fadc0694a71805ba6" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:10.728142 23235 raft_consensus.cc:2468] T a51c8a6c6cfe460fadc0694a71805ba6 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 0.
I20260709 12:12:10.729517 23127 leader_election.cc:304] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:10.730355 23619 raft_consensus.cc:2804] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:10.730733 23619 raft_consensus.cc:493] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:10.731050 23619 raft_consensus.cc:3060] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:10.733871 23430 tablet_bootstrap.cc:654] T e3b19b20feb045058cd1cfbd684ff05f P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:10.733770 23308 raft_consensus.cc:2468] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 3.
I20260709 12:12:10.735451 23429 raft_consensus.cc:359] T e3b19b20feb045058cd1cfbd684ff05f P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:10.735702 23126 leader_election.cc:304] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689; no voters: 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:10.736536 23522 consensus_queue.cc:1048] T c880cf7f327c4b709c29dd91c8645c18 P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:10.736152 23429 raft_consensus.cc:385] T e3b19b20feb045058cd1cfbd684ff05f P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:10.736636 23624 raft_consensus.cc:2804] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:10.738189 23624 raft_consensus.cc:697] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [term 3 LEADER]: Becoming Leader. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Running, Role: LEADER
I20260709 12:12:10.739037 23624 consensus_queue.cc:237] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:10.737262 23429 raft_consensus.cc:740] T e3b19b20feb045058cd1cfbd684ff05f P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:10.741077 23429 consensus_queue.cc:260] T e3b19b20feb045058cd1cfbd684ff05f P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:10.742666 23429 ts_tablet_manager.cc:1434] T e3b19b20feb045058cd1cfbd684ff05f P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.000s
I20260709 12:12:10.753840 23429 tablet_bootstrap.cc:492] T 89d4b46113284ecc9db8b0e3c2b46f89 P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:10.769665 23431 tablet_bootstrap.cc:492] T e3b19b20feb045058cd1cfbd684ff05f P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:10.770361 23431 ts_tablet_manager.cc:1403] T e3b19b20feb045058cd1cfbd684ff05f P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.242s	user 0.013s	sys 0.022s
I20260709 12:12:10.773993 23545 leader_election.cc:290] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:10.775028 23308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51c8a6c6cfe460fadc0694a71805ba6" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:10.775775 23308 raft_consensus.cc:2468] T a51c8a6c6cfe460fadc0694a71805ba6 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 0.
I20260709 12:12:10.777283 23540 consensus_queue.cc:1048] T 2d308deadcb9416c9b0b16ef4891e6eb P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:10.784121 23619 raft_consensus.cc:515] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:10.787241 23235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51c8a6c6cfe460fadc0694a71805ba6" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:10.787822 23235 raft_consensus.cc:3060] T a51c8a6c6cfe460fadc0694a71805ba6 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:10.789124 23431 raft_consensus.cc:359] T e3b19b20feb045058cd1cfbd684ff05f P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:10.789788 23431 raft_consensus.cc:385] T e3b19b20feb045058cd1cfbd684ff05f P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:10.790035 23431 raft_consensus.cc:740] T e3b19b20feb045058cd1cfbd684ff05f P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:10.792763 23309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51c8a6c6cfe460fadc0694a71805ba6" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:10.793363 23309 raft_consensus.cc:3060] T a51c8a6c6cfe460fadc0694a71805ba6 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:10.793869 23499 raft_consensus.cc:515] T 7f25493a942c4d96ad5fed839ad58386 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:10.796407 23499 leader_election.cc:290] T 7f25493a942c4d96ad5fed839ad58386 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 election: Requested vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:10.803848 23382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25493a942c4d96ad5fed839ad58386" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:10.804452 23382 raft_consensus.cc:3060] T 7f25493a942c4d96ad5fed839ad58386 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:10.799889 23058 catalog_manager.cc:5697] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 reported cstate change: term changed from 2 to 3, leader changed from 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196) to 3824bca1df8e4020b18c7989f7758391 (127.16.98.193). New cstate: current_term: 3 leader_uuid: "3824bca1df8e4020b18c7989f7758391" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:10.804929 23433 raft_consensus.cc:359] T af6b6c7f82544d968d77f359f1a34403 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:10.805629 23433 raft_consensus.cc:385] T af6b6c7f82544d968d77f359f1a34403 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:10.805893 23433 raft_consensus.cc:740] T af6b6c7f82544d968d77f359f1a34403 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:10.808859 23431 consensus_queue.cc:260] T e3b19b20feb045058cd1cfbd684ff05f P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:10.786417 23619 leader_election.cc:290] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 election: Requested vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:10.806548 23433 consensus_queue.cc:260] T af6b6c7f82544d968d77f359f1a34403 P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:10.817696 23057 catalog_manager.cc:5697] T a7d44e74deb341179f886489282ced2f P 48bc58ace75f40e995efc1edcefe79fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196). New cstate: current_term: 1 leader_uuid: "48bc58ace75f40e995efc1edcefe79fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:10.819702 23057 catalog_manager.cc:5697] T af6b6c7f82544d968d77f359f1a34403 P 48bc58ace75f40e995efc1edcefe79fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196). New cstate: current_term: 1 leader_uuid: "48bc58ace75f40e995efc1edcefe79fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:10.802526 23429 tablet_bootstrap.cc:654] T 89d4b46113284ecc9db8b0e3c2b46f89 P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:10.821400 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25493a942c4d96ad5fed839ad58386" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:10.824676 23161 raft_consensus.cc:3060] T 7f25493a942c4d96ad5fed839ad58386 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:10.827266 23433 ts_tablet_manager.cc:1434] T af6b6c7f82544d968d77f359f1a34403 P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.105s	user 0.007s	sys 0.000s
I20260709 12:12:10.828011 23431 ts_tablet_manager.cc:1434] T e3b19b20feb045058cd1cfbd684ff05f P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.000s
I20260709 12:12:10.829675 23431 tablet_bootstrap.cc:492] T 89d4b46113284ecc9db8b0e3c2b46f89 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:10.830240 23433 tablet_bootstrap.cc:492] T da47bda397e2471388bcab5069dd7edc P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:10.838949 23235 raft_consensus.cc:2468] T a51c8a6c6cfe460fadc0694a71805ba6 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 1.
I20260709 12:12:10.840297 23127 leader_election.cc:304] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:10.843391 23545 raft_consensus.cc:2804] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:10.844767 23430 tablet_bootstrap.cc:492] T e3b19b20feb045058cd1cfbd684ff05f P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:10.845013 23545 raft_consensus.cc:697] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391 [term 1 LEADER]: Becoming Leader. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Running, Role: LEADER
I20260709 12:12:10.845265 23430 ts_tablet_manager.cc:1403] T e3b19b20feb045058cd1cfbd684ff05f P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.157s	user 0.041s	sys 0.017s
I20260709 12:12:10.850085 23518 consensus_queue.cc:1048] T c880cf7f327c4b709c29dd91c8645c18 P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:12:10.856201 23540 consensus_queue.cc:1048] T 2d308deadcb9416c9b0b16ef4891e6eb P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:10.858093 23437 raft_consensus.cc:493] T da47bda397e2471388bcab5069dd7edc P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.858687 23437 raft_consensus.cc:515] T da47bda397e2471388bcab5069dd7edc P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:10.862160 23382 raft_consensus.cc:2468] T 7f25493a942c4d96ad5fed839ad58386 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 1.
I20260709 12:12:10.865828 23199 leader_election.cc:304] T 7f25493a942c4d96ad5fed839ad58386 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:10.867484 23433 tablet_bootstrap.cc:654] T da47bda397e2471388bcab5069dd7edc P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:10.867868 23437 leader_election.cc:290] T da47bda397e2471388bcab5069dd7edc P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:10.870780 23599 raft_consensus.cc:2804] T 7f25493a942c4d96ad5fed839ad58386 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:10.846271 23545 consensus_queue.cc:237] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:10.875057 23599 raft_consensus.cc:697] T 7f25493a942c4d96ad5fed839ad58386 P abe65f4962e147ac841608b6c30f7e1b [term 1 LEADER]: Becoming Leader. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Running, Role: LEADER
I20260709 12:12:10.875957 23599 consensus_queue.cc:237] T 7f25493a942c4d96ad5fed839ad58386 P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:10.877594 23431 tablet_bootstrap.cc:654] T 89d4b46113284ecc9db8b0e3c2b46f89 P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:10.879822 23232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da47bda397e2471388bcab5069dd7edc" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:10.881739 23159 raft_consensus.cc:1240] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [term 3 LEADER]: Rejecting Update request from peer 48bc58ace75f40e995efc1edcefe79fa for earlier term 2. Current term is 3. Ops: []
I20260709 12:12:10.883455 23509 consensus_queue.cc:1059] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:10.884162 23509 consensus_queue.cc:1243] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Peer 3824bca1df8e4020b18c7989f7758391 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 12:12:10.884642 23509 raft_consensus.cc:3055] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:10.884966 23509 raft_consensus.cc:740] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Running, Role: LEADER
I20260709 12:12:10.885800 23509 consensus_queue.cc:260] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:10.862108 23309 raft_consensus.cc:2468] T a51c8a6c6cfe460fadc0694a71805ba6 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 1.
W20260709 12:12:10.887296 23127 leader_election.cc:343] T da47bda397e2471388bcab5069dd7edc P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:10.888298 23509 raft_consensus.cc:3060] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:10.889472 23430 raft_consensus.cc:359] T e3b19b20feb045058cd1cfbd684ff05f P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:10.897871 23430 raft_consensus.cc:385] T e3b19b20feb045058cd1cfbd684ff05f P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:10.898176 23430 raft_consensus.cc:740] T e3b19b20feb045058cd1cfbd684ff05f P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:10.898880 23430 consensus_queue.cc:260] T e3b19b20feb045058cd1cfbd684ff05f P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:10.900391 23429 tablet_bootstrap.cc:492] T 89d4b46113284ecc9db8b0e3c2b46f89 P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:10.900924 23429 ts_tablet_manager.cc:1403] T 89d4b46113284ecc9db8b0e3c2b46f89 P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.147s	user 0.012s	sys 0.008s
I20260709 12:12:10.900949 23430 ts_tablet_manager.cc:1434] T e3b19b20feb045058cd1cfbd684ff05f P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.053s	user 0.001s	sys 0.003s
I20260709 12:12:10.905332 23430 tablet_bootstrap.cc:492] T da47bda397e2471388bcab5069dd7edc P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:10.908010 23429 raft_consensus.cc:359] T 89d4b46113284ecc9db8b0e3c2b46f89 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:10.908747 23429 raft_consensus.cc:385] T 89d4b46113284ecc9db8b0e3c2b46f89 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:10.909171 23429 raft_consensus.cc:740] T 89d4b46113284ecc9db8b0e3c2b46f89 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:10.914934 23429 consensus_queue.cc:260] T 89d4b46113284ecc9db8b0e3c2b46f89 P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:10.919706 23161 raft_consensus.cc:2468] T 7f25493a942c4d96ad5fed839ad58386 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 1.
I20260709 12:12:10.908632 23382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da47bda397e2471388bcab5069dd7edc" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:10.923794 23429 ts_tablet_manager.cc:1434] T 89d4b46113284ecc9db8b0e3c2b46f89 P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 12:12:10.925154 23429 tablet_bootstrap.cc:492] T 024ae14c007f4c469b22ad43f153b12e P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
W20260709 12:12:10.928794 23124 leader_election.cc:343] T da47bda397e2471388bcab5069dd7edc P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:10.929318 23124 leader_election.cc:304] T da47bda397e2471388bcab5069dd7edc P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391; no voters: 48bc58ace75f40e995efc1edcefe79fa, abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:10.930111 23619 raft_consensus.cc:2749] T da47bda397e2471388bcab5069dd7edc P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:10.931671 23509 raft_consensus.cc:493] T e3b19b20feb045058cd1cfbd684ff05f P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.932178 23509 raft_consensus.cc:515] T e3b19b20feb045058cd1cfbd684ff05f P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:10.935411 23509 leader_election.cc:290] T e3b19b20feb045058cd1cfbd684ff05f P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:10.938544 23309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b19b20feb045058cd1cfbd684ff05f" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:10.939363 23309 raft_consensus.cc:2468] T e3b19b20feb045058cd1cfbd684ff05f P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 0.
I20260709 12:12:10.940770 23349 leader_election.cc:304] T e3b19b20feb045058cd1cfbd684ff05f P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689; no voters: 
I20260709 12:12:10.941206 23429 tablet_bootstrap.cc:654] T 024ae14c007f4c469b22ad43f153b12e P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:10.939484 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b19b20feb045058cd1cfbd684ff05f" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:10.941787 23499 raft_consensus.cc:493] T af6b6c7f82544d968d77f359f1a34403 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.941951 23161 raft_consensus.cc:2468] T e3b19b20feb045058cd1cfbd684ff05f P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 0.
I20260709 12:12:10.942301 23499 raft_consensus.cc:515] T af6b6c7f82544d968d77f359f1a34403 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:10.945108 23509 raft_consensus.cc:2804] T e3b19b20feb045058cd1cfbd684ff05f P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:10.945511 23509 raft_consensus.cc:493] T e3b19b20feb045058cd1cfbd684ff05f P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:10.954958 23520 raft_consensus.cc:493] T 89d4b46113284ecc9db8b0e3c2b46f89 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:10.963006 23309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af6b6c7f82544d968d77f359f1a34403" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:10.963874 23309 raft_consensus.cc:2393] T af6b6c7f82544d968d77f359f1a34403 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abe65f4962e147ac841608b6c30f7e1b in current term 1: Already voted for candidate 48bc58ace75f40e995efc1edcefe79fa in this term.
I20260709 12:12:10.961304 23499 leader_election.cc:290] T af6b6c7f82544d968d77f359f1a34403 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:10.965451 23382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af6b6c7f82544d968d77f359f1a34403" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:10.968043 23199 leader_election.cc:304] T af6b6c7f82544d968d77f359f1a34403 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abe65f4962e147ac841608b6c30f7e1b; no voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689
I20260709 12:12:10.967464 23059 catalog_manager.cc:5697] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3824bca1df8e4020b18c7989f7758391 (127.16.98.193). New cstate: current_term: 1 leader_uuid: "3824bca1df8e4020b18c7989f7758391" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:10.959471 23509 raft_consensus.cc:3060] T e3b19b20feb045058cd1cfbd684ff05f P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:10.962076 23520 raft_consensus.cc:515] T 89d4b46113284ecc9db8b0e3c2b46f89 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:10.969940 23499 raft_consensus.cc:3060] T af6b6c7f82544d968d77f359f1a34403 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:10.970736 23430 tablet_bootstrap.cc:654] T da47bda397e2471388bcab5069dd7edc P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:10.977646 23499 raft_consensus.cc:2749] T af6b6c7f82544d968d77f359f1a34403 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:10.978542 23431 tablet_bootstrap.cc:492] T 89d4b46113284ecc9db8b0e3c2b46f89 P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:10.979096 23431 ts_tablet_manager.cc:1403] T 89d4b46113284ecc9db8b0e3c2b46f89 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.150s	user 0.008s	sys 0.007s
I20260709 12:12:10.983340 23232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d4b46113284ecc9db8b0e3c2b46f89" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:10.983935 23158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d4b46113284ecc9db8b0e3c2b46f89" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:10.986500 23509 raft_consensus.cc:515] T e3b19b20feb045058cd1cfbd684ff05f P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
W20260709 12:12:10.987242 23276 leader_election.cc:343] T 89d4b46113284ecc9db8b0e3c2b46f89 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:10.989030 23431 raft_consensus.cc:359] T 89d4b46113284ecc9db8b0e3c2b46f89 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:10.988713 23058 catalog_manager.cc:5697] T 7f25493a942c4d96ad5fed839ad58386 P abe65f4962e147ac841608b6c30f7e1b reported cstate change: term changed from 0 to 1, leader changed from <none> to abe65f4962e147ac841608b6c30f7e1b (127.16.98.194). New cstate: current_term: 1 leader_uuid: "abe65f4962e147ac841608b6c30f7e1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:10.989676 23431 raft_consensus.cc:385] T 89d4b46113284ecc9db8b0e3c2b46f89 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:10.989970 23431 raft_consensus.cc:740] T 89d4b46113284ecc9db8b0e3c2b46f89 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:10.990870 23509 leader_election.cc:290] T e3b19b20feb045058cd1cfbd684ff05f P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Requested vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:10.990628 23431 consensus_queue.cc:260] T 89d4b46113284ecc9db8b0e3c2b46f89 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:10.991461 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b19b20feb045058cd1cfbd684ff05f" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:10.991667 23158 raft_consensus.cc:2468] T 89d4b46113284ecc9db8b0e3c2b46f89 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 0.
I20260709 12:12:10.992044 23161 raft_consensus.cc:3060] T e3b19b20feb045058cd1cfbd684ff05f P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:10.994611 23431 ts_tablet_manager.cc:1434] T 89d4b46113284ecc9db8b0e3c2b46f89 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:12:10.995602 23431 tablet_bootstrap.cc:492] T bda09a1e5c59409c96c419b65061c1dc P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:10.996052 23309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3b19b20feb045058cd1cfbd684ff05f" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:10.996721 23309 raft_consensus.cc:3060] T e3b19b20feb045058cd1cfbd684ff05f P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:10.996008 23274 leader_election.cc:304] T 89d4b46113284ecc9db8b0e3c2b46f89 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689; no voters: abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:10.998752 23482 raft_consensus.cc:2804] T 89d4b46113284ecc9db8b0e3c2b46f89 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:10.999125 23482 raft_consensus.cc:493] T 89d4b46113284ecc9db8b0e3c2b46f89 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:10.999451 23482 raft_consensus.cc:3060] T 89d4b46113284ecc9db8b0e3c2b46f89 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:11.003737 23536 consensus_queue.cc:1048] T 1b4285f9faa34fc595e0b7db3f7f0946 P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:10.979875 23520 leader_election.cc:290] T 89d4b46113284ecc9db8b0e3c2b46f89 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:11.003765 23309 raft_consensus.cc:2468] T e3b19b20feb045058cd1cfbd684ff05f P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 1.
I20260709 12:12:11.008891 23161 raft_consensus.cc:2468] T e3b19b20feb045058cd1cfbd684ff05f P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 1.
I20260709 12:12:11.009968 23348 leader_election.cc:304] T e3b19b20feb045058cd1cfbd684ff05f P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, 48bc58ace75f40e995efc1edcefe79fa; no voters: 
I20260709 12:12:11.011183 23431 tablet_bootstrap.cc:654] T bda09a1e5c59409c96c419b65061c1dc P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:11.011484 23623 raft_consensus.cc:2804] T e3b19b20feb045058cd1cfbd684ff05f P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:11.021592 23482 raft_consensus.cc:515] T 89d4b46113284ecc9db8b0e3c2b46f89 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:11.023028 23433 tablet_bootstrap.cc:492] T da47bda397e2471388bcab5069dd7edc P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:11.023506 23433 ts_tablet_manager.cc:1403] T da47bda397e2471388bcab5069dd7edc P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.195s	user 0.029s	sys 0.004s
I20260709 12:12:11.023248 23477 consensus_queue.cc:1048] T a7d44e74deb341179f886489282ced2f P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:11.025444 23482 leader_election.cc:290] T 89d4b46113284ecc9db8b0e3c2b46f89 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Requested vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:11.027235 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d4b46113284ecc9db8b0e3c2b46f89" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:11.027837 23161 raft_consensus.cc:3060] T 89d4b46113284ecc9db8b0e3c2b46f89 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:11.028559 23429 tablet_bootstrap.cc:492] T 024ae14c007f4c469b22ad43f153b12e P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:11.029024 23429 ts_tablet_manager.cc:1403] T 024ae14c007f4c469b22ad43f153b12e P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.104s	user 0.013s	sys 0.008s
I20260709 12:12:11.029233 23433 raft_consensus.cc:359] T da47bda397e2471388bcab5069dd7edc P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:11.029906 23433 raft_consensus.cc:385] T da47bda397e2471388bcab5069dd7edc P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:11.030179 23433 raft_consensus.cc:740] T da47bda397e2471388bcab5069dd7edc P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:11.030805 23433 consensus_queue.cc:260] T da47bda397e2471388bcab5069dd7edc P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:11.032961 23433 ts_tablet_manager.cc:1434] T da47bda397e2471388bcab5069dd7edc P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:12:11.033862 23433 tablet_bootstrap.cc:492] T 024ae14c007f4c469b22ad43f153b12e P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:11.034837 23161 raft_consensus.cc:2468] T 89d4b46113284ecc9db8b0e3c2b46f89 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 1.
I20260709 12:12:11.038328 23509 consensus_queue.cc:1048] T a7d44e74deb341179f886489282ced2f P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:11.039629 23433 tablet_bootstrap.cc:654] T 024ae14c007f4c469b22ad43f153b12e P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:11.041172 23232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89d4b46113284ecc9db8b0e3c2b46f89" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:11.042893 23623 raft_consensus.cc:697] T e3b19b20feb045058cd1cfbd684ff05f P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Becoming Leader. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Running, Role: LEADER
I20260709 12:12:11.056030 23274 leader_election.cc:304] T 89d4b46113284ecc9db8b0e3c2b46f89 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689; no voters: 
I20260709 12:12:11.057101 23520 raft_consensus.cc:2804] T 89d4b46113284ecc9db8b0e3c2b46f89 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:11.057632 23520 raft_consensus.cc:697] T 89d4b46113284ecc9db8b0e3c2b46f89 P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Becoming Leader. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Running, Role: LEADER
W20260709 12:12:11.058259 23276 leader_election.cc:343] T 89d4b46113284ecc9db8b0e3c2b46f89 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:11.042387 23429 raft_consensus.cc:359] T 024ae14c007f4c469b22ad43f153b12e P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:11.058475 23520 consensus_queue.cc:237] T 89d4b46113284ecc9db8b0e3c2b46f89 P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:11.059656 23429 raft_consensus.cc:385] T 024ae14c007f4c469b22ad43f153b12e P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:11.059918 23429 raft_consensus.cc:740] T 024ae14c007f4c469b22ad43f153b12e P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:11.060611 23429 consensus_queue.cc:260] T 024ae14c007f4c469b22ad43f153b12e P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:11.049602 23522 consensus_queue.cc:1048] T 1b4285f9faa34fc595e0b7db3f7f0946 P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:11.063238 23429 ts_tablet_manager.cc:1434] T 024ae14c007f4c469b22ad43f153b12e P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.004s
I20260709 12:12:11.053462 23431 tablet_bootstrap.cc:492] T bda09a1e5c59409c96c419b65061c1dc P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:11.056730 23623 consensus_queue.cc:237] T e3b19b20feb045058cd1cfbd684ff05f P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:11.064221 23429 tablet_bootstrap.cc:492] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:11.048628 23430 tablet_bootstrap.cc:492] T da47bda397e2471388bcab5069dd7edc P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:11.067569 23430 ts_tablet_manager.cc:1403] T da47bda397e2471388bcab5069dd7edc P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.162s	user 0.011s	sys 0.000s
I20260709 12:12:11.072302 23429 tablet_bootstrap.cc:654] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:11.082700 23431 ts_tablet_manager.cc:1403] T bda09a1e5c59409c96c419b65061c1dc P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.087s	user 0.021s	sys 0.005s
I20260709 12:12:11.085708 23431 raft_consensus.cc:359] T bda09a1e5c59409c96c419b65061c1dc P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:11.084740 23430 raft_consensus.cc:359] T da47bda397e2471388bcab5069dd7edc P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:11.088603 23430 raft_consensus.cc:385] T da47bda397e2471388bcab5069dd7edc P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:11.089740 23430 raft_consensus.cc:740] T da47bda397e2471388bcab5069dd7edc P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:11.091900 23430 consensus_queue.cc:260] T da47bda397e2471388bcab5069dd7edc P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:11.095717 23430 ts_tablet_manager.cc:1434] T da47bda397e2471388bcab5069dd7edc P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:12:11.101725 23430 tablet_bootstrap.cc:492] T d12a070001934296ba81c85f9ba61e27 P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:11.098942 23058 catalog_manager.cc:5697] T e3b19b20feb045058cd1cfbd684ff05f P 48bc58ace75f40e995efc1edcefe79fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196). New cstate: current_term: 1 leader_uuid: "48bc58ace75f40e995efc1edcefe79fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:11.086540 23431 raft_consensus.cc:385] T bda09a1e5c59409c96c419b65061c1dc P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:11.123067 23431 raft_consensus.cc:740] T bda09a1e5c59409c96c419b65061c1dc P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:11.124179 23433 tablet_bootstrap.cc:492] T 024ae14c007f4c469b22ad43f153b12e P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:11.123904 23431 consensus_queue.cc:260] T bda09a1e5c59409c96c419b65061c1dc P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:11.124672 23433 ts_tablet_manager.cc:1403] T 024ae14c007f4c469b22ad43f153b12e P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.091s	user 0.013s	sys 0.004s
I20260709 12:12:11.126678 23431 ts_tablet_manager.cc:1434] T bda09a1e5c59409c96c419b65061c1dc P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 12:12:11.127928 23431 tablet_bootstrap.cc:492] T d12a070001934296ba81c85f9ba61e27 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:11.132875 23430 tablet_bootstrap.cc:654] T d12a070001934296ba81c85f9ba61e27 P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:11.133560 23431 tablet_bootstrap.cc:654] T d12a070001934296ba81c85f9ba61e27 P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:11.134197 23059 catalog_manager.cc:5697] T 89d4b46113284ecc9db8b0e3c2b46f89 P a9d87b20401744c7bd0c491f60cf0689 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "a9d87b20401744c7bd0c491f60cf0689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:11.149344 23522 raft_consensus.cc:493] T 024ae14c007f4c469b22ad43f153b12e P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.149863 23522 raft_consensus.cc:515] T 024ae14c007f4c469b22ad43f153b12e P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:11.152796 23232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "024ae14c007f4c469b22ad43f153b12e" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:11.155824 23522 leader_election.cc:290] T 024ae14c007f4c469b22ad43f153b12e P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:11.158042 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "024ae14c007f4c469b22ad43f153b12e" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
W20260709 12:12:11.159332 23276 leader_election.cc:343] T 024ae14c007f4c469b22ad43f153b12e P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:11.160028 23273 leader_election.cc:343] T 024ae14c007f4c469b22ad43f153b12e P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:11.160624 23273 leader_election.cc:304] T 024ae14c007f4c469b22ad43f153b12e P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689; no voters: 48bc58ace75f40e995efc1edcefe79fa, abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:11.162187 23520 raft_consensus.cc:2749] T 024ae14c007f4c469b22ad43f153b12e P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:11.163486 23433 raft_consensus.cc:359] T 024ae14c007f4c469b22ad43f153b12e P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:11.164213 23433 raft_consensus.cc:385] T 024ae14c007f4c469b22ad43f153b12e P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:11.164469 23433 raft_consensus.cc:740] T 024ae14c007f4c469b22ad43f153b12e P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:11.165026 23430 tablet_bootstrap.cc:492] T d12a070001934296ba81c85f9ba61e27 P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:11.165601 23430 ts_tablet_manager.cc:1403] T d12a070001934296ba81c85f9ba61e27 P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.001s
I20260709 12:12:11.165822 23433 consensus_queue.cc:260] T 024ae14c007f4c469b22ad43f153b12e P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:11.169085 23309 raft_consensus.cc:1275] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [term 3 FOLLOWER]: Refusing update from remote peer 3824bca1df8e4020b18c7989f7758391: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:11.170526 23545 consensus_queue.cc:1048] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:11.174794 23509 consensus_queue.cc:1048] T af6b6c7f82544d968d77f359f1a34403 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:11.176388 23545 raft_consensus.cc:493] T bda09a1e5c59409c96c419b65061c1dc P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.176908 23545 raft_consensus.cc:515] T bda09a1e5c59409c96c419b65061c1dc P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:11.178500 23433 ts_tablet_manager.cc:1434] T 024ae14c007f4c469b22ad43f153b12e P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.054s	user 0.009s	sys 0.000s
I20260709 12:12:11.179911 23307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda09a1e5c59409c96c419b65061c1dc" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:11.180310 23545 leader_election.cc:290] T bda09a1e5c59409c96c419b65061c1dc P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:11.180722 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda09a1e5c59409c96c419b65061c1dc" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
W20260709 12:12:11.181371 23126 leader_election.cc:343] T bda09a1e5c59409c96c419b65061c1dc P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:11.181377 23429 tablet_bootstrap.cc:492] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
W20260709 12:12:11.182269 23124 leader_election.cc:343] T bda09a1e5c59409c96c419b65061c1dc P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:11.182602 23429 ts_tablet_manager.cc:1403] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.119s	user 0.036s	sys 0.025s
I20260709 12:12:11.182744 23124 leader_election.cc:304] T bda09a1e5c59409c96c419b65061c1dc P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391; no voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689
I20260709 12:12:11.185318 23545 raft_consensus.cc:2749] T bda09a1e5c59409c96c419b65061c1dc P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:11.185446 23429 raft_consensus.cc:359] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:11.170892 23430 raft_consensus.cc:359] T d12a070001934296ba81c85f9ba61e27 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:11.186559 23430 raft_consensus.cc:385] T d12a070001934296ba81c85f9ba61e27 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:11.186919 23430 raft_consensus.cc:740] T d12a070001934296ba81c85f9ba61e27 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:11.187628 23430 consensus_queue.cc:260] T d12a070001934296ba81c85f9ba61e27 P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:11.189731 23430 ts_tablet_manager.cc:1434] T d12a070001934296ba81c85f9ba61e27 P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 12:12:11.207269 23430 tablet_bootstrap.cc:492] T 024ae14c007f4c469b22ad43f153b12e P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:11.199378 23431 tablet_bootstrap.cc:492] T d12a070001934296ba81c85f9ba61e27 P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:11.200016 23383 raft_consensus.cc:1275] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa [term 3 FOLLOWER]: Refusing update from remote peer 3824bca1df8e4020b18c7989f7758391: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:12:11.210965 23383 pending_rounds.cc:85] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa: Aborting all ops after (but not including) 1
I20260709 12:12:11.211035 23431 ts_tablet_manager.cc:1403] T d12a070001934296ba81c85f9ba61e27 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.083s	user 0.011s	sys 0.017s
I20260709 12:12:11.211259 23383 pending_rounds.cc:107] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:12:11.211627 23383 raft_consensus.cc:2889] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:11.213191 23545 consensus_queue.cc:1048] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:11.213701 23431 raft_consensus.cc:359] T d12a070001934296ba81c85f9ba61e27 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:11.214268 23431 raft_consensus.cc:385] T d12a070001934296ba81c85f9ba61e27 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:11.204609 23433 tablet_bootstrap.cc:492] T d12a070001934296ba81c85f9ba61e27 P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:11.214510 23431 raft_consensus.cc:740] T d12a070001934296ba81c85f9ba61e27 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:11.216229 23431 consensus_queue.cc:260] T d12a070001934296ba81c85f9ba61e27 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:11.186179 23429 raft_consensus.cc:385] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:11.217087 23429 raft_consensus.cc:740] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:11.217806 23429 consensus_queue.cc:260] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:11.218343 23431 ts_tablet_manager.cc:1434] T d12a070001934296ba81c85f9ba61e27 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:12:11.219293 23431 tablet_bootstrap.cc:492] T 6c03bbe73aee42039c1f868590838eaf P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:11.219707 23429 ts_tablet_manager.cc:1434] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.037s	user 0.002s	sys 0.004s
I20260709 12:12:11.220567 23429 tablet_bootstrap.cc:492] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:11.223248 23509 raft_consensus.cc:493] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.223757 23509 raft_consensus.cc:515] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:11.225844 23509 leader_election.cc:290] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:11.227519 23309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be6b80356b0415ba28a56482e13d24f" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:11.227797 23232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be6b80356b0415ba28a56482e13d24f" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:11.229621 23430 tablet_bootstrap.cc:654] T 024ae14c007f4c469b22ad43f153b12e P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:11.229813 23349 leader_election.cc:304] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa; no voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:11.233220 23477 raft_consensus.cc:2749] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:11.233788 23431 tablet_bootstrap.cc:654] T 6c03bbe73aee42039c1f868590838eaf P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:11.236392 23436 consensus_queue.cc:1048] T af6b6c7f82544d968d77f359f1a34403 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:11.238592 23429 tablet_bootstrap.cc:654] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:11.238848 23430 tablet_bootstrap.cc:492] T 024ae14c007f4c469b22ad43f153b12e P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:11.239481 23430 ts_tablet_manager.cc:1403] T 024ae14c007f4c469b22ad43f153b12e P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.003s
I20260709 12:12:11.241797 23433 tablet_bootstrap.cc:654] T d12a070001934296ba81c85f9ba61e27 P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:11.243057 23430 raft_consensus.cc:359] T 024ae14c007f4c469b22ad43f153b12e P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:11.243996 23430 raft_consensus.cc:385] T 024ae14c007f4c469b22ad43f153b12e P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:11.244324 23430 raft_consensus.cc:740] T 024ae14c007f4c469b22ad43f153b12e P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:11.247525 23431 tablet_bootstrap.cc:492] T 6c03bbe73aee42039c1f868590838eaf P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:11.248040 23431 ts_tablet_manager.cc:1403] T 6c03bbe73aee42039c1f868590838eaf P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.000s
I20260709 12:12:11.250630 23431 raft_consensus.cc:359] T 6c03bbe73aee42039c1f868590838eaf P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:11.251330 23431 raft_consensus.cc:385] T 6c03bbe73aee42039c1f868590838eaf P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:11.251609 23431 raft_consensus.cc:740] T 6c03bbe73aee42039c1f868590838eaf P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:11.252331 23431 consensus_queue.cc:260] T 6c03bbe73aee42039c1f868590838eaf P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:11.245718 23430 consensus_queue.cc:260] T 024ae14c007f4c469b22ad43f153b12e P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:11.253785 23429 tablet_bootstrap.cc:492] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:11.254848 23430 ts_tablet_manager.cc:1434] T 024ae14c007f4c469b22ad43f153b12e P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:12:11.255558 23429 ts_tablet_manager.cc:1403] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.004s
I20260709 12:12:11.255810 23430 tablet_bootstrap.cc:492] T bda09a1e5c59409c96c419b65061c1dc P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:11.262979 23433 tablet_bootstrap.cc:492] T d12a070001934296ba81c85f9ba61e27 P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:11.263562 23433 ts_tablet_manager.cc:1403] T d12a070001934296ba81c85f9ba61e27 P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.059s	user 0.006s	sys 0.008s
I20260709 12:12:11.268741 23433 raft_consensus.cc:359] T d12a070001934296ba81c85f9ba61e27 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:11.269281 23433 raft_consensus.cc:385] T d12a070001934296ba81c85f9ba61e27 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:11.269510 23433 raft_consensus.cc:740] T d12a070001934296ba81c85f9ba61e27 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:11.270223 23499 raft_consensus.cc:493] T 024ae14c007f4c469b22ad43f153b12e P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.270103 23433 consensus_queue.cc:260] T d12a070001934296ba81c85f9ba61e27 P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:11.270713 23499 raft_consensus.cc:515] T 024ae14c007f4c469b22ad43f153b12e P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:11.272702 23499 leader_election.cc:290] T 024ae14c007f4c469b22ad43f153b12e P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:11.272949 23429 raft_consensus.cc:359] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:11.273617 23429 raft_consensus.cc:385] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:11.273869 23429 raft_consensus.cc:740] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:11.274736 23429 consensus_queue.cc:260] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:11.276189 23624 consensus_queue.cc:1048] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:11.276811 23429 ts_tablet_manager.cc:1434] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.000s
I20260709 12:12:11.277659 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "024ae14c007f4c469b22ad43f153b12e" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:11.278422 23383 raft_consensus.cc:2468] T 024ae14c007f4c469b22ad43f153b12e P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 0.
I20260709 12:12:11.279124 23431 ts_tablet_manager.cc:1434] T 6c03bbe73aee42039c1f868590838eaf P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 12:12:11.279309 23433 ts_tablet_manager.cc:1434] T d12a070001934296ba81c85f9ba61e27 P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.002s
I20260709 12:12:11.279788 23199 leader_election.cc:304] T 024ae14c007f4c469b22ad43f153b12e P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:11.280169 23431 tablet_bootstrap.cc:492] T 6b891c5848b248d8a1830e801c7dce9a P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:11.280258 23433 tablet_bootstrap.cc:492] T 89d4b46113284ecc9db8b0e3c2b46f89 P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:11.283061 23309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "024ae14c007f4c469b22ad43f153b12e" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:11.283730 23309 raft_consensus.cc:2468] T 024ae14c007f4c469b22ad43f153b12e P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 0.
I20260709 12:12:11.286478 23429 tablet_bootstrap.cc:492] T bda09a1e5c59409c96c419b65061c1dc P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:11.288483 23430 tablet_bootstrap.cc:654] T bda09a1e5c59409c96c419b65061c1dc P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:11.297724 23106 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:11.298156 23499 raft_consensus.cc:2804] T 024ae14c007f4c469b22ad43f153b12e P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:11.298591 23499 raft_consensus.cc:493] T 024ae14c007f4c469b22ad43f153b12e P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.298985 23499 raft_consensus.cc:3060] T 024ae14c007f4c469b22ad43f153b12e P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:11.300464 23431 tablet_bootstrap.cc:654] T 6b891c5848b248d8a1830e801c7dce9a P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:11.303004 23433 tablet_bootstrap.cc:654] T 89d4b46113284ecc9db8b0e3c2b46f89 P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:11.304288 23540 raft_consensus.cc:493] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48bc58ace75f40e995efc1edcefe79fa)
I20260709 12:12:11.304797 23540 raft_consensus.cc:515] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:11.307821 23309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be6b80356b0415ba28a56482e13d24f" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:11.308547 23309 raft_consensus.cc:2393] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abe65f4962e147ac841608b6c30f7e1b in current term 2: Already voted for candidate a9d87b20401744c7bd0c491f60cf0689 in this term.
I20260709 12:12:11.311074 23540 leader_election.cc:290] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:11.313638 23382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be6b80356b0415ba28a56482e13d24f" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:11.314299 23382 raft_consensus.cc:2468] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 2.
I20260709 12:12:11.315611 23199 leader_election.cc:304] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, abe65f4962e147ac841608b6c30f7e1b; no voters: a9d87b20401744c7bd0c491f60cf0689
I20260709 12:12:11.331787 23430 tablet_bootstrap.cc:492] T bda09a1e5c59409c96c419b65061c1dc P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:11.317271 23429 tablet_bootstrap.cc:654] T bda09a1e5c59409c96c419b65061c1dc P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:11.332330 23430 ts_tablet_manager.cc:1403] T bda09a1e5c59409c96c419b65061c1dc P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.077s	user 0.010s	sys 0.004s
I20260709 12:12:11.332518 23433 tablet_bootstrap.cc:492] T 89d4b46113284ecc9db8b0e3c2b46f89 P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:11.333076 23433 ts_tablet_manager.cc:1403] T 89d4b46113284ecc9db8b0e3c2b46f89 P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.053s	user 0.011s	sys 0.002s
I20260709 12:12:11.335289 23430 raft_consensus.cc:359] T bda09a1e5c59409c96c419b65061c1dc P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:11.335696 23433 raft_consensus.cc:359] T 89d4b46113284ecc9db8b0e3c2b46f89 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:11.336376 23433 raft_consensus.cc:385] T 89d4b46113284ecc9db8b0e3c2b46f89 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:11.336659 23433 raft_consensus.cc:740] T 89d4b46113284ecc9db8b0e3c2b46f89 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:11.337342 23599 raft_consensus.cc:2804] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:11.337749 23599 raft_consensus.cc:493] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 48bc58ace75f40e995efc1edcefe79fa)
I20260709 12:12:11.338109 23599 raft_consensus.cc:3060] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:11.337985 23624 consensus_queue.cc:1048] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:11.345157 23540 consensus_queue.cc:1048] T 7f25493a942c4d96ad5fed839ad58386 P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:11.345397 23599 raft_consensus.cc:515] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:11.348532 23308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be6b80356b0415ba28a56482e13d24f" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:11.349395 23308 raft_consensus.cc:2393] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate abe65f4962e147ac841608b6c30f7e1b in current term 2: Already voted for candidate a9d87b20401744c7bd0c491f60cf0689 in this term.
I20260709 12:12:11.336045 23430 raft_consensus.cc:385] T bda09a1e5c59409c96c419b65061c1dc P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:11.350742 23430 raft_consensus.cc:740] T bda09a1e5c59409c96c419b65061c1dc P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:11.351796 23430 consensus_queue.cc:260] T bda09a1e5c59409c96c419b65061c1dc P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:11.354907 23599 leader_election.cc:290] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 election: Requested vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:11.353976 23430 ts_tablet_manager.cc:1434] T bda09a1e5c59409c96c419b65061c1dc P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:12:11.356254 23382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be6b80356b0415ba28a56482e13d24f" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:11.356383 23433 consensus_queue.cc:260] T 89d4b46113284ecc9db8b0e3c2b46f89 P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:11.358546 23433 ts_tablet_manager.cc:1434] T 89d4b46113284ecc9db8b0e3c2b46f89 P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 12:12:11.359499 23433 tablet_bootstrap.cc:492] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:11.361513 23430 tablet_bootstrap.cc:492] T cd128874f9674cb7802ec50ad0b65026 P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:11.363791 23429 tablet_bootstrap.cc:492] T bda09a1e5c59409c96c419b65061c1dc P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:11.364317 23429 ts_tablet_manager.cc:1403] T bda09a1e5c59409c96c419b65061c1dc P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.078s	user 0.011s	sys 0.002s
I20260709 12:12:11.367177 23429 raft_consensus.cc:359] T bda09a1e5c59409c96c419b65061c1dc P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:11.367871 23429 raft_consensus.cc:385] T bda09a1e5c59409c96c419b65061c1dc P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:11.368194 23429 raft_consensus.cc:740] T bda09a1e5c59409c96c419b65061c1dc P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:11.368983 23429 consensus_queue.cc:260] T bda09a1e5c59409c96c419b65061c1dc P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:11.370033 23382 raft_consensus.cc:2468] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 2.
I20260709 12:12:11.371987 23199 leader_election.cc:304] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, abe65f4962e147ac841608b6c30f7e1b; no voters: a9d87b20401744c7bd0c491f60cf0689
I20260709 12:12:11.373301 23599 raft_consensus.cc:2804] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:11.373999 23599 raft_consensus.cc:697] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [term 2 LEADER]: Becoming Leader. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Running, Role: LEADER
I20260709 12:12:11.374949 23599 consensus_queue.cc:237] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:11.377414 23482 raft_consensus.cc:493] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.377900 23482 raft_consensus.cc:515] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:11.378481 23433 tablet_bootstrap.cc:654] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:11.380045 23482 leader_election.cc:290] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:11.380184 23430 tablet_bootstrap.cc:654] T cd128874f9674cb7802ec50ad0b65026 P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:11.382915 23235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be6b80356b0415ba28a56482e13d24f" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:11.390334 23436 raft_consensus.cc:493] T d12a070001934296ba81c85f9ba61e27 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.391093 23436 raft_consensus.cc:515] T d12a070001934296ba81c85f9ba61e27 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:11.393489 23382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be6b80356b0415ba28a56482e13d24f" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:11.395717 23382 raft_consensus.cc:2468] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 2.
I20260709 12:12:11.394802 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12a070001934296ba81c85f9ba61e27" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:11.399883 23161 raft_consensus.cc:2468] T d12a070001934296ba81c85f9ba61e27 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 0.
I20260709 12:12:11.369899 23499 raft_consensus.cc:515] T 024ae14c007f4c469b22ad43f153b12e P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:11.398469 23235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12a070001934296ba81c85f9ba61e27" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:11.405747 23235 raft_consensus.cc:2468] T d12a070001934296ba81c85f9ba61e27 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 0.
I20260709 12:12:11.401710 23348 leader_election.cc:304] T d12a070001934296ba81c85f9ba61e27 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, 48bc58ace75f40e995efc1edcefe79fa; no voters: 
I20260709 12:12:11.399976 23436 leader_election.cc:290] T d12a070001934296ba81c85f9ba61e27 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:11.407928 23436 raft_consensus.cc:2804] T d12a070001934296ba81c85f9ba61e27 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:11.408347 23436 raft_consensus.cc:493] T d12a070001934296ba81c85f9ba61e27 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.408862 23436 raft_consensus.cc:3060] T d12a070001934296ba81c85f9ba61e27 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:11.414088 23540 consensus_queue.cc:1048] T 7f25493a942c4d96ad5fed839ad58386 P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:11.371960 23429 ts_tablet_manager.cc:1434] T bda09a1e5c59409c96c419b65061c1dc P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:12:11.420218 23429 tablet_bootstrap.cc:492] T cd128874f9674cb7802ec50ad0b65026 P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:11.437711 23308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "024ae14c007f4c469b22ad43f153b12e" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:11.438690 23308 raft_consensus.cc:3060] T 024ae14c007f4c469b22ad43f153b12e P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:11.443949 23430 tablet_bootstrap.cc:492] T cd128874f9674cb7802ec50ad0b65026 P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:11.444659 23430 ts_tablet_manager.cc:1403] T cd128874f9674cb7802ec50ad0b65026 P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.083s	user 0.008s	sys 0.007s
I20260709 12:12:11.447906 23273 leader_election.cc:304] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689; no voters: abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:11.448843 23482 raft_consensus.cc:2804] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:11.449330 23482 raft_consensus.cc:493] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.449774 23482 raft_consensus.cc:3060] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:11.448328 23430 raft_consensus.cc:359] T cd128874f9674cb7802ec50ad0b65026 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:11.454712 23430 raft_consensus.cc:385] T cd128874f9674cb7802ec50ad0b65026 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:11.454986 23430 raft_consensus.cc:740] T cd128874f9674cb7802ec50ad0b65026 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:11.455646 23430 consensus_queue.cc:260] T cd128874f9674cb7802ec50ad0b65026 P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:11.457000 23604 raft_consensus.cc:493] T da47bda397e2471388bcab5069dd7edc P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.457509 23604 raft_consensus.cc:515] T da47bda397e2471388bcab5069dd7edc P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:11.459632 23604 leader_election.cc:290] T da47bda397e2471388bcab5069dd7edc P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:11.459841 23522 raft_consensus.cc:493] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.455225 23436 raft_consensus.cc:515] T d12a070001934296ba81c85f9ba61e27 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:11.460340 23522 raft_consensus.cc:515] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:11.462730 23430 ts_tablet_manager.cc:1434] T cd128874f9674cb7802ec50ad0b65026 P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:12:11.463666 23430 tablet_bootstrap.cc:492] T 5002a306b4474c909091a65333c74939 P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:11.464048 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c03bbe73aee42039c1f868590838eaf" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:11.464731 23161 raft_consensus.cc:2468] T 6c03bbe73aee42039c1f868590838eaf P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 0.
I20260709 12:12:11.462428 23522 leader_election.cc:290] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:11.451804 23499 leader_election.cc:290] T 024ae14c007f4c469b22ad43f153b12e P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 election: Requested vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:11.468135 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da47bda397e2471388bcab5069dd7edc" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:11.468811 23383 raft_consensus.cc:2468] T da47bda397e2471388bcab5069dd7edc P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 0.
W20260709 12:12:11.466348 23200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:42187, user_credentials={real_user=slave}} blocked reactor thread for 65867.1us
I20260709 12:12:11.472663 23199 leader_election.cc:304] T da47bda397e2471388bcab5069dd7edc P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:11.473292 23429 tablet_bootstrap.cc:654] T cd128874f9674cb7802ec50ad0b65026 P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:11.476089 23274 leader_election.cc:304] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689; no voters: 
I20260709 12:12:11.476344 23382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "024ae14c007f4c469b22ad43f153b12e" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:11.476948 23382 raft_consensus.cc:3060] T 024ae14c007f4c469b22ad43f153b12e P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:11.477105 23235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c03bbe73aee42039c1f868590838eaf" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:11.477516 23159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12a070001934296ba81c85f9ba61e27" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:11.478189 23159 raft_consensus.cc:3060] T d12a070001934296ba81c85f9ba61e27 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:11.475620 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da47bda397e2471388bcab5069dd7edc" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:11.479027 23161 raft_consensus.cc:2468] T da47bda397e2471388bcab5069dd7edc P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 0.
I20260709 12:12:11.477779 23431 tablet_bootstrap.cc:492] T 6b891c5848b248d8a1830e801c7dce9a P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:11.484467 23431 ts_tablet_manager.cc:1403] T 6b891c5848b248d8a1830e801c7dce9a P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.204s	user 0.048s	sys 0.064s
I20260709 12:12:11.485553 23308 raft_consensus.cc:2468] T 024ae14c007f4c469b22ad43f153b12e P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 1.
I20260709 12:12:11.485837 23671 raft_consensus.cc:2804] T da47bda397e2471388bcab5069dd7edc P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:11.486358 23671 raft_consensus.cc:493] T da47bda397e2471388bcab5069dd7edc P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.486698 23671 raft_consensus.cc:3060] T da47bda397e2471388bcab5069dd7edc P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:11.487797 23276 leader_election.cc:343] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:11.469698 23436 leader_election.cc:290] T d12a070001934296ba81c85f9ba61e27 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Requested vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:11.478837 23536 raft_consensus.cc:2804] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:11.493862 23536 raft_consensus.cc:493] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.494239 23536 raft_consensus.cc:3060] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:11.494987 23201 leader_election.cc:304] T 024ae14c007f4c469b22ad43f153b12e P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:11.495664 23382 raft_consensus.cc:2468] T 024ae14c007f4c469b22ad43f153b12e P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 1.
I20260709 12:12:11.496564 23670 raft_consensus.cc:2804] T 024ae14c007f4c469b22ad43f153b12e P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:11.498163 23670 raft_consensus.cc:697] T 024ae14c007f4c469b22ad43f153b12e P abe65f4962e147ac841608b6c30f7e1b [term 1 LEADER]: Becoming Leader. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Running, Role: LEADER
I20260709 12:12:11.493413 23159 raft_consensus.cc:2468] T d12a070001934296ba81c85f9ba61e27 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 1.
I20260709 12:12:11.499140 23232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12a070001934296ba81c85f9ba61e27" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:11.504154 23232 raft_consensus.cc:3060] T d12a070001934296ba81c85f9ba61e27 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:11.504374 23348 leader_election.cc:304] T d12a070001934296ba81c85f9ba61e27 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, 48bc58ace75f40e995efc1edcefe79fa; no voters: 
I20260709 12:12:11.505249 23623 raft_consensus.cc:2804] T d12a070001934296ba81c85f9ba61e27 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:11.505698 23623 raft_consensus.cc:697] T d12a070001934296ba81c85f9ba61e27 P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Becoming Leader. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Running, Role: LEADER
I20260709 12:12:11.506034 23482 raft_consensus.cc:515] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:11.506477 23623 consensus_queue.cc:237] T d12a070001934296ba81c85f9ba61e27 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:11.508955 23235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be6b80356b0415ba28a56482e13d24f" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:11.510074 23382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be6b80356b0415ba28a56482e13d24f" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:11.510634 23382 raft_consensus.cc:3060] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:11.512823 23482 leader_election.cc:290] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 3 election: Requested vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:11.515551 23433 tablet_bootstrap.cc:492] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:11.516045 23433 ts_tablet_manager.cc:1403] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.157s	user 0.014s	sys 0.012s
I20260709 12:12:11.500188 23430 tablet_bootstrap.cc:654] T 5002a306b4474c909091a65333c74939 P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:11.492882 23431 raft_consensus.cc:359] T 6b891c5848b248d8a1830e801c7dce9a P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:11.516633 23431 raft_consensus.cc:385] T 6b891c5848b248d8a1830e801c7dce9a P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:11.515941 23536 raft_consensus.cc:515] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:11.516934 23431 raft_consensus.cc:740] T 6b891c5848b248d8a1830e801c7dce9a P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:11.517692 23431 consensus_queue.cc:260] T 6b891c5848b248d8a1830e801c7dce9a P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:11.519838 23431 ts_tablet_manager.cc:1434] T 6b891c5848b248d8a1830e801c7dce9a P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.035s	user 0.002s	sys 0.004s
I20260709 12:12:11.520117 23433 raft_consensus.cc:359] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:11.520774 23431 tablet_bootstrap.cc:492] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:11.520910 23536 leader_election.cc:290] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Requested vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:11.520622 23670 consensus_queue.cc:237] T 024ae14c007f4c469b22ad43f153b12e P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:11.520079 23159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c03bbe73aee42039c1f868590838eaf" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:11.522019 23235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c03bbe73aee42039c1f868590838eaf" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:11.523363 23159 raft_consensus.cc:3060] T 6c03bbe73aee42039c1f868590838eaf P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:11.524279 23276 leader_election.cc:343] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:11.520944 23433 raft_consensus.cc:385] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:11.524922 23433 raft_consensus.cc:740] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:11.525632 23433 consensus_queue.cc:260] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:11.525094 23232 raft_consensus.cc:2468] T d12a070001934296ba81c85f9ba61e27 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 1.
I20260709 12:12:11.527659 23433 ts_tablet_manager.cc:1434] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:12:11.528710 23433 tablet_bootstrap.cc:492] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:11.531085 23159 raft_consensus.cc:2468] T 6c03bbe73aee42039c1f868590838eaf P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 1.
I20260709 12:12:11.532322 23274 leader_election.cc:304] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689; no voters: abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:11.533468 23482 raft_consensus.cc:2804] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:11.533962 23482 raft_consensus.cc:697] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Becoming Leader. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Running, Role: LEADER
I20260709 12:12:11.540015 23482 consensus_queue.cc:237] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:11.546018 23232 raft_consensus.cc:3060] T 89d4b46113284ecc9db8b0e3c2b46f89 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:11.502521 23671 raft_consensus.cc:515] T da47bda397e2471388bcab5069dd7edc P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:11.554134 23671 leader_election.cc:290] T da47bda397e2471388bcab5069dd7edc P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 election: Requested vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:11.554231 23623 consensus_queue.cc:1048] T e3b19b20feb045058cd1cfbd684ff05f P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:11.553777 23059 catalog_manager.cc:5697] T d12a070001934296ba81c85f9ba61e27 P 48bc58ace75f40e995efc1edcefe79fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196). New cstate: current_term: 1 leader_uuid: "48bc58ace75f40e995efc1edcefe79fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:11.557310 23429 tablet_bootstrap.cc:492] T cd128874f9674cb7802ec50ad0b65026 P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:11.557986 23429 ts_tablet_manager.cc:1403] T cd128874f9674cb7802ec50ad0b65026 P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.138s	user 0.012s	sys 0.012s
I20260709 12:12:11.558550 23431 tablet_bootstrap.cc:654] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:11.557104 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da47bda397e2471388bcab5069dd7edc" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:11.560038 23159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da47bda397e2471388bcab5069dd7edc" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:11.560370 23383 raft_consensus.cc:3060] T da47bda397e2471388bcab5069dd7edc P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:11.560685 23159 raft_consensus.cc:3060] T da47bda397e2471388bcab5069dd7edc P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:11.570679 23623 raft_consensus.cc:493] T cd128874f9674cb7802ec50ad0b65026 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.575738 23383 raft_consensus.cc:2468] T da47bda397e2471388bcab5069dd7edc P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 1.
I20260709 12:12:11.576164 23623 raft_consensus.cc:515] T cd128874f9674cb7802ec50ad0b65026 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:11.577067 23199 leader_election.cc:304] T da47bda397e2471388bcab5069dd7edc P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:11.577929 23599 raft_consensus.cc:2804] T da47bda397e2471388bcab5069dd7edc P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:11.578440 23599 raft_consensus.cc:697] T da47bda397e2471388bcab5069dd7edc P abe65f4962e147ac841608b6c30f7e1b [term 1 LEADER]: Becoming Leader. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Running, Role: LEADER
I20260709 12:12:11.579733 23308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd128874f9674cb7802ec50ad0b65026" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:11.580555 23599 consensus_queue.cc:237] T da47bda397e2471388bcab5069dd7edc P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:11.584206 23382 raft_consensus.cc:2468] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 3.
I20260709 12:12:11.578413 23623 leader_election.cc:290] T cd128874f9674cb7802ec50ad0b65026 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:11.592437 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd128874f9674cb7802ec50ad0b65026" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:11.594981 23273 leader_election.cc:304] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689; no voters: abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:11.595005 23623 consensus_queue.cc:1048] T e3b19b20feb045058cd1cfbd684ff05f P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:11.596891 23522 raft_consensus.cc:2804] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:11.597409 23522 raft_consensus.cc:697] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [term 3 LEADER]: Becoming Leader. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Running, Role: LEADER
I20260709 12:12:11.598210 23433 tablet_bootstrap.cc:654] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:11.600252 23430 tablet_bootstrap.cc:492] T 5002a306b4474c909091a65333c74939 P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:11.600678 23430 ts_tablet_manager.cc:1403] T 5002a306b4474c909091a65333c74939 P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.137s	user 0.009s	sys 0.002s
I20260709 12:12:11.602921 23522 consensus_queue.cc:237] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
W20260709 12:12:11.604918 23350 leader_election.cc:343] T cd128874f9674cb7802ec50ad0b65026 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:11.608086 23623 raft_consensus.cc:493] T bda09a1e5c59409c96c419b65061c1dc P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.619282 23429 raft_consensus.cc:359] T cd128874f9674cb7802ec50ad0b65026 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:11.621264 23429 raft_consensus.cc:385] T cd128874f9674cb7802ec50ad0b65026 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:11.621553 23429 raft_consensus.cc:740] T cd128874f9674cb7802ec50ad0b65026 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:11.622342 23429 consensus_queue.cc:260] T cd128874f9674cb7802ec50ad0b65026 P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:11.617460 23520 consensus_queue.cc:1048] T 89d4b46113284ecc9db8b0e3c2b46f89 P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:12:11.630507 23429 ts_tablet_manager.cc:1434] T cd128874f9674cb7802ec50ad0b65026 P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.000s
I20260709 12:12:11.632539 23518 raft_consensus.cc:493] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.633152 23518 raft_consensus.cc:515] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:11.639694 23308 raft_consensus.cc:2468] T cd128874f9674cb7802ec50ad0b65026 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 0.
I20260709 12:12:11.641566 23159 raft_consensus.cc:2468] T da47bda397e2471388bcab5069dd7edc P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 1.
I20260709 12:12:11.615548 23623 raft_consensus.cc:515] T bda09a1e5c59409c96c419b65061c1dc P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:11.651160 23518 leader_election.cc:290] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:11.653144 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db21ddd040d409a9154cbe649864397" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:11.653972 23236 raft_consensus.cc:2468] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 0.
I20260709 12:12:11.655732 23276 leader_election.cc:304] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:11.656651 23623 leader_election.cc:290] T bda09a1e5c59409c96c419b65061c1dc P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:11.656862 23159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda09a1e5c59409c96c419b65061c1dc" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:11.659221 23159 raft_consensus.cc:2468] T bda09a1e5c59409c96c419b65061c1dc P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 0.
I20260709 12:12:11.660374 23348 leader_election.cc:304] T bda09a1e5c59409c96c419b65061c1dc P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, 48bc58ace75f40e995efc1edcefe79fa; no voters: 
I20260709 12:12:11.661111 23429 tablet_bootstrap.cc:492] T 5002a306b4474c909091a65333c74939 P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:11.658672 23536 raft_consensus.cc:2804] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:11.661583 23536 raft_consensus.cc:493] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.661943 23536 raft_consensus.cc:3060] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:11.658095 23382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db21ddd040d409a9154cbe649864397" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:11.665238 23436 raft_consensus.cc:2804] T bda09a1e5c59409c96c419b65061c1dc P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:11.665654 23436 raft_consensus.cc:493] T bda09a1e5c59409c96c419b65061c1dc P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.665987 23436 raft_consensus.cc:3060] T bda09a1e5c59409c96c419b65061c1dc P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:11.670054 23273 leader_election.cc:343] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:11.674212 23518 raft_consensus.cc:493] T bda09a1e5c59409c96c419b65061c1dc P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.674803 23518 raft_consensus.cc:515] T bda09a1e5c59409c96c419b65061c1dc P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:11.677457 23382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda09a1e5c59409c96c419b65061c1dc" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:11.678755 23518 leader_election.cc:290] T bda09a1e5c59409c96c419b65061c1dc P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:11.680751 23436 raft_consensus.cc:515] T bda09a1e5c59409c96c419b65061c1dc P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:11.681973 23382 raft_consensus.cc:2393] T bda09a1e5c59409c96c419b65061c1dc P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d87b20401744c7bd0c491f60cf0689 in current term 1: Already voted for candidate 48bc58ace75f40e995efc1edcefe79fa in this term.
I20260709 12:12:11.687207 23536 raft_consensus.cc:515] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:11.691779 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db21ddd040d409a9154cbe649864397" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:11.692559 23236 raft_consensus.cc:3060] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:11.698865 23156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda09a1e5c59409c96c419b65061c1dc" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:11.699509 23156 raft_consensus.cc:3060] T bda09a1e5c59409c96c419b65061c1dc P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:11.691053 23436 leader_election.cc:290] T bda09a1e5c59409c96c419b65061c1dc P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Requested vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:11.702509 23382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db21ddd040d409a9154cbe649864397" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
W20260709 12:12:11.704170 23273 leader_election.cc:343] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:11.704852 23536 leader_election.cc:290] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Requested vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:11.706719 23156 raft_consensus.cc:2468] T bda09a1e5c59409c96c419b65061c1dc P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 1.
I20260709 12:12:11.707942 23236 raft_consensus.cc:2468] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 1.
I20260709 12:12:11.707973 23348 leader_election.cc:304] T bda09a1e5c59409c96c419b65061c1dc P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, 48bc58ace75f40e995efc1edcefe79fa; no voters: 
I20260709 12:12:11.709158 23436 raft_consensus.cc:2804] T bda09a1e5c59409c96c419b65061c1dc P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:11.709694 23436 raft_consensus.cc:697] T bda09a1e5c59409c96c419b65061c1dc P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Becoming Leader. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Running, Role: LEADER
I20260709 12:12:11.710002 23276 leader_election.cc:304] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b; no voters: 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:11.710852 23436 consensus_queue.cc:237] T bda09a1e5c59409c96c419b65061c1dc P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:11.711467 23536 raft_consensus.cc:2804] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:11.712319 23536 raft_consensus.cc:697] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Becoming Leader. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Running, Role: LEADER
I20260709 12:12:11.713577 23536 consensus_queue.cc:237] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:11.673722 23430 raft_consensus.cc:359] T 5002a306b4474c909091a65333c74939 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:11.718632 23430 raft_consensus.cc:385] T 5002a306b4474c909091a65333c74939 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:11.718904 23430 raft_consensus.cc:740] T 5002a306b4474c909091a65333c74939 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:11.719689 23430 consensus_queue.cc:260] T 5002a306b4474c909091a65333c74939 P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:11.721750 23430 ts_tablet_manager.cc:1434] T 5002a306b4474c909091a65333c74939 P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.121s	user 0.004s	sys 0.000s
I20260709 12:12:11.737142 23433 tablet_bootstrap.cc:492] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:11.737685 23433 ts_tablet_manager.cc:1403] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.209s	user 0.007s	sys 0.004s
I20260709 12:12:11.740020 23429 tablet_bootstrap.cc:654] T 5002a306b4474c909091a65333c74939 P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:11.748924 23433 raft_consensus.cc:359] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:11.749647 23433 raft_consensus.cc:385] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:11.749907 23433 raft_consensus.cc:740] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:11.750556 23433 consensus_queue.cc:260] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:11.755702 23430 tablet_bootstrap.cc:492] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:11.758172 23431 tablet_bootstrap.cc:492] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:11.758813 23431 ts_tablet_manager.cc:1403] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.238s	user 0.013s	sys 0.004s
I20260709 12:12:11.780390 23433 ts_tablet_manager.cc:1434] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 12:12:11.782335 23433 tablet_bootstrap.cc:492] T cd128874f9674cb7802ec50ad0b65026 P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:11.809609 23056 catalog_manager.cc:5697] T bda09a1e5c59409c96c419b65061c1dc P 48bc58ace75f40e995efc1edcefe79fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196). New cstate: current_term: 1 leader_uuid: "48bc58ace75f40e995efc1edcefe79fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:11.815369 23431 raft_consensus.cc:359] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:11.816394 23431 raft_consensus.cc:385] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:11.816754 23431 raft_consensus.cc:740] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
W20260709 12:12:11.752926 23274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:42187, user_credentials={real_user=slave}} blocked reactor thread for 122830us
I20260709 12:12:11.823326 23349 leader_election.cc:304] T cd128874f9674cb7802ec50ad0b65026 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689; no voters: abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:11.825037 23436 raft_consensus.cc:2804] T cd128874f9674cb7802ec50ad0b65026 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:11.825524 23436 raft_consensus.cc:493] T cd128874f9674cb7802ec50ad0b65026 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.825953 23436 raft_consensus.cc:3060] T cd128874f9674cb7802ec50ad0b65026 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:11.828678 23433 tablet_bootstrap.cc:654] T cd128874f9674cb7802ec50ad0b65026 P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:11.840519 23058 catalog_manager.cc:5697] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "a9d87b20401744c7bd0c491f60cf0689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:11.847628 23058 catalog_manager.cc:5697] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "a9d87b20401744c7bd0c491f60cf0689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:11.850124 23430 tablet_bootstrap.cc:654] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:11.869727 23431 consensus_queue.cc:260] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:11.871847 23429 tablet_bootstrap.cc:492] T 5002a306b4474c909091a65333c74939 P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:11.871977 23431 ts_tablet_manager.cc:1434] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.113s	user 0.014s	sys 0.002s
I20260709 12:12:11.872372 23429 ts_tablet_manager.cc:1403] T 5002a306b4474c909091a65333c74939 P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.211s	user 0.072s	sys 0.049s
I20260709 12:12:11.872908 23431 tablet_bootstrap.cc:492] T 9ffb43b95dbe424d89c123a2179445ec P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:11.851271 23158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda09a1e5c59409c96c419b65061c1dc" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:11.873750 23158 raft_consensus.cc:2393] T bda09a1e5c59409c96c419b65061c1dc P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d87b20401744c7bd0c491f60cf0689 in current term 1: Already voted for candidate 48bc58ace75f40e995efc1edcefe79fa in this term.
I20260709 12:12:11.875267 23429 raft_consensus.cc:359] T 5002a306b4474c909091a65333c74939 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:11.876449 23429 raft_consensus.cc:385] T 5002a306b4474c909091a65333c74939 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:11.876714 23429 raft_consensus.cc:740] T 5002a306b4474c909091a65333c74939 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:11.876940 23437 raft_consensus.cc:493] T 6b891c5848b248d8a1830e801c7dce9a P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.877295 23429 consensus_queue.cc:260] T 5002a306b4474c909091a65333c74939 P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:11.877439 23437 raft_consensus.cc:515] T 6b891c5848b248d8a1830e801c7dce9a P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:11.878530 23431 tablet_bootstrap.cc:654] T 9ffb43b95dbe424d89c123a2179445ec P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:11.879549 23429 ts_tablet_manager.cc:1434] T 5002a306b4474c909091a65333c74939 P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:12:11.879671 23437 leader_election.cc:290] T 6b891c5848b248d8a1830e801c7dce9a P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:11.880525 23429 tablet_bootstrap.cc:492] T 6b891c5848b248d8a1830e801c7dce9a P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:11.881719 23307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b891c5848b248d8a1830e801c7dce9a" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:11.884001 23309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda09a1e5c59409c96c419b65061c1dc" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:11.884621 23309 raft_consensus.cc:2468] T bda09a1e5c59409c96c419b65061c1dc P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 0.
I20260709 12:12:11.886693 23309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda09a1e5c59409c96c419b65061c1dc" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:11.887485 23309 raft_consensus.cc:3060] T bda09a1e5c59409c96c419b65061c1dc P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:11.889663 23429 tablet_bootstrap.cc:654] T 6b891c5848b248d8a1830e801c7dce9a P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:11.838219 23436 raft_consensus.cc:515] T cd128874f9674cb7802ec50ad0b65026 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
W20260709 12:12:11.896517 23126 leader_election.cc:343] T 6b891c5848b248d8a1830e801c7dce9a P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:11.899554 23683 consensus_queue.cc:1048] T d12a070001934296ba81c85f9ba61e27 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:11.901103 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b891c5848b248d8a1830e801c7dce9a" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
W20260709 12:12:11.903366 23127 leader_election.cc:343] T 6b891c5848b248d8a1830e801c7dce9a P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:11.903954 23127 leader_election.cc:304] T 6b891c5848b248d8a1830e801c7dce9a P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391; no voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:11.905192 23429 tablet_bootstrap.cc:492] T 6b891c5848b248d8a1830e801c7dce9a P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:11.905416 23545 raft_consensus.cc:2749] T 6b891c5848b248d8a1830e801c7dce9a P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:11.905656 23429 ts_tablet_manager.cc:1403] T 6b891c5848b248d8a1830e801c7dce9a P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.025s	user 0.004s	sys 0.010s
I20260709 12:12:11.906132 23509 consensus_queue.cc:1048] T d12a070001934296ba81c85f9ba61e27 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:11.912837 23429 raft_consensus.cc:359] T 6b891c5848b248d8a1830e801c7dce9a P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:11.913698 23429 raft_consensus.cc:385] T 6b891c5848b248d8a1830e801c7dce9a P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:11.914017 23429 raft_consensus.cc:740] T 6b891c5848b248d8a1830e801c7dce9a P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:11.914779 23429 consensus_queue.cc:260] T 6b891c5848b248d8a1830e801c7dce9a P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:11.917723 23429 ts_tablet_manager.cc:1434] T 6b891c5848b248d8a1830e801c7dce9a P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:12:11.919113 23429 tablet_bootstrap.cc:492] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:11.927901 23429 tablet_bootstrap.cc:654] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:11.938829 23430 tablet_bootstrap.cc:492] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:11.938876 23429 tablet_bootstrap.cc:492] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:11.939432 23430 ts_tablet_manager.cc:1403] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.184s	user 0.012s	sys 0.000s
I20260709 12:12:11.939481 23429 ts_tablet_manager.cc:1403] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.007s
I20260709 12:12:11.942636 23430 raft_consensus.cc:359] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:11.943603 23430 raft_consensus.cc:385] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:11.943964 23430 raft_consensus.cc:740] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:11.950161 23232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd128874f9674cb7802ec50ad0b65026" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
W20260709 12:12:11.952198 23350 leader_election.cc:343] T cd128874f9674cb7802ec50ad0b65026 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:11.943240 23058 catalog_manager.cc:5697] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 reported cstate change: term changed from 1 to 3, leader changed from 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196) to a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195). New cstate: current_term: 3 leader_uuid: "a9d87b20401744c7bd0c491f60cf0689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:11.954741 23429 raft_consensus.cc:359] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:11.955873 23429 raft_consensus.cc:385] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:11.956133 23433 tablet_bootstrap.cc:492] T cd128874f9674cb7802ec50ad0b65026 P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:11.956187 23429 raft_consensus.cc:740] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:11.957118 23429 consensus_queue.cc:260] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:11.959863 23429 ts_tablet_manager.cc:1434] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.005s
I20260709 12:12:11.960702 23429 tablet_bootstrap.cc:492] T fba757d381304cc0bcbb4f9dbcfc812c P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:11.956817 23433 ts_tablet_manager.cc:1403] T cd128874f9674cb7802ec50ad0b65026 P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.175s	user 0.019s	sys 0.033s
I20260709 12:12:11.965994 23433 raft_consensus.cc:359] T cd128874f9674cb7802ec50ad0b65026 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:11.966498 23429 tablet_bootstrap.cc:654] T fba757d381304cc0bcbb4f9dbcfc812c P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:11.966956 23437 raft_consensus.cc:493] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.967463 23437 raft_consensus.cc:515] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:11.969748 23437 leader_election.cc:290] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:11.972225 23670 raft_consensus.cc:493] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:11.972642 23382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c07af998424a59b0e3cb3d0b63579a" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:11.972730 23670 raft_consensus.cc:515] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:11.973511 23431 tablet_bootstrap.cc:492] T 9ffb43b95dbe424d89c123a2179445ec P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:11.974032 23431 ts_tablet_manager.cc:1403] T 9ffb43b95dbe424d89c123a2179445ec P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.101s	user 0.020s	sys 0.012s
I20260709 12:12:11.974913 23670 leader_election.cc:290] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
W20260709 12:12:11.975265 23124 leader_election.cc:343] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:11.975711 23308 raft_consensus.cc:1240] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [term 3 LEADER]: Rejecting Update request from peer abe65f4962e147ac841608b6c30f7e1b for earlier term 2. Current term is 3. Ops: []
I20260709 12:12:11.977401 23433 raft_consensus.cc:385] T cd128874f9674cb7802ec50ad0b65026 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:11.977479 23670 consensus_queue.cc:1059] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:11.977852 23433 raft_consensus.cc:740] T cd128874f9674cb7802ec50ad0b65026 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:11.978224 23670 consensus_queue.cc:1243] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Peer a9d87b20401744c7bd0c491f60cf0689 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 12:12:11.978780 23670 raft_consensus.cc:3055] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:11.979784 23383 raft_consensus.cc:1240] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [term 3 FOLLOWER]: Rejecting Update request from peer abe65f4962e147ac841608b6c30f7e1b for earlier term 2. Current term is 3. Ops: []
I20260709 12:12:11.980001 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c07af998424a59b0e3cb3d0b63579a" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:11.980849 23236 raft_consensus.cc:2468] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 0.
I20260709 12:12:11.981230 23429 tablet_bootstrap.cc:492] T fba757d381304cc0bcbb4f9dbcfc812c P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:11.980000 23433 consensus_queue.cc:260] T cd128874f9674cb7802ec50ad0b65026 P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:11.981735 23429 ts_tablet_manager.cc:1403] T fba757d381304cc0bcbb4f9dbcfc812c P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.007s
I20260709 12:12:11.981612 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c07af998424a59b0e3cb3d0b63579a" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:11.979188 23670 raft_consensus.cc:740] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Running, Role: LEADER
I20260709 12:12:11.983261 23670 consensus_queue.cc:260] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:11.984578 23433 ts_tablet_manager.cc:1434] T cd128874f9674cb7802ec50ad0b65026 P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:12:11.986685 23599 consensus_queue.cc:1059] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:11.987228 23433 tablet_bootstrap.cc:492] T 6c03bbe73aee42039c1f868590838eaf P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
W20260709 12:12:11.987741 23199 leader_election.cc:343] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:11.989692 23156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c07af998424a59b0e3cb3d0b63579a" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:11.990696 23156 raft_consensus.cc:2468] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 0.
I20260709 12:12:11.991887 23200 leader_election.cc:304] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, abe65f4962e147ac841608b6c30f7e1b; no voters: 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:11.993322 23599 raft_consensus.cc:2804] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:11.993602 23433 tablet_bootstrap.cc:654] T 6c03bbe73aee42039c1f868590838eaf P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:11.993758 23599 raft_consensus.cc:493] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:11.994113 23599 raft_consensus.cc:3060] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:11.984498 23429 raft_consensus.cc:359] T fba757d381304cc0bcbb4f9dbcfc812c P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:11.994801 23429 raft_consensus.cc:385] T fba757d381304cc0bcbb4f9dbcfc812c P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:11.996052 23429 raft_consensus.cc:740] T fba757d381304cc0bcbb4f9dbcfc812c P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:11.996732 23429 consensus_queue.cc:260] T fba757d381304cc0bcbb4f9dbcfc812c P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:11.998976 23429 ts_tablet_manager.cc:1434] T fba757d381304cc0bcbb4f9dbcfc812c P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 12:12:11.976831 23431 raft_consensus.cc:359] T 9ffb43b95dbe424d89c123a2179445ec P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:11.985795 23127 leader_election.cc:304] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, abe65f4962e147ac841608b6c30f7e1b; no voters: 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:11.999439 23431 raft_consensus.cc:385] T 9ffb43b95dbe424d89c123a2179445ec P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:11.999765 23431 raft_consensus.cc:740] T 9ffb43b95dbe424d89c123a2179445ec P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:11.999877 23429 tablet_bootstrap.cc:492] T 9aa8c90489d54dc6b2684d1970165a8a P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:12.000483 23431 consensus_queue.cc:260] T 9ffb43b95dbe424d89c123a2179445ec P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:12.001499 23545 raft_consensus.cc:2804] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:12.001861 23545 raft_consensus.cc:493] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:12.002254 23545 raft_consensus.cc:3060] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:12.006630 23599 raft_consensus.cc:515] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:12.007741 23429 tablet_bootstrap.cc:654] T 9aa8c90489d54dc6b2684d1970165a8a P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:12.010828 23545 raft_consensus.cc:515] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:12.011372 23670 raft_consensus.cc:3060] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:12.014907 23382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c07af998424a59b0e3cb3d0b63579a" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:12.015368 23431 ts_tablet_manager.cc:1434] T 9ffb43b95dbe424d89c123a2179445ec P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.041s	user 0.002s	sys 0.005s
I20260709 12:12:12.016379 23431 tablet_bootstrap.cc:492] T 5002a306b4474c909091a65333c74939 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:12.017081 23545 leader_election.cc:290] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 election: Requested vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:12.018596 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c07af998424a59b0e3cb3d0b63579a" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
W20260709 12:12:12.020385 23124 leader_election.cc:343] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:12.024106 23671 consensus_queue.cc:1048] T da47bda397e2471388bcab5069dd7edc P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:12.024677 23431 tablet_bootstrap.cc:654] T 5002a306b4474c909091a65333c74939 P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:12.025027 23056 catalog_manager.cc:5697] T 024ae14c007f4c469b22ad43f153b12e P abe65f4962e147ac841608b6c30f7e1b reported cstate change: term changed from 0 to 1, leader changed from <none> to abe65f4962e147ac841608b6c30f7e1b (127.16.98.194). New cstate: current_term: 1 leader_uuid: "abe65f4962e147ac841608b6c30f7e1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:12.027372 23056 catalog_manager.cc:5697] T da47bda397e2471388bcab5069dd7edc P abe65f4962e147ac841608b6c30f7e1b reported cstate change: term changed from 0 to 1, leader changed from <none> to abe65f4962e147ac841608b6c30f7e1b (127.16.98.194). New cstate: current_term: 1 leader_uuid: "abe65f4962e147ac841608b6c30f7e1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:12.029614 23433 tablet_bootstrap.cc:492] T 6c03bbe73aee42039c1f868590838eaf P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:12.039584 23433 ts_tablet_manager.cc:1403] T 6c03bbe73aee42039c1f868590838eaf P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.053s	user 0.006s	sys 0.014s
W20260709 12:12:12.030897 23199 leader_election.cc:343] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:12.041074 23232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c07af998424a59b0e3cb3d0b63579a" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:12.041874 23232 raft_consensus.cc:2393] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3824bca1df8e4020b18c7989f7758391 in current term 1: Already voted for candidate abe65f4962e147ac841608b6c30f7e1b in this term.
I20260709 12:12:12.042338 23433 raft_consensus.cc:359] T 6c03bbe73aee42039c1f868590838eaf P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:12.043124 23433 raft_consensus.cc:385] T 6c03bbe73aee42039c1f868590838eaf P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:12.043380 23433 raft_consensus.cc:740] T 6c03bbe73aee42039c1f868590838eaf P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:12.044028 23433 consensus_queue.cc:260] T 6c03bbe73aee42039c1f868590838eaf P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:12.033675 23431 tablet_bootstrap.cc:492] T 5002a306b4474c909091a65333c74939 P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:12.045372 23431 ts_tablet_manager.cc:1403] T 5002a306b4474c909091a65333c74939 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.003s
I20260709 12:12:12.045463 23433 ts_tablet_manager.cc:1434] T 6c03bbe73aee42039c1f868590838eaf P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 12:12:12.046347 23433 tablet_bootstrap.cc:492] T 6b891c5848b248d8a1830e801c7dce9a P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:12.049129 23431 raft_consensus.cc:359] T 5002a306b4474c909091a65333c74939 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:12.050026 23431 raft_consensus.cc:385] T 5002a306b4474c909091a65333c74939 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:12.053409 23127 leader_election.cc:304] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391; no voters: 48bc58ace75f40e995efc1edcefe79fa, abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:12.054036 23232 raft_consensus.cc:3060] T 6c03bbe73aee42039c1f868590838eaf P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:12.055684 23545 raft_consensus.cc:2749] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:12.062716 23684 consensus_queue.cc:1048] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:12.064878 23433 tablet_bootstrap.cc:654] T 6b891c5848b248d8a1830e801c7dce9a P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:12.067940 23235 raft_consensus.cc:1275] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [term 3 FOLLOWER]: Refusing update from remote peer a9d87b20401744c7bd0c491f60cf0689: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:12:12.068468 23235 pending_rounds.cc:85] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b: Aborting all ops after (but not including) 1
I20260709 12:12:12.068782 23235 pending_rounds.cc:107] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:12:12.069089 23235 raft_consensus.cc:2889] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:12.071053 23540 consensus_queue.cc:1048] T da47bda397e2471388bcab5069dd7edc P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:12.071625 23520 consensus_queue.cc:1048] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:12.072585 23671 consensus_queue.cc:1048] T 024ae14c007f4c469b22ad43f153b12e P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:12.078799 23670 raft_consensus.cc:493] T cd128874f9674cb7802ec50ad0b65026 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.079281 23670 raft_consensus.cc:515] T cd128874f9674cb7802ec50ad0b65026 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:12.082191 23509 raft_consensus.cc:493] T 5002a306b4474c909091a65333c74939 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.082883 23509 raft_consensus.cc:515] T 5002a306b4474c909091a65333c74939 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:12.085847 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd128874f9674cb7802ec50ad0b65026" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:12.086720 23310 raft_consensus.cc:2468] T cd128874f9674cb7802ec50ad0b65026 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 0.
I20260709 12:12:12.088327 23201 leader_election.cc:304] T cd128874f9674cb7802ec50ad0b65026 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:12.089056 23509 leader_election.cc:290] T 5002a306b4474c909091a65333c74939 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:12.083243 23670 leader_election.cc:290] T cd128874f9674cb7802ec50ad0b65026 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:12.089329 23540 raft_consensus.cc:2804] T cd128874f9674cb7802ec50ad0b65026 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:12.090008 23540 raft_consensus.cc:493] T cd128874f9674cb7802ec50ad0b65026 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:12.090072 23159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5002a306b4474c909091a65333c74939" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:12.090515 23540 raft_consensus.cc:3060] T cd128874f9674cb7802ec50ad0b65026 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:12.091266 23274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:42187, user_credentials={real_user=slave}} blocked reactor thread for 138306us
I20260709 12:12:12.092599 23274 leader_election.cc:304] T bda09a1e5c59409c96c419b65061c1dc P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689; no voters: 3824bca1df8e4020b18c7989f7758391, 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:12.096721 23436 leader_election.cc:290] T cd128874f9674cb7802ec50ad0b65026 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Requested vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:12.090674 23430 consensus_queue.cc:260] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:12.100747 23430 ts_tablet_manager.cc:1434] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.161s	user 0.007s	sys 0.000s
I20260709 12:12:12.103149 23430 tablet_bootstrap.cc:492] T 9ffb43b95dbe424d89c123a2179445ec P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:12.117422 23540 raft_consensus.cc:515] T cd128874f9674cb7802ec50ad0b65026 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:12.139587 23308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd128874f9674cb7802ec50ad0b65026" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:12.140332 23308 raft_consensus.cc:3060] T cd128874f9674cb7802ec50ad0b65026 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:12.050349 23431 raft_consensus.cc:740] T 5002a306b4474c909091a65333c74939 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:12.124825 23382 raft_consensus.cc:1275] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [term 3 FOLLOWER]: Refusing update from remote peer a9d87b20401744c7bd0c491f60cf0689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:12.126456 23430 tablet_bootstrap.cc:654] T 9ffb43b95dbe424d89c123a2179445ec P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:12.146257 23684 consensus_queue.cc:1048] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:12.126988 23384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd128874f9674cb7802ec50ad0b65026" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:12.147740 23384 raft_consensus.cc:2393] T cd128874f9674cb7802ec50ad0b65026 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abe65f4962e147ac841608b6c30f7e1b in current term 1: Already voted for candidate 48bc58ace75f40e995efc1edcefe79fa in this term.
I20260709 12:12:12.146587 23433 tablet_bootstrap.cc:492] T 6b891c5848b248d8a1830e801c7dce9a P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:12.149245 23433 ts_tablet_manager.cc:1403] T 6b891c5848b248d8a1830e801c7dce9a P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.103s	user 0.018s	sys 0.000s
I20260709 12:12:12.152045 23433 raft_consensus.cc:359] T 6b891c5848b248d8a1830e801c7dce9a P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:12.152697 23433 raft_consensus.cc:385] T 6b891c5848b248d8a1830e801c7dce9a P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:12.152966 23433 raft_consensus.cc:740] T 6b891c5848b248d8a1830e801c7dce9a P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:12.154569 23540 leader_election.cc:290] T cd128874f9674cb7802ec50ad0b65026 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 election: Requested vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:12.153609 23433 consensus_queue.cc:260] T 6b891c5848b248d8a1830e801c7dce9a P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:12.131155 23309 raft_consensus.cc:2468] T bda09a1e5c59409c96c419b65061c1dc P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 1.
I20260709 12:12:12.155992 23522 raft_consensus.cc:2749] T bda09a1e5c59409c96c419b65061c1dc P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:12.160832 23308 raft_consensus.cc:2468] T cd128874f9674cb7802ec50ad0b65026 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 1.
I20260709 12:12:12.162298 23201 leader_election.cc:304] T cd128874f9674cb7802ec50ad0b65026 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:12.163337 23540 raft_consensus.cc:2804] T cd128874f9674cb7802ec50ad0b65026 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:12.164049 23433 ts_tablet_manager.cc:1434] T 6b891c5848b248d8a1830e801c7dce9a P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:12:12.163839 23540 raft_consensus.cc:697] T cd128874f9674cb7802ec50ad0b65026 P abe65f4962e147ac841608b6c30f7e1b [term 1 LEADER]: Becoming Leader. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Running, Role: LEADER
I20260709 12:12:12.165001 23433 tablet_bootstrap.cc:492] T 9ffb43b95dbe424d89c123a2179445ec P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:12.165112 23540 consensus_queue.cc:237] T cd128874f9674cb7802ec50ad0b65026 P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:12.168411 23710 consensus_queue.cc:1048] T 024ae14c007f4c469b22ad43f153b12e P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:12.175462 23382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd128874f9674cb7802ec50ad0b65026" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:12.176345 23382 raft_consensus.cc:2393] T cd128874f9674cb7802ec50ad0b65026 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate abe65f4962e147ac841608b6c30f7e1b in current term 1: Already voted for candidate 48bc58ace75f40e995efc1edcefe79fa in this term.
I20260709 12:12:12.180052 23623 consensus_queue.cc:1048] T bda09a1e5c59409c96c419b65061c1dc P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:12.145210 23431 consensus_queue.cc:260] T 5002a306b4474c909091a65333c74939 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:12.185567 23159 raft_consensus.cc:2468] T 5002a306b4474c909091a65333c74939 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 0.
I20260709 12:12:12.187068 23431 ts_tablet_manager.cc:1434] T 5002a306b4474c909091a65333c74939 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.141s	user 0.008s	sys 0.000s
I20260709 12:12:12.187852 23430 tablet_bootstrap.cc:492] T 9ffb43b95dbe424d89c123a2179445ec P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:12.188019 23431 tablet_bootstrap.cc:492] T c113311e527c47578f8c136d335aa87f P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:12.188366 23430 ts_tablet_manager.cc:1403] T 9ffb43b95dbe424d89c123a2179445ec P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.085s	user 0.014s	sys 0.004s
I20260709 12:12:12.189682 23348 leader_election.cc:304] T 5002a306b4474c909091a65333c74939 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, 48bc58ace75f40e995efc1edcefe79fa; no voters: 
I20260709 12:12:12.194986 23623 raft_consensus.cc:2804] T 5002a306b4474c909091a65333c74939 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:12:12.195833 23274 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:42187, user_credentials={real_user=slave}} blocked reactor thread for 103359us
I20260709 12:12:12.195665 23623 raft_consensus.cc:493] T 5002a306b4474c909091a65333c74939 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:12.196512 23623 raft_consensus.cc:3060] T 5002a306b4474c909091a65333c74939 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:12.196774 23522 consensus_queue.cc:1048] T 89d4b46113284ecc9db8b0e3c2b46f89 P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:12.207237 23429 tablet_bootstrap.cc:492] T 9aa8c90489d54dc6b2684d1970165a8a P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:12.207746 23429 ts_tablet_manager.cc:1403] T 9aa8c90489d54dc6b2684d1970165a8a P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.208s	user 0.035s	sys 0.053s
I20260709 12:12:12.203140 23430 raft_consensus.cc:359] T 9ffb43b95dbe424d89c123a2179445ec P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:12.209666 23430 raft_consensus.cc:385] T 9ffb43b95dbe424d89c123a2179445ec P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:12.209955 23430 raft_consensus.cc:740] T 9ffb43b95dbe424d89c123a2179445ec P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:12.211835 23430 consensus_queue.cc:260] T 9ffb43b95dbe424d89c123a2179445ec P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:12.194981 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c07af998424a59b0e3cb3d0b63579a" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:12.214201 23384 raft_consensus.cc:3060] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:12.214740 23161 raft_consensus.cc:2393] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate abe65f4962e147ac841608b6c30f7e1b in current term 1: Already voted for candidate 3824bca1df8e4020b18c7989f7758391 in this term.
I20260709 12:12:12.217237 23431 tablet_bootstrap.cc:654] T c113311e527c47578f8c136d335aa87f P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:12.217666 23200 leader_election.cc:304] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abe65f4962e147ac841608b6c30f7e1b; no voters: 3824bca1df8e4020b18c7989f7758391, 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:12.218596 23540 raft_consensus.cc:2749] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:12.219115 23308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd128874f9674cb7802ec50ad0b65026" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:12.219887 23308 raft_consensus.cc:2393] T cd128874f9674cb7802ec50ad0b65026 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 48bc58ace75f40e995efc1edcefe79fa in current term 1: Already voted for candidate abe65f4962e147ac841608b6c30f7e1b in this term.
I20260709 12:12:12.221117 23308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5002a306b4474c909091a65333c74939" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:12.221791 23308 raft_consensus.cc:2468] T 5002a306b4474c909091a65333c74939 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 0.
I20260709 12:12:12.222803 23429 raft_consensus.cc:359] T 9aa8c90489d54dc6b2684d1970165a8a P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:12.223523 23429 raft_consensus.cc:385] T 9aa8c90489d54dc6b2684d1970165a8a P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:12.223791 23429 raft_consensus.cc:740] T 9aa8c90489d54dc6b2684d1970165a8a P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:12.224862 23349 leader_election.cc:304] T cd128874f9674cb7802ec50ad0b65026 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa; no voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:12.195088 23599 leader_election.cc:290] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 election: Requested vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:12.226702 23436 raft_consensus.cc:2749] T cd128874f9674cb7802ec50ad0b65026 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:12.228083 23522 consensus_queue.cc:1048] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:12.230536 23477 consensus_queue.cc:1048] T bda09a1e5c59409c96c419b65061c1dc P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:12.233646 23430 ts_tablet_manager.cc:1434] T 9ffb43b95dbe424d89c123a2179445ec P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 12:12:12.234838 23430 tablet_bootstrap.cc:492] T 77c07af998424a59b0e3cb3d0b63579a P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:12.234804 23522 consensus_queue.cc:1048] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:12.226701 23433 tablet_bootstrap.cc:654] T 9ffb43b95dbe424d89c123a2179445ec P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:12.237437 23429 consensus_queue.cc:260] T 9aa8c90489d54dc6b2684d1970165a8a P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:12.240381 23509 raft_consensus.cc:493] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.240952 23509 raft_consensus.cc:515] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:12.244580 23623 raft_consensus.cc:515] T 5002a306b4474c909091a65333c74939 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:12.244606 23430 tablet_bootstrap.cc:654] T 77c07af998424a59b0e3cb3d0b63579a P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:12.250909 23684 raft_consensus.cc:493] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.254078 23429 ts_tablet_manager.cc:1434] T 9aa8c90489d54dc6b2684d1970165a8a P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 12:12:12.255577 23429 tablet_bootstrap.cc:492] T 07201eb1b13e4b54af9c1c18752a9edf P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:12.255920 23684 raft_consensus.cc:515] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:12.258026 23684 leader_election.cc:290] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:12.262428 23233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bd92608bfe43d784e7596be01b388e" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:12.267171 23509 leader_election.cc:290] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
W20260709 12:12:12.276409 23276 leader_election.cc:343] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:12.276814 23233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db21ddd040d409a9154cbe649864397" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:12.277494 23233 raft_consensus.cc:2468] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 1.
I20260709 12:12:12.283720 23158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bd92608bfe43d784e7596be01b388e" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:12.285012 23350 leader_election.cc:304] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:12.285467 23309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db21ddd040d409a9154cbe649864397" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:12.285864 23509 raft_consensus.cc:2804] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:12.278301 23520 raft_consensus.cc:493] T fba757d381304cc0bcbb4f9dbcfc812c P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.286244 23509 raft_consensus.cc:493] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting leader election (detected failure of leader a9d87b20401744c7bd0c491f60cf0689)
I20260709 12:12:12.286818 23509 raft_consensus.cc:3060] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:12.286751 23520 raft_consensus.cc:515] T fba757d381304cc0bcbb4f9dbcfc812c P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:12.288852 23520 leader_election.cc:290] T fba757d381304cc0bcbb4f9dbcfc812c P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
W20260709 12:12:12.291067 23274 leader_election.cc:343] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:12.291548 23274 leader_election.cc:304] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689; no voters: 3824bca1df8e4020b18c7989f7758391, abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:12.303475 23477 raft_consensus.cc:493] T 9ffb43b95dbe424d89c123a2179445ec P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.304026 23477 raft_consensus.cc:515] T 9ffb43b95dbe424d89c123a2179445ec P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:12.306145 23477 leader_election.cc:290] T 9ffb43b95dbe424d89c123a2179445ec P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:12.306928 23158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba757d381304cc0bcbb4f9dbcfc812c" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:12.311429 23433 tablet_bootstrap.cc:492] T 9ffb43b95dbe424d89c123a2179445ec P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:12.311897 23433 ts_tablet_manager.cc:1403] T 9ffb43b95dbe424d89c123a2179445ec P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.147s	user 0.010s	sys 0.003s
I20260709 12:12:12.299675 23522 raft_consensus.cc:2749] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:12.317503 23429 tablet_bootstrap.cc:654] T 07201eb1b13e4b54af9c1c18752a9edf P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:12.307709 23159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffb43b95dbe424d89c123a2179445ec" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:12.321040 23059 catalog_manager.cc:5697] T cd128874f9674cb7802ec50ad0b65026 P abe65f4962e147ac841608b6c30f7e1b reported cstate change: term changed from 0 to 1, leader changed from <none> to abe65f4962e147ac841608b6c30f7e1b (127.16.98.194). New cstate: current_term: 1 leader_uuid: "abe65f4962e147ac841608b6c30f7e1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:12.325661 23233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffb43b95dbe424d89c123a2179445ec" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:12.327261 23159 raft_consensus.cc:2468] T 9ffb43b95dbe424d89c123a2179445ec P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 0.
I20260709 12:12:12.330966 23623 leader_election.cc:290] T 5002a306b4474c909091a65333c74939 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Requested vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
W20260709 12:12:12.323278 23274 leader_election.cc:343] T fba757d381304cc0bcbb4f9dbcfc812c P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:12.331700 23348 leader_election.cc:304] T 9ffb43b95dbe424d89c123a2179445ec P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, 48bc58ace75f40e995efc1edcefe79fa; no voters: 
I20260709 12:12:12.332356 23309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5002a306b4474c909091a65333c74939" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:12.331722 23158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5002a306b4474c909091a65333c74939" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:12.332979 23309 raft_consensus.cc:3060] T 5002a306b4474c909091a65333c74939 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:12.333029 23158 raft_consensus.cc:3060] T 5002a306b4474c909091a65333c74939 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:12.336623 23684 consensus_queue.cc:1048] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:12.344339 23158 raft_consensus.cc:2468] T 5002a306b4474c909091a65333c74939 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 1.
I20260709 12:12:12.346808 23623 raft_consensus.cc:2804] T 9ffb43b95dbe424d89c123a2179445ec P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:12.359517 23623 raft_consensus.cc:493] T 9ffb43b95dbe424d89c123a2179445ec P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:12.359906 23623 raft_consensus.cc:3060] T 9ffb43b95dbe424d89c123a2179445ec P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:12.360642 23348 leader_election.cc:304] T 5002a306b4474c909091a65333c74939 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, 48bc58ace75f40e995efc1edcefe79fa; no voters: 
I20260709 12:12:12.361872 23436 raft_consensus.cc:2804] T 5002a306b4474c909091a65333c74939 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:12.362308 23436 raft_consensus.cc:697] T 5002a306b4474c909091a65333c74939 P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Becoming Leader. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Running, Role: LEADER
I20260709 12:12:12.347350 23384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba757d381304cc0bcbb4f9dbcfc812c" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
W20260709 12:12:12.348850 23350 leader_election.cc:343] T 9ffb43b95dbe424d89c123a2179445ec P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:12.367417 23273 leader_election.cc:343] T fba757d381304cc0bcbb4f9dbcfc812c P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:12.367892 23273 leader_election.cc:304] T fba757d381304cc0bcbb4f9dbcfc812c P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689; no voters: 3824bca1df8e4020b18c7989f7758391, 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:12.352226 23309 raft_consensus.cc:2468] T 5002a306b4474c909091a65333c74939 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 1.
I20260709 12:12:12.355389 23431 tablet_bootstrap.cc:492] T c113311e527c47578f8c136d335aa87f P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:12.375228 23431 ts_tablet_manager.cc:1403] T c113311e527c47578f8c136d335aa87f P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.187s	user 0.029s	sys 0.006s
I20260709 12:12:12.355335 23433 raft_consensus.cc:359] T 9ffb43b95dbe424d89c123a2179445ec P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:12.382232 23433 raft_consensus.cc:385] T 9ffb43b95dbe424d89c123a2179445ec P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:12.382710 23433 raft_consensus.cc:740] T 9ffb43b95dbe424d89c123a2179445ec P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:12.363052 23436 consensus_queue.cc:237] T 5002a306b4474c909091a65333c74939 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:12.383373 23623 raft_consensus.cc:515] T 9ffb43b95dbe424d89c123a2179445ec P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:12.385485 23433 consensus_queue.cc:260] T 9ffb43b95dbe424d89c123a2179445ec P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:12.328856 23509 raft_consensus.cc:515] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:12.392168 23383 raft_consensus.cc:1240] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Rejecting Update request from peer a9d87b20401744c7bd0c491f60cf0689 for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:12.393879 23623 leader_election.cc:290] T 9ffb43b95dbe424d89c123a2179445ec P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Requested vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:12.369055 23522 raft_consensus.cc:2749] T fba757d381304cc0bcbb4f9dbcfc812c P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:12.398895 23522 consensus_queue.cc:1059] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:12.400833 23309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db21ddd040d409a9154cbe649864397" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:12.401028 23233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffb43b95dbe424d89c123a2179445ec" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:12.401922 23233 raft_consensus.cc:3060] T 9ffb43b95dbe424d89c123a2179445ec P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:12.387887 23431 raft_consensus.cc:359] T c113311e527c47578f8c136d335aa87f P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:12.403343 23431 raft_consensus.cc:385] T c113311e527c47578f8c136d335aa87f P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:12.403687 23431 raft_consensus.cc:740] T c113311e527c47578f8c136d335aa87f P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:12.404397 23431 consensus_queue.cc:260] T c113311e527c47578f8c136d335aa87f P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:12.403437 23509 leader_election.cc:290] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 2 election: Requested vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:12.386114 23158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ffb43b95dbe424d89c123a2179445ec" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:12.412976 23158 raft_consensus.cc:3060] T 9ffb43b95dbe424d89c123a2179445ec P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:12.413237 23522 raft_consensus.cc:3055] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:12.413681 23522 raft_consensus.cc:740] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Running, Role: LEADER
I20260709 12:12:12.414469 23522 consensus_queue.cc:260] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:12.415167 23430 tablet_bootstrap.cc:492] T 77c07af998424a59b0e3cb3d0b63579a P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:12.415668 23430 ts_tablet_manager.cc:1403] T 77c07af998424a59b0e3cb3d0b63579a P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.181s	user 0.009s	sys 0.009s
I20260709 12:12:12.413102 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db21ddd040d409a9154cbe649864397" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:12.415911 23522 raft_consensus.cc:3060] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:12.418506 23430 raft_consensus.cc:359] T 77c07af998424a59b0e3cb3d0b63579a P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:12.419230 23430 raft_consensus.cc:385] T 77c07af998424a59b0e3cb3d0b63579a P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:12.419500 23430 raft_consensus.cc:740] T 77c07af998424a59b0e3cb3d0b63579a P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:12.420698 23430 consensus_queue.cc:260] T 77c07af998424a59b0e3cb3d0b63579a P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:12.421594 23429 tablet_bootstrap.cc:492] T 07201eb1b13e4b54af9c1c18752a9edf P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:12.412062 23433 ts_tablet_manager.cc:1434] T 9ffb43b95dbe424d89c123a2179445ec P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.100s	user 0.007s	sys 0.000s
I20260709 12:12:12.424547 23350 leader_election.cc:304] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa; no voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:12.425181 23429 ts_tablet_manager.cc:1403] T 07201eb1b13e4b54af9c1c18752a9edf P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.169s	user 0.004s	sys 0.015s
I20260709 12:12:12.425374 23436 raft_consensus.cc:2749] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:12.426211 23233 raft_consensus.cc:2468] T 9ffb43b95dbe424d89c123a2179445ec P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 1.
I20260709 12:12:12.411481 23431 ts_tablet_manager.cc:1434] T c113311e527c47578f8c136d335aa87f P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.002s
I20260709 12:12:12.427330 23433 tablet_bootstrap.cc:492] T 07201eb1b13e4b54af9c1c18752a9edf P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:12.429598 23431 tablet_bootstrap.cc:492] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:12.424190 23430 ts_tablet_manager.cc:1434] T 77c07af998424a59b0e3cb3d0b63579a P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:12:12.433413 23430 tablet_bootstrap.cc:492] T 9aa8c90489d54dc6b2684d1970165a8a P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:12.434976 23433 tablet_bootstrap.cc:654] T 07201eb1b13e4b54af9c1c18752a9edf P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:12.438493 23431 tablet_bootstrap.cc:654] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:12.440239 23430 tablet_bootstrap.cc:654] T 9aa8c90489d54dc6b2684d1970165a8a P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:12.428148 23429 raft_consensus.cc:359] T 07201eb1b13e4b54af9c1c18752a9edf P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:12.442855 23429 raft_consensus.cc:385] T 07201eb1b13e4b54af9c1c18752a9edf P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:12.443245 23429 raft_consensus.cc:740] T 07201eb1b13e4b54af9c1c18752a9edf P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:12.444195 23429 consensus_queue.cc:260] T 07201eb1b13e4b54af9c1c18752a9edf P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:12.445358 23522 raft_consensus.cc:493] T 6b891c5848b248d8a1830e801c7dce9a P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.445984 23522 raft_consensus.cc:515] T 6b891c5848b248d8a1830e801c7dce9a P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:12.447883 23433 tablet_bootstrap.cc:492] T 07201eb1b13e4b54af9c1c18752a9edf P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:12.448203 23522 leader_election.cc:290] T 6b891c5848b248d8a1830e801c7dce9a P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:12.448357 23433 ts_tablet_manager.cc:1403] T 07201eb1b13e4b54af9c1c18752a9edf P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.009s
I20260709 12:12:12.450584 23431 tablet_bootstrap.cc:492] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:12.451177 23433 raft_consensus.cc:359] T 07201eb1b13e4b54af9c1c18752a9edf P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:12.451707 23429 ts_tablet_manager.cc:1434] T 07201eb1b13e4b54af9c1c18752a9edf P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:12:12.452050 23433 raft_consensus.cc:385] T 07201eb1b13e4b54af9c1c18752a9edf P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:12.452381 23433 raft_consensus.cc:740] T 07201eb1b13e4b54af9c1c18752a9edf P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:12.452721 23431 ts_tablet_manager.cc:1403] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.000s
I20260709 12:12:12.452966 23429 tablet_bootstrap.cc:492] T b71f710147be434e8d790a50e145def8 P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:12.453084 23433 consensus_queue.cc:260] T 07201eb1b13e4b54af9c1c18752a9edf P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:12.453630 23430 tablet_bootstrap.cc:492] T 9aa8c90489d54dc6b2684d1970165a8a P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:12.454095 23430 ts_tablet_manager.cc:1403] T 9aa8c90489d54dc6b2684d1970165a8a P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.000s
I20260709 12:12:12.456012 23433 ts_tablet_manager.cc:1434] T 07201eb1b13e4b54af9c1c18752a9edf P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 12:12:12.515822 23429 tablet_bootstrap.cc:654] T b71f710147be434e8d790a50e145def8 P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:12.523756 23518 raft_consensus.cc:493] T 07201eb1b13e4b54af9c1c18752a9edf P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.524923 23518 raft_consensus.cc:515] T 07201eb1b13e4b54af9c1c18752a9edf P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:12.528522 23709 raft_consensus.cc:493] T 6b891c5848b248d8a1830e801c7dce9a P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.528394 23158 raft_consensus.cc:2468] T 9ffb43b95dbe424d89c123a2179445ec P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 1.
I20260709 12:12:12.528842 23518 leader_election.cc:290] T 07201eb1b13e4b54af9c1c18752a9edf P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:12.529517 23709 raft_consensus.cc:515] T 6b891c5848b248d8a1830e801c7dce9a P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:12.519120 23436 raft_consensus.cc:493] T 77c07af998424a59b0e3cb3d0b63579a P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.533916 23436 raft_consensus.cc:515] T 77c07af998424a59b0e3cb3d0b63579a P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:12.544282 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b891c5848b248d8a1830e801c7dce9a" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:12.544616 23348 leader_election.cc:304] T 9ffb43b95dbe424d89c123a2179445ec P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, 48bc58ace75f40e995efc1edcefe79fa; no voters: 
I20260709 12:12:12.545528 23236 raft_consensus.cc:2468] T 6b891c5848b248d8a1830e801c7dce9a P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 0.
I20260709 12:12:12.546258 23509 raft_consensus.cc:2804] T 9ffb43b95dbe424d89c123a2179445ec P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:12.546931 23509 raft_consensus.cc:697] T 9ffb43b95dbe424d89c123a2179445ec P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Becoming Leader. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Running, Role: LEADER
I20260709 12:12:12.550012 23158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b891c5848b248d8a1830e801c7dce9a" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:12.554885 23158 raft_consensus.cc:2468] T 6b891c5848b248d8a1830e801c7dce9a P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 0.
I20260709 12:12:12.559623 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07201eb1b13e4b54af9c1c18752a9edf" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:12.560648 23236 raft_consensus.cc:2468] T 07201eb1b13e4b54af9c1c18752a9edf P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 0.
I20260709 12:12:12.561302 23232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c07af998424a59b0e3cb3d0b63579a" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:12.561587 23709 leader_election.cc:290] T 6b891c5848b248d8a1830e801c7dce9a P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:12.562436 23232 raft_consensus.cc:2393] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48bc58ace75f40e995efc1edcefe79fa in current term 1: Already voted for candidate abe65f4962e147ac841608b6c30f7e1b in this term.
I20260709 12:12:12.563203 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07201eb1b13e4b54af9c1c18752a9edf" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
W20260709 12:12:12.569020 23273 leader_election.cc:343] T 07201eb1b13e4b54af9c1c18752a9edf P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:12.551659 23276 leader_election.cc:304] T 6b891c5848b248d8a1830e801c7dce9a P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:12.571355 23522 raft_consensus.cc:2804] T 6b891c5848b248d8a1830e801c7dce9a P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:12.571933 23522 raft_consensus.cc:493] T 6b891c5848b248d8a1830e801c7dce9a P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:12.572464 23522 raft_consensus.cc:3060] T 6b891c5848b248d8a1830e801c7dce9a P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:12.572309 23430 raft_consensus.cc:359] T 9aa8c90489d54dc6b2684d1970165a8a P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:12.573729 23430 raft_consensus.cc:385] T 9aa8c90489d54dc6b2684d1970165a8a P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:12.574118 23430 raft_consensus.cc:740] T 9aa8c90489d54dc6b2684d1970165a8a P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:12.569815 23156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b891c5848b248d8a1830e801c7dce9a" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:12.575783 23156 raft_consensus.cc:2468] T 6b891c5848b248d8a1830e801c7dce9a P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 0.
I20260709 12:12:12.577561 23200 leader_election.cc:304] T 6b891c5848b248d8a1830e801c7dce9a P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:12.579319 23710 raft_consensus.cc:2804] T 6b891c5848b248d8a1830e801c7dce9a P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:12.579774 23710 raft_consensus.cc:493] T 6b891c5848b248d8a1830e801c7dce9a P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:12.580169 23710 raft_consensus.cc:3060] T 6b891c5848b248d8a1830e801c7dce9a P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:12.559680 23436 leader_election.cc:290] T 77c07af998424a59b0e3cb3d0b63579a P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:12.585300 23276 leader_election.cc:304] T 07201eb1b13e4b54af9c1c18752a9edf P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b; no voters: 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:12.586988 23536 raft_consensus.cc:2804] T 07201eb1b13e4b54af9c1c18752a9edf P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:12.550035 23509 consensus_queue.cc:237] T 9ffb43b95dbe424d89c123a2179445ec P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:12.587337 23309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b891c5848b248d8a1830e801c7dce9a" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:12.587374 23536 raft_consensus.cc:493] T 07201eb1b13e4b54af9c1c18752a9edf P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:12.588558 23536 raft_consensus.cc:3060] T 07201eb1b13e4b54af9c1c18752a9edf P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:12.590834 23156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c07af998424a59b0e3cb3d0b63579a" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:12.591161 23522 raft_consensus.cc:515] T 6b891c5848b248d8a1830e801c7dce9a P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:12.592607 23309 raft_consensus.cc:2393] T 6b891c5848b248d8a1830e801c7dce9a P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abe65f4962e147ac841608b6c30f7e1b in current term 1: Already voted for candidate a9d87b20401744c7bd0c491f60cf0689 in this term.
I20260709 12:12:12.592465 23430 consensus_queue.cc:260] T 9aa8c90489d54dc6b2684d1970165a8a P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:12.596809 23522 leader_election.cc:290] T 6b891c5848b248d8a1830e801c7dce9a P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Requested vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:12.597918 23156 raft_consensus.cc:2393] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48bc58ace75f40e995efc1edcefe79fa in current term 1: Already voted for candidate 3824bca1df8e4020b18c7989f7758391 in this term.
I20260709 12:12:12.599069 23348 leader_election.cc:304] T 77c07af998424a59b0e3cb3d0b63579a P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa; no voters: 3824bca1df8e4020b18c7989f7758391, abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:12.600467 23436 raft_consensus.cc:3060] T 77c07af998424a59b0e3cb3d0b63579a P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:12.602288 23431 raft_consensus.cc:359] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:12.603288 23431 raft_consensus.cc:385] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:12.603596 23431 raft_consensus.cc:740] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:12.607462 23156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b891c5848b248d8a1830e801c7dce9a" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:12.607820 23433 tablet_bootstrap.cc:492] T c113311e527c47578f8c136d335aa87f P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:12.611020 23477 raft_consensus.cc:493] T 9aa8c90489d54dc6b2684d1970165a8a P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.611019 23156 raft_consensus.cc:3060] T 6b891c5848b248d8a1830e801c7dce9a P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:12.611675 23477 raft_consensus.cc:515] T 9aa8c90489d54dc6b2684d1970165a8a P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:12.615381 23160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa8c90489d54dc6b2684d1970165a8a" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:12.614228 23477 leader_election.cc:290] T 9aa8c90489d54dc6b2684d1970165a8a P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
W20260709 12:12:12.616771 23348 leader_election.cc:343] T 9aa8c90489d54dc6b2684d1970165a8a P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:12.618491 23536 raft_consensus.cc:515] T 07201eb1b13e4b54af9c1c18752a9edf P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:12.619894 23309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa8c90489d54dc6b2684d1970165a8a" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:12.620653 23309 raft_consensus.cc:2468] T 9aa8c90489d54dc6b2684d1970165a8a P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 0.
I20260709 12:12:12.614197 23232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b891c5848b248d8a1830e801c7dce9a" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:12.623425 23349 leader_election.cc:304] T 9aa8c90489d54dc6b2684d1970165a8a P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689; no voters: 3824bca1df8e4020b18c7989f7758391
I20260709 12:12:12.623749 23156 raft_consensus.cc:2468] T 6b891c5848b248d8a1830e801c7dce9a P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 1.
I20260709 12:12:12.624454 23384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07201eb1b13e4b54af9c1c18752a9edf" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:12.624761 23477 raft_consensus.cc:2804] T 9aa8c90489d54dc6b2684d1970165a8a P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:12.625214 23477 raft_consensus.cc:493] T 9aa8c90489d54dc6b2684d1970165a8a P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:12.625553 23477 raft_consensus.cc:3060] T 9aa8c90489d54dc6b2684d1970165a8a P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:12.625801 23536 leader_election.cc:290] T 07201eb1b13e4b54af9c1c18752a9edf P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Requested vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
W20260709 12:12:12.625857 23273 leader_election.cc:343] T 07201eb1b13e4b54af9c1c18752a9edf P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:12.627807 23274 leader_election.cc:304] T 6b891c5848b248d8a1830e801c7dce9a P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689; no voters: 
I20260709 12:12:12.630906 23536 raft_consensus.cc:2804] T 6b891c5848b248d8a1830e801c7dce9a P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:12.630532 23431 consensus_queue.cc:260] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:12.610548 23436 raft_consensus.cc:2749] T 77c07af998424a59b0e3cb3d0b63579a P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:12.638613 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07201eb1b13e4b54af9c1c18752a9edf" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:12.639488 23236 raft_consensus.cc:3060] T 07201eb1b13e4b54af9c1c18752a9edf P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:12.636930 23536 raft_consensus.cc:697] T 6b891c5848b248d8a1830e801c7dce9a P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Becoming Leader. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Running, Role: LEADER
I20260709 12:12:12.651823 23536 consensus_queue.cc:237] T 6b891c5848b248d8a1830e801c7dce9a P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:12.641129 23430 ts_tablet_manager.cc:1434] T 9aa8c90489d54dc6b2684d1970165a8a P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.187s	user 0.012s	sys 0.000s
I20260709 12:12:12.641705 23431 ts_tablet_manager.cc:1434] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.189s	user 0.008s	sys 0.000s
I20260709 12:12:12.698443 23430 tablet_bootstrap.cc:492] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:12.699846 23431 tablet_bootstrap.cc:492] T 64daa90835844e619fa313a9d91a83cc P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:12.694077 23477 raft_consensus.cc:515] T 9aa8c90489d54dc6b2684d1970165a8a P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:12.709843 23709 consensus_queue.cc:1048] T cd128874f9674cb7802ec50ad0b65026 P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:12.720463 23429 tablet_bootstrap.cc:492] T b71f710147be434e8d790a50e145def8 P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:12.721024 23431 tablet_bootstrap.cc:654] T 64daa90835844e619fa313a9d91a83cc P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:12.721138 23429 ts_tablet_manager.cc:1403] T b71f710147be434e8d790a50e145def8 P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.268s	user 0.019s	sys 0.001s
I20260709 12:12:12.694432 23710 raft_consensus.cc:515] T 6b891c5848b248d8a1830e801c7dce9a P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:12.786240 23158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa8c90489d54dc6b2684d1970165a8a" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:12.786084 23477 leader_election.cc:290] T 9aa8c90489d54dc6b2684d1970165a8a P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Requested vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:12.770304 23709 consensus_queue.cc:1048] T cd128874f9674cb7802ec50ad0b65026 P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:12:12.779320 23710 leader_election.cc:290] T 6b891c5848b248d8a1830e801c7dce9a P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 election: Requested vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
W20260709 12:12:12.789011 23348 leader_election.cc:343] T 9aa8c90489d54dc6b2684d1970165a8a P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:12.780028 23307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b891c5848b248d8a1830e801c7dce9a" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:12.725919 23309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aa8c90489d54dc6b2684d1970165a8a" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:12.745262 23156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b891c5848b248d8a1830e801c7dce9a" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:12.791785 23309 raft_consensus.cc:3060] T 9aa8c90489d54dc6b2684d1970165a8a P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:12.792135 23156 raft_consensus.cc:2393] T 6b891c5848b248d8a1830e801c7dce9a P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate abe65f4962e147ac841608b6c30f7e1b in current term 1: Already voted for candidate a9d87b20401744c7bd0c491f60cf0689 in this term.
I20260709 12:12:12.731820 23232 raft_consensus.cc:2393] T 6b891c5848b248d8a1830e801c7dce9a P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d87b20401744c7bd0c491f60cf0689 in current term 1: Already voted for candidate abe65f4962e147ac841608b6c30f7e1b in this term.
I20260709 12:12:12.799286 23200 leader_election.cc:304] T 6b891c5848b248d8a1830e801c7dce9a P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abe65f4962e147ac841608b6c30f7e1b; no voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689
I20260709 12:12:12.801141 23710 raft_consensus.cc:2749] T 6b891c5848b248d8a1830e801c7dce9a P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:12.803959 23545 raft_consensus.cc:493] T c113311e527c47578f8c136d335aa87f P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.804541 23545 raft_consensus.cc:515] T c113311e527c47578f8c136d335aa87f P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:12.807196 23545 leader_election.cc:290] T c113311e527c47578f8c136d335aa87f P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:12.808866 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c113311e527c47578f8c136d335aa87f" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
W20260709 12:12:12.810319 23124 leader_election.cc:343] T c113311e527c47578f8c136d335aa87f P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:12.811064 23232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c113311e527c47578f8c136d335aa87f" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:12.736052 23236 raft_consensus.cc:2468] T 07201eb1b13e4b54af9c1c18752a9edf P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 1.
I20260709 12:12:12.826066 23276 leader_election.cc:304] T 07201eb1b13e4b54af9c1c18752a9edf P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b; no voters: 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:12.827287 23536 raft_consensus.cc:2804] T 07201eb1b13e4b54af9c1c18752a9edf P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:12.827795 23536 raft_consensus.cc:697] T 07201eb1b13e4b54af9c1c18752a9edf P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Becoming Leader. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Running, Role: LEADER
I20260709 12:12:12.828896 23536 consensus_queue.cc:237] T 07201eb1b13e4b54af9c1c18752a9edf P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:12.738742 23058 catalog_manager.cc:5697] T 5002a306b4474c909091a65333c74939 P 48bc58ace75f40e995efc1edcefe79fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196). New cstate: current_term: 1 leader_uuid: "48bc58ace75f40e995efc1edcefe79fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:12.831251 23477 consensus_queue.cc:1048] T 5002a306b4474c909091a65333c74939 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:12.725896 23433 tablet_bootstrap.cc:654] T c113311e527c47578f8c136d335aa87f P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:12.779939 23429 raft_consensus.cc:359] T b71f710147be434e8d790a50e145def8 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:12.833041 23429 raft_consensus.cc:385] T b71f710147be434e8d790a50e145def8 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:12.832558 23058 catalog_manager.cc:5697] T 9ffb43b95dbe424d89c123a2179445ec P 48bc58ace75f40e995efc1edcefe79fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196). New cstate: current_term: 1 leader_uuid: "48bc58ace75f40e995efc1edcefe79fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:12.833338 23429 raft_consensus.cc:740] T b71f710147be434e8d790a50e145def8 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:12.807772 23431 tablet_bootstrap.cc:492] T 64daa90835844e619fa313a9d91a83cc P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:12.835011 23431 ts_tablet_manager.cc:1403] T 64daa90835844e619fa313a9d91a83cc P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.136s	user 0.008s	sys 0.006s
I20260709 12:12:12.816485 23430 tablet_bootstrap.cc:654] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:12.816609 23106 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:12:12.815397 23127 leader_election.cc:343] T c113311e527c47578f8c136d335aa87f P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:12.819665 23545 raft_consensus.cc:493] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.834120 23429 consensus_queue.cc:260] T b71f710147be434e8d790a50e145def8 P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:12.840267 23429 ts_tablet_manager.cc:1434] T b71f710147be434e8d790a50e145def8 P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.119s	user 0.009s	sys 0.005s
I20260709 12:12:12.841086 23431 raft_consensus.cc:359] T 64daa90835844e619fa313a9d91a83cc P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:12.837692 23545 raft_consensus.cc:515] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:12.841845 23431 raft_consensus.cc:385] T 64daa90835844e619fa313a9d91a83cc P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:12.841387 23429 tablet_bootstrap.cc:492] T 64daa90835844e619fa313a9d91a83cc P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:12.843204 23431 raft_consensus.cc:740] T 64daa90835844e619fa313a9d91a83cc P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:12.843909 23127 leader_election.cc:304] T c113311e527c47578f8c136d335aa87f P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391; no voters: 48bc58ace75f40e995efc1edcefe79fa, abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:12.847167 23431 consensus_queue.cc:260] T 64daa90835844e619fa313a9d91a83cc P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:12.854544 23545 leader_election.cc:290] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:12.855690 23309 raft_consensus.cc:2468] T 9aa8c90489d54dc6b2684d1970165a8a P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 1.
I20260709 12:12:12.856048 23545 raft_consensus.cc:2749] T c113311e527c47578f8c136d335aa87f P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:12.862746 23349 leader_election.cc:304] T 9aa8c90489d54dc6b2684d1970165a8a P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689; no voters: 3824bca1df8e4020b18c7989f7758391
I20260709 12:12:12.863827 23509 raft_consensus.cc:2804] T 9aa8c90489d54dc6b2684d1970165a8a P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:12.863698 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bd92608bfe43d784e7596be01b388e" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:12.864323 23509 raft_consensus.cc:697] T 9aa8c90489d54dc6b2684d1970165a8a P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Becoming Leader. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Running, Role: LEADER
I20260709 12:12:12.864477 23310 raft_consensus.cc:2468] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 0.
I20260709 12:12:12.865130 23509 consensus_queue.cc:237] T 9aa8c90489d54dc6b2684d1970165a8a P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:12.867934 23126 leader_election.cc:304] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689; no voters: 
I20260709 12:12:12.877256 23429 tablet_bootstrap.cc:654] T 64daa90835844e619fa313a9d91a83cc P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:12.868377 23055 catalog_manager.cc:5697] T 6b891c5848b248d8a1830e801c7dce9a P a9d87b20401744c7bd0c491f60cf0689 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "a9d87b20401744c7bd0c491f60cf0689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:12.887099 23433 tablet_bootstrap.cc:492] T c113311e527c47578f8c136d335aa87f P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:12.887650 23433 ts_tablet_manager.cc:1403] T c113311e527c47578f8c136d335aa87f P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.280s	user 0.013s	sys 0.007s
I20260709 12:12:12.878588 23545 raft_consensus.cc:2804] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:12.909812 23433 raft_consensus.cc:359] T c113311e527c47578f8c136d335aa87f P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:12.911345 23433 raft_consensus.cc:385] T c113311e527c47578f8c136d335aa87f P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:12.911703 23433 raft_consensus.cc:740] T c113311e527c47578f8c136d335aa87f P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:12.913458 23743 raft_consensus.cc:493] T 64daa90835844e619fa313a9d91a83cc P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.913276 23433 consensus_queue.cc:260] T c113311e527c47578f8c136d335aa87f P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:12.913997 23743 raft_consensus.cc:515] T 64daa90835844e619fa313a9d91a83cc P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:12.900802 23545 raft_consensus.cc:493] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:12.916323 23743 leader_election.cc:290] T 64daa90835844e619fa313a9d91a83cc P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:12.916541 23545 raft_consensus.cc:3060] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:12.921607 23309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64daa90835844e619fa313a9d91a83cc" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
W20260709 12:12:12.924830 23126 leader_election.cc:343] T 64daa90835844e619fa313a9d91a83cc P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:12.935685 23433 ts_tablet_manager.cc:1434] T c113311e527c47578f8c136d335aa87f P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.048s	user 0.003s	sys 0.006s
I20260709 12:12:12.944872 23545 raft_consensus.cc:515] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:12.947172 23545 leader_election.cc:290] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 election: Requested vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:12.948427 23433 tablet_bootstrap.cc:492] T b0348215bfbf4d0bb5ffd2ddc86a4279 P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:12.950337 23431 ts_tablet_manager.cc:1434] T 64daa90835844e619fa313a9d91a83cc P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.115s	user 0.010s	sys 0.024s
W20260709 12:12:12.949580 23127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.194:41907, user_credentials={real_user=slave}} blocked reactor thread for 134344us
I20260709 12:12:12.954835 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bd92608bfe43d784e7596be01b388e" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:12.957592 23683 consensus_queue.cc:1048] T 5002a306b4474c909091a65333c74939 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:12.962370 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64daa90835844e619fa313a9d91a83cc" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:12.964905 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bd92608bfe43d784e7596be01b388e" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
W20260709 12:12:12.969583 23127 leader_election.cc:343] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:12.970750 23127 leader_election.cc:343] T 64daa90835844e619fa313a9d91a83cc P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:12.971186 23127 leader_election.cc:304] T 64daa90835844e619fa313a9d91a83cc P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391; no voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:12.972420 23744 raft_consensus.cc:2749] T 64daa90835844e619fa313a9d91a83cc P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:12.972595 23308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bd92608bfe43d784e7596be01b388e" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
W20260709 12:12:12.972697 23127 leader_election.cc:343] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:12.974035 23308 raft_consensus.cc:3060] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:12.979457 23433 tablet_bootstrap.cc:654] T b0348215bfbf4d0bb5ffd2ddc86a4279 P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:12.983691 23431 tablet_bootstrap.cc:492] T fba757d381304cc0bcbb4f9dbcfc812c P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:12.985457 23430 tablet_bootstrap.cc:492] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:12.985924 23430 ts_tablet_manager.cc:1403] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.288s	user 0.034s	sys 0.023s
I20260709 12:12:12.988550 23430 raft_consensus.cc:359] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:12.989275 23430 raft_consensus.cc:385] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:12.989558 23430 raft_consensus.cc:740] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:12.990437 23430 consensus_queue.cc:260] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:12.991261 23509 raft_consensus.cc:493] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:12.991676 23509 raft_consensus.cc:515] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:12.995913 23307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba757d381304cc0bcbb4f9dbcfc812c" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:12.996567 23509 leader_election.cc:290] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:12.996686 23307 raft_consensus.cc:2468] T fba757d381304cc0bcbb4f9dbcfc812c P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 0.
I20260709 12:12:12.997191 23158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba757d381304cc0bcbb4f9dbcfc812c" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:12.998186 23349 leader_election.cc:304] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689; no voters: 
W20260709 12:12:12.999060 23348 leader_election.cc:343] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:12.999372 23430 ts_tablet_manager.cc:1434] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:12:12.999240 23509 raft_consensus.cc:2804] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:12.999835 23509 raft_consensus.cc:493] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:13.000157 23509 raft_consensus.cc:3060] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:13.005613 23308 raft_consensus.cc:2468] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 1.
I20260709 12:12:13.007944 23509 raft_consensus.cc:515] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:13.009342 23126 leader_election.cc:304] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689; no voters: abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:13.010371 23744 raft_consensus.cc:2804] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:13.010877 23744 raft_consensus.cc:697] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391 [term 1 LEADER]: Becoming Leader. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Running, Role: LEADER
I20260709 12:12:13.010927 23308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba757d381304cc0bcbb4f9dbcfc812c" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:13.011791 23308 raft_consensus.cc:3060] T fba757d381304cc0bcbb4f9dbcfc812c P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:13.011713 23744 consensus_queue.cc:237] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:13.016444 23430 tablet_bootstrap.cc:492] T c113311e527c47578f8c136d335aa87f P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:13.019656 23429 tablet_bootstrap.cc:492] T 64daa90835844e619fa313a9d91a83cc P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:13.020140 23429 ts_tablet_manager.cc:1403] T 64daa90835844e619fa313a9d91a83cc P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.179s	user 0.015s	sys 0.024s
I20260709 12:12:13.020424 23431 tablet_bootstrap.cc:654] T fba757d381304cc0bcbb4f9dbcfc812c P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:13.022498 23433 tablet_bootstrap.cc:492] T b0348215bfbf4d0bb5ffd2ddc86a4279 P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:13.023298 23433 ts_tablet_manager.cc:1403] T b0348215bfbf4d0bb5ffd2ddc86a4279 P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.075s	user 0.017s	sys 0.001s
I20260709 12:12:13.027287 23433 raft_consensus.cc:359] T b0348215bfbf4d0bb5ffd2ddc86a4279 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:13.028178 23433 raft_consensus.cc:385] T b0348215bfbf4d0bb5ffd2ddc86a4279 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:13.028478 23433 raft_consensus.cc:740] T b0348215bfbf4d0bb5ffd2ddc86a4279 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:13.029520 23433 consensus_queue.cc:260] T b0348215bfbf4d0bb5ffd2ddc86a4279 P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:13.031920 23429 raft_consensus.cc:359] T 64daa90835844e619fa313a9d91a83cc P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:13.032656 23429 raft_consensus.cc:385] T 64daa90835844e619fa313a9d91a83cc P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:13.032934 23429 raft_consensus.cc:740] T 64daa90835844e619fa313a9d91a83cc P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:13.036609 23433 ts_tablet_manager.cc:1434] T b0348215bfbf4d0bb5ffd2ddc86a4279 P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:12:13.037806 23433 tablet_bootstrap.cc:492] T 50bd92608bfe43d784e7596be01b388e P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:13.039635 23540 raft_consensus.cc:493] T b0348215bfbf4d0bb5ffd2ddc86a4279 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.040119 23540 raft_consensus.cc:515] T b0348215bfbf4d0bb5ffd2ddc86a4279 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:13.040347 23156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba757d381304cc0bcbb4f9dbcfc812c" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
W20260709 12:12:13.042189 23348 leader_election.cc:343] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:13.042513 23540 leader_election.cc:290] T b0348215bfbf4d0bb5ffd2ddc86a4279 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:13.042954 23509 leader_election.cc:290] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Requested vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:13.044827 23307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0348215bfbf4d0bb5ffd2ddc86a4279" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:13.047115 23384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0348215bfbf4d0bb5ffd2ddc86a4279" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:13.047788 23429 consensus_queue.cc:260] T 64daa90835844e619fa313a9d91a83cc P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:13.050963 23429 ts_tablet_manager.cc:1434] T 64daa90835844e619fa313a9d91a83cc P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.004s
W20260709 12:12:13.051422 23199 leader_election.cc:343] T b0348215bfbf4d0bb5ffd2ddc86a4279 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:13.052237 23429 tablet_bootstrap.cc:492] T b0348215bfbf4d0bb5ffd2ddc86a4279 P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
W20260709 12:12:13.052325 23201 leader_election.cc:343] T b0348215bfbf4d0bb5ffd2ddc86a4279 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:13.052955 23201 leader_election.cc:304] T b0348215bfbf4d0bb5ffd2ddc86a4279 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abe65f4962e147ac841608b6c30f7e1b; no voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689
I20260709 12:12:13.054093 23709 raft_consensus.cc:2749] T b0348215bfbf4d0bb5ffd2ddc86a4279 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:13.038511 23430 tablet_bootstrap.cc:654] T c113311e527c47578f8c136d335aa87f P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:13.066540 23429 tablet_bootstrap.cc:654] T b0348215bfbf4d0bb5ffd2ddc86a4279 P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:13.085078 23431 tablet_bootstrap.cc:492] T fba757d381304cc0bcbb4f9dbcfc812c P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:13.085556 23431 ts_tablet_manager.cc:1403] T fba757d381304cc0bcbb4f9dbcfc812c P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.102s	user 0.008s	sys 0.025s
I20260709 12:12:13.103788 23308 raft_consensus.cc:2468] T fba757d381304cc0bcbb4f9dbcfc812c P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 1.
I20260709 12:12:13.105508 23349 leader_election.cc:304] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689; no voters: 3824bca1df8e4020b18c7989f7758391
I20260709 12:12:13.106627 23509 raft_consensus.cc:2804] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:13.107179 23509 raft_consensus.cc:697] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Becoming Leader. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Running, Role: LEADER
I20260709 12:12:13.107872 23509 consensus_queue.cc:237] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:13.110261 23431 raft_consensus.cc:359] T fba757d381304cc0bcbb4f9dbcfc812c P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:13.111044 23431 raft_consensus.cc:385] T fba757d381304cc0bcbb4f9dbcfc812c P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:13.111307 23431 raft_consensus.cc:740] T fba757d381304cc0bcbb4f9dbcfc812c P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:13.107901 23429 tablet_bootstrap.cc:492] T b0348215bfbf4d0bb5ffd2ddc86a4279 P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:13.112179 23429 ts_tablet_manager.cc:1403] T b0348215bfbf4d0bb5ffd2ddc86a4279 P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.060s	user 0.015s	sys 0.005s
I20260709 12:12:13.112051 23431 consensus_queue.cc:260] T fba757d381304cc0bcbb4f9dbcfc812c P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:13.122177 23430 tablet_bootstrap.cc:492] T c113311e527c47578f8c136d335aa87f P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:13.122707 23430 ts_tablet_manager.cc:1403] T c113311e527c47578f8c136d335aa87f P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.107s	user 0.011s	sys 0.009s
I20260709 12:12:13.128067 23429 raft_consensus.cc:359] T b0348215bfbf4d0bb5ffd2ddc86a4279 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:13.127528 23430 raft_consensus.cc:359] T c113311e527c47578f8c136d335aa87f P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:13.128979 23430 raft_consensus.cc:385] T c113311e527c47578f8c136d335aa87f P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:13.129249 23430 raft_consensus.cc:740] T c113311e527c47578f8c136d335aa87f P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:13.129921 23431 ts_tablet_manager.cc:1434] T fba757d381304cc0bcbb4f9dbcfc812c P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 12:12:13.131083 23431 tablet_bootstrap.cc:492] T 9aa8c90489d54dc6b2684d1970165a8a P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:13.128795 23429 raft_consensus.cc:385] T b0348215bfbf4d0bb5ffd2ddc86a4279 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:13.131549 23429 raft_consensus.cc:740] T b0348215bfbf4d0bb5ffd2ddc86a4279 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:13.131754 23430 consensus_queue.cc:260] T c113311e527c47578f8c136d335aa87f P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:13.132195 23429 consensus_queue.cc:260] T b0348215bfbf4d0bb5ffd2ddc86a4279 P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:13.137961 23429 ts_tablet_manager.cc:1434] T b0348215bfbf4d0bb5ffd2ddc86a4279 P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.025s	user 0.000s	sys 0.006s
I20260709 12:12:13.133230 23477 consensus_queue.cc:1048] T 9ffb43b95dbe424d89c123a2179445ec P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:12:13.143255 23429 tablet_bootstrap.cc:492] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:13.136226 23055 catalog_manager.cc:5697] T 07201eb1b13e4b54af9c1c18752a9edf P a9d87b20401744c7bd0c491f60cf0689 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "a9d87b20401744c7bd0c491f60cf0689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:13.149900 23431 tablet_bootstrap.cc:654] T 9aa8c90489d54dc6b2684d1970165a8a P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:13.153793 23536 consensus_queue.cc:1048] T 6b891c5848b248d8a1830e801c7dce9a P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:13.159099 23056 catalog_manager.cc:5697] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3824bca1df8e4020b18c7989f7758391 (127.16.98.193). New cstate: current_term: 1 leader_uuid: "3824bca1df8e4020b18c7989f7758391" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:13.168449 23685 consensus_queue.cc:1048] T 6b891c5848b248d8a1830e801c7dce9a P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:13.174544 23058 catalog_manager.cc:5697] T 9aa8c90489d54dc6b2684d1970165a8a P 48bc58ace75f40e995efc1edcefe79fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196). New cstate: current_term: 1 leader_uuid: "48bc58ace75f40e995efc1edcefe79fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:13.204020 23430 ts_tablet_manager.cc:1434] T c113311e527c47578f8c136d335aa87f P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.081s	user 0.005s	sys 0.002s
I20260709 12:12:13.204473 23540 raft_consensus.cc:493] T c113311e527c47578f8c136d335aa87f P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.205092 23540 raft_consensus.cc:515] T c113311e527c47578f8c136d335aa87f P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:13.208117 23430 tablet_bootstrap.cc:492] T 07201eb1b13e4b54af9c1c18752a9edf P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:13.224099 23683 consensus_queue.cc:1048] T 9ffb43b95dbe424d89c123a2179445ec P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:13.224225 23384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c113311e527c47578f8c136d335aa87f" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:13.239624 23384 raft_consensus.cc:2468] T c113311e527c47578f8c136d335aa87f P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 0.
I20260709 12:12:13.245754 23199 leader_election.cc:304] T c113311e527c47578f8c136d335aa87f P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:13.247567 23670 raft_consensus.cc:2804] T c113311e527c47578f8c136d335aa87f P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:12:13.251149 23273 consensus_peers.cc:597] T 07201eb1b13e4b54af9c1c18752a9edf P a9d87b20401744c7bd0c491f60cf0689 -> Peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Couldn't send request to peer 48bc58ace75f40e995efc1edcefe79fa. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:13.247974 23670 raft_consensus.cc:493] T c113311e527c47578f8c136d335aa87f P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:13.262714 23670 raft_consensus.cc:3060] T c113311e527c47578f8c136d335aa87f P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:13.259764 23429 tablet_bootstrap.cc:654] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:13.267169 23430 tablet_bootstrap.cc:654] T 07201eb1b13e4b54af9c1c18752a9edf P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:13.271839 23540 leader_election.cc:290] T c113311e527c47578f8c136d335aa87f P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:13.274149 23159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c113311e527c47578f8c136d335aa87f" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:13.274886 23159 raft_consensus.cc:2468] T c113311e527c47578f8c136d335aa87f P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 0.
I20260709 12:12:13.280226 23433 tablet_bootstrap.cc:654] T 50bd92608bfe43d784e7596be01b388e P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:13.283293 23431 tablet_bootstrap.cc:492] T 9aa8c90489d54dc6b2684d1970165a8a P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:13.283782 23431 ts_tablet_manager.cc:1403] T 9aa8c90489d54dc6b2684d1970165a8a P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.153s	user 0.024s	sys 0.036s
I20260709 12:12:13.287417 23431 raft_consensus.cc:359] T 9aa8c90489d54dc6b2684d1970165a8a P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:13.289108 23431 raft_consensus.cc:385] T 9aa8c90489d54dc6b2684d1970165a8a P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:13.289395 23431 raft_consensus.cc:740] T 9aa8c90489d54dc6b2684d1970165a8a P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:13.290709 23431 consensus_queue.cc:260] T 9aa8c90489d54dc6b2684d1970165a8a P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:13.290362 23518 raft_consensus.cc:493] T b71f710147be434e8d790a50e145def8 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.296661 23518 raft_consensus.cc:515] T b71f710147be434e8d790a50e145def8 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:13.301720 23431 ts_tablet_manager.cc:1434] T 9aa8c90489d54dc6b2684d1970165a8a P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.002s
I20260709 12:12:13.302871 23431 tablet_bootstrap.cc:492] T f55cb07c30bc42a0930276baefc1d4b7 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:13.312820 23518 leader_election.cc:290] T b71f710147be434e8d790a50e145def8 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:13.319232 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b71f710147be434e8d790a50e145def8" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:13.322268 23234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b71f710147be434e8d790a50e145def8" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:13.324218 23670 raft_consensus.cc:515] T c113311e527c47578f8c136d335aa87f P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
W20260709 12:12:13.326732 23276 leader_election.cc:343] T b71f710147be434e8d790a50e145def8 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:13.329521 23273 leader_election.cc:343] T b71f710147be434e8d790a50e145def8 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:13.329978 23273 leader_election.cc:304] T b71f710147be434e8d790a50e145def8 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689; no voters: 48bc58ace75f40e995efc1edcefe79fa, abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:13.332579 23430 tablet_bootstrap.cc:492] T 07201eb1b13e4b54af9c1c18752a9edf P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:13.333055 23430 ts_tablet_manager.cc:1403] T 07201eb1b13e4b54af9c1c18752a9edf P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.128s	user 0.004s	sys 0.016s
I20260709 12:12:13.331679 23670 leader_election.cc:290] T c113311e527c47578f8c136d335aa87f P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 election: Requested vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:13.336310 23158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c113311e527c47578f8c136d335aa87f" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:13.336974 23158 raft_consensus.cc:3060] T c113311e527c47578f8c136d335aa87f P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:13.340799 23430 raft_consensus.cc:359] T 07201eb1b13e4b54af9c1c18752a9edf P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:13.341629 23430 raft_consensus.cc:385] T 07201eb1b13e4b54af9c1c18752a9edf P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:13.341935 23430 raft_consensus.cc:740] T 07201eb1b13e4b54af9c1c18752a9edf P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:13.342296 23518 raft_consensus.cc:2749] T b71f710147be434e8d790a50e145def8 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:13.346065 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c113311e527c47578f8c136d335aa87f" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:13.346807 23383 raft_consensus.cc:3060] T c113311e527c47578f8c136d335aa87f P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:13.347074 23429 tablet_bootstrap.cc:492] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:13.347748 23429 ts_tablet_manager.cc:1403] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.205s	user 0.022s	sys 0.003s
I20260709 12:12:13.353626 23518 raft_consensus.cc:493] T b0348215bfbf4d0bb5ffd2ddc86a4279 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.363154 23518 raft_consensus.cc:515] T b0348215bfbf4d0bb5ffd2ddc86a4279 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:13.355221 23765 raft_consensus.cc:493] T 64daa90835844e619fa313a9d91a83cc P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.366427 23765 raft_consensus.cc:515] T 64daa90835844e619fa313a9d91a83cc P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:13.368929 23765 leader_election.cc:290] T 64daa90835844e619fa313a9d91a83cc P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:13.369844 23518 leader_election.cc:290] T b0348215bfbf4d0bb5ffd2ddc86a4279 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:13.370448 23159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64daa90835844e619fa313a9d91a83cc" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:13.371230 23159 raft_consensus.cc:2468] T 64daa90835844e619fa313a9d91a83cc P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 0.
I20260709 12:12:13.371933 23433 tablet_bootstrap.cc:492] T 50bd92608bfe43d784e7596be01b388e P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:13.370383 23382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0348215bfbf4d0bb5ffd2ddc86a4279" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:13.372499 23433 ts_tablet_manager.cc:1403] T 50bd92608bfe43d784e7596be01b388e P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.335s	user 0.013s	sys 0.001s
I20260709 12:12:13.353976 23431 tablet_bootstrap.cc:654] T f55cb07c30bc42a0930276baefc1d4b7 P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:13.353423 23430 consensus_queue.cc:260] T 07201eb1b13e4b54af9c1c18752a9edf P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:13.372864 23274 leader_election.cc:304] T 64daa90835844e619fa313a9d91a83cc P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689; no voters: 
I20260709 12:12:13.376372 23685 consensus_queue.cc:1048] T 07201eb1b13e4b54af9c1c18752a9edf P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:12:13.379007 23273 leader_election.cc:343] T b0348215bfbf4d0bb5ffd2ddc86a4279 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:13.379145 23233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64daa90835844e619fa313a9d91a83cc" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:13.380015 23232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0348215bfbf4d0bb5ffd2ddc86a4279" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:13.380781 23232 raft_consensus.cc:2468] T b0348215bfbf4d0bb5ffd2ddc86a4279 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 0.
I20260709 12:12:13.383096 23765 raft_consensus.cc:2804] T 64daa90835844e619fa313a9d91a83cc P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:13.383495 23765 raft_consensus.cc:493] T 64daa90835844e619fa313a9d91a83cc P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:13.383838 23765 raft_consensus.cc:3060] T 64daa90835844e619fa313a9d91a83cc P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:13.385222 23276 leader_election.cc:343] T 64daa90835844e619fa313a9d91a83cc P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:13.386149 23276 leader_election.cc:304] T b0348215bfbf4d0bb5ffd2ddc86a4279 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b; no voters: 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:13.386430 23383 raft_consensus.cc:2468] T c113311e527c47578f8c136d335aa87f P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 1.
I20260709 12:12:13.396466 23199 leader_election.cc:304] T c113311e527c47578f8c136d335aa87f P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:13.397454 23670 raft_consensus.cc:2804] T c113311e527c47578f8c136d335aa87f P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:13.397993 23670 raft_consensus.cc:697] T c113311e527c47578f8c136d335aa87f P abe65f4962e147ac841608b6c30f7e1b [term 1 LEADER]: Becoming Leader. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Running, Role: LEADER
I20260709 12:12:13.402187 23433 raft_consensus.cc:359] T 50bd92608bfe43d784e7596be01b388e P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:13.402885 23433 raft_consensus.cc:385] T 50bd92608bfe43d784e7596be01b388e P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:13.403121 23433 raft_consensus.cc:740] T 50bd92608bfe43d784e7596be01b388e P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:13.403728 23433 consensus_queue.cc:260] T 50bd92608bfe43d784e7596be01b388e P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:13.405062 23433 ts_tablet_manager.cc:1434] T 50bd92608bfe43d784e7596be01b388e P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.000s
I20260709 12:12:13.406432 23430 ts_tablet_manager.cc:1434] T 07201eb1b13e4b54af9c1c18752a9edf P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.073s	user 0.003s	sys 0.004s
I20260709 12:12:13.398931 23670 consensus_queue.cc:237] T c113311e527c47578f8c136d335aa87f P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:13.407545 23430 tablet_bootstrap.cc:492] T b71f710147be434e8d790a50e145def8 P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:13.407271 23623 consensus_queue.cc:1048] T 9aa8c90489d54dc6b2684d1970165a8a P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:13.408883 23746 raft_consensus.cc:493] T fba757d381304cc0bcbb4f9dbcfc812c P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.409394 23746 raft_consensus.cc:515] T fba757d381304cc0bcbb4f9dbcfc812c P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:13.411476 23746 leader_election.cc:290] T fba757d381304cc0bcbb4f9dbcfc812c P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:13.414294 23765 raft_consensus.cc:515] T 64daa90835844e619fa313a9d91a83cc P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:13.393231 23770 raft_consensus.cc:2804] T b0348215bfbf4d0bb5ffd2ddc86a4279 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:13.421259 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba757d381304cc0bcbb4f9dbcfc812c" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:13.424747 23308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba757d381304cc0bcbb4f9dbcfc812c" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:13.425532 23308 raft_consensus.cc:2393] T fba757d381304cc0bcbb4f9dbcfc812c P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3824bca1df8e4020b18c7989f7758391 in current term 1: Already voted for candidate 48bc58ace75f40e995efc1edcefe79fa in this term.
I20260709 12:12:13.427088 23126 leader_election.cc:304] T fba757d381304cc0bcbb4f9dbcfc812c P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391; no voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689
I20260709 12:12:13.421145 23770 raft_consensus.cc:493] T b0348215bfbf4d0bb5ffd2ddc86a4279 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:13.427800 23770 raft_consensus.cc:3060] T b0348215bfbf4d0bb5ffd2ddc86a4279 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:13.432112 23744 raft_consensus.cc:3060] T fba757d381304cc0bcbb4f9dbcfc812c P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:13.441562 23055 catalog_manager.cc:5697] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196). New cstate: current_term: 1 leader_uuid: "48bc58ace75f40e995efc1edcefe79fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:13.447077 23429 raft_consensus.cc:359] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:13.447873 23429 raft_consensus.cc:385] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:13.448218 23429 raft_consensus.cc:740] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:13.448778 23429 consensus_queue.cc:260] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:13.453390 23159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64daa90835844e619fa313a9d91a83cc" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:13.455358 23159 raft_consensus.cc:3060] T 64daa90835844e619fa313a9d91a83cc P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:13.456401 23433 tablet_bootstrap.cc:492] T 64daa90835844e619fa313a9d91a83cc P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:13.460654 23765 leader_election.cc:290] T 64daa90835844e619fa313a9d91a83cc P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Requested vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:13.461519 23429 ts_tablet_manager.cc:1434] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.113s	user 0.007s	sys 0.000s
I20260709 12:12:13.461654 23234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64daa90835844e619fa313a9d91a83cc" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
W20260709 12:12:13.463349 23276 leader_election.cc:343] T 64daa90835844e619fa313a9d91a83cc P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:13.465821 23158 raft_consensus.cc:2468] T c113311e527c47578f8c136d335aa87f P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 1.
I20260709 12:12:13.468559 23429 tablet_bootstrap.cc:492] T 85dca37fe4fc46b792220de05fc68749 P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:13.509346 23433 tablet_bootstrap.cc:654] T 64daa90835844e619fa313a9d91a83cc P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:13.532361 23777 consensus_queue.cc:1048] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:13.547124 23059 catalog_manager.cc:5697] T c113311e527c47578f8c136d335aa87f P abe65f4962e147ac841608b6c30f7e1b reported cstate change: term changed from 0 to 1, leader changed from <none> to abe65f4962e147ac841608b6c30f7e1b (127.16.98.194). New cstate: current_term: 1 leader_uuid: "abe65f4962e147ac841608b6c30f7e1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:13.552361 23234 raft_consensus.cc:3060] T 50bd92608bfe43d784e7596be01b388e P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:13.563417 23683 raft_consensus.cc:493] T 07201eb1b13e4b54af9c1c18752a9edf P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.564203 23683 raft_consensus.cc:515] T 07201eb1b13e4b54af9c1c18752a9edf P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:13.567735 23232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07201eb1b13e4b54af9c1c18752a9edf" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:13.570447 23683 leader_election.cc:290] T 07201eb1b13e4b54af9c1c18752a9edf P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:13.571465 23307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07201eb1b13e4b54af9c1c18752a9edf" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:13.573470 23349 leader_election.cc:304] T 07201eb1b13e4b54af9c1c18752a9edf P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa; no voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:13.578094 23477 raft_consensus.cc:2749] T 07201eb1b13e4b54af9c1c18752a9edf P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:13.606047 23430 tablet_bootstrap.cc:654] T b71f710147be434e8d790a50e145def8 P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:13.601066 23744 raft_consensus.cc:2749] T fba757d381304cc0bcbb4f9dbcfc812c P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:13.522454 23770 raft_consensus.cc:515] T b0348215bfbf4d0bb5ffd2ddc86a4279 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:13.610538 23158 raft_consensus.cc:3060] T 9aa8c90489d54dc6b2684d1970165a8a P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:13.616496 23429 tablet_bootstrap.cc:654] T 85dca37fe4fc46b792220de05fc68749 P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:13.623065 23770 leader_election.cc:290] T b0348215bfbf4d0bb5ffd2ddc86a4279 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Requested vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:13.623749 23433 tablet_bootstrap.cc:492] T 64daa90835844e619fa313a9d91a83cc P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:13.624217 23433 ts_tablet_manager.cc:1403] T 64daa90835844e619fa313a9d91a83cc P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.173s	user 0.014s	sys 0.001s
I20260709 12:12:13.624614 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0348215bfbf4d0bb5ffd2ddc86a4279" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:13.625247 23236 raft_consensus.cc:3060] T b0348215bfbf4d0bb5ffd2ddc86a4279 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:13.626930 23433 raft_consensus.cc:359] T 64daa90835844e619fa313a9d91a83cc P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:13.627624 23433 raft_consensus.cc:385] T 64daa90835844e619fa313a9d91a83cc P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:13.627888 23433 raft_consensus.cc:740] T 64daa90835844e619fa313a9d91a83cc P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:13.628512 23433 consensus_queue.cc:260] T 64daa90835844e619fa313a9d91a83cc P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:13.629329 23509 consensus_queue.cc:1048] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:13.633649 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0348215bfbf4d0bb5ffd2ddc86a4279" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:13.630573 23433 ts_tablet_manager.cc:1434] T 64daa90835844e619fa313a9d91a83cc P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:12:13.635831 23433 tablet_bootstrap.cc:492] T b71f710147be434e8d790a50e145def8 P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
W20260709 12:12:13.636946 23273 leader_election.cc:343] T b0348215bfbf4d0bb5ffd2ddc86a4279 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:13.637764 23683 consensus_queue.cc:1048] T 9aa8c90489d54dc6b2684d1970165a8a P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:13.641969 23433 tablet_bootstrap.cc:654] T b71f710147be434e8d790a50e145def8 P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:13.642277 23509 consensus_queue.cc:1048] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:13.610900 23159 raft_consensus.cc:2468] T 64daa90835844e619fa313a9d91a83cc P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 1.
I20260709 12:12:13.649140 23431 tablet_bootstrap.cc:492] T f55cb07c30bc42a0930276baefc1d4b7 P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:13.659245 23431 ts_tablet_manager.cc:1403] T f55cb07c30bc42a0930276baefc1d4b7 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.357s	user 0.058s	sys 0.051s
I20260709 12:12:13.650454 23236 raft_consensus.cc:2468] T b0348215bfbf4d0bb5ffd2ddc86a4279 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 1.
I20260709 12:12:13.671084 23276 leader_election.cc:304] T b0348215bfbf4d0bb5ffd2ddc86a4279 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b; no voters: 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:13.674629 23685 raft_consensus.cc:2804] T b0348215bfbf4d0bb5ffd2ddc86a4279 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:13.678480 23685 raft_consensus.cc:697] T b0348215bfbf4d0bb5ffd2ddc86a4279 P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Becoming Leader. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Running, Role: LEADER
I20260709 12:12:13.679700 23685 consensus_queue.cc:237] T b0348215bfbf4d0bb5ffd2ddc86a4279 P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:13.681139 23778 consensus_queue.cc:1048] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:13.683521 23274 leader_election.cc:304] T 64daa90835844e619fa313a9d91a83cc P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689; no voters: abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:13.685714 23518 raft_consensus.cc:2804] T 64daa90835844e619fa313a9d91a83cc P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:13.686182 23518 raft_consensus.cc:697] T 64daa90835844e619fa313a9d91a83cc P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Becoming Leader. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Running, Role: LEADER
I20260709 12:12:13.684159 23431 raft_consensus.cc:359] T f55cb07c30bc42a0930276baefc1d4b7 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:13.687572 23431 raft_consensus.cc:385] T f55cb07c30bc42a0930276baefc1d4b7 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:13.687238 23518 consensus_queue.cc:237] T 64daa90835844e619fa313a9d91a83cc P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:13.692730 23431 raft_consensus.cc:740] T f55cb07c30bc42a0930276baefc1d4b7 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:13.706441 23670 raft_consensus.cc:493] T 64daa90835844e619fa313a9d91a83cc P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.707101 23670 raft_consensus.cc:515] T 64daa90835844e619fa313a9d91a83cc P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:13.709838 23431 consensus_queue.cc:260] T f55cb07c30bc42a0930276baefc1d4b7 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:13.712725 23431 ts_tablet_manager.cc:1434] T f55cb07c30bc42a0930276baefc1d4b7 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.001s
I20260709 12:12:13.713781 23431 tablet_bootstrap.cc:492] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:13.716948 23765 raft_consensus.cc:493] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.717479 23765 raft_consensus.cc:515] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:13.719584 23765 leader_election.cc:290] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:13.720512 23160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64daa90835844e619fa313a9d91a83cc" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:13.720791 23431 tablet_bootstrap.cc:654] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:13.721349 23160 raft_consensus.cc:2393] T 64daa90835844e619fa313a9d91a83cc P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abe65f4962e147ac841608b6c30f7e1b in current term 1: Already voted for candidate a9d87b20401744c7bd0c491f60cf0689 in this term.
I20260709 12:12:13.723045 23160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c320c6212b4bb187e8d32cb79479a8" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:13.724608 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c320c6212b4bb187e8d32cb79479a8" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
W20260709 12:12:13.725732 23274 leader_election.cc:343] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:13.727082 23273 leader_election.cc:343] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:13.727667 23273 leader_election.cc:304] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689; no voters: 3824bca1df8e4020b18c7989f7758391, 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:13.731735 23670 leader_election.cc:290] T 64daa90835844e619fa313a9d91a83cc P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:13.733024 23770 raft_consensus.cc:2749] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:13.736640 23429 tablet_bootstrap.cc:492] T 85dca37fe4fc46b792220de05fc68749 P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:13.737087 23429 ts_tablet_manager.cc:1403] T 85dca37fe4fc46b792220de05fc68749 P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.269s	user 0.009s	sys 0.008s
I20260709 12:12:13.742393 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64daa90835844e619fa313a9d91a83cc" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:13.744596 23201 leader_election.cc:304] T 64daa90835844e619fa313a9d91a83cc P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abe65f4962e147ac841608b6c30f7e1b; no voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689
I20260709 12:12:13.745290 23429 raft_consensus.cc:359] T 85dca37fe4fc46b792220de05fc68749 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:13.746033 23429 raft_consensus.cc:385] T 85dca37fe4fc46b792220de05fc68749 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:13.746306 23429 raft_consensus.cc:740] T 85dca37fe4fc46b792220de05fc68749 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:13.746956 23429 consensus_queue.cc:260] T 85dca37fe4fc46b792220de05fc68749 P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:13.747211 23433 tablet_bootstrap.cc:492] T b71f710147be434e8d790a50e145def8 P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:13.747831 23433 ts_tablet_manager.cc:1403] T b71f710147be434e8d790a50e145def8 P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.112s	user 0.019s	sys 0.000s
I20260709 12:12:13.751506 23433 raft_consensus.cc:359] T b71f710147be434e8d790a50e145def8 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:13.751778 23670 raft_consensus.cc:3060] T 64daa90835844e619fa313a9d91a83cc P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:13.752205 23433 raft_consensus.cc:385] T b71f710147be434e8d790a50e145def8 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:13.752530 23433 raft_consensus.cc:740] T b71f710147be434e8d790a50e145def8 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:13.753168 23433 consensus_queue.cc:260] T b71f710147be434e8d790a50e145def8 P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:13.758190 23433 ts_tablet_manager.cc:1434] T b71f710147be434e8d790a50e145def8 P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:12:13.760625 23429 ts_tablet_manager.cc:1434] T 85dca37fe4fc46b792220de05fc68749 P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 12:12:13.773211 23670 raft_consensus.cc:2749] T 64daa90835844e619fa313a9d91a83cc P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:13.791628 23429 tablet_bootstrap.cc:492] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:13.791666 23709 raft_consensus.cc:493] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.792361 23709 raft_consensus.cc:515] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:13.795081 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c07af998424a59b0e3cb3d0b63579a" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:13.795744 23383 raft_consensus.cc:2468] T 77c07af998424a59b0e3cb3d0b63579a P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 1.
I20260709 12:12:13.796911 23199 leader_election.cc:304] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:13.797804 23540 raft_consensus.cc:2804] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:13.797354 23433 tablet_bootstrap.cc:492] T 72855efda9164489afb0f46a7f8da834 P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:13.798200 23540 raft_consensus.cc:493] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:13.798802 23540 raft_consensus.cc:3060] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:13.802819 23431 tablet_bootstrap.cc:492] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:13.803319 23431 ts_tablet_manager.cc:1403] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.090s	user 0.024s	sys 0.015s
I20260709 12:12:13.803450 23383 raft_consensus.cc:3060] T 07201eb1b13e4b54af9c1c18752a9edf P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:13.806051 23433 tablet_bootstrap.cc:654] T 72855efda9164489afb0f46a7f8da834 P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:13.805998 23431 raft_consensus.cc:359] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:13.806861 23431 raft_consensus.cc:385] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:13.807160 23431 raft_consensus.cc:740] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:13.808549 23431 consensus_queue.cc:260] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:13.809079 23429 tablet_bootstrap.cc:654] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:13.809928 23709 leader_election.cc:290] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:13.812829 23431 ts_tablet_manager.cc:1434] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 12:12:13.814962 23159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c07af998424a59b0e3cb3d0b63579a" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:13.815598 23159 raft_consensus.cc:2468] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 1.
I20260709 12:12:13.826226 23431 tablet_bootstrap.cc:492] T 36d2201b0b3d4f07abf9c901453cda82 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:13.826589 23429 tablet_bootstrap.cc:492] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:13.827145 23429 ts_tablet_manager.cc:1403] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.004s
I20260709 12:12:13.830045 23433 tablet_bootstrap.cc:492] T 72855efda9164489afb0f46a7f8da834 P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:13.829787 23429 raft_consensus.cc:359] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:13.830567 23429 raft_consensus.cc:385] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:13.832873 23430 tablet_bootstrap.cc:492] T b71f710147be434e8d790a50e145def8 P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:13.830904 23429 raft_consensus.cc:740] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:13.863812 23431 tablet_bootstrap.cc:654] T 36d2201b0b3d4f07abf9c901453cda82 P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:13.863871 23430 ts_tablet_manager.cc:1403] T b71f710147be434e8d790a50e145def8 P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.457s	user 0.014s	sys 0.002s
I20260709 12:12:13.864110 23429 consensus_queue.cc:260] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:13.866246 23429 ts_tablet_manager.cc:1434] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 12:12:13.867007 23430 raft_consensus.cc:359] T b71f710147be434e8d790a50e145def8 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:13.867746 23430 raft_consensus.cc:385] T b71f710147be434e8d790a50e145def8 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:13.868058 23430 raft_consensus.cc:740] T b71f710147be434e8d790a50e145def8 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:13.868765 23430 consensus_queue.cc:260] T b71f710147be434e8d790a50e145def8 P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:13.844689 23709 raft_consensus.cc:493] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a9d87b20401744c7bd0c491f60cf0689)
I20260709 12:12:13.870985 23709 raft_consensus.cc:515] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:13.871425 23430 ts_tablet_manager.cc:1434] T b71f710147be434e8d790a50e145def8 P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:12:13.845649 23056 catalog_manager.cc:5697] T b0348215bfbf4d0bb5ffd2ddc86a4279 P a9d87b20401744c7bd0c491f60cf0689 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "a9d87b20401744c7bd0c491f60cf0689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:13.872560 23430 tablet_bootstrap.cc:492] T b0348215bfbf4d0bb5ffd2ddc86a4279 P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:13.830672 23433 ts_tablet_manager.cc:1403] T 72855efda9164489afb0f46a7f8da834 P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.002s
I20260709 12:12:13.830622 23540 raft_consensus.cc:515] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:13.875515 23709 leader_election.cc:290] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:13.876349 23540 leader_election.cc:290] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 election: Requested vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:13.877104 23382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db21ddd040d409a9154cbe649864397" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:13.877456 23429 tablet_bootstrap.cc:492] T ae5efc2770bb4bc7a09585a220a45131 P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:13.877880 23685 raft_consensus.cc:493] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.878376 23685 raft_consensus.cc:515] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:13.878870 23384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c07af998424a59b0e3cb3d0b63579a" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:13.879663 23384 raft_consensus.cc:3060] T 77c07af998424a59b0e3cb3d0b63579a P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:13.880513 23685 leader_election.cc:290] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:13.873037 23056 catalog_manager.cc:5697] T 64daa90835844e619fa313a9d91a83cc P a9d87b20401744c7bd0c491f60cf0689 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "a9d87b20401744c7bd0c491f60cf0689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:13.876991 23433 raft_consensus.cc:359] T 72855efda9164489afb0f46a7f8da834 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:13.885097 23433 raft_consensus.cc:385] T 72855efda9164489afb0f46a7f8da834 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:13.885479 23433 raft_consensus.cc:740] T 72855efda9164489afb0f46a7f8da834 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:13.886605 23382 raft_consensus.cc:2393] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abe65f4962e147ac841608b6c30f7e1b in current term 2: Already voted for candidate 48bc58ace75f40e995efc1edcefe79fa in this term.
I20260709 12:12:13.886904 23433 consensus_queue.cc:260] T 72855efda9164489afb0f46a7f8da834 P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:13.889114 23433 ts_tablet_manager.cc:1434] T 72855efda9164489afb0f46a7f8da834 P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.002s
I20260709 12:12:13.889801 23159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72855efda9164489afb0f46a7f8da834" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
W20260709 12:12:13.891398 23274 leader_election.cc:343] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:13.892534 23433 tablet_bootstrap.cc:492] T 36d2201b0b3d4f07abf9c901453cda82 P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:13.894749 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db21ddd040d409a9154cbe649864397" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:13.895244 23429 tablet_bootstrap.cc:654] T ae5efc2770bb4bc7a09585a220a45131 P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:13.895447 23310 raft_consensus.cc:2468] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 2.
W20260709 12:12:13.894620 23106 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:13.898916 23384 raft_consensus.cc:2468] T 77c07af998424a59b0e3cb3d0b63579a P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 2.
I20260709 12:12:13.901427 23431 tablet_bootstrap.cc:492] T 36d2201b0b3d4f07abf9c901453cda82 P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:13.902034 23431 ts_tablet_manager.cc:1403] T 36d2201b0b3d4f07abf9c901453cda82 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.076s	user 0.011s	sys 0.023s
I20260709 12:12:13.903581 23199 leader_election.cc:304] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:13.904640 23709 raft_consensus.cc:2804] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:13.905155 23709 raft_consensus.cc:697] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b [term 2 LEADER]: Becoming Leader. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Running, Role: LEADER
I20260709 12:12:13.906100 23709 consensus_queue.cc:237] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:13.906553 23430 tablet_bootstrap.cc:654] T b0348215bfbf4d0bb5ffd2ddc86a4279 P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:13.927958 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72855efda9164489afb0f46a7f8da834" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:13.930217 23236 raft_consensus.cc:2468] T 72855efda9164489afb0f46a7f8da834 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 0.
I20260709 12:12:13.932883 23276 leader_election.cc:304] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b; no voters: 3824bca1df8e4020b18c7989f7758391
I20260709 12:12:13.933764 23685 raft_consensus.cc:2804] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:13.934186 23685 raft_consensus.cc:493] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:13.934484 23685 raft_consensus.cc:3060] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:13.937886 23160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77c07af998424a59b0e3cb3d0b63579a" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:13.938589 23160 raft_consensus.cc:3060] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:13.916391 23201 leader_election.cc:304] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b; no voters: 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:13.941128 23709 raft_consensus.cc:2804] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:13.941520 23709 raft_consensus.cc:493] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting leader election (detected failure of leader a9d87b20401744c7bd0c491f60cf0689)
I20260709 12:12:13.941884 23709 raft_consensus.cc:3060] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:13.941934 23794 consensus_queue.cc:1048] T c113311e527c47578f8c136d335aa87f P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:13.946758 23683 raft_consensus.cc:493] T b71f710147be434e8d790a50e145def8 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:13.946959 23429 tablet_bootstrap.cc:492] T ae5efc2770bb4bc7a09585a220a45131 P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:13.947443 23429 ts_tablet_manager.cc:1403] T ae5efc2770bb4bc7a09585a220a45131 P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.070s	user 0.010s	sys 0.003s
I20260709 12:12:13.947263 23683 raft_consensus.cc:515] T b71f710147be434e8d790a50e145def8 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:13.949396 23683 leader_election.cc:290] T b71f710147be434e8d790a50e145def8 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:13.951548 23308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b71f710147be434e8d790a50e145def8" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:13.952260 23433 tablet_bootstrap.cc:654] T 36d2201b0b3d4f07abf9c901453cda82 P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:13.939221 23431 raft_consensus.cc:359] T 36d2201b0b3d4f07abf9c901453cda82 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:13.961309 23431 raft_consensus.cc:385] T 36d2201b0b3d4f07abf9c901453cda82 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:13.961764 23431 raft_consensus.cc:740] T 36d2201b0b3d4f07abf9c901453cda82 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:13.952208 23308 raft_consensus.cc:2468] T b71f710147be434e8d790a50e145def8 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 0.
I20260709 12:12:13.964325 23349 leader_election.cc:304] T b71f710147be434e8d790a50e145def8 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689; no voters: 
I20260709 12:12:13.965188 23683 raft_consensus.cc:2804] T b71f710147be434e8d790a50e145def8 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:13.965544 23683 raft_consensus.cc:493] T b71f710147be434e8d790a50e145def8 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:13.965875 23683 raft_consensus.cc:3060] T b71f710147be434e8d790a50e145def8 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:13.968146 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b71f710147be434e8d790a50e145def8" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:13.968801 23236 raft_consensus.cc:2468] T b71f710147be434e8d790a50e145def8 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 0.
I20260709 12:12:13.969276 23160 raft_consensus.cc:2468] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 2.
I20260709 12:12:13.972884 23429 raft_consensus.cc:359] T ae5efc2770bb4bc7a09585a220a45131 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:13.977520 23429 raft_consensus.cc:385] T ae5efc2770bb4bc7a09585a220a45131 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:13.977771 23429 raft_consensus.cc:740] T ae5efc2770bb4bc7a09585a220a45131 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:13.971383 23431 consensus_queue.cc:260] T 36d2201b0b3d4f07abf9c901453cda82 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:13.981084 23429 consensus_queue.cc:260] T ae5efc2770bb4bc7a09585a220a45131 P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:13.982930 23430 tablet_bootstrap.cc:492] T b0348215bfbf4d0bb5ffd2ddc86a4279 P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:13.983453 23430 ts_tablet_manager.cc:1403] T b0348215bfbf4d0bb5ffd2ddc86a4279 P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.111s	user 0.014s	sys 0.009s
I20260709 12:12:13.983915 23431 ts_tablet_manager.cc:1434] T 36d2201b0b3d4f07abf9c901453cda82 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.082s	user 0.004s	sys 0.008s
I20260709 12:12:13.984900 23431 tablet_bootstrap.cc:492] T 72855efda9164489afb0f46a7f8da834 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:13.988581 23429 ts_tablet_manager.cc:1434] T ae5efc2770bb4bc7a09585a220a45131 P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.001s
I20260709 12:12:13.990522 23540 consensus_queue.cc:1048] T c113311e527c47578f8c136d335aa87f P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:13.966323 23685 raft_consensus.cc:515] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:13.991041 23430 raft_consensus.cc:359] T b0348215bfbf4d0bb5ffd2ddc86a4279 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:13.991756 23430 raft_consensus.cc:385] T b0348215bfbf4d0bb5ffd2ddc86a4279 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:13.992044 23430 raft_consensus.cc:740] T b0348215bfbf4d0bb5ffd2ddc86a4279 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:13.993417 23685 leader_election.cc:290] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Requested vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:13.994414 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72855efda9164489afb0f46a7f8da834" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:13.995047 23431 tablet_bootstrap.cc:654] T 72855efda9164489afb0f46a7f8da834 P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:13.995271 23236 raft_consensus.cc:3060] T 72855efda9164489afb0f46a7f8da834 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:13.999148 23429 tablet_bootstrap.cc:492] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:14.000425 23158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72855efda9164489afb0f46a7f8da834" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
W20260709 12:12:14.001876 23274 leader_election.cc:343] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:14.005735 23430 consensus_queue.cc:260] T b0348215bfbf4d0bb5ffd2ddc86a4279 P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:14.010452 23429 tablet_bootstrap.cc:654] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:14.019205 23430 ts_tablet_manager.cc:1434] T b0348215bfbf4d0bb5ffd2ddc86a4279 P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.001s
I20260709 12:12:14.026834 23430 tablet_bootstrap.cc:492] T d8c320c6212b4bb187e8d32cb79479a8 P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:14.018002 23236 raft_consensus.cc:2468] T 72855efda9164489afb0f46a7f8da834 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 1.
I20260709 12:12:13.990609 23683 raft_consensus.cc:515] T b71f710147be434e8d790a50e145def8 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:14.035917 23276 leader_election.cc:304] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b; no voters: 3824bca1df8e4020b18c7989f7758391
I20260709 12:12:14.036734 23685 raft_consensus.cc:2804] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:14.037211 23685 raft_consensus.cc:697] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Becoming Leader. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Running, Role: LEADER
I20260709 12:12:14.001267 23056 catalog_manager.cc:5697] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b reported cstate change: term changed from 0 to 2, leader changed from <none> to abe65f4962e147ac841608b6c30f7e1b (127.16.98.194). New cstate: current_term: 2 leader_uuid: "abe65f4962e147ac841608b6c30f7e1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:14.038318 23709 raft_consensus.cc:515] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:14.038003 23685 consensus_queue.cc:237] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:14.041653 23709 leader_election.cc:290] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 election: Requested vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:14.037292 23683 leader_election.cc:290] T b71f710147be434e8d790a50e145def8 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Requested vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:14.044603 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b71f710147be434e8d790a50e145def8" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:14.044941 23433 tablet_bootstrap.cc:492] T 36d2201b0b3d4f07abf9c901453cda82 P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:14.044845 23384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db21ddd040d409a9154cbe649864397" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:14.045501 23433 ts_tablet_manager.cc:1403] T 36d2201b0b3d4f07abf9c901453cda82 P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.153s	user 0.012s	sys 0.012s
I20260709 12:12:14.045715 23384 raft_consensus.cc:2393] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate abe65f4962e147ac841608b6c30f7e1b in current term 2: Already voted for candidate 48bc58ace75f40e995efc1edcefe79fa in this term.
I20260709 12:12:14.049404 23310 raft_consensus.cc:3060] T b71f710147be434e8d790a50e145def8 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:14.052143 23433 raft_consensus.cc:359] T 36d2201b0b3d4f07abf9c901453cda82 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:14.052843 23433 raft_consensus.cc:385] T 36d2201b0b3d4f07abf9c901453cda82 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:14.053114 23433 raft_consensus.cc:740] T 36d2201b0b3d4f07abf9c901453cda82 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:14.053781 23433 consensus_queue.cc:260] T 36d2201b0b3d4f07abf9c901453cda82 P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:14.028213 23431 tablet_bootstrap.cc:492] T 72855efda9164489afb0f46a7f8da834 P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:14.054982 23431 ts_tablet_manager.cc:1403] T 72855efda9164489afb0f46a7f8da834 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.070s	user 0.009s	sys 0.003s
I20260709 12:12:14.057755 23431 raft_consensus.cc:359] T 72855efda9164489afb0f46a7f8da834 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:14.058138 23308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db21ddd040d409a9154cbe649864397" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:14.058468 23431 raft_consensus.cc:385] T 72855efda9164489afb0f46a7f8da834 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:14.058838 23431 raft_consensus.cc:740] T 72855efda9164489afb0f46a7f8da834 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:14.059489 23431 consensus_queue.cc:260] T 72855efda9164489afb0f46a7f8da834 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:14.058158 23234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b71f710147be434e8d790a50e145def8" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:14.063625 23234 raft_consensus.cc:3060] T b71f710147be434e8d790a50e145def8 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:14.063696 23430 tablet_bootstrap.cc:654] T d8c320c6212b4bb187e8d32cb79479a8 P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:14.064177 23310 raft_consensus.cc:2468] T b71f710147be434e8d790a50e145def8 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 1.
I20260709 12:12:14.066771 23778 raft_consensus.cc:493] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.067533 23778 raft_consensus.cc:515] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:14.069777 23778 leader_election.cc:290] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:14.070240 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c320c6212b4bb187e8d32cb79479a8" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:14.071844 23349 leader_election.cc:304] T b71f710147be434e8d790a50e145def8 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689; no voters: 
I20260709 12:12:14.071252 23384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c320c6212b4bb187e8d32cb79479a8" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:14.074127 23683 raft_consensus.cc:2804] T b71f710147be434e8d790a50e145def8 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:14.071775 23433 ts_tablet_manager.cc:1434] T 36d2201b0b3d4f07abf9c901453cda82 P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.026s	user 0.002s	sys 0.005s
I20260709 12:12:14.074896 23683 raft_consensus.cc:697] T b71f710147be434e8d790a50e145def8 P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Becoming Leader. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Running, Role: LEADER
W20260709 12:12:14.076149 23124 leader_election.cc:343] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:14.076406 23310 raft_consensus.cc:2468] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 0.
I20260709 12:12:14.077266 23433 tablet_bootstrap.cc:492] T f55cb07c30bc42a0930276baefc1d4b7 P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:14.077548 23126 leader_election.cc:304] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689; no voters: 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:14.078862 23777 raft_consensus.cc:2804] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:14.079226 23777 raft_consensus.cc:493] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:14.079576 23777 raft_consensus.cc:3060] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:14.061573 23431 ts_tablet_manager.cc:1434] T 72855efda9164489afb0f46a7f8da834 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:12:14.088775 23536 consensus_queue.cc:1048] T b0348215bfbf4d0bb5ffd2ddc86a4279 P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:12:14.085304 23234 raft_consensus.cc:2468] T b71f710147be434e8d790a50e145def8 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 1.
I20260709 12:12:14.076167 23683 consensus_queue.cc:237] T b71f710147be434e8d790a50e145def8 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:14.100232 23431 tablet_bootstrap.cc:492] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:14.101125 23777 raft_consensus.cc:515] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:14.101969 23308 raft_consensus.cc:2468] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 2.
I20260709 12:12:14.106619 23431 tablet_bootstrap.cc:654] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:14.120743 23201 leader_election.cc:304] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b; no voters: 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:14.121659 23795 raft_consensus.cc:2804] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:14.115451 23540 raft_consensus.cc:493] T 36d2201b0b3d4f07abf9c901453cda82 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.122211 23795 raft_consensus.cc:697] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b [term 2 LEADER]: Becoming Leader. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Running, Role: LEADER
I20260709 12:12:14.122423 23540 raft_consensus.cc:515] T 36d2201b0b3d4f07abf9c901453cda82 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:14.123214 23433 tablet_bootstrap.cc:654] T f55cb07c30bc42a0930276baefc1d4b7 P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:14.123214 23795 consensus_queue.cc:237] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:14.125613 23540 leader_election.cc:290] T 36d2201b0b3d4f07abf9c901453cda82 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:14.107187 23308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c320c6212b4bb187e8d32cb79479a8" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:14.126734 23308 raft_consensus.cc:3060] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:14.126874 23159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2201b0b3d4f07abf9c901453cda82" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:14.127537 23159 raft_consensus.cc:2468] T 36d2201b0b3d4f07abf9c901453cda82 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 0.
I20260709 12:12:14.128713 23200 leader_election.cc:304] T 36d2201b0b3d4f07abf9c901453cda82 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:14.133313 23794 raft_consensus.cc:2804] T 36d2201b0b3d4f07abf9c901453cda82 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:14.133708 23794 raft_consensus.cc:493] T 36d2201b0b3d4f07abf9c901453cda82 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:14.134058 23794 raft_consensus.cc:3060] T 36d2201b0b3d4f07abf9c901453cda82 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:14.135345 23384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2201b0b3d4f07abf9c901453cda82" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:14.136680 23382 raft_consensus.cc:3060] T b0348215bfbf4d0bb5ffd2ddc86a4279 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:14.141840 23308 raft_consensus.cc:2468] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 1.
I20260709 12:12:14.142505 23794 raft_consensus.cc:515] T 36d2201b0b3d4f07abf9c901453cda82 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:14.151321 23794 leader_election.cc:290] T 36d2201b0b3d4f07abf9c901453cda82 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 election: Requested vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:14.144111 23778 raft_consensus.cc:493] T f55cb07c30bc42a0930276baefc1d4b7 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.151949 23778 raft_consensus.cc:515] T f55cb07c30bc42a0930276baefc1d4b7 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:14.154198 23778 leader_election.cc:290] T f55cb07c30bc42a0930276baefc1d4b7 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:14.155296 23126 leader_election.cc:304] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689; no voters: 
I20260709 12:12:14.157250 23159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2201b0b3d4f07abf9c901453cda82" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:14.157809 23159 raft_consensus.cc:3060] T 36d2201b0b3d4f07abf9c901453cda82 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:14.159868 23746 raft_consensus.cc:2804] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:14.160390 23746 raft_consensus.cc:697] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391 [term 1 LEADER]: Becoming Leader. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Running, Role: LEADER
I20260709 12:12:14.161199 23746 consensus_queue.cc:237] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:14.144577 23384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c320c6212b4bb187e8d32cb79479a8" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
W20260709 12:12:14.142405 23199 leader_election.cc:343] T 36d2201b0b3d4f07abf9c901453cda82 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:14.167687 23124 leader_election.cc:343] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:14.169080 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f55cb07c30bc42a0930276baefc1d4b7" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:14.170087 23381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2201b0b3d4f07abf9c901453cda82" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
W20260709 12:12:14.171223 23127 leader_election.cc:343] T f55cb07c30bc42a0930276baefc1d4b7 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:14.171510 23199 leader_election.cc:343] T 36d2201b0b3d4f07abf9c901453cda82 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:14.178509 23056 catalog_manager.cc:5697] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "a9d87b20401744c7bd0c491f60cf0689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:14.190853 23159 raft_consensus.cc:2468] T 36d2201b0b3d4f07abf9c901453cda82 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 1.
I20260709 12:12:14.148399 23433 tablet_bootstrap.cc:492] T f55cb07c30bc42a0930276baefc1d4b7 P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:14.109012 23777 leader_election.cc:290] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 election: Requested vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:14.149523 23430 tablet_bootstrap.cc:492] T d8c320c6212b4bb187e8d32cb79479a8 P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:14.194183 23430 ts_tablet_manager.cc:1403] T d8c320c6212b4bb187e8d32cb79479a8 P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.168s	user 0.009s	sys 0.002s
I20260709 12:12:14.197885 23430 raft_consensus.cc:359] T d8c320c6212b4bb187e8d32cb79479a8 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:14.199457 23430 raft_consensus.cc:385] T d8c320c6212b4bb187e8d32cb79479a8 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:14.199731 23430 raft_consensus.cc:740] T d8c320c6212b4bb187e8d32cb79479a8 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:14.200526 23430 consensus_queue.cc:260] T d8c320c6212b4bb187e8d32cb79479a8 P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:14.203195 23430 ts_tablet_manager.cc:1434] T d8c320c6212b4bb187e8d32cb79479a8 P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 12:12:14.211190 23433 ts_tablet_manager.cc:1403] T f55cb07c30bc42a0930276baefc1d4b7 P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.136s	user 0.010s	sys 0.008s
I20260709 12:12:14.211284 23536 raft_consensus.cc:493] T 85dca37fe4fc46b792220de05fc68749 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.212522 23536 raft_consensus.cc:515] T 85dca37fe4fc46b792220de05fc68749 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:14.216260 23685 consensus_queue.cc:1048] T 64daa90835844e619fa313a9d91a83cc P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:14.217629 23685 consensus_queue.cc:1048] T 64daa90835844e619fa313a9d91a83cc P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:14.220480 23158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dca37fe4fc46b792220de05fc68749" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
W20260709 12:12:14.224818 23274 leader_election.cc:343] T 85dca37fe4fc46b792220de05fc68749 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:14.230360 23200 leader_election.cc:304] T 36d2201b0b3d4f07abf9c901453cda82 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, abe65f4962e147ac841608b6c30f7e1b; no voters: 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:14.231994 23794 raft_consensus.cc:2804] T 36d2201b0b3d4f07abf9c901453cda82 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:14.232651 23794 raft_consensus.cc:697] T 36d2201b0b3d4f07abf9c901453cda82 P abe65f4962e147ac841608b6c30f7e1b [term 1 LEADER]: Becoming Leader. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Running, Role: LEADER
I20260709 12:12:14.233122 23536 leader_election.cc:290] T 85dca37fe4fc46b792220de05fc68749 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:14.233747 23794 consensus_queue.cc:237] T 36d2201b0b3d4f07abf9c901453cda82 P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:14.240170 23384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dca37fe4fc46b792220de05fc68749" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
W20260709 12:12:14.241677 23273 leader_election.cc:343] T 85dca37fe4fc46b792220de05fc68749 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:14.242131 23273 leader_election.cc:304] T 85dca37fe4fc46b792220de05fc68749 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689; no voters: 3824bca1df8e4020b18c7989f7758391, 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:14.243423 23536 raft_consensus.cc:2749] T 85dca37fe4fc46b792220de05fc68749 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:14.244815 23477 raft_consensus.cc:493] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.245342 23433 raft_consensus.cc:359] T f55cb07c30bc42a0930276baefc1d4b7 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:14.246080 23433 raft_consensus.cc:385] T f55cb07c30bc42a0930276baefc1d4b7 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:14.245532 23477 raft_consensus.cc:515] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:14.246372 23433 raft_consensus.cc:740] T f55cb07c30bc42a0930276baefc1d4b7 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:14.252151 23430 tablet_bootstrap.cc:492] T f55cb07c30bc42a0930276baefc1d4b7 P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:14.267503 23477 leader_election.cc:290] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:14.272301 23623 raft_consensus.cc:493] T b0348215bfbf4d0bb5ffd2ddc86a4279 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.317476 23623 raft_consensus.cc:515] T b0348215bfbf4d0bb5ffd2ddc86a4279 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:14.317754 23433 consensus_queue.cc:260] T f55cb07c30bc42a0930276baefc1d4b7 P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:14.318837 23056 catalog_manager.cc:5697] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3824bca1df8e4020b18c7989f7758391 (127.16.98.193). New cstate: current_term: 1 leader_uuid: "3824bca1df8e4020b18c7989f7758391" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:14.319706 23433 ts_tablet_manager.cc:1434] T f55cb07c30bc42a0930276baefc1d4b7 P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.108s	user 0.011s	sys 0.003s
I20260709 12:12:14.320915 23433 tablet_bootstrap.cc:492] T ae5efc2770bb4bc7a09585a220a45131 P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:14.324059 23430 tablet_bootstrap.cc:654] T f55cb07c30bc42a0930276baefc1d4b7 P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:14.327610 23433 tablet_bootstrap.cc:654] T ae5efc2770bb4bc7a09585a220a45131 P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:14.334457 23234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0348215bfbf4d0bb5ffd2ddc86a4279" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:14.337597 23308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0348215bfbf4d0bb5ffd2ddc86a4279" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:14.339787 23349 leader_election.cc:304] T b0348215bfbf4d0bb5ffd2ddc86a4279 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa; no voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:14.340662 23477 raft_consensus.cc:2749] T b0348215bfbf4d0bb5ffd2ddc86a4279 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:14.250061 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f55cb07c30bc42a0930276baefc1d4b7" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:14.253321 23232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db21ddd040d409a9154cbe649864397" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:14.269837 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db21ddd040d409a9154cbe649864397" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:14.348255 23310 raft_consensus.cc:2468] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 2.
I20260709 12:12:14.348570 23522 raft_consensus.cc:493] T ae5efc2770bb4bc7a09585a220a45131 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.349040 23522 raft_consensus.cc:515] T ae5efc2770bb4bc7a09585a220a45131 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:14.351931 23522 leader_election.cc:290] T ae5efc2770bb4bc7a09585a220a45131 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:14.352591 23522 consensus_queue.cc:1048] T b0348215bfbf4d0bb5ffd2ddc86a4279 P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:14.354348 23623 leader_election.cc:290] T b0348215bfbf4d0bb5ffd2ddc86a4279 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
W20260709 12:12:14.354415 23124 leader_election.cc:343] T f55cb07c30bc42a0930276baefc1d4b7 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:14.355274 23124 leader_election.cc:304] T f55cb07c30bc42a0930276baefc1d4b7 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391; no voters: 48bc58ace75f40e995efc1edcefe79fa, abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:14.356251 23746 raft_consensus.cc:2749] T f55cb07c30bc42a0930276baefc1d4b7 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:14.354789 23232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae5efc2770bb4bc7a09585a220a45131" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:14.358525 23349 leader_election.cc:304] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689; no voters: abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:14.360208 23623 raft_consensus.cc:2804] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:12:14.360674 23623 raft_consensus.cc:493] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:14.361071 23623 raft_consensus.cc:3060] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:12:14.363242 23276 leader_election.cc:343] T ae5efc2770bb4bc7a09585a220a45131 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:14.369326 23429 tablet_bootstrap.cc:492] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:14.369763 23429 ts_tablet_manager.cc:1403] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.371s	user 0.043s	sys 0.084s
I20260709 12:12:14.372453 23429 raft_consensus.cc:359] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:14.373054 23429 raft_consensus.cc:385] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:14.373306 23429 raft_consensus.cc:740] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:14.374082 23429 consensus_queue.cc:260] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:14.375535 23429 ts_tablet_manager.cc:1434] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:12:14.376494 23429 tablet_bootstrap.cc:492] T 4bffc92cd6c84709bd0335a988eeef96 P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:14.382289 23429 tablet_bootstrap.cc:654] T 4bffc92cd6c84709bd0335a988eeef96 P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:14.384384 23431 tablet_bootstrap.cc:492] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:14.384866 23431 ts_tablet_manager.cc:1403] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.285s	user 0.047s	sys 0.063s
I20260709 12:12:14.387676 23431 raft_consensus.cc:359] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:14.388353 23431 raft_consensus.cc:385] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:14.388628 23431 raft_consensus.cc:740] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:14.346019 23055 catalog_manager.cc:5697] T b71f710147be434e8d790a50e145def8 P 48bc58ace75f40e995efc1edcefe79fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196). New cstate: current_term: 1 leader_uuid: "48bc58ace75f40e995efc1edcefe79fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:14.389243 23431 consensus_queue.cc:260] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:14.391511 23431 ts_tablet_manager.cc:1434] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:12:14.393798 23431 tablet_bootstrap.cc:492] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:14.405666 23382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae5efc2770bb4bc7a09585a220a45131" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:14.407671 23431 tablet_bootstrap.cc:654] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:14.408643 23273 leader_election.cc:343] T ae5efc2770bb4bc7a09585a220a45131 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:14.409696 23273 leader_election.cc:304] T ae5efc2770bb4bc7a09585a220a45131 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689; no voters: 48bc58ace75f40e995efc1edcefe79fa, abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:14.411710 23536 raft_consensus.cc:2749] T ae5efc2770bb4bc7a09585a220a45131 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:14.411243 23059 catalog_manager.cc:5697] T 36d2201b0b3d4f07abf9c901453cda82 P abe65f4962e147ac841608b6c30f7e1b reported cstate change: term changed from 0 to 1, leader changed from <none> to abe65f4962e147ac841608b6c30f7e1b (127.16.98.194). New cstate: current_term: 1 leader_uuid: "abe65f4962e147ac841608b6c30f7e1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:14.413029 23382 raft_consensus.cc:1275] T 77c07af998424a59b0e3cb3d0b63579a P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Refusing update from remote peer abe65f4962e147ac841608b6c30f7e1b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:12:14.413148 23059 catalog_manager.cc:5697] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b reported cstate change: term changed from 1 to 2, leader changed from a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195) to abe65f4962e147ac841608b6c30f7e1b (127.16.98.194). New cstate: current_term: 2 leader_uuid: "abe65f4962e147ac841608b6c30f7e1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:14.416026 23709 consensus_queue.cc:1048] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:14.419606 23429 tablet_bootstrap.cc:492] T 4bffc92cd6c84709bd0335a988eeef96 P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:14.420121 23429 ts_tablet_manager.cc:1403] T 4bffc92cd6c84709bd0335a988eeef96 P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.044s	user 0.004s	sys 0.008s
I20260709 12:12:14.422891 23429 raft_consensus.cc:359] T 4bffc92cd6c84709bd0335a988eeef96 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:14.423537 23429 raft_consensus.cc:385] T 4bffc92cd6c84709bd0335a988eeef96 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:14.423804 23429 raft_consensus.cc:740] T 4bffc92cd6c84709bd0335a988eeef96 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:14.424486 23429 consensus_queue.cc:260] T 4bffc92cd6c84709bd0335a988eeef96 P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:14.426610 23429 ts_tablet_manager.cc:1434] T 4bffc92cd6c84709bd0335a988eeef96 P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 12:12:14.430351 23429 tablet_bootstrap.cc:492] T d2d3a5114a7842179f9957c7f5660f7e P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:14.430743 23477 raft_consensus.cc:493] T d8c320c6212b4bb187e8d32cb79479a8 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.431228 23477 raft_consensus.cc:515] T d8c320c6212b4bb187e8d32cb79479a8 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:14.429322 23431 tablet_bootstrap.cc:492] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:14.432480 23431 ts_tablet_manager.cc:1403] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.000s
I20260709 12:12:14.434396 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c320c6212b4bb187e8d32cb79479a8" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:14.434831 23160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c320c6212b4bb187e8d32cb79479a8" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:14.435213 23310 raft_consensus.cc:2393] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48bc58ace75f40e995efc1edcefe79fa in current term 1: Already voted for candidate 3824bca1df8e4020b18c7989f7758391 in this term.
I20260709 12:12:14.436570 23477 leader_election.cc:290] T d8c320c6212b4bb187e8d32cb79479a8 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:14.438607 23349 leader_election.cc:304] T d8c320c6212b4bb187e8d32cb79479a8 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa; no voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689
I20260709 12:12:14.440081 23429 tablet_bootstrap.cc:654] T d2d3a5114a7842179f9957c7f5660f7e P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:14.440953 23683 raft_consensus.cc:3060] T d8c320c6212b4bb187e8d32cb79479a8 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:14.451973 23429 tablet_bootstrap.cc:492] T d2d3a5114a7842179f9957c7f5660f7e P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:14.452533 23429 ts_tablet_manager.cc:1403] T d2d3a5114a7842179f9957c7f5660f7e P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.004s
I20260709 12:12:14.435257 23431 raft_consensus.cc:359] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:14.457288 23431 raft_consensus.cc:385] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:14.457640 23431 raft_consensus.cc:740] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:14.455615 23429 raft_consensus.cc:359] T d2d3a5114a7842179f9957c7f5660f7e P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:14.458681 23429 raft_consensus.cc:385] T d2d3a5114a7842179f9957c7f5660f7e P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:14.458379 23431 consensus_queue.cc:260] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:14.458983 23429 raft_consensus.cc:740] T d2d3a5114a7842179f9957c7f5660f7e P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:14.459719 23429 consensus_queue.cc:260] T d2d3a5114a7842179f9957c7f5660f7e P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:14.456841 23683 raft_consensus.cc:2749] T d8c320c6212b4bb187e8d32cb79479a8 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:14.462821 23429 ts_tablet_manager.cc:1434] T d2d3a5114a7842179f9957c7f5660f7e P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:12:14.463958 23429 tablet_bootstrap.cc:492] T d8c6d6433d204aa3b5fa3a304e66dd7e P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:14.465965 23160 raft_consensus.cc:3060] T 72855efda9164489afb0f46a7f8da834 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:14.466861 23623 raft_consensus.cc:515] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:14.469758 23429 tablet_bootstrap.cc:654] T d8c6d6433d204aa3b5fa3a304e66dd7e P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:14.470114 23430 tablet_bootstrap.cc:492] T f55cb07c30bc42a0930276baefc1d4b7 P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:14.475033 23430 ts_tablet_manager.cc:1403] T f55cb07c30bc42a0930276baefc1d4b7 P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.265s	user 0.038s	sys 0.047s
I20260709 12:12:14.480721 23709 raft_consensus.cc:493] T f55cb07c30bc42a0930276baefc1d4b7 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.483812 23709 raft_consensus.cc:515] T f55cb07c30bc42a0930276baefc1d4b7 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:14.486533 23384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f55cb07c30bc42a0930276baefc1d4b7" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
W20260709 12:12:14.488741 23199 leader_election.cc:343] T f55cb07c30bc42a0930276baefc1d4b7 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:14.488793 23430 raft_consensus.cc:359] T f55cb07c30bc42a0930276baefc1d4b7 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:14.489604 23430 raft_consensus.cc:385] T f55cb07c30bc42a0930276baefc1d4b7 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:14.489876 23430 raft_consensus.cc:740] T f55cb07c30bc42a0930276baefc1d4b7 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:14.490602 23430 consensus_queue.cc:260] T f55cb07c30bc42a0930276baefc1d4b7 P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:14.493065 23430 ts_tablet_manager.cc:1434] T f55cb07c30bc42a0930276baefc1d4b7 P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.018s	user 0.001s	sys 0.005s
I20260709 12:12:14.494089 23430 tablet_bootstrap.cc:492] T 36d2201b0b3d4f07abf9c901453cda82 P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:14.494854 23158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f55cb07c30bc42a0930276baefc1d4b7" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:14.495191 23623 leader_election.cc:290] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 3 election: Requested vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:14.495636 23158 raft_consensus.cc:2468] T f55cb07c30bc42a0930276baefc1d4b7 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 0.
I20260709 12:12:14.495739 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db21ddd040d409a9154cbe649864397" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:14.496362 23310 raft_consensus.cc:3060] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:14.497229 23200 leader_election.cc:304] T f55cb07c30bc42a0930276baefc1d4b7 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, abe65f4962e147ac841608b6c30f7e1b; no voters: 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:14.498085 23540 raft_consensus.cc:2804] T f55cb07c30bc42a0930276baefc1d4b7 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:14.498442 23540 raft_consensus.cc:493] T f55cb07c30bc42a0930276baefc1d4b7 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:14.498994 23540 raft_consensus.cc:3060] T f55cb07c30bc42a0930276baefc1d4b7 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:14.498391 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db21ddd040d409a9154cbe649864397" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:14.503198 23429 tablet_bootstrap.cc:492] T d8c6d6433d204aa3b5fa3a304e66dd7e P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:14.503671 23429 ts_tablet_manager.cc:1403] T d8c6d6433d204aa3b5fa3a304e66dd7e P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.040s	user 0.021s	sys 0.010s
I20260709 12:12:14.504087 23709 leader_election.cc:290] T f55cb07c30bc42a0930276baefc1d4b7 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:14.478081 23433 tablet_bootstrap.cc:492] T ae5efc2770bb4bc7a09585a220a45131 P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:14.505214 23433 ts_tablet_manager.cc:1403] T ae5efc2770bb4bc7a09585a220a45131 P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.185s	user 0.012s	sys 0.012s
I20260709 12:12:14.503767 23310 raft_consensus.cc:2468] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 3.
I20260709 12:12:14.505755 23540 raft_consensus.cc:515] T f55cb07c30bc42a0930276baefc1d4b7 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:14.506501 23429 raft_consensus.cc:359] T d8c6d6433d204aa3b5fa3a304e66dd7e P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:14.507299 23429 raft_consensus.cc:385] T d8c6d6433d204aa3b5fa3a304e66dd7e P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:14.507563 23429 raft_consensus.cc:740] T d8c6d6433d204aa3b5fa3a304e66dd7e P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
I20260709 12:12:14.507858 23349 leader_election.cc:304] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689; no voters: abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:14.508239 23429 consensus_queue.cc:260] T d8c6d6433d204aa3b5fa3a304e66dd7e P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:14.508703 23431 ts_tablet_manager.cc:1434] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.076s	user 0.004s	sys 0.003s
I20260709 12:12:14.508993 23623 raft_consensus.cc:2804] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:14.509544 23623 raft_consensus.cc:697] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa [term 3 LEADER]: Becoming Leader. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Running, Role: LEADER
I20260709 12:12:14.510408 23429 ts_tablet_manager.cc:1434] T d8c6d6433d204aa3b5fa3a304e66dd7e P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:12:14.510356 23623 consensus_queue.cc:237] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:14.513633 23540 leader_election.cc:290] T f55cb07c30bc42a0930276baefc1d4b7 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 election: Requested vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:14.514385 23158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f55cb07c30bc42a0930276baefc1d4b7" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:14.515046 23158 raft_consensus.cc:3060] T f55cb07c30bc42a0930276baefc1d4b7 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:14.515508 23430 tablet_bootstrap.cc:654] T 36d2201b0b3d4f07abf9c901453cda82 P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:14.519176 23431 tablet_bootstrap.cc:492] T 541dc3e21d4e461b8c299d0186a42e7f P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:14.514410 23382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f55cb07c30bc42a0930276baefc1d4b7" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:14.521869 23382 raft_consensus.cc:3060] T f55cb07c30bc42a0930276baefc1d4b7 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:14.525264 23433 raft_consensus.cc:359] T ae5efc2770bb4bc7a09585a220a45131 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:14.525956 23433 raft_consensus.cc:385] T ae5efc2770bb4bc7a09585a220a45131 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:14.526115 23536 consensus_queue.cc:1048] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:14.549353 23429 tablet_bootstrap.cc:492] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689: Bootstrap starting.
I20260709 12:12:14.551218 23159 raft_consensus.cc:1275] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Refusing update from remote peer abe65f4962e147ac841608b6c30f7e1b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:12:14.551396 23746 raft_consensus.cc:493] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.551903 23746 raft_consensus.cc:515] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:14.553143 23536 consensus_queue.cc:1048] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:14.554698 23234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2d3a5114a7842179f9957c7f5660f7e" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
W20260709 12:12:14.556107 23127 leader_election.cc:343] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:14.558532 23795 consensus_queue.cc:1048] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:14.559662 23429 tablet_bootstrap.cc:654] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:14.563970 23744 raft_consensus.cc:493] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.564554 23744 raft_consensus.cc:515] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:14.572532 23744 leader_election.cc:290] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:14.573727 23522 raft_consensus.cc:493] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.574250 23522 raft_consensus.cc:515] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:14.576424 23522 leader_election.cc:290] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:14.584091 23433 raft_consensus.cc:740] T ae5efc2770bb4bc7a09585a220a45131 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:14.587564 23381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb0ec62373d4b39bd83ded02981c6dc" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:14.588529 23161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb0ec62373d4b39bd83ded02981c6dc" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:14.589582 23384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dca37fe4fc46b792220de05fc68749" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
W20260709 12:12:14.594187 23124 leader_election.cc:343] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:14.598569 23433 consensus_queue.cc:260] T ae5efc2770bb4bc7a09585a220a45131 P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:14.584051 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dca37fe4fc46b792220de05fc68749" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:14.600765 23310 raft_consensus.cc:2468] T 85dca37fe4fc46b792220de05fc68749 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 0.
I20260709 12:12:14.602227 23431 tablet_bootstrap.cc:654] T 541dc3e21d4e461b8c299d0186a42e7f P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:14.601770 23126 leader_election.cc:304] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689; no voters: 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:14.604417 23778 raft_consensus.cc:2804] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:14.604769 23778 raft_consensus.cc:493] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:14.605086 23778 raft_consensus.cc:3060] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:14.605233 23744 consensus_queue.cc:1048] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:12:14.612424 23274 leader_election.cc:343] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:14.614224 23778 raft_consensus.cc:515] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:14.598462 23158 raft_consensus.cc:2468] T f55cb07c30bc42a0930276baefc1d4b7 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 1.
I20260709 12:12:14.627099 23310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2d3a5114a7842179f9957c7f5660f7e" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:14.632790 23310 raft_consensus.cc:2468] T d2d3a5114a7842179f9957c7f5660f7e P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 0.
I20260709 12:12:14.633834 23433 ts_tablet_manager.cc:1434] T ae5efc2770bb4bc7a09585a220a45131 P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.128s	user 0.007s	sys 0.000s
I20260709 12:12:14.634228 23126 leader_election.cc:304] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689; no voters: abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:14.635185 23744 raft_consensus.cc:2804] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:14.635524 23744 raft_consensus.cc:493] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:14.635820 23744 raft_consensus.cc:3060] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:14.640267 23200 leader_election.cc:304] T f55cb07c30bc42a0930276baefc1d4b7 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:14.644706 23709 raft_consensus.cc:2804] T f55cb07c30bc42a0930276baefc1d4b7 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:12:14.644570 23273 leader_election.cc:343] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:14.645216 23709 raft_consensus.cc:697] T f55cb07c30bc42a0930276baefc1d4b7 P abe65f4962e147ac841608b6c30f7e1b [term 1 LEADER]: Becoming Leader. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Running, Role: LEADER
I20260709 12:12:14.645388 23273 leader_election.cc:304] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689; no voters: 3824bca1df8e4020b18c7989f7758391, 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:14.646164 23770 raft_consensus.cc:2749] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:14.646088 23709 consensus_queue.cc:237] T f55cb07c30bc42a0930276baefc1d4b7 P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:14.647032 23433 tablet_bootstrap.cc:492] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:14.622051 23746 leader_election.cc:290] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:14.666291 23429 tablet_bootstrap.cc:492] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689: No bootstrap required, opened a new log
I20260709 12:12:14.667441 23429 ts_tablet_manager.cc:1403] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689: Time spent bootstrapping tablet: real 0.118s	user 0.014s	sys 0.001s
I20260709 12:12:14.662714 23477 consensus_queue.cc:1048] T b71f710147be434e8d790a50e145def8 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:12:14.674191 23433 tablet_bootstrap.cc:654] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:14.690618 23382 raft_consensus.cc:2468] T f55cb07c30bc42a0930276baefc1d4b7 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 1.
I20260709 12:12:14.710464 23380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dca37fe4fc46b792220de05fc68749" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:14.699172 23308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dca37fe4fc46b792220de05fc68749" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:14.723129 23308 raft_consensus.cc:3060] T 85dca37fe4fc46b792220de05fc68749 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:14.723783 23059 catalog_manager.cc:5697] T f55cb07c30bc42a0930276baefc1d4b7 P abe65f4962e147ac841608b6c30f7e1b reported cstate change: term changed from 0 to 1, leader changed from <none> to abe65f4962e147ac841608b6c30f7e1b (127.16.98.194). New cstate: current_term: 1 leader_uuid: "abe65f4962e147ac841608b6c30f7e1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:14.721688 23429 raft_consensus.cc:359] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:14.726951 23429 raft_consensus.cc:385] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:14.727227 23429 raft_consensus.cc:740] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Initialized, Role: FOLLOWER
W20260709 12:12:14.727450 23124 leader_election.cc:343] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:14.732931 23809 consensus_queue.cc:1048] T b71f710147be434e8d790a50e145def8 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:14.699986 23778 leader_election.cc:290] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 election: Requested vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:14.722503 23433 tablet_bootstrap.cc:492] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:14.739112 23433 ts_tablet_manager.cc:1403] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.092s	user 0.018s	sys 0.006s
I20260709 12:12:14.739450 23430 tablet_bootstrap.cc:492] T 36d2201b0b3d4f07abf9c901453cda82 P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:14.739804 23430 ts_tablet_manager.cc:1403] T 36d2201b0b3d4f07abf9c901453cda82 P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.246s	user 0.011s	sys 0.031s
I20260709 12:12:14.736328 23055 catalog_manager.cc:5697] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa reported cstate change: term changed from 2 to 3, leader changed from abe65f4962e147ac841608b6c30f7e1b (127.16.98.194) to 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196). New cstate: current_term: 3 leader_uuid: "48bc58ace75f40e995efc1edcefe79fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:14.727891 23429 consensus_queue.cc:260] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:14.753358 23431 tablet_bootstrap.cc:492] T 541dc3e21d4e461b8c299d0186a42e7f P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:14.753886 23431 ts_tablet_manager.cc:1403] T 541dc3e21d4e461b8c299d0186a42e7f P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.235s	user 0.032s	sys 0.007s
I20260709 12:12:14.757871 23429 ts_tablet_manager.cc:1434] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689: Time spent starting tablet: real 0.090s	user 0.005s	sys 0.002s
I20260709 12:12:14.744123 23518 raft_consensus.cc:493] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.770720 23744 raft_consensus.cc:515] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:14.773030 23430 raft_consensus.cc:359] T 36d2201b0b3d4f07abf9c901453cda82 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:14.774266 23430 raft_consensus.cc:385] T 36d2201b0b3d4f07abf9c901453cda82 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:14.768056 23518 raft_consensus.cc:515] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:14.767621 23431 raft_consensus.cc:359] T 541dc3e21d4e461b8c299d0186a42e7f P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:14.774623 23430 raft_consensus.cc:740] T 36d2201b0b3d4f07abf9c901453cda82 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:14.783283 23431 raft_consensus.cc:385] T 541dc3e21d4e461b8c299d0186a42e7f P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:14.784643 23431 raft_consensus.cc:740] T 541dc3e21d4e461b8c299d0186a42e7f P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:14.789819 23430 consensus_queue.cc:260] T 36d2201b0b3d4f07abf9c901453cda82 P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:14.790480 23431 consensus_queue.cc:260] T 541dc3e21d4e461b8c299d0186a42e7f P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:14.791915 23777 consensus_queue.cc:1048] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:14.812330 23308 raft_consensus.cc:2468] T 85dca37fe4fc46b792220de05fc68749 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 1.
I20260709 12:12:14.814468 23431 ts_tablet_manager.cc:1434] T 541dc3e21d4e461b8c299d0186a42e7f P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.000s
I20260709 12:12:14.822925 23126 leader_election.cc:304] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689; no voters: 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:14.824048 23306 raft_consensus.cc:1240] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689 [term 3 FOLLOWER]: Rejecting Update request from peer abe65f4962e147ac841608b6c30f7e1b for earlier term 2. Current term is 3. Ops: []
I20260709 12:12:14.824472 23777 raft_consensus.cc:2804] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:14.825012 23777 raft_consensus.cc:697] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391 [term 1 LEADER]: Becoming Leader. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Running, Role: LEADER
I20260709 12:12:14.826078 23232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2d3a5114a7842179f9957c7f5660f7e" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:14.831646 23430 ts_tablet_manager.cc:1434] T 36d2201b0b3d4f07abf9c901453cda82 P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.092s	user 0.000s	sys 0.008s
I20260709 12:12:14.831322 23522 raft_consensus.cc:493] T 4bffc92cd6c84709bd0335a988eeef96 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.839931 23522 raft_consensus.cc:515] T 4bffc92cd6c84709bd0335a988eeef96 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:14.839010 23777 consensus_queue.cc:237] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:14.844632 23522 leader_election.cc:290] T 4bffc92cd6c84709bd0335a988eeef96 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
W20260709 12:12:14.848347 23127 leader_election.cc:343] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:14.853499 23384 raft_consensus.cc:1240] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa [term 3 LEADER]: Rejecting Update request from peer abe65f4962e147ac841608b6c30f7e1b for earlier term 2. Current term is 3. Ops: []
I20260709 12:12:14.853735 23383 raft_consensus.cc:3060] T 36d2201b0b3d4f07abf9c901453cda82 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:12:14.854892 23833 log.cc:927] Time spent T f55cb07c30bc42a0930276baefc1d4b7 P abe65f4962e147ac841608b6c30f7e1b: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:12:14.855813 23540 consensus_queue.cc:1059] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:14.856776 23540 consensus_queue.cc:1243] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Peer 48bc58ace75f40e995efc1edcefe79fa log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 12:12:14.857455 23836 raft_consensus.cc:3055] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:14.857816 23836 raft_consensus.cc:740] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Running, Role: LEADER
I20260709 12:12:14.858091 23744 leader_election.cc:290] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 election: Requested vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:14.861666 23518 leader_election.cc:290] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:14.863196 23540 consensus_queue.cc:1048] T 36d2201b0b3d4f07abf9c901453cda82 P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:14.863978 23306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2d3a5114a7842179f9957c7f5660f7e" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:14.864210 23234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bffc92cd6c84709bd0335a988eeef96" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:14.864770 23306 raft_consensus.cc:3060] T d2d3a5114a7842179f9957c7f5660f7e P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:14.877979 23536 raft_consensus.cc:493] T d8c6d6433d204aa3b5fa3a304e66dd7e P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.878517 23536 raft_consensus.cc:515] T d8c6d6433d204aa3b5fa3a304e66dd7e P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:14.879072 23430 tablet_bootstrap.cc:492] T 98439efe5217407d95ff24969e5b4083 P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:14.880302 23431 tablet_bootstrap.cc:492] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:14.868219 23384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bffc92cd6c84709bd0335a988eeef96" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:14.886463 23157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541dc3e21d4e461b8c299d0186a42e7f" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:14.887058 23381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541dc3e21d4e461b8c299d0186a42e7f" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:14.887183 23157 raft_consensus.cc:2468] T 541dc3e21d4e461b8c299d0186a42e7f P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 0.
I20260709 12:12:14.888865 23433 raft_consensus.cc:359] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:14.889506 23433 raft_consensus.cc:385] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:14.889775 23433 raft_consensus.cc:740] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:14.890425 23536 leader_election.cc:290] T d8c6d6433d204aa3b5fa3a304e66dd7e P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:14.890269 23433 consensus_queue.cc:260] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
W20260709 12:12:14.889050 23273 leader_election.cc:343] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:14.891619 23795 consensus_queue.cc:1048] T 36d2201b0b3d4f07abf9c901453cda82 P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:14.892557 23156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c6d6433d204aa3b5fa3a304e66dd7e" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
W20260709 12:12:14.903154 23276 leader_election.cc:343] T 4bffc92cd6c84709bd0335a988eeef96 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:14.906325 23795 consensus_queue.cc:1059] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:14.906980 23232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c6d6433d204aa3b5fa3a304e66dd7e" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
W20260709 12:12:14.909960 23273 leader_election.cc:343] T 4bffc92cd6c84709bd0335a988eeef96 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:14.910408 23273 leader_election.cc:304] T 4bffc92cd6c84709bd0335a988eeef96 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689; no voters: 48bc58ace75f40e995efc1edcefe79fa, abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:14.911811 23836 consensus_queue.cc:260] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:14.912642 23536 raft_consensus.cc:2749] T 4bffc92cd6c84709bd0335a988eeef96 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:14.913102 23836 raft_consensus.cc:3060] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:12:14.913797 23276 leader_election.cc:343] T d8c6d6433d204aa3b5fa3a304e66dd7e P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:14.922317 23274 leader_election.cc:304] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689; no voters: 48bc58ace75f40e995efc1edcefe79fa
W20260709 12:12:14.924329 23274 leader_election.cc:343] T d8c6d6433d204aa3b5fa3a304e66dd7e P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:14.924723 23274 leader_election.cc:304] T d8c6d6433d204aa3b5fa3a304e66dd7e P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689; no voters: 3824bca1df8e4020b18c7989f7758391, abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:14.925408 23770 raft_consensus.cc:2804] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:14.925770 23770 raft_consensus.cc:493] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:14.926090 23770 raft_consensus.cc:3060] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:14.927029 23518 raft_consensus.cc:2749] T d8c6d6433d204aa3b5fa3a304e66dd7e P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:14.935544 23433 ts_tablet_manager.cc:1434] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.196s	user 0.007s	sys 0.000s
I20260709 12:12:14.941932 23058 catalog_manager.cc:5697] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3824bca1df8e4020b18c7989f7758391 (127.16.98.193). New cstate: current_term: 1 leader_uuid: "3824bca1df8e4020b18c7989f7758391" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:14.983620 23709 raft_consensus.cc:493] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:14.984311 23709 raft_consensus.cc:515] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:14.987484 23384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "058e9aef198f48b8956a676b6f12b2e1" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
W20260709 12:12:14.990131 23199 leader_election.cc:343] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:14.991452 23709 leader_election.cc:290] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:14.995973 23156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "058e9aef198f48b8956a676b6f12b2e1" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:15.004601 23306 raft_consensus.cc:2468] T d2d3a5114a7842179f9957c7f5660f7e P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 1.
I20260709 12:12:15.006364 23126 leader_election.cc:304] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689; no voters: abe65f4962e147ac841608b6c30f7e1b
W20260709 12:12:15.007579 23200 leader_election.cc:343] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:15.008200 23200 leader_election.cc:304] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abe65f4962e147ac841608b6c30f7e1b; no voters: 3824bca1df8e4020b18c7989f7758391, 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:15.009107 23777 raft_consensus.cc:2804] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:15.009469 23795 raft_consensus.cc:2749] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:15.009621 23777 raft_consensus.cc:697] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391 [term 1 LEADER]: Becoming Leader. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Running, Role: LEADER
I20260709 12:12:15.010838 23433 tablet_bootstrap.cc:492] T d2d3a5114a7842179f9957c7f5660f7e P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
W20260709 12:12:15.010874 23106 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:15.010520 23777 consensus_queue.cc:237] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:15.035532 23431 tablet_bootstrap.cc:654] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:15.040868 23430 tablet_bootstrap.cc:700] T 98439efe5217407d95ff24969e5b4083 P 48bc58ace75f40e995efc1edcefe79fa: Time spent opening tablet: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:12:15.042716 23430 tablet_bootstrap.cc:654] T 98439efe5217407d95ff24969e5b4083 P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:15.039626 23709 raft_consensus.cc:493] T ae5efc2770bb4bc7a09585a220a45131 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.038924 23770 raft_consensus.cc:515] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:15.051009 23770 leader_election.cc:290] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Requested vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:15.054023 23157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541dc3e21d4e461b8c299d0186a42e7f" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:15.046028 23709 raft_consensus.cc:515] T ae5efc2770bb4bc7a09585a220a45131 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:15.067807 23157 raft_consensus.cc:3060] T 541dc3e21d4e461b8c299d0186a42e7f P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:15.071166 23059 catalog_manager.cc:5697] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3824bca1df8e4020b18c7989f7758391 (127.16.98.193). New cstate: current_term: 1 leader_uuid: "3824bca1df8e4020b18c7989f7758391" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:15.067816 23384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541dc3e21d4e461b8c299d0186a42e7f" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:15.076138 23433 tablet_bootstrap.cc:654] T d2d3a5114a7842179f9957c7f5660f7e P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:15.076645 23795 consensus_queue.cc:1048] T f55cb07c30bc42a0930276baefc1d4b7 P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:15.088275 23540 consensus_queue.cc:1048] T f55cb07c30bc42a0930276baefc1d4b7 P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:12:15.091041 23273 leader_election.cc:343] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:15.101595 23157 raft_consensus.cc:2468] T 541dc3e21d4e461b8c299d0186a42e7f P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 1.
I20260709 12:12:15.103691 23709 leader_election.cc:290] T ae5efc2770bb4bc7a09585a220a45131 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:15.109457 23431 tablet_bootstrap.cc:492] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:15.109973 23380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae5efc2770bb4bc7a09585a220a45131" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:15.109975 23431 ts_tablet_manager.cc:1403] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.236s	user 0.012s	sys 0.000s
W20260709 12:12:15.115666 23199 leader_election.cc:343] T ae5efc2770bb4bc7a09585a220a45131 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:15.116559 23232 raft_consensus.cc:1275] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b [term 3 FOLLOWER]: Refusing update from remote peer 48bc58ace75f40e995efc1edcefe79fa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:12:15.116951 23232 pending_rounds.cc:85] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b: Aborting all ops after (but not including) 1
I20260709 12:12:15.117201 23232 pending_rounds.cc:107] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:12:15.117142 23431 raft_consensus.cc:359] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:15.117726 23232 raft_consensus.cc:2889] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:15.117998 23431 raft_consensus.cc:385] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:15.118336 23431 raft_consensus.cc:740] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:15.119514 23809 consensus_queue.cc:1048] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:15.120234 23431 consensus_queue.cc:260] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:15.122426 23431 ts_tablet_manager.cc:1434] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:12:15.129585 23306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae5efc2770bb4bc7a09585a220a45131" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:15.130307 23306 raft_consensus.cc:2468] T ae5efc2770bb4bc7a09585a220a45131 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 0.
I20260709 12:12:15.131532 23201 leader_election.cc:304] T ae5efc2770bb4bc7a09585a220a45131 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b; no voters: 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:15.132443 23843 raft_consensus.cc:2804] T ae5efc2770bb4bc7a09585a220a45131 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:15.132808 23843 raft_consensus.cc:493] T ae5efc2770bb4bc7a09585a220a45131 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.133150 23843 raft_consensus.cc:3060] T ae5efc2770bb4bc7a09585a220a45131 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:15.141247 23843 raft_consensus.cc:515] T ae5efc2770bb4bc7a09585a220a45131 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:15.146608 23274 leader_election.cc:304] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689; no voters: 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:15.148633 23843 leader_election.cc:290] T ae5efc2770bb4bc7a09585a220a45131 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 election: Requested vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:15.149080 23536 raft_consensus.cc:2804] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:15.153083 23536 raft_consensus.cc:697] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Becoming Leader. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Running, Role: LEADER
I20260709 12:12:15.153810 23536 consensus_queue.cc:237] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:15.156999 23307 raft_consensus.cc:1275] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689 [term 3 FOLLOWER]: Refusing update from remote peer 48bc58ace75f40e995efc1edcefe79fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:15.150403 23431 tablet_bootstrap.cc:492] T 98439efe5217407d95ff24969e5b4083 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:15.160182 23307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae5efc2770bb4bc7a09585a220a45131" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:15.160748 23307 raft_consensus.cc:3060] T ae5efc2770bb4bc7a09585a220a45131 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:15.152354 23384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae5efc2770bb4bc7a09585a220a45131" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
W20260709 12:12:15.163417 23199 leader_election.cc:343] T ae5efc2770bb4bc7a09585a220a45131 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:15.167709 23431 tablet_bootstrap.cc:654] T 98439efe5217407d95ff24969e5b4083 P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:15.169206 23307 raft_consensus.cc:2468] T ae5efc2770bb4bc7a09585a220a45131 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 1.
I20260709 12:12:15.172930 23201 leader_election.cc:304] T ae5efc2770bb4bc7a09585a220a45131 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b; no voters: 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:15.173931 23843 raft_consensus.cc:2804] T ae5efc2770bb4bc7a09585a220a45131 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:15.174429 23843 raft_consensus.cc:697] T ae5efc2770bb4bc7a09585a220a45131 P abe65f4962e147ac841608b6c30f7e1b [term 1 LEADER]: Becoming Leader. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Running, Role: LEADER
I20260709 12:12:15.175264 23843 consensus_queue.cc:237] T ae5efc2770bb4bc7a09585a220a45131 P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:15.178035 23683 consensus_queue.cc:1048] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:15.179051 23431 tablet_bootstrap.cc:492] T 98439efe5217407d95ff24969e5b4083 P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:15.179553 23431 ts_tablet_manager.cc:1403] T 98439efe5217407d95ff24969e5b4083 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.000s
I20260709 12:12:15.182123 23431 raft_consensus.cc:359] T 98439efe5217407d95ff24969e5b4083 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:15.182961 23431 raft_consensus.cc:385] T 98439efe5217407d95ff24969e5b4083 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:15.183247 23431 raft_consensus.cc:740] T 98439efe5217407d95ff24969e5b4083 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:15.185243 23431 consensus_queue.cc:260] T 98439efe5217407d95ff24969e5b4083 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:15.187193 23431 ts_tablet_manager.cc:1434] T 98439efe5217407d95ff24969e5b4083 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 12:12:15.188282 23431 tablet_bootstrap.cc:492] T 058e9aef198f48b8956a676b6f12b2e1 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:15.195840 23431 tablet_bootstrap.cc:654] T 058e9aef198f48b8956a676b6f12b2e1 P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:15.211069 23431 tablet_bootstrap.cc:492] T 058e9aef198f48b8956a676b6f12b2e1 P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:15.211588 23431 ts_tablet_manager.cc:1403] T 058e9aef198f48b8956a676b6f12b2e1 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.004s
I20260709 12:12:15.212167 23433 tablet_bootstrap.cc:492] T d2d3a5114a7842179f9957c7f5660f7e P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:15.212877 23433 ts_tablet_manager.cc:1403] T d2d3a5114a7842179f9957c7f5660f7e P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.202s	user 0.013s	sys 0.003s
I20260709 12:12:15.236888 23431 raft_consensus.cc:359] T 058e9aef198f48b8956a676b6f12b2e1 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:15.237720 23431 raft_consensus.cc:385] T 058e9aef198f48b8956a676b6f12b2e1 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:15.237973 23431 raft_consensus.cc:740] T 058e9aef198f48b8956a676b6f12b2e1 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:15.238579 23431 consensus_queue.cc:260] T 058e9aef198f48b8956a676b6f12b2e1 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:15.241371 23431 ts_tablet_manager.cc:1434] T 058e9aef198f48b8956a676b6f12b2e1 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.004s
I20260709 12:12:15.242491 23431 tablet_bootstrap.cc:492] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:15.248363 23431 tablet_bootstrap.cc:654] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:15.256644 23058 catalog_manager.cc:5697] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "a9d87b20401744c7bd0c491f60cf0689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:15.258224 23431 tablet_bootstrap.cc:492] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391: No bootstrap required, opened a new log
I20260709 12:12:15.258728 23431 ts_tablet_manager.cc:1403] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 12:12:15.263187 23431 raft_consensus.cc:359] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:15.264019 23431 raft_consensus.cc:385] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:15.265177 23431 raft_consensus.cc:740] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:15.265829 23431 consensus_queue.cc:260] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:15.267892 23431 ts_tablet_manager.cc:1434] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.002s
I20260709 12:12:15.269953 23430 tablet_bootstrap.cc:492] T 98439efe5217407d95ff24969e5b4083 P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:15.270526 23430 ts_tablet_manager.cc:1403] T 98439efe5217407d95ff24969e5b4083 P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.397s	user 0.007s	sys 0.010s
I20260709 12:12:15.274065 23430 raft_consensus.cc:359] T 98439efe5217407d95ff24969e5b4083 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:15.274745 23430 raft_consensus.cc:385] T 98439efe5217407d95ff24969e5b4083 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:15.275046 23430 raft_consensus.cc:740] T 98439efe5217407d95ff24969e5b4083 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:15.276464 23433 raft_consensus.cc:359] T d2d3a5114a7842179f9957c7f5660f7e P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:15.275838 23430 consensus_queue.cc:260] T 98439efe5217407d95ff24969e5b4083 P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:15.280005 23433 raft_consensus.cc:385] T d2d3a5114a7842179f9957c7f5660f7e P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:15.281045 23433 raft_consensus.cc:740] T d2d3a5114a7842179f9957c7f5660f7e P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:15.281893 23433 consensus_queue.cc:260] T d2d3a5114a7842179f9957c7f5660f7e P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:15.284731 23433 ts_tablet_manager.cc:1434] T d2d3a5114a7842179f9957c7f5660f7e P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.071s	user 0.001s	sys 0.004s
I20260709 12:12:15.285902 23433 tablet_bootstrap.cc:492] T 98439efe5217407d95ff24969e5b4083 P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:15.287799 23430 ts_tablet_manager.cc:1434] T 98439efe5217407d95ff24969e5b4083 P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:12:15.289762 23430 tablet_bootstrap.cc:492] T ae5efc2770bb4bc7a09585a220a45131 P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:15.293577 23433 tablet_bootstrap.cc:654] T 98439efe5217407d95ff24969e5b4083 P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:15.293176 23055 catalog_manager.cc:5697] T ae5efc2770bb4bc7a09585a220a45131 P abe65f4962e147ac841608b6c30f7e1b reported cstate change: term changed from 0 to 1, leader changed from <none> to abe65f4962e147ac841608b6c30f7e1b (127.16.98.194). New cstate: current_term: 1 leader_uuid: "abe65f4962e147ac841608b6c30f7e1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:15.303009 23430 tablet_bootstrap.cc:654] T ae5efc2770bb4bc7a09585a220a45131 P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:15.309722 23433 tablet_bootstrap.cc:492] T 98439efe5217407d95ff24969e5b4083 P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:15.310220 23433 ts_tablet_manager.cc:1403] T 98439efe5217407d95ff24969e5b4083 P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.011s
I20260709 12:12:15.315874 23433 raft_consensus.cc:359] T 98439efe5217407d95ff24969e5b4083 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:15.320230 23433 raft_consensus.cc:385] T 98439efe5217407d95ff24969e5b4083 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:15.320590 23433 raft_consensus.cc:740] T 98439efe5217407d95ff24969e5b4083 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:15.321501 23433 consensus_queue.cc:260] T 98439efe5217407d95ff24969e5b4083 P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:15.324299 23433 ts_tablet_manager.cc:1434] T 98439efe5217407d95ff24969e5b4083 P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.003s
I20260709 12:12:15.327023 23433 tablet_bootstrap.cc:492] T 4bffc92cd6c84709bd0335a988eeef96 P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:15.329461 23430 tablet_bootstrap.cc:492] T ae5efc2770bb4bc7a09585a220a45131 P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:15.329993 23430 ts_tablet_manager.cc:1403] T ae5efc2770bb4bc7a09585a220a45131 P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.002s
I20260709 12:12:15.332669 23433 tablet_bootstrap.cc:654] T 4bffc92cd6c84709bd0335a988eeef96 P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:15.333033 23430 raft_consensus.cc:359] T ae5efc2770bb4bc7a09585a220a45131 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:15.333700 23430 raft_consensus.cc:385] T ae5efc2770bb4bc7a09585a220a45131 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:15.333954 23430 raft_consensus.cc:740] T ae5efc2770bb4bc7a09585a220a45131 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:15.334815 23430 consensus_queue.cc:260] T ae5efc2770bb4bc7a09585a220a45131 P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:15.337246 23430 ts_tablet_manager.cc:1434] T ae5efc2770bb4bc7a09585a220a45131 P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:12:15.338718 23430 tablet_bootstrap.cc:492] T 85dca37fe4fc46b792220de05fc68749 P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:15.346724 23430 tablet_bootstrap.cc:654] T 85dca37fe4fc46b792220de05fc68749 P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:15.349968 23433 tablet_bootstrap.cc:492] T 4bffc92cd6c84709bd0335a988eeef96 P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:15.350414 23433 ts_tablet_manager.cc:1403] T 4bffc92cd6c84709bd0335a988eeef96 P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.013s
I20260709 12:12:15.351567 23430 tablet_bootstrap.cc:492] T 85dca37fe4fc46b792220de05fc68749 P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:15.351995 23430 ts_tablet_manager.cc:1403] T 85dca37fe4fc46b792220de05fc68749 P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 12:12:15.352584 23433 raft_consensus.cc:359] T 4bffc92cd6c84709bd0335a988eeef96 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:15.353240 23433 raft_consensus.cc:385] T 4bffc92cd6c84709bd0335a988eeef96 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:15.353483 23433 raft_consensus.cc:740] T 4bffc92cd6c84709bd0335a988eeef96 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:15.354007 23430 raft_consensus.cc:359] T 85dca37fe4fc46b792220de05fc68749 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:15.354477 23430 raft_consensus.cc:385] T 85dca37fe4fc46b792220de05fc68749 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:15.354115 23433 consensus_queue.cc:260] T 4bffc92cd6c84709bd0335a988eeef96 P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:15.354732 23430 raft_consensus.cc:740] T 85dca37fe4fc46b792220de05fc68749 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:15.356313 23433 ts_tablet_manager.cc:1434] T 4bffc92cd6c84709bd0335a988eeef96 P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:12:15.357324 23430 consensus_queue.cc:260] T 85dca37fe4fc46b792220de05fc68749 P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:15.358734 23433 tablet_bootstrap.cc:492] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b: Bootstrap starting.
I20260709 12:12:15.360453 23430 ts_tablet_manager.cc:1434] T 85dca37fe4fc46b792220de05fc68749 P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:12:15.361449 23430 tablet_bootstrap.cc:492] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:15.366582 23433 tablet_bootstrap.cc:654] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:15.368829 23380 raft_consensus.cc:3060] T 85dca37fe4fc46b792220de05fc68749 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:15.370955 23430 tablet_bootstrap.cc:654] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:15.377378 23433 tablet_bootstrap.cc:492] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b: No bootstrap required, opened a new log
I20260709 12:12:15.377818 23433 ts_tablet_manager.cc:1403] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.003s
I20260709 12:12:15.380302 23433 raft_consensus.cc:359] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:15.380930 23433 raft_consensus.cc:385] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:15.381194 23433 raft_consensus.cc:740] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Initialized, Role: FOLLOWER
I20260709 12:12:15.382023 23433 consensus_queue.cc:260] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:15.383637 23433 ts_tablet_manager.cc:1434] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:12:15.388123 23777 consensus_queue.cc:1048] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:15.398345 23683 raft_consensus.cc:493] T ae5efc2770bb4bc7a09585a220a45131 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.399014 23683 raft_consensus.cc:515] T ae5efc2770bb4bc7a09585a220a45131 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:15.401178 23683 leader_election.cc:290] T ae5efc2770bb4bc7a09585a220a45131 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:15.402009 23234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae5efc2770bb4bc7a09585a220a45131" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:15.403986 23307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae5efc2770bb4bc7a09585a220a45131" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:15.404721 23307 raft_consensus.cc:2393] T ae5efc2770bb4bc7a09585a220a45131 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48bc58ace75f40e995efc1edcefe79fa in current term 1: Already voted for candidate abe65f4962e147ac841608b6c30f7e1b in this term.
I20260709 12:12:15.405851 23349 leader_election.cc:304] T ae5efc2770bb4bc7a09585a220a45131 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa; no voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:15.406808 23623 raft_consensus.cc:3060] T ae5efc2770bb4bc7a09585a220a45131 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:15.401270 23430 tablet_bootstrap.cc:492] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:15.407423 23430 ts_tablet_manager.cc:1403] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.015s
I20260709 12:12:15.417344 23430 raft_consensus.cc:359] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:15.418004 23430 raft_consensus.cc:385] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:15.418272 23430 raft_consensus.cc:740] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:15.418895 23430 consensus_queue.cc:260] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:15.422421 23837 consensus_queue.cc:1048] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:15.424393 23623 raft_consensus.cc:2749] T ae5efc2770bb4bc7a09585a220a45131 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:15.425740 23430 ts_tablet_manager.cc:1434] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 12:12:15.426760 23430 tablet_bootstrap.cc:492] T 4bffc92cd6c84709bd0335a988eeef96 P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:15.430989 23836 raft_consensus.cc:493] T 98439efe5217407d95ff24969e5b4083 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.431692 23836 raft_consensus.cc:515] T 98439efe5217407d95ff24969e5b4083 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:15.432461 23430 tablet_bootstrap.cc:654] T 4bffc92cd6c84709bd0335a988eeef96 P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:15.435187 23380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98439efe5217407d95ff24969e5b4083" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:15.435653 23157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98439efe5217407d95ff24969e5b4083" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:15.436182 23380 raft_consensus.cc:2468] T 98439efe5217407d95ff24969e5b4083 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 0.
I20260709 12:12:15.436606 23157 raft_consensus.cc:2468] T 98439efe5217407d95ff24969e5b4083 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 0.
I20260709 12:12:15.437736 23199 leader_election.cc:304] T 98439efe5217407d95ff24969e5b4083 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:15.438787 23843 raft_consensus.cc:2804] T 98439efe5217407d95ff24969e5b4083 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:15.439147 23843 raft_consensus.cc:493] T 98439efe5217407d95ff24969e5b4083 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.439492 23843 raft_consensus.cc:3060] T 98439efe5217407d95ff24969e5b4083 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:15.440332 23836 leader_election.cc:290] T 98439efe5217407d95ff24969e5b4083 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:15.447180 23430 tablet_bootstrap.cc:492] T 4bffc92cd6c84709bd0335a988eeef96 P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:15.447671 23430 ts_tablet_manager.cc:1403] T 4bffc92cd6c84709bd0335a988eeef96 P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.009s
I20260709 12:12:15.450028 23843 raft_consensus.cc:515] T 98439efe5217407d95ff24969e5b4083 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:15.450115 23430 raft_consensus.cc:359] T 4bffc92cd6c84709bd0335a988eeef96 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:15.450979 23430 raft_consensus.cc:385] T 4bffc92cd6c84709bd0335a988eeef96 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:15.451234 23430 raft_consensus.cc:740] T 4bffc92cd6c84709bd0335a988eeef96 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:15.451952 23430 consensus_queue.cc:260] T 4bffc92cd6c84709bd0335a988eeef96 P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:15.453490 23380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98439efe5217407d95ff24969e5b4083" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:15.454077 23380 raft_consensus.cc:3060] T 98439efe5217407d95ff24969e5b4083 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:15.454169 23430 ts_tablet_manager.cc:1434] T 4bffc92cd6c84709bd0335a988eeef96 P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:12:15.456171 23157 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98439efe5217407d95ff24969e5b4083" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:15.456761 23157 raft_consensus.cc:3060] T 98439efe5217407d95ff24969e5b4083 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:15.460314 23430 tablet_bootstrap.cc:492] T 058e9aef198f48b8956a676b6f12b2e1 P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:15.462970 23843 leader_election.cc:290] T 98439efe5217407d95ff24969e5b4083 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 election: Requested vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:15.463901 23157 raft_consensus.cc:2468] T 98439efe5217407d95ff24969e5b4083 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 1.
I20260709 12:12:15.466457 23200 leader_election.cc:304] T 98439efe5217407d95ff24969e5b4083 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:15.467594 23430 tablet_bootstrap.cc:654] T 058e9aef198f48b8956a676b6f12b2e1 P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:15.468205 23843 raft_consensus.cc:2804] T 98439efe5217407d95ff24969e5b4083 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:15.469010 23843 raft_consensus.cc:697] T 98439efe5217407d95ff24969e5b4083 P abe65f4962e147ac841608b6c30f7e1b [term 1 LEADER]: Becoming Leader. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Running, Role: LEADER
I20260709 12:12:15.469893 23843 consensus_queue.cc:237] T 98439efe5217407d95ff24969e5b4083 P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:15.471294 23234 raft_consensus.cc:3060] T d2d3a5114a7842179f9957c7f5660f7e P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:15.479283 23837 consensus_queue.cc:1048] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:15.490036 23837 consensus_queue.cc:1048] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:15.465058 23380 raft_consensus.cc:2468] T 98439efe5217407d95ff24969e5b4083 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 1.
I20260709 12:12:15.495947 23056 catalog_manager.cc:5697] T 98439efe5217407d95ff24969e5b4083 P abe65f4962e147ac841608b6c30f7e1b reported cstate change: term changed from 0 to 1, leader changed from <none> to abe65f4962e147ac841608b6c30f7e1b (127.16.98.194). New cstate: current_term: 1 leader_uuid: "abe65f4962e147ac841608b6c30f7e1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:15.515638 23430 tablet_bootstrap.cc:492] T 058e9aef198f48b8956a676b6f12b2e1 P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:15.516499 23430 ts_tablet_manager.cc:1403] T 058e9aef198f48b8956a676b6f12b2e1 P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.056s	user 0.020s	sys 0.021s
I20260709 12:12:15.519228 23430 raft_consensus.cc:359] T 058e9aef198f48b8956a676b6f12b2e1 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:15.519930 23430 raft_consensus.cc:385] T 058e9aef198f48b8956a676b6f12b2e1 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:15.520246 23430 raft_consensus.cc:740] T 058e9aef198f48b8956a676b6f12b2e1 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:15.521107 23430 consensus_queue.cc:260] T 058e9aef198f48b8956a676b6f12b2e1 P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:15.523142 23430 ts_tablet_manager.cc:1434] T 058e9aef198f48b8956a676b6f12b2e1 P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:12:15.524565 23430 tablet_bootstrap.cc:492] T 8fb0ec62373d4b39bd83ded02981c6dc P 48bc58ace75f40e995efc1edcefe79fa: Bootstrap starting.
I20260709 12:12:15.532130 23430 tablet_bootstrap.cc:654] T 8fb0ec62373d4b39bd83ded02981c6dc P 48bc58ace75f40e995efc1edcefe79fa: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:15.583431 23380 raft_consensus.cc:3060] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:15.583950 23795 consensus_queue.cc:1048] T ae5efc2770bb4bc7a09585a220a45131 P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:15.591533 23777 raft_consensus.cc:493] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.592039 23777 raft_consensus.cc:515] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:15.595141 23307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c6d6433d204aa3b5fa3a304e66dd7e" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:15.595420 23744 raft_consensus.cc:493] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.595969 23744 raft_consensus.cc:515] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:15.595769 23307 raft_consensus.cc:2468] T d8c6d6433d204aa3b5fa3a304e66dd7e P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 0.
I20260709 12:12:15.596623 23430 tablet_bootstrap.cc:492] T 8fb0ec62373d4b39bd83ded02981c6dc P 48bc58ace75f40e995efc1edcefe79fa: No bootstrap required, opened a new log
I20260709 12:12:15.596771 23777 leader_election.cc:290] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:15.597227 23430 ts_tablet_manager.cc:1403] T 8fb0ec62373d4b39bd83ded02981c6dc P 48bc58ace75f40e995efc1edcefe79fa: Time spent bootstrapping tablet: real 0.073s	user 0.020s	sys 0.004s
I20260709 12:12:15.597736 23232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c6d6433d204aa3b5fa3a304e66dd7e" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:15.598066 23744 leader_election.cc:290] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:15.598363 23232 raft_consensus.cc:2468] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 0.
I20260709 12:12:15.599838 23430 raft_consensus.cc:359] T 8fb0ec62373d4b39bd83ded02981c6dc P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:15.600495 23430 raft_consensus.cc:385] T 8fb0ec62373d4b39bd83ded02981c6dc P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:15.600006 23127 leader_election.cc:304] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:15.600754 23384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb0ec62373d4b39bd83ded02981c6dc" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:15.601249 23744 raft_consensus.cc:2804] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:15.600754 23307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb0ec62373d4b39bd83ded02981c6dc" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:15.602980 23307 raft_consensus.cc:2468] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 0.
I20260709 12:12:15.601676 23744 raft_consensus.cc:493] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.600838 23430 raft_consensus.cc:740] T 8fb0ec62373d4b39bd83ded02981c6dc P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Initialized, Role: FOLLOWER
I20260709 12:12:15.604102 23126 leader_election.cc:304] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689; no voters: 
I20260709 12:12:15.603763 23744 raft_consensus.cc:3060] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:15.604310 23536 consensus_queue.cc:1048] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:15.605727 23838 raft_consensus.cc:2804] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:15.606129 23838 raft_consensus.cc:493] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.606460 23838 raft_consensus.cc:3060] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:15.606535 23809 raft_consensus.cc:493] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.607040 23809 raft_consensus.cc:515] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:15.604487 23430 consensus_queue.cc:260] T 8fb0ec62373d4b39bd83ded02981c6dc P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:15.609972 23777 raft_consensus.cc:493] T 058e9aef198f48b8956a676b6f12b2e1 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.609440 23384 raft_consensus.cc:2468] T 8fb0ec62373d4b39bd83ded02981c6dc P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 0.
I20260709 12:12:15.610905 23777 raft_consensus.cc:515] T 058e9aef198f48b8956a676b6f12b2e1 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:15.614975 23158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541dc3e21d4e461b8c299d0186a42e7f" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:15.615589 23158 raft_consensus.cc:2468] T 541dc3e21d4e461b8c299d0186a42e7f P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 1.
I20260709 12:12:15.611742 23809 leader_election.cc:290] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:15.612622 23430 ts_tablet_manager.cc:1434] T 8fb0ec62373d4b39bd83ded02981c6dc P 48bc58ace75f40e995efc1edcefe79fa: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:12:15.617849 23348 leader_election.cc:304] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, 48bc58ace75f40e995efc1edcefe79fa; no voters: 
I20260709 12:12:15.618383 23777 leader_election.cc:290] T 058e9aef198f48b8956a676b6f12b2e1 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:15.618140 23232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "058e9aef198f48b8956a676b6f12b2e1" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:15.619490 23232 raft_consensus.cc:2468] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 0.
I20260709 12:12:15.621008 23127 leader_election.cc:304] T 058e9aef198f48b8956a676b6f12b2e1 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:15.622109 23777 raft_consensus.cc:2804] T 058e9aef198f48b8956a676b6f12b2e1 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:15.621145 23744 raft_consensus.cc:515] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:15.622677 23777 raft_consensus.cc:493] T 058e9aef198f48b8956a676b6f12b2e1 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.623754 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "058e9aef198f48b8956a676b6f12b2e1" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:15.629402 23383 raft_consensus.cc:2468] T 058e9aef198f48b8956a676b6f12b2e1 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 0.
I20260709 12:12:15.624297 23307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541dc3e21d4e461b8c299d0186a42e7f" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:15.634835 23838 raft_consensus.cc:515] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:15.641072 23838 leader_election.cc:290] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 election: Requested vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:15.637192 23232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c6d6433d204aa3b5fa3a304e66dd7e" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:15.643260 23232 raft_consensus.cc:3060] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:15.631172 23777 raft_consensus.cc:3060] T 058e9aef198f48b8956a676b6f12b2e1 P 3824bca1df8e4020b18c7989f7758391 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:15.647123 23795 consensus_queue.cc:1048] T ae5efc2770bb4bc7a09585a220a45131 P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:15.657547 23809 raft_consensus.cc:2804] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:15.659010 23309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c6d6433d204aa3b5fa3a304e66dd7e" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:15.659703 23309 raft_consensus.cc:3060] T d8c6d6433d204aa3b5fa3a304e66dd7e P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:15.660317 23307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb0ec62373d4b39bd83ded02981c6dc" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:15.660894 23307 raft_consensus.cc:3060] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:15.663722 23809 raft_consensus.cc:493] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting leader election (detected failure of leader a9d87b20401744c7bd0c491f60cf0689)
I20260709 12:12:15.664152 23809 raft_consensus.cc:3060] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:15.666805 23777 raft_consensus.cc:515] T 058e9aef198f48b8956a676b6f12b2e1 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:15.667531 23536 consensus_queue.cc:1048] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:15.668881 23777 leader_election.cc:290] T 058e9aef198f48b8956a676b6f12b2e1 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 election: Requested vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:15.670179 23232 raft_consensus.cc:2468] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 1.
I20260709 12:12:15.672000 23232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "058e9aef198f48b8956a676b6f12b2e1" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:15.672600 23232 raft_consensus.cc:3060] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:15.672034 23127 leader_election.cc:304] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:15.674784 23838 raft_consensus.cc:2804] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:15.674974 23809 raft_consensus.cc:515] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:15.675383 23838 raft_consensus.cc:697] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391 [term 1 LEADER]: Becoming Leader. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Running, Role: LEADER
I20260709 12:12:15.676503 23838 consensus_queue.cc:237] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:15.678108 23156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541dc3e21d4e461b8c299d0186a42e7f" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:15.677203 23380 raft_consensus.cc:1240] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Rejecting Update request from peer a9d87b20401744c7bd0c491f60cf0689 for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:15.677110 23809 leader_election.cc:290] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 2 election: Requested vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
W20260709 12:12:15.681973 23124 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.196:37599, user_credentials={real_user=slave}} blocked reactor thread for 57001.4us
I20260709 12:12:15.683151 23536 consensus_queue.cc:1059] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:15.684039 23518 raft_consensus.cc:3055] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:15.684391 23518 raft_consensus.cc:740] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Running, Role: LEADER
I20260709 12:12:15.685196 23518 consensus_queue.cc:260] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:15.686080 23518 raft_consensus.cc:3060] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:15.687004 23306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541dc3e21d4e461b8c299d0186a42e7f" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:15.687351 23309 raft_consensus.cc:2468] T d8c6d6433d204aa3b5fa3a304e66dd7e P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 1.
I20260709 12:12:15.687811 23384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb0ec62373d4b39bd83ded02981c6dc" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:15.689082 23380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "058e9aef198f48b8956a676b6f12b2e1" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:15.692760 23384 raft_consensus.cc:3060] T 8fb0ec62373d4b39bd83ded02981c6dc P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:15.692930 23380 raft_consensus.cc:3060] T 058e9aef198f48b8956a676b6f12b2e1 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:15.662396 23744 leader_election.cc:290] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 election: Requested vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:15.699324 23384 raft_consensus.cc:2468] T 8fb0ec62373d4b39bd83ded02981c6dc P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 1.
I20260709 12:12:15.700603 23124 leader_election.cc:304] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, 48bc58ace75f40e995efc1edcefe79fa; no voters: 
I20260709 12:12:15.701892 23744 raft_consensus.cc:2804] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:15.702585 23744 raft_consensus.cc:697] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391 [term 1 LEADER]: Becoming Leader. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Running, Role: LEADER
I20260709 12:12:15.703550 23744 consensus_queue.cc:237] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:15.704833 23232 raft_consensus.cc:2468] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 1.
I20260709 12:12:15.706229 23127 leader_election.cc:304] T 058e9aef198f48b8956a676b6f12b2e1 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:15.706969 23837 raft_consensus.cc:2804] T 058e9aef198f48b8956a676b6f12b2e1 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:15.707441 23837 raft_consensus.cc:697] T 058e9aef198f48b8956a676b6f12b2e1 P 3824bca1df8e4020b18c7989f7758391 [term 1 LEADER]: Becoming Leader. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Running, Role: LEADER
I20260709 12:12:15.708235 23837 consensus_queue.cc:237] T 058e9aef198f48b8956a676b6f12b2e1 P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:15.710218 23380 raft_consensus.cc:2468] T 058e9aef198f48b8956a676b6f12b2e1 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 1.
I20260709 12:12:15.714799 23306 raft_consensus.cc:2468] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 2.
I20260709 12:12:15.727826 23349 leader_election.cc:304] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689; no voters: 3824bca1df8e4020b18c7989f7758391
I20260709 12:12:15.728760 23809 raft_consensus.cc:2804] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:15.729578 23809 raft_consensus.cc:697] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa [term 2 LEADER]: Becoming Leader. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Running, Role: LEADER
I20260709 12:12:15.730506 23809 consensus_queue.cc:237] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:15.733875 23307 raft_consensus.cc:2468] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 1.
I20260709 12:12:15.753468 23058 catalog_manager.cc:5697] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3824bca1df8e4020b18c7989f7758391 (127.16.98.193). New cstate: current_term: 1 leader_uuid: "3824bca1df8e4020b18c7989f7758391" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:15.754669 23058 catalog_manager.cc:5697] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3824bca1df8e4020b18c7989f7758391 (127.16.98.193). New cstate: current_term: 1 leader_uuid: "3824bca1df8e4020b18c7989f7758391" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:15.755734 23058 catalog_manager.cc:5697] T 058e9aef198f48b8956a676b6f12b2e1 P 3824bca1df8e4020b18c7989f7758391 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3824bca1df8e4020b18c7989f7758391 (127.16.98.193). New cstate: current_term: 1 leader_uuid: "3824bca1df8e4020b18c7989f7758391" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:15.764878 23059 catalog_manager.cc:5697] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa reported cstate change: term changed from 1 to 2, leader changed from a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195) to 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196). New cstate: current_term: 2 leader_uuid: "48bc58ace75f40e995efc1edcefe79fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:15.805495 23477 raft_consensus.cc:493] T 4bffc92cd6c84709bd0335a988eeef96 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:15.805974 23477 raft_consensus.cc:515] T 4bffc92cd6c84709bd0335a988eeef96 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:15.807914 23477 leader_election.cc:290] T 4bffc92cd6c84709bd0335a988eeef96 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:15.808584 23232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bffc92cd6c84709bd0335a988eeef96" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:15.808864 23307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bffc92cd6c84709bd0335a988eeef96" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:15.809165 23232 raft_consensus.cc:2468] T 4bffc92cd6c84709bd0335a988eeef96 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 0.
I20260709 12:12:15.809543 23307 raft_consensus.cc:2468] T 4bffc92cd6c84709bd0335a988eeef96 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 0.
I20260709 12:12:15.810215 23350 leader_election.cc:304] T 4bffc92cd6c84709bd0335a988eeef96 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:15.810959 23477 raft_consensus.cc:2804] T 4bffc92cd6c84709bd0335a988eeef96 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:15.811336 23477 raft_consensus.cc:493] T 4bffc92cd6c84709bd0335a988eeef96 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:15.811689 23477 raft_consensus.cc:3060] T 4bffc92cd6c84709bd0335a988eeef96 P 48bc58ace75f40e995efc1edcefe79fa [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:15.816123 23477 raft_consensus.cc:515] T 4bffc92cd6c84709bd0335a988eeef96 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:15.817391 23477 leader_election.cc:290] T 4bffc92cd6c84709bd0335a988eeef96 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Requested vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:15.818197 23232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bffc92cd6c84709bd0335a988eeef96" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:15.818327 23307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bffc92cd6c84709bd0335a988eeef96" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:15.818852 23232 raft_consensus.cc:3060] T 4bffc92cd6c84709bd0335a988eeef96 P abe65f4962e147ac841608b6c30f7e1b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:15.818902 23307 raft_consensus.cc:3060] T 4bffc92cd6c84709bd0335a988eeef96 P a9d87b20401744c7bd0c491f60cf0689 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:15.825555 23307 raft_consensus.cc:2468] T 4bffc92cd6c84709bd0335a988eeef96 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 1.
I20260709 12:12:15.826359 23232 raft_consensus.cc:2468] T 4bffc92cd6c84709bd0335a988eeef96 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 1.
I20260709 12:12:15.826979 23349 leader_election.cc:304] T 4bffc92cd6c84709bd0335a988eeef96 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689; no voters: 
I20260709 12:12:15.827713 23477 raft_consensus.cc:2804] T 4bffc92cd6c84709bd0335a988eeef96 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:15.828378 23477 raft_consensus.cc:697] T 4bffc92cd6c84709bd0335a988eeef96 P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Becoming Leader. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Running, Role: LEADER
I20260709 12:12:15.829180 23477 consensus_queue.cc:237] T 4bffc92cd6c84709bd0335a988eeef96 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:15.844317 23059 catalog_manager.cc:5697] T 4bffc92cd6c84709bd0335a988eeef96 P 48bc58ace75f40e995efc1edcefe79fa reported cstate change: term changed from 0 to 1, leader changed from <none> to 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196). New cstate: current_term: 1 leader_uuid: "48bc58ace75f40e995efc1edcefe79fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:15.925318 23709 consensus_queue.cc:1048] T 98439efe5217407d95ff24969e5b4083 P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:15.936857 23795 consensus_queue.cc:1048] T 98439efe5217407d95ff24969e5b4083 P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:16.091699 23838 consensus_queue.cc:1048] T 058e9aef198f48b8956a676b6f12b2e1 P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:16.107486 23838 consensus_queue.cc:1048] T 058e9aef198f48b8956a676b6f12b2e1 P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:16.158077 23873 consensus_queue.cc:1048] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:16.168483 23837 consensus_queue.cc:1048] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:16.233330 23837 consensus_queue.cc:1048] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:16.245111 23837 consensus_queue.cc:1048] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:16.295910 23306 raft_consensus.cc:1275] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Refusing update from remote peer 48bc58ace75f40e995efc1edcefe79fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:16.297068 23623 consensus_queue.cc:1048] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:16.306598 23157 raft_consensus.cc:3060] T 541dc3e21d4e461b8c299d0186a42e7f P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:16.313575 23157 raft_consensus.cc:1275] T 541dc3e21d4e461b8c299d0186a42e7f P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Refusing update from remote peer 48bc58ace75f40e995efc1edcefe79fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:16.315732 23623 consensus_queue.cc:1048] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:16.355568 23623 consensus_queue.cc:1048] T 4bffc92cd6c84709bd0335a988eeef96 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:16.367347 23623 consensus_queue.cc:1048] T 4bffc92cd6c84709bd0335a988eeef96 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:16.815799 16779 tablet_server.cc:179] TabletServer@127.16.98.193:0 shutting down...
W20260709 12:12:16.824458 23200 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:12:16.830978 23200 consensus_peers.cc:597] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:16.841543 23348 consensus_peers.cc:597] T a7d44e74deb341179f886489282ced2f P 48bc58ace75f40e995efc1edcefe79fa -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:16.843125 23274 consensus_peers.cc:597] T c880cf7f327c4b709c29dd91c8645c18 P a9d87b20401744c7bd0c491f60cf0689 -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:16.859612 23348 consensus_peers.cc:597] T d12a070001934296ba81c85f9ba61e27 P 48bc58ace75f40e995efc1edcefe79fa -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:16.860272 23348 consensus_peers.cc:597] T 5002a306b4474c909091a65333c74939 P 48bc58ace75f40e995efc1edcefe79fa -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:16.870630 16779 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:16.871481 16779 tablet_replica.cc:333] T 058e9aef198f48b8956a676b6f12b2e1 P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:16.872092 16779 raft_consensus.cc:2243] T 058e9aef198f48b8956a676b6f12b2e1 P 3824bca1df8e4020b18c7989f7758391 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:16.872824 16779 raft_consensus.cc:2272] T 058e9aef198f48b8956a676b6f12b2e1 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:16.875098 16779 tablet_replica.cc:333] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:16.875698 16779 raft_consensus.cc:2243] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:16.876538 16779 raft_consensus.cc:2272] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:16.878885 16779 tablet_replica.cc:333] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:16.879429 16779 raft_consensus.cc:2243] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:16.880040 16779 raft_consensus.cc:2272] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:16.881911 16779 tablet_replica.cc:333] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:16.882615 16779 raft_consensus.cc:2243] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:16.883468 16779 raft_consensus.cc:2272] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:16.885610 16779 tablet_replica.cc:333] T 72855efda9164489afb0f46a7f8da834 P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:16.886312 16779 raft_consensus.cc:2243] T 72855efda9164489afb0f46a7f8da834 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:16.886787 16779 raft_consensus.cc:2272] T 72855efda9164489afb0f46a7f8da834 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:16.886910 23274 consensus_peers.cc:597] T 3fb3705cd5724f208798f30d9ab01bda P a9d87b20401744c7bd0c491f60cf0689 -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:16.888846 16779 tablet_replica.cc:333] T 36d2201b0b3d4f07abf9c901453cda82 P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:16.889479 16779 raft_consensus.cc:2243] T 36d2201b0b3d4f07abf9c901453cda82 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:16.889928 16779 raft_consensus.cc:2272] T 36d2201b0b3d4f07abf9c901453cda82 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:16.891848 16779 tablet_replica.cc:333] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:16.892630 16779 raft_consensus.cc:2243] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:12:16.893249 23200 consensus_peers.cc:597] T c113311e527c47578f8c136d335aa87f P abe65f4962e147ac841608b6c30f7e1b -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:16.893433 16779 raft_consensus.cc:2272] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:16.895315 16779 tablet_replica.cc:333] T fba757d381304cc0bcbb4f9dbcfc812c P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:16.895992 16779 raft_consensus.cc:2243] T fba757d381304cc0bcbb4f9dbcfc812c P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:16.896386 16779 raft_consensus.cc:2272] T fba757d381304cc0bcbb4f9dbcfc812c P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:16.898149 16779 tablet_replica.cc:333] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:16.898765 16779 raft_consensus.cc:2243] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:16.899438 16779 raft_consensus.cc:2272] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:16.901394 16779 tablet_replica.cc:333] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:16.901929 16779 raft_consensus.cc:2243] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:16.902276 16779 raft_consensus.cc:2272] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:16.904574 16779 tablet_replica.cc:333] T 6b891c5848b248d8a1830e801c7dce9a P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:16.905256 16779 raft_consensus.cc:2243] T 6b891c5848b248d8a1830e801c7dce9a P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:16.905735 16779 raft_consensus.cc:2272] T 6b891c5848b248d8a1830e801c7dce9a P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:16.906435 23274 consensus_peers.cc:597] T 1f5cfd203dcc43d4a86864c2eaaf234c P a9d87b20401744c7bd0c491f60cf0689 -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:16.908181 16779 tablet_replica.cc:333] T 6c03bbe73aee42039c1f868590838eaf P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:16.909046 16779 raft_consensus.cc:2243] T 6c03bbe73aee42039c1f868590838eaf P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:16.909564 16779 raft_consensus.cc:2272] T 6c03bbe73aee42039c1f868590838eaf P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:16.909821 23274 consensus_peers.cc:597] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689 -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:16.911762 16779 tablet_replica.cc:333] T 89d4b46113284ecc9db8b0e3c2b46f89 P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:16.912395 16779 raft_consensus.cc:2243] T 89d4b46113284ecc9db8b0e3c2b46f89 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:16.912829 16779 raft_consensus.cc:2272] T 89d4b46113284ecc9db8b0e3c2b46f89 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:16.914608 16779 tablet_replica.cc:333] T e3b19b20feb045058cd1cfbd684ff05f P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:16.915118 16779 raft_consensus.cc:2243] T e3b19b20feb045058cd1cfbd684ff05f P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:16.915542 16779 raft_consensus.cc:2272] T e3b19b20feb045058cd1cfbd684ff05f P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:16.918195 16779 tablet_replica.cc:333] T 9ffb43b95dbe424d89c123a2179445ec P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:16.919046 16779 raft_consensus.cc:2243] T 9ffb43b95dbe424d89c123a2179445ec P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:16.919539 16779 raft_consensus.cc:2272] T 9ffb43b95dbe424d89c123a2179445ec P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:16.922078 16779 tablet_replica.cc:333] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:16.922833 16779 raft_consensus.cc:2243] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:16.923635 16779 raft_consensus.cc:2272] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:16.925712 16779 tablet_replica.cc:333] T d12a070001934296ba81c85f9ba61e27 P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:16.926229 16779 raft_consensus.cc:2243] T d12a070001934296ba81c85f9ba61e27 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:16.926781 16779 raft_consensus.cc:2272] T d12a070001934296ba81c85f9ba61e27 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:16.929129 16779 tablet_replica.cc:333] T 3fb3705cd5724f208798f30d9ab01bda P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:16.929868 16779 raft_consensus.cc:2243] T 3fb3705cd5724f208798f30d9ab01bda P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:16.930205 23274 consensus_peers.cc:597] T 89d4b46113284ecc9db8b0e3c2b46f89 P a9d87b20401744c7bd0c491f60cf0689 -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:16.930377 16779 raft_consensus.cc:2272] T 3fb3705cd5724f208798f30d9ab01bda P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:16.933112 16779 tablet_replica.cc:333] T 1b4285f9faa34fc595e0b7db3f7f0946 P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:16.933924 16779 raft_consensus.cc:2243] T 1b4285f9faa34fc595e0b7db3f7f0946 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:16.934446 16779 raft_consensus.cc:2272] T 1b4285f9faa34fc595e0b7db3f7f0946 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:16.934804 23274 consensus_peers.cc:597] T 2693b48366d0430b9db7d8cc90d9667c P a9d87b20401744c7bd0c491f60cf0689 -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:16.936445 16779 tablet_replica.cc:333] T f55cb07c30bc42a0930276baefc1d4b7 P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:16.937048 16779 raft_consensus.cc:2243] T f55cb07c30bc42a0930276baefc1d4b7 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:16.937467 16779 raft_consensus.cc:2272] T f55cb07c30bc42a0930276baefc1d4b7 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:16.939697 16779 tablet_replica.cc:333] T da47bda397e2471388bcab5069dd7edc P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:16.940503 16779 raft_consensus.cc:2243] T da47bda397e2471388bcab5069dd7edc P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:16.940995 16779 raft_consensus.cc:2272] T da47bda397e2471388bcab5069dd7edc P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:16.943677 16779 tablet_replica.cc:333] T 1f5cfd203dcc43d4a86864c2eaaf234c P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
W20260709 12:12:16.944289 23274 consensus_peers.cc:597] T 3243e85ef0e741d696af414124ca96bd P a9d87b20401744c7bd0c491f60cf0689 -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:16.944418 16779 raft_consensus.cc:2243] T 1f5cfd203dcc43d4a86864c2eaaf234c P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:16.944945 16779 raft_consensus.cc:2272] T 1f5cfd203dcc43d4a86864c2eaaf234c P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:16.947597 16779 tablet_replica.cc:333] T 98439efe5217407d95ff24969e5b4083 P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:16.948342 16779 raft_consensus.cc:2243] T 98439efe5217407d95ff24969e5b4083 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:16.948787 16779 raft_consensus.cc:2272] T 98439efe5217407d95ff24969e5b4083 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:16.949376 23200 consensus_peers.cc:597] T 98439efe5217407d95ff24969e5b4083 P abe65f4962e147ac841608b6c30f7e1b -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:16.950995 16779 tablet_replica.cc:333] T 7f25493a942c4d96ad5fed839ad58386 P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:16.951826 16779 raft_consensus.cc:2243] T 7f25493a942c4d96ad5fed839ad58386 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:16.952298 16779 raft_consensus.cc:2272] T 7f25493a942c4d96ad5fed839ad58386 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:16.954327 16779 tablet_replica.cc:333] T 7193dd2dee9c4d1c9992ad4eff434b59 P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:16.955021 16779 raft_consensus.cc:2243] T 7193dd2dee9c4d1c9992ad4eff434b59 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:16.955435 16779 raft_consensus.cc:2272] T 7193dd2dee9c4d1c9992ad4eff434b59 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:16.956218 23274 consensus_peers.cc:597] T 2954a8837137444496d21a25638b3f2a P a9d87b20401744c7bd0c491f60cf0689 -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:16.957510 16779 tablet_replica.cc:333] T 5d0efec949fc4455838db7fb01259d69 P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:16.958046 16779 raft_consensus.cc:2243] T 5d0efec949fc4455838db7fb01259d69 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:16.958420 16779 raft_consensus.cc:2272] T 5d0efec949fc4455838db7fb01259d69 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:16.960275 16779 tablet_replica.cc:333] T 64daa90835844e619fa313a9d91a83cc P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:16.960903 16779 raft_consensus.cc:2243] T 64daa90835844e619fa313a9d91a83cc P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:16.961244 16779 raft_consensus.cc:2272] T 64daa90835844e619fa313a9d91a83cc P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:16.963155 16779 tablet_replica.cc:333] T 2693b48366d0430b9db7d8cc90d9667c P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:16.963696 16779 raft_consensus.cc:2243] T 2693b48366d0430b9db7d8cc90d9667c P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:16.964119 16779 raft_consensus.cc:2272] T 2693b48366d0430b9db7d8cc90d9667c P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:16.965596 23348 consensus_peers.cc:597] T e3b19b20feb045058cd1cfbd684ff05f P 48bc58ace75f40e995efc1edcefe79fa -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:16.966027 16779 tablet_replica.cc:333] T a7d44e74deb341179f886489282ced2f P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:16.966708 16779 raft_consensus.cc:2243] T a7d44e74deb341179f886489282ced2f P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:16.967123 16779 raft_consensus.cc:2272] T a7d44e74deb341179f886489282ced2f P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:16.969003 16779 tablet_replica.cc:333] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:16.969522 16779 raft_consensus.cc:2243] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:16.969924 16779 raft_consensus.cc:2272] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:16.971766 16779 tablet_replica.cc:333] T e53f580024c14b33b72266b89a1ab8e3 P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:16.972285 16779 raft_consensus.cc:2243] T e53f580024c14b33b72266b89a1ab8e3 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:16.972663 16779 raft_consensus.cc:2272] T e53f580024c14b33b72266b89a1ab8e3 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:16.974448 16779 tablet_replica.cc:333] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:16.974995 16779 raft_consensus.cc:2243] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:16.975399 16779 raft_consensus.cc:2272] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:16.977069 16779 tablet_replica.cc:333] T c880cf7f327c4b709c29dd91c8645c18 P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:16.977752 16779 raft_consensus.cc:2243] T c880cf7f327c4b709c29dd91c8645c18 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:16.978200 16779 raft_consensus.cc:2272] T c880cf7f327c4b709c29dd91c8645c18 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:16.980469 16779 tablet_replica.cc:333] T 9aa8c90489d54dc6b2684d1970165a8a P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:16.981186 16779 raft_consensus.cc:2243] T 9aa8c90489d54dc6b2684d1970165a8a P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:16.981253 23200 consensus_peers.cc:597] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:16.981752 16779 raft_consensus.cc:2272] T 9aa8c90489d54dc6b2684d1970165a8a P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:16.984159 16779 tablet_replica.cc:333] T 11b1c6ca5b8b4d61a6e200744c543ede P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
W20260709 12:12:16.984726 23274 consensus_peers.cc:597] T 64daa90835844e619fa313a9d91a83cc P a9d87b20401744c7bd0c491f60cf0689 -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:16.984871 16779 raft_consensus.cc:2243] T 11b1c6ca5b8b4d61a6e200744c543ede P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:16.985365 16779 raft_consensus.cc:2272] T 11b1c6ca5b8b4d61a6e200744c543ede P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:16.987174 16779 tablet_replica.cc:333] T c113311e527c47578f8c136d335aa87f P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:16.987701 16779 raft_consensus.cc:2243] T c113311e527c47578f8c136d335aa87f P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:16.988071 16779 raft_consensus.cc:2272] T c113311e527c47578f8c136d335aa87f P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:16.989713 16779 tablet_replica.cc:333] T 5002a306b4474c909091a65333c74939 P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:16.990227 16779 raft_consensus.cc:2243] T 5002a306b4474c909091a65333c74939 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:16.990636 16779 raft_consensus.cc:2272] T 5002a306b4474c909091a65333c74939 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:16.992393 16779 tablet_replica.cc:333] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:16.992887 16779 raft_consensus.cc:2243] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:16.993590 16779 raft_consensus.cc:2272] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:16.996068 16779 tablet_replica.cc:333] T 9d57b510cd3745fabb0748a6f9008fca P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:16.996819 16779 raft_consensus.cc:2243] T 9d57b510cd3745fabb0748a6f9008fca P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:16.997253 16779 raft_consensus.cc:2272] T 9d57b510cd3745fabb0748a6f9008fca P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:16.999142 16779 tablet_replica.cc:333] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:16.999776 16779 raft_consensus.cc:2243] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:17.000504 16779 raft_consensus.cc:2272] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:17.002982 16779 tablet_replica.cc:333] T d53aaedd982440259b3ef5d84cddcbed P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:17.003501 16779 raft_consensus.cc:2243] T d53aaedd982440259b3ef5d84cddcbed P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:17.003903 16779 raft_consensus.cc:2272] T d53aaedd982440259b3ef5d84cddcbed P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:17.005667 16779 tablet_replica.cc:333] T 541dc3e21d4e461b8c299d0186a42e7f P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:17.006172 16779 raft_consensus.cc:2243] T 541dc3e21d4e461b8c299d0186a42e7f P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:17.006563 16779 raft_consensus.cc:2272] T 541dc3e21d4e461b8c299d0186a42e7f P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:17.008685 16779 tablet_replica.cc:333] T bda09a1e5c59409c96c419b65061c1dc P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:17.009188 16779 raft_consensus.cc:2243] T bda09a1e5c59409c96c419b65061c1dc P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:17.009567 16779 raft_consensus.cc:2272] T bda09a1e5c59409c96c419b65061c1dc P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:17.011346 16779 tablet_replica.cc:333] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:17.011804 16779 raft_consensus.cc:2243] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:17.012487 16779 raft_consensus.cc:2272] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:17.014783 16779 tablet_replica.cc:333] T 3243e85ef0e741d696af414124ca96bd P 3824bca1df8e4020b18c7989f7758391: stopping tablet replica
I20260709 12:12:17.015393 16779 raft_consensus.cc:2243] T 3243e85ef0e741d696af414124ca96bd P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:17.015875 16779 raft_consensus.cc:2272] T 3243e85ef0e741d696af414124ca96bd P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:17.034929 23348 consensus_peers.cc:597] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:17.055348 23274 consensus_peers.cc:597] T 6b891c5848b248d8a1830e801c7dce9a P a9d87b20401744c7bd0c491f60cf0689 -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:17.089766 16779 tablet_server.cc:196] TabletServer@127.16.98.193:0 shutdown complete.
W20260709 12:12:17.095278 23200 consensus_peers.cc:597] T f55cb07c30bc42a0930276baefc1d4b7 P abe65f4962e147ac841608b6c30f7e1b -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:42187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:17.097831 23348 consensus_peers.cc:597] T 9aa8c90489d54dc6b2684d1970165a8a P 48bc58ace75f40e995efc1edcefe79fa -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:42187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:17.121969 23348 consensus_peers.cc:597] T bda09a1e5c59409c96c419b65061c1dc P 48bc58ace75f40e995efc1edcefe79fa -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:42187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:17.131953 23200 consensus_peers.cc:597] T 7f25493a942c4d96ad5fed839ad58386 P abe65f4962e147ac841608b6c30f7e1b -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:42187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:17.147433 23200 consensus_peers.cc:597] T 36d2201b0b3d4f07abf9c901453cda82 P abe65f4962e147ac841608b6c30f7e1b -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:42187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:17.163977 23274 consensus_peers.cc:597] T 11b1c6ca5b8b4d61a6e200744c543ede P a9d87b20401744c7bd0c491f60cf0689 -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:42187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:17.173801 23348 consensus_peers.cc:597] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:42187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:17.176694 23200 consensus_peers.cc:597] T da47bda397e2471388bcab5069dd7edc P abe65f4962e147ac841608b6c30f7e1b -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:42187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:17.179296 23348 consensus_peers.cc:597] T 9d57b510cd3745fabb0748a6f9008fca P 48bc58ace75f40e995efc1edcefe79fa -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:42187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:17.180402 16779 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:17.189255 23899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:17.189669 23900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:17.190181 23902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:17.193473 16779 server_base.cc:1061] running on GCE node
I20260709 12:12:17.198163 16779 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:17.198422 16779 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:17.198678 16779 hybrid_clock.cc:648] HybridClock initialized: now 1783599137198657 us; error 0 us; skew 500 ppm
I20260709 12:12:17.199321 16779 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:17.202188 16779 webserver.cc:533] Webserver started at http://127.16.98.193:40489/ using document root <none> and password file <none>
I20260709 12:12:17.202804 16779 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:17.203017 16779 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:12:17.206619 16779 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:12:17.214977 23907 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:17.215799 16779 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:12:17.216152 16779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895573690-16779-0/minicluster-data/ts-0-root
uuid: "3824bca1df8e4020b18c7989f7758391"
format_stamp: "Formatted at 2026-07-09 12:12:06 on dist-test-slave-9bv4"
I20260709 12:12:17.216673 16779 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895573690-16779-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895573690-16779-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783598895573690-16779-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 12:12:17.230316 23274 consensus_peers.cc:597] T 1b4285f9faa34fc595e0b7db3f7f0946 P a9d87b20401744c7bd0c491f60cf0689 -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:42187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:17.234903 16779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:17.236230 16779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:17.237707 16779 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
W20260709 12:12:17.243270 23348 consensus_peers.cc:597] T 9ffb43b95dbe424d89c123a2179445ec P 48bc58ace75f40e995efc1edcefe79fa -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:42187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:17.244418 23914 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 12:12:17.249146 23348 consensus_peers.cc:597] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:42187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:17.285672 23274 consensus_peers.cc:597] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689 -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:42187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:17.335873 23200 consensus_peers.cc:597] T d53aaedd982440259b3ef5d84cddcbed P abe65f4962e147ac841608b6c30f7e1b -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:42187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:17.365595 23348 consensus_peers.cc:597] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:42187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:17.403278 23274 consensus_peers.cc:597] T 8ac0ace3682c4f29b9e5ecad75f783f7 P a9d87b20401744c7bd0c491f60cf0689 -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:42187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:17.516181 16779 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:12:17.516590 16779 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.273s	user 0.009s	sys 0.000s
I20260709 12:12:17.516950 16779 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:12:17.527002 23914 tablet_bootstrap.cc:492] T 6b891c5848b248d8a1830e801c7dce9a P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:17.555052 23914 tablet_bootstrap.cc:492] T 6b891c5848b248d8a1830e801c7dce9a P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:17.555940 23914 tablet_bootstrap.cc:492] T 6b891c5848b248d8a1830e801c7dce9a P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:17.556530 23914 ts_tablet_manager.cc:1403] T 6b891c5848b248d8a1830e801c7dce9a P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.000s
I20260709 12:12:17.558952 23914 raft_consensus.cc:359] T 6b891c5848b248d8a1830e801c7dce9a P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:17.559639 23914 raft_consensus.cc:740] T 6b891c5848b248d8a1830e801c7dce9a P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:17.560324 23914 consensus_queue.cc:260] T 6b891c5848b248d8a1830e801c7dce9a P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:17.563308 23914 ts_tablet_manager.cc:1434] T 6b891c5848b248d8a1830e801c7dce9a P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:12:17.564113 23914 tablet_bootstrap.cc:492] T 64daa90835844e619fa313a9d91a83cc P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:17.573989 23914 tablet_bootstrap.cc:492] T 64daa90835844e619fa313a9d91a83cc P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:17.574769 23914 tablet_bootstrap.cc:492] T 64daa90835844e619fa313a9d91a83cc P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:17.575273 23914 ts_tablet_manager.cc:1403] T 64daa90835844e619fa313a9d91a83cc P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.011s	user 0.003s	sys 0.007s
I20260709 12:12:17.576977 23914 raft_consensus.cc:359] T 64daa90835844e619fa313a9d91a83cc P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:17.577495 23914 raft_consensus.cc:740] T 64daa90835844e619fa313a9d91a83cc P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:17.578066 23914 consensus_queue.cc:260] T 64daa90835844e619fa313a9d91a83cc P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:17.579672 23914 ts_tablet_manager.cc:1434] T 64daa90835844e619fa313a9d91a83cc P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:12:17.580370 23914 tablet_bootstrap.cc:492] T 2693b48366d0430b9db7d8cc90d9667c P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:17.599870 23914 tablet_bootstrap.cc:492] T 2693b48366d0430b9db7d8cc90d9667c P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:17.600822 23914 tablet_bootstrap.cc:492] T 2693b48366d0430b9db7d8cc90d9667c P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:17.601401 23914 ts_tablet_manager.cc:1403] T 2693b48366d0430b9db7d8cc90d9667c P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.008s
I20260709 12:12:17.604074 23914 raft_consensus.cc:359] T 2693b48366d0430b9db7d8cc90d9667c P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:17.604699 23914 raft_consensus.cc:740] T 2693b48366d0430b9db7d8cc90d9667c P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:17.605278 23914 consensus_queue.cc:260] T 2693b48366d0430b9db7d8cc90d9667c P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:17.607280 23914 ts_tablet_manager.cc:1434] T 2693b48366d0430b9db7d8cc90d9667c P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:12:17.608289 23914 tablet_bootstrap.cc:492] T 5d0efec949fc4455838db7fb01259d69 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:17.624428 23914 tablet_bootstrap.cc:492] T 5d0efec949fc4455838db7fb01259d69 P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:17.625115 23914 tablet_bootstrap.cc:492] T 5d0efec949fc4455838db7fb01259d69 P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:17.625598 23914 ts_tablet_manager.cc:1403] T 5d0efec949fc4455838db7fb01259d69 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 12:12:17.627305 23914 raft_consensus.cc:359] T 5d0efec949fc4455838db7fb01259d69 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:17.627771 23914 raft_consensus.cc:740] T 5d0efec949fc4455838db7fb01259d69 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:17.628271 23914 consensus_queue.cc:260] T 5d0efec949fc4455838db7fb01259d69 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:17.629527 23914 ts_tablet_manager.cc:1434] T 5d0efec949fc4455838db7fb01259d69 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:12:17.630090 23914 tablet_bootstrap.cc:492] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:17.658885 23914 tablet_bootstrap.cc:492] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:17.659565 23914 tablet_bootstrap.cc:492] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:17.660102 23914 ts_tablet_manager.cc:1403] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.030s	user 0.022s	sys 0.004s
I20260709 12:12:17.661785 23914 raft_consensus.cc:359] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:17.662252 23914 raft_consensus.cc:740] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:17.662940 23914 consensus_queue.cc:260] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:17.664526 23914 ts_tablet_manager.cc:1434] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:12:17.665143 23914 tablet_bootstrap.cc:492] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:17.704456 23914 tablet_bootstrap.cc:492] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:17.711870 23914 tablet_bootstrap.cc:492] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:17.712463 23914 ts_tablet_manager.cc:1403] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.047s	user 0.022s	sys 0.016s
I20260709 12:12:17.714824 23914 raft_consensus.cc:359] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:17.715473 23914 raft_consensus.cc:740] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:17.716112 23914 consensus_queue.cc:260] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:17.718122 23914 ts_tablet_manager.cc:1434] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:12:17.719085 23914 tablet_bootstrap.cc:492] T 5002a306b4474c909091a65333c74939 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:17.735129 23914 tablet_bootstrap.cc:492] T 5002a306b4474c909091a65333c74939 P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:17.735821 23914 tablet_bootstrap.cc:492] T 5002a306b4474c909091a65333c74939 P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:17.736330 23914 ts_tablet_manager.cc:1403] T 5002a306b4474c909091a65333c74939 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 12:12:17.738109 23914 raft_consensus.cc:359] T 5002a306b4474c909091a65333c74939 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:17.738454 16779 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:12:17.738590 23914 raft_consensus.cc:740] T 5002a306b4474c909091a65333c74939 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:17.738890 16779 ts_tablet_manager.cc:595] Time spent register tablets: real 0.222s	user 0.217s	sys 0.000s
I20260709 12:12:17.739341 23914 consensus_queue.cc:260] T 5002a306b4474c909091a65333c74939 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:17.741158 23914 ts_tablet_manager.cc:1434] T 5002a306b4474c909091a65333c74939 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 12:12:17.741863 23914 tablet_bootstrap.cc:492] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:17.754027 23914 tablet_bootstrap.cc:492] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:17.754838 23914 tablet_bootstrap.cc:492] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:17.755481 23914 ts_tablet_manager.cc:1403] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 12:12:17.757896 23914 raft_consensus.cc:359] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:17.758544 23914 raft_consensus.cc:740] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:17.759218 23914 consensus_queue.cc:260] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:17.761104 23914 ts_tablet_manager.cc:1434] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:12:17.761830 23914 tablet_bootstrap.cc:492] T d53aaedd982440259b3ef5d84cddcbed P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:17.777261 23914 tablet_bootstrap.cc:492] T d53aaedd982440259b3ef5d84cddcbed P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:17.778218 23914 tablet_bootstrap.cc:492] T d53aaedd982440259b3ef5d84cddcbed P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:17.778945 23914 ts_tablet_manager.cc:1403] T d53aaedd982440259b3ef5d84cddcbed P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.008s
I20260709 12:12:17.781353 23914 raft_consensus.cc:359] T d53aaedd982440259b3ef5d84cddcbed P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:17.782049 23914 raft_consensus.cc:740] T d53aaedd982440259b3ef5d84cddcbed P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:17.782965 23914 consensus_queue.cc:260] T d53aaedd982440259b3ef5d84cddcbed P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:17.784662 23914 ts_tablet_manager.cc:1434] T d53aaedd982440259b3ef5d84cddcbed P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:12:17.785292 23914 tablet_bootstrap.cc:492] T 11b1c6ca5b8b4d61a6e200744c543ede P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:17.797525 23914 tablet_bootstrap.cc:492] T 11b1c6ca5b8b4d61a6e200744c543ede P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:17.798610 23914 tablet_bootstrap.cc:492] T 11b1c6ca5b8b4d61a6e200744c543ede P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:17.799433 23914 ts_tablet_manager.cc:1403] T 11b1c6ca5b8b4d61a6e200744c543ede P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.007s
I20260709 12:12:17.801952 23914 raft_consensus.cc:359] T 11b1c6ca5b8b4d61a6e200744c543ede P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:17.802685 23914 raft_consensus.cc:740] T 11b1c6ca5b8b4d61a6e200744c543ede P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:17.803396 23914 consensus_queue.cc:260] T 11b1c6ca5b8b4d61a6e200744c543ede P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:17.805874 23914 ts_tablet_manager.cc:1434] T 11b1c6ca5b8b4d61a6e200744c543ede P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:12:17.806609 23914 tablet_bootstrap.cc:492] T 1b4285f9faa34fc595e0b7db3f7f0946 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:17.845976 23914 tablet_bootstrap.cc:492] T 1b4285f9faa34fc595e0b7db3f7f0946 P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:17.846923 23914 tablet_bootstrap.cc:492] T 1b4285f9faa34fc595e0b7db3f7f0946 P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:17.847510 23914 ts_tablet_manager.cc:1403] T 1b4285f9faa34fc595e0b7db3f7f0946 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.012s
I20260709 12:12:17.849858 23914 raft_consensus.cc:359] T 1b4285f9faa34fc595e0b7db3f7f0946 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:17.850515 23914 raft_consensus.cc:740] T 1b4285f9faa34fc595e0b7db3f7f0946 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:17.851287 23914 consensus_queue.cc:260] T 1b4285f9faa34fc595e0b7db3f7f0946 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:17.853482 23914 ts_tablet_manager.cc:1434] T 1b4285f9faa34fc595e0b7db3f7f0946 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:12:17.854215 23914 tablet_bootstrap.cc:492] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:17.874601 23914 tablet_bootstrap.cc:492] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:17.875744 23914 tablet_bootstrap.cc:492] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:17.876617 23914 ts_tablet_manager.cc:1403] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.003s
I20260709 12:12:17.879549 23914 raft_consensus.cc:359] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:17.880347 23914 raft_consensus.cc:740] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:17.881212 23914 consensus_queue.cc:260] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:17.882177 16779 rpc_server.cc:307] RPC server started. Bound to: 127.16.98.193:42187
I20260709 12:12:17.882594 23988 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.98.193:42187 every 8 connection(s)
I20260709 12:12:17.883553 23914 ts_tablet_manager.cc:1434] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:12:17.884333 23914 tablet_bootstrap.cc:492] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:17.917294 23914 tablet_bootstrap.cc:492] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:17.918308 23914 tablet_bootstrap.cc:492] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:17.919039 23914 ts_tablet_manager.cc:1403] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.035s	user 0.022s	sys 0.008s
I20260709 12:12:17.921687 23914 raft_consensus.cc:359] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:17.922348 23914 raft_consensus.cc:740] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:17.922581 23989 heartbeater.cc:344] Connected to a master server at 127.16.98.254:44847
I20260709 12:12:17.923072 23989 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:17.923982 23989 heartbeater.cc:507] Master 127.16.98.254:44847 requested a full tablet report, sending...
I20260709 12:12:17.925263 23914 consensus_queue.cc:260] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:17.927963 23914 ts_tablet_manager.cc:1434] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:12:17.928743 23914 tablet_bootstrap.cc:492] T 7f25493a942c4d96ad5fed839ad58386 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:17.943356 23914 tablet_bootstrap.cc:492] T 7f25493a942c4d96ad5fed839ad58386 P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:17.944264 23914 tablet_bootstrap.cc:492] T 7f25493a942c4d96ad5fed839ad58386 P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:17.944197 23059 ts_manager.cc:194] Re-registered known tserver with Master: 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:17.945057 23914 ts_tablet_manager.cc:1403] T 7f25493a942c4d96ad5fed839ad58386 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 12:12:17.947415 23914 raft_consensus.cc:359] T 7f25493a942c4d96ad5fed839ad58386 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:17.948055 23914 raft_consensus.cc:740] T 7f25493a942c4d96ad5fed839ad58386 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:17.948686 23914 consensus_queue.cc:260] T 7f25493a942c4d96ad5fed839ad58386 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:17.950598 23914 ts_tablet_manager.cc:1434] T 7f25493a942c4d96ad5fed839ad58386 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:12:17.951375 23914 tablet_bootstrap.cc:492] T 72855efda9164489afb0f46a7f8da834 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:17.964999 23914 tablet_bootstrap.cc:492] T 72855efda9164489afb0f46a7f8da834 P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:17.965744 23914 tablet_bootstrap.cc:492] T 72855efda9164489afb0f46a7f8da834 P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:17.966245 23914 ts_tablet_manager.cc:1403] T 72855efda9164489afb0f46a7f8da834 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 12:12:17.968052 23914 raft_consensus.cc:359] T 72855efda9164489afb0f46a7f8da834 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:17.968658 23914 raft_consensus.cc:740] T 72855efda9164489afb0f46a7f8da834 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:17.969309 23914 consensus_queue.cc:260] T 72855efda9164489afb0f46a7f8da834 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:17.971385 23914 ts_tablet_manager.cc:1434] T 72855efda9164489afb0f46a7f8da834 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.004s
I20260709 12:12:17.972087 23914 tablet_bootstrap.cc:492] T c880cf7f327c4b709c29dd91c8645c18 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:17.986398 23059 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57202
I20260709 12:12:17.991575 23989 heartbeater.cc:499] Master 127.16.98.254:44847 was elected leader, sending a full tablet report...
I20260709 12:12:18.004442 23914 tablet_bootstrap.cc:492] T c880cf7f327c4b709c29dd91c8645c18 P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:18.005446 23914 tablet_bootstrap.cc:492] T c880cf7f327c4b709c29dd91c8645c18 P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:18.006104 23914 ts_tablet_manager.cc:1403] T c880cf7f327c4b709c29dd91c8645c18 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.005s
I20260709 12:12:18.007453 23843 raft_consensus.cc:493] T 50bd92608bfe43d784e7596be01b388e P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3824bca1df8e4020b18c7989f7758391)
I20260709 12:12:18.007956 23843 raft_consensus.cc:515] T 50bd92608bfe43d784e7596be01b388e P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:18.008479 23914 raft_consensus.cc:359] T c880cf7f327c4b709c29dd91c8645c18 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:18.009156 23914 raft_consensus.cc:740] T c880cf7f327c4b709c29dd91c8645c18 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:18.010082 23843 leader_election.cc:290] T 50bd92608bfe43d784e7596be01b388e P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:18.009791 23914 consensus_queue.cc:260] T c880cf7f327c4b709c29dd91c8645c18 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:18.011483 23307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bd92608bfe43d784e7596be01b388e" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:18.012123 23914 ts_tablet_manager.cc:1434] T c880cf7f327c4b709c29dd91c8645c18 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:12:18.012877 23914 tablet_bootstrap.cc:492] T 541dc3e21d4e461b8c299d0186a42e7f P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:18.017249 23959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bd92608bfe43d784e7596be01b388e" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
W20260709 12:12:18.019500 23200 leader_election.cc:343] T 50bd92608bfe43d784e7596be01b388e P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:18.019901 23200 leader_election.cc:304] T 50bd92608bfe43d784e7596be01b388e P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abe65f4962e147ac841608b6c30f7e1b; no voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689
I20260709 12:12:18.021198 23843 raft_consensus.cc:2749] T 50bd92608bfe43d784e7596be01b388e P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:18.022210 23915 raft_consensus.cc:493] T 85dca37fe4fc46b792220de05fc68749 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3824bca1df8e4020b18c7989f7758391)
I20260709 12:12:18.022753 23915 raft_consensus.cc:515] T 85dca37fe4fc46b792220de05fc68749 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:18.026409 23959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dca37fe4fc46b792220de05fc68749" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:18.026953 23915 leader_election.cc:290] T 85dca37fe4fc46b792220de05fc68749 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:18.027118 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dca37fe4fc46b792220de05fc68749" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
W20260709 12:12:18.027722 23274 leader_election.cc:343] T 85dca37fe4fc46b792220de05fc68749 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:18.028594 23273 leader_election.cc:304] T 85dca37fe4fc46b792220de05fc68749 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689; no voters: 3824bca1df8e4020b18c7989f7758391, 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:18.028924 23843 raft_consensus.cc:493] T 162d91be31a64ad688b7b433392ed1a2 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3824bca1df8e4020b18c7989f7758391)
I20260709 12:12:18.029572 23915 raft_consensus.cc:2749] T 85dca37fe4fc46b792220de05fc68749 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:18.029462 23843 raft_consensus.cc:515] T 162d91be31a64ad688b7b433392ed1a2 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:18.032183 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162d91be31a64ad688b7b433392ed1a2" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:18.032325 23914 tablet_bootstrap.cc:492] T 541dc3e21d4e461b8c299d0186a42e7f P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:18.032369 23843 leader_election.cc:290] T 162d91be31a64ad688b7b433392ed1a2 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:18.032881 23959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162d91be31a64ad688b7b433392ed1a2" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:18.033464 23914 tablet_bootstrap.cc:492] T 541dc3e21d4e461b8c299d0186a42e7f P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:18.033547 23959 raft_consensus.cc:2468] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 1.
I20260709 12:12:18.034229 23914 ts_tablet_manager.cc:1403] T 541dc3e21d4e461b8c299d0186a42e7f P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.000s
I20260709 12:12:18.034848 23200 leader_election.cc:304] T 162d91be31a64ad688b7b433392ed1a2 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:18.035650 23843 raft_consensus.cc:2804] T 162d91be31a64ad688b7b433392ed1a2 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:18.036002 23843 raft_consensus.cc:493] T 162d91be31a64ad688b7b433392ed1a2 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3824bca1df8e4020b18c7989f7758391)
I20260709 12:12:18.036350 23843 raft_consensus.cc:3060] T 162d91be31a64ad688b7b433392ed1a2 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:18.036865 23914 raft_consensus.cc:359] T 541dc3e21d4e461b8c299d0186a42e7f P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:18.037529 23914 raft_consensus.cc:740] T 541dc3e21d4e461b8c299d0186a42e7f P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:18.038182 23914 consensus_queue.cc:260] T 541dc3e21d4e461b8c299d0186a42e7f P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:18.040150 23914 ts_tablet_manager.cc:1434] T 541dc3e21d4e461b8c299d0186a42e7f P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:12:18.040871 23914 tablet_bootstrap.cc:492] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:18.044183 23843 raft_consensus.cc:515] T 162d91be31a64ad688b7b433392ed1a2 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:18.046756 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162d91be31a64ad688b7b433392ed1a2" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:18.047049 23959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162d91be31a64ad688b7b433392ed1a2" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:18.047652 23959 raft_consensus.cc:3060] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:18.055387 23843 leader_election.cc:290] T 162d91be31a64ad688b7b433392ed1a2 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 election: Requested vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:18.057029 23914 tablet_bootstrap.cc:492] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:18.056914 23959 raft_consensus.cc:2468] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 2.
I20260709 12:12:18.057976 23914 tablet_bootstrap.cc:492] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:18.058122 23200 leader_election.cc:304] T 162d91be31a64ad688b7b433392ed1a2 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, abe65f4962e147ac841608b6c30f7e1b; no voters: 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:18.059623 23914 ts_tablet_manager.cc:1403] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 12:12:18.060045 23795 raft_consensus.cc:2804] T 162d91be31a64ad688b7b433392ed1a2 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:18.060590 23795 raft_consensus.cc:697] T 162d91be31a64ad688b7b433392ed1a2 P abe65f4962e147ac841608b6c30f7e1b [term 2 LEADER]: Becoming Leader. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Running, Role: LEADER
I20260709 12:12:18.061422 23795 consensus_queue.cc:237] T 162d91be31a64ad688b7b433392ed1a2 P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:18.062047 23914 raft_consensus.cc:359] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:18.062829 23914 raft_consensus.cc:740] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:18.063493 23914 consensus_queue.cc:260] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:18.065672 23914 ts_tablet_manager.cc:1434] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 12:12:18.068204 23914 tablet_bootstrap.cc:492] T 98439efe5217407d95ff24969e5b4083 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:18.074985 23058 catalog_manager.cc:5697] T 162d91be31a64ad688b7b433392ed1a2 P abe65f4962e147ac841608b6c30f7e1b reported cstate change: term changed from 1 to 2, leader changed from 3824bca1df8e4020b18c7989f7758391 (127.16.98.193) to abe65f4962e147ac841608b6c30f7e1b (127.16.98.194). New cstate: current_term: 2 leader_uuid: "abe65f4962e147ac841608b6c30f7e1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:18.087044 23914 tablet_bootstrap.cc:492] T 98439efe5217407d95ff24969e5b4083 P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:18.088016 23914 tablet_bootstrap.cc:492] T 98439efe5217407d95ff24969e5b4083 P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:18.088660 23914 ts_tablet_manager.cc:1403] T 98439efe5217407d95ff24969e5b4083 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.000s
I20260709 12:12:18.094203 23914 raft_consensus.cc:359] T 98439efe5217407d95ff24969e5b4083 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:18.094866 23914 raft_consensus.cc:740] T 98439efe5217407d95ff24969e5b4083 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:18.095599 23914 consensus_queue.cc:260] T 98439efe5217407d95ff24969e5b4083 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:18.099954 23914 ts_tablet_manager.cc:1434] T 98439efe5217407d95ff24969e5b4083 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:12:18.101076 23914 tablet_bootstrap.cc:492] T 36d2201b0b3d4f07abf9c901453cda82 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:18.115918 23914 tablet_bootstrap.cc:492] T 36d2201b0b3d4f07abf9c901453cda82 P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:18.116636 23914 tablet_bootstrap.cc:492] T 36d2201b0b3d4f07abf9c901453cda82 P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:18.117164 23914 ts_tablet_manager.cc:1403] T 36d2201b0b3d4f07abf9c901453cda82 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 12:12:18.119529 23914 raft_consensus.cc:359] T 36d2201b0b3d4f07abf9c901453cda82 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:18.120076 23914 raft_consensus.cc:740] T 36d2201b0b3d4f07abf9c901453cda82 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:18.120692 23914 consensus_queue.cc:260] T 36d2201b0b3d4f07abf9c901453cda82 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:18.122504 23914 ts_tablet_manager.cc:1434] T 36d2201b0b3d4f07abf9c901453cda82 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:12:18.123463 23914 tablet_bootstrap.cc:492] T a7d44e74deb341179f886489282ced2f P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:18.129513 23917 raft_consensus.cc:493] T 058e9aef198f48b8956a676b6f12b2e1 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3824bca1df8e4020b18c7989f7758391)
I20260709 12:12:18.130029 23917 raft_consensus.cc:515] T 058e9aef198f48b8956a676b6f12b2e1 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:18.131872 23917 leader_election.cc:290] T 058e9aef198f48b8956a676b6f12b2e1 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:18.132696 23959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "058e9aef198f48b8956a676b6f12b2e1" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
W20260709 12:12:18.134325 23348 leader_election.cc:343] T 058e9aef198f48b8956a676b6f12b2e1 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:18.135623 23234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "058e9aef198f48b8956a676b6f12b2e1" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:18.136809 23350 leader_election.cc:304] T 058e9aef198f48b8956a676b6f12b2e1 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa; no voters: 3824bca1df8e4020b18c7989f7758391, abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:18.137394 23917 raft_consensus.cc:2749] T 058e9aef198f48b8956a676b6f12b2e1 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:18.138463 23914 tablet_bootstrap.cc:492] T a7d44e74deb341179f886489282ced2f P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:18.139258 23914 tablet_bootstrap.cc:492] T a7d44e74deb341179f886489282ced2f P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:18.139703 23914 ts_tablet_manager.cc:1403] T a7d44e74deb341179f886489282ced2f P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 12:12:18.141750 23914 raft_consensus.cc:359] T a7d44e74deb341179f886489282ced2f P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:18.142688 23914 raft_consensus.cc:740] T a7d44e74deb341179f886489282ced2f P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:18.143199 23914 consensus_queue.cc:260] T a7d44e74deb341179f886489282ced2f P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:18.144582 23914 ts_tablet_manager.cc:1434] T a7d44e74deb341179f886489282ced2f P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:12:18.146034 23914 tablet_bootstrap.cc:492] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:18.150784 23890 raft_consensus.cc:493] T d2d3a5114a7842179f9957c7f5660f7e P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3824bca1df8e4020b18c7989f7758391)
I20260709 12:12:18.151350 23890 raft_consensus.cc:515] T d2d3a5114a7842179f9957c7f5660f7e P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:18.153630 23890 leader_election.cc:290] T d2d3a5114a7842179f9957c7f5660f7e P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:18.154237 23959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2d3a5114a7842179f9957c7f5660f7e" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:18.155915 23959 raft_consensus.cc:2468] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 1.
I20260709 12:12:18.154934 23232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2d3a5114a7842179f9957c7f5660f7e" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:18.157122 23274 leader_election.cc:304] T d2d3a5114a7842179f9957c7f5660f7e P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689; no voters: 
I20260709 12:12:18.158046 23890 raft_consensus.cc:2804] T d2d3a5114a7842179f9957c7f5660f7e P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:18.158455 23890 raft_consensus.cc:493] T d2d3a5114a7842179f9957c7f5660f7e P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3824bca1df8e4020b18c7989f7758391)
I20260709 12:12:18.158895 23890 raft_consensus.cc:3060] T d2d3a5114a7842179f9957c7f5660f7e P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:18.168776 23809 raft_consensus.cc:493] T 8fb0ec62373d4b39bd83ded02981c6dc P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3824bca1df8e4020b18c7989f7758391)
I20260709 12:12:18.169358 23809 raft_consensus.cc:515] T 8fb0ec62373d4b39bd83ded02981c6dc P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:18.174166 23518 raft_consensus.cc:493] T a51c8a6c6cfe460fadc0694a71805ba6 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3824bca1df8e4020b18c7989f7758391)
I20260709 12:12:18.174680 23518 raft_consensus.cc:515] T a51c8a6c6cfe460fadc0694a71805ba6 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:18.176482 23518 leader_election.cc:290] T a51c8a6c6cfe460fadc0694a71805ba6 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:18.176625 23809 leader_election.cc:290] T 8fb0ec62373d4b39bd83ded02981c6dc P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:18.178166 23959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb0ec62373d4b39bd83ded02981c6dc" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:18.179509 23960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51c8a6c6cfe460fadc0694a71805ba6" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:18.180721 23306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb0ec62373d4b39bd83ded02981c6dc" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:18.181430 23795 raft_consensus.cc:493] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3824bca1df8e4020b18c7989f7758391)
W20260709 12:12:18.182292 23274 leader_election.cc:343] T a51c8a6c6cfe460fadc0694a71805ba6 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:12:18.183436 23348 leader_election.cc:343] T 8fb0ec62373d4b39bd83ded02981c6dc P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:18.182041 23795 raft_consensus.cc:515] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:18.185213 23349 leader_election.cc:304] T 8fb0ec62373d4b39bd83ded02981c6dc P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa; no voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689
I20260709 12:12:18.186110 23809 raft_consensus.cc:2749] T 8fb0ec62373d4b39bd83ded02981c6dc P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:18.187254 23232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51c8a6c6cfe460fadc0694a71805ba6" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:18.187750 23795 leader_election.cc:290] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:18.186190 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "058e9aef198f48b8956a676b6f12b2e1" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:18.188601 23960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "058e9aef198f48b8956a676b6f12b2e1" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:18.188702 23276 leader_election.cc:304] T a51c8a6c6cfe460fadc0694a71805ba6 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689; no voters: 3824bca1df8e4020b18c7989f7758391, abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:18.189720 23915 raft_consensus.cc:2749] T a51c8a6c6cfe460fadc0694a71805ba6 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:12:18.189999 23200 leader_election.cc:343] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:18.188649 23383 raft_consensus.cc:2468] T 058e9aef198f48b8956a676b6f12b2e1 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 1.
I20260709 12:12:18.190945 23890 raft_consensus.cc:515] T d2d3a5114a7842179f9957c7f5660f7e P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:18.192963 23199 leader_election.cc:304] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, abe65f4962e147ac841608b6c30f7e1b; no voters: 3824bca1df8e4020b18c7989f7758391
I20260709 12:12:18.193651 23795 raft_consensus.cc:2804] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:18.193990 23795 raft_consensus.cc:493] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3824bca1df8e4020b18c7989f7758391)
I20260709 12:12:18.194334 23795 raft_consensus.cc:3060] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:18.195115 23960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2d3a5114a7842179f9957c7f5660f7e" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:18.195976 23960 raft_consensus.cc:3060] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:18.199359 23890 leader_election.cc:290] T d2d3a5114a7842179f9957c7f5660f7e P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 2 election: Requested vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:18.200721 23232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2d3a5114a7842179f9957c7f5660f7e" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:18.201576 23795 raft_consensus.cc:515] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:18.204224 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "058e9aef198f48b8956a676b6f12b2e1" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:18.204816 23383 raft_consensus.cc:3060] T 058e9aef198f48b8956a676b6f12b2e1 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:18.212961 23919 raft_consensus.cc:493] T 85dca37fe4fc46b792220de05fc68749 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3824bca1df8e4020b18c7989f7758391)
I20260709 12:12:18.213505 23919 raft_consensus.cc:515] T 85dca37fe4fc46b792220de05fc68749 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:18.216410 23919 leader_election.cc:290] T 85dca37fe4fc46b792220de05fc68749 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:18.218210 23307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dca37fe4fc46b792220de05fc68749" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:18.219105 23307 raft_consensus.cc:2468] T 85dca37fe4fc46b792220de05fc68749 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 1.
I20260709 12:12:18.220650 23349 leader_election.cc:304] T 85dca37fe4fc46b792220de05fc68749 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689; no voters: 
I20260709 12:12:18.220896 23959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dca37fe4fc46b792220de05fc68749" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
W20260709 12:12:18.222874 23348 leader_election.cc:343] T 85dca37fe4fc46b792220de05fc68749 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:18.221397 23809 raft_consensus.cc:2804] T 85dca37fe4fc46b792220de05fc68749 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:18.223904 23809 raft_consensus.cc:493] T 85dca37fe4fc46b792220de05fc68749 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3824bca1df8e4020b18c7989f7758391)
I20260709 12:12:18.228706 23959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "058e9aef198f48b8956a676b6f12b2e1" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:18.225757 23960 raft_consensus.cc:2468] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 2.
W20260709 12:12:18.230126 23200 leader_election.cc:343] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:18.230684 23795 leader_election.cc:290] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 election: Requested vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:18.230742 23274 leader_election.cc:304] T d2d3a5114a7842179f9957c7f5660f7e P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689; no voters: abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:18.231817 23890 raft_consensus.cc:2804] T d2d3a5114a7842179f9957c7f5660f7e P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:18.237107 23809 raft_consensus.cc:3060] T 85dca37fe4fc46b792220de05fc68749 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:18.232980 23890 raft_consensus.cc:697] T d2d3a5114a7842179f9957c7f5660f7e P a9d87b20401744c7bd0c491f60cf0689 [term 2 LEADER]: Becoming Leader. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Running, Role: LEADER
I20260709 12:12:18.241138 23890 consensus_queue.cc:237] T d2d3a5114a7842179f9957c7f5660f7e P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:18.249140 23915 raft_consensus.cc:493] T d8c6d6433d204aa3b5fa3a304e66dd7e P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3824bca1df8e4020b18c7989f7758391)
I20260709 12:12:18.249662 23915 raft_consensus.cc:515] T d8c6d6433d204aa3b5fa3a304e66dd7e P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:18.251951 23914 tablet_bootstrap.cc:492] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:18.252702 23915 leader_election.cc:290] T d8c6d6433d204aa3b5fa3a304e66dd7e P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:18.253090 23914 tablet_bootstrap.cc:492] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:18.253858 23959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c6d6433d204aa3b5fa3a304e66dd7e" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:18.253822 23914 ts_tablet_manager.cc:1403] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.108s	user 0.038s	sys 0.048s
I20260709 12:12:18.253829 23234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c6d6433d204aa3b5fa3a304e66dd7e" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
W20260709 12:12:18.255308 23274 leader_election.cc:343] T d8c6d6433d204aa3b5fa3a304e66dd7e P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:18.256285 23276 leader_election.cc:304] T d8c6d6433d204aa3b5fa3a304e66dd7e P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689; no voters: 3824bca1df8e4020b18c7989f7758391, abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:18.257090 24010 raft_consensus.cc:2749] T d8c6d6433d204aa3b5fa3a304e66dd7e P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:18.258697 23914 raft_consensus.cc:359] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:18.262355 23914 raft_consensus.cc:740] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:18.263058 23914 consensus_queue.cc:260] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:18.265487 24010 raft_consensus.cc:493] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3824bca1df8e4020b18c7989f7758391)
I20260709 12:12:18.266111 24010 raft_consensus.cc:515] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:18.268987 23380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923f193f1d2d4e61ae30850183122635" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:18.266851 23914 ts_tablet_manager.cc:1434] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:12:18.269306 23960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923f193f1d2d4e61ae30850183122635" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:18.270287 24010 leader_election.cc:290] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:18.270057 23960 raft_consensus.cc:2468] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 3.
I20260709 12:12:18.271917 23274 leader_election.cc:304] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689; no voters: 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:18.272925 24010 raft_consensus.cc:2804] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:12:18.273317 24010 raft_consensus.cc:493] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3824bca1df8e4020b18c7989f7758391)
I20260709 12:12:18.273842 24010 raft_consensus.cc:3060] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:18.259248 23383 raft_consensus.cc:2468] T 058e9aef198f48b8956a676b6f12b2e1 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 2.
I20260709 12:12:18.280274 23199 leader_election.cc:304] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, abe65f4962e147ac841608b6c30f7e1b; no voters: 3824bca1df8e4020b18c7989f7758391
I20260709 12:12:18.281740 23916 raft_consensus.cc:2804] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:18.282228 23916 raft_consensus.cc:697] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b [term 2 LEADER]: Becoming Leader. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Running, Role: LEADER
I20260709 12:12:18.283143 23916 consensus_queue.cc:237] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:18.283159 24010 raft_consensus.cc:515] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:18.285435 23809 raft_consensus.cc:515] T 85dca37fe4fc46b792220de05fc68749 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:18.286175 23518 raft_consensus.cc:493] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3824bca1df8e4020b18c7989f7758391)
I20260709 12:12:18.288105 23914 tablet_bootstrap.cc:492] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:18.286545 24010 leader_election.cc:290] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 4 election: Requested vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:18.292698 23960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dca37fe4fc46b792220de05fc68749" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:18.292514 23809 leader_election.cc:290] T 85dca37fe4fc46b792220de05fc68749 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 2 election: Requested vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
W20260709 12:12:18.300000 23348 leader_election.cc:343] T 85dca37fe4fc46b792220de05fc68749 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:18.292310 23307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dca37fe4fc46b792220de05fc68749" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:18.301110 23307 raft_consensus.cc:3060] T 85dca37fe4fc46b792220de05fc68749 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:18.288857 23959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923f193f1d2d4e61ae30850183122635" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:18.303351 23959 raft_consensus.cc:3060] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:18.304381 23809 raft_consensus.cc:493] T d8c320c6212b4bb187e8d32cb79479a8 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3824bca1df8e4020b18c7989f7758391)
I20260709 12:12:18.304875 23809 raft_consensus.cc:515] T d8c320c6212b4bb187e8d32cb79479a8 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:18.286674 23518 raft_consensus.cc:515] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:18.307653 23306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c320c6212b4bb187e8d32cb79479a8" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:18.308686 23518 leader_election.cc:290] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:18.309136 23518 raft_consensus.cc:493] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3824bca1df8e4020b18c7989f7758391)
I20260709 12:12:18.308328 23307 raft_consensus.cc:2468] T 85dca37fe4fc46b792220de05fc68749 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 2.
I20260709 12:12:18.309684 23380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb0ec62373d4b39bd83ded02981c6dc" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:18.310449 23380 raft_consensus.cc:2468] T 8fb0ec62373d4b39bd83ded02981c6dc P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 1.
I20260709 12:12:18.310937 23960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb0ec62373d4b39bd83ded02981c6dc" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:18.311652 23273 leader_election.cc:304] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689; no voters: 
W20260709 12:12:18.313102 23274 leader_election.cc:343] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:18.307008 23915 raft_consensus.cc:493] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3824bca1df8e4020b18c7989f7758391)
I20260709 12:12:18.309556 23518 raft_consensus.cc:515] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:18.314497 23915 raft_consensus.cc:515] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:18.315358 23349 leader_election.cc:304] T 85dca37fe4fc46b792220de05fc68749 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689; no voters: 3824bca1df8e4020b18c7989f7758391
I20260709 12:12:18.316376 23919 raft_consensus.cc:2804] T 85dca37fe4fc46b792220de05fc68749 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:18.316469 23915 leader_election.cc:290] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:18.316882 23919 raft_consensus.cc:697] T 85dca37fe4fc46b792220de05fc68749 P 48bc58ace75f40e995efc1edcefe79fa [term 2 LEADER]: Becoming Leader. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Running, Role: LEADER
I20260709 12:12:18.317000 23518 leader_election.cc:290] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:18.317194 23234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bd92608bfe43d784e7596be01b388e" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:18.317585 23518 raft_consensus.cc:2804] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:18.317965 23518 raft_consensus.cc:493] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3824bca1df8e4020b18c7989f7758391)
I20260709 12:12:18.318071 23306 raft_consensus.cc:2468] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 1.
I20260709 12:12:18.318324 23518 raft_consensus.cc:3060] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:18.317751 23919 consensus_queue.cc:237] T 85dca37fe4fc46b792220de05fc68749 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:18.321094 23961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c320c6212b4bb187e8d32cb79479a8" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:18.321746 23961 raft_consensus.cc:2468] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 1.
I20260709 12:12:18.321846 23959 raft_consensus.cc:2468] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 4.
I20260709 12:12:18.317801 23234 raft_consensus.cc:2468] T 50bd92608bfe43d784e7596be01b388e P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 1.
I20260709 12:12:18.323239 23960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bd92608bfe43d784e7596be01b388e" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:18.323482 23276 leader_election.cc:304] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:18.323884 23960 raft_consensus.cc:2468] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 1.
I20260709 12:12:18.324343 24010 raft_consensus.cc:2804] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:18.324384 23843 raft_consensus.cc:493] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3824bca1df8e4020b18c7989f7758391)
I20260709 12:12:18.324842 24010 raft_consensus.cc:493] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3824bca1df8e4020b18c7989f7758391)
I20260709 12:12:18.325383 24010 raft_consensus.cc:3060] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:18.325169 23843 raft_consensus.cc:515] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:18.325970 23274 leader_election.cc:304] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689; no voters: 
I20260709 12:12:18.326577 23349 leader_election.cc:304] T d8c320c6212b4bb187e8d32cb79479a8 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689; no voters: 
I20260709 12:12:18.328729 23889 raft_consensus.cc:2804] T d8c320c6212b4bb187e8d32cb79479a8 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:18.329207 23889 raft_consensus.cc:493] T d8c320c6212b4bb187e8d32cb79479a8 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3824bca1df8e4020b18c7989f7758391)
I20260709 12:12:18.329548 23889 raft_consensus.cc:3060] T d8c320c6212b4bb187e8d32cb79479a8 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:18.330116 23843 leader_election.cc:290] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:18.335179 23917 raft_consensus.cc:493] T 162d91be31a64ad688b7b433392ed1a2 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3824bca1df8e4020b18c7989f7758391)
I20260709 12:12:18.335738 23917 raft_consensus.cc:515] T 162d91be31a64ad688b7b433392ed1a2 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:18.336169 24016 raft_consensus.cc:2804] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:18.336568 24016 raft_consensus.cc:493] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3824bca1df8e4020b18c7989f7758391)
I20260709 12:12:18.336905 24016 raft_consensus.cc:3060] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:18.337833 23917 leader_election.cc:290] T 162d91be31a64ad688b7b433392ed1a2 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:18.344671 23889 raft_consensus.cc:515] T d8c320c6212b4bb187e8d32cb79479a8 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:18.343963 23916 raft_consensus.cc:493] T a51c8a6c6cfe460fadc0694a71805ba6 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3824bca1df8e4020b18c7989f7758391)
I20260709 12:12:18.348804 23916 raft_consensus.cc:515] T a51c8a6c6cfe460fadc0694a71805ba6 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:18.349323 23518 raft_consensus.cc:515] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:18.350979 23274 leader_election.cc:304] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689; no voters: 
I20260709 12:12:18.352077 23960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c6d6433d204aa3b5fa3a304e66dd7e" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:18.353124 23307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c6d6433d204aa3b5fa3a304e66dd7e" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:18.360208 23059 catalog_manager.cc:5697] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b reported cstate change: term changed from 1 to 2, leader changed from 3824bca1df8e4020b18c7989f7758391 (127.16.98.193) to abe65f4962e147ac841608b6c30f7e1b (127.16.98.194). New cstate: current_term: 2 leader_uuid: "abe65f4962e147ac841608b6c30f7e1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:18.360966 23518 leader_election.cc:290] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 2 election: Requested vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:18.361585 23518 raft_consensus.cc:2804] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:18.361948 23518 raft_consensus.cc:697] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [term 4 LEADER]: Becoming Leader. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Running, Role: LEADER
I20260709 12:12:18.362730 23960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb0ec62373d4b39bd83ded02981c6dc" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:18.362682 23518 consensus_queue.cc:237] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
W20260709 12:12:18.364233 23274 leader_election.cc:343] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:18.353214 23232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162d91be31a64ad688b7b433392ed1a2" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b" is_pre_election: true
I20260709 12:12:18.359071 23307 raft_consensus.cc:2468] T d8c6d6433d204aa3b5fa3a304e66dd7e P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 1.
I20260709 12:12:18.354063 24010 raft_consensus.cc:515] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:18.354317 23380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c320c6212b4bb187e8d32cb79479a8" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa" is_pre_election: true
I20260709 12:12:18.366194 23380 raft_consensus.cc:2393] T d8c320c6212b4bb187e8d32cb79479a8 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a9d87b20401744c7bd0c491f60cf0689 in current term 2: Already voted for candidate 48bc58ace75f40e995efc1edcefe79fa in this term.
I20260709 12:12:18.366710 23960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51c8a6c6cfe460fadc0694a71805ba6" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:18.367394 23960 raft_consensus.cc:2468] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 1.
I20260709 12:12:18.368284 24010 leader_election.cc:290] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 2 election: Requested vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:18.354514 24016 raft_consensus.cc:515] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
W20260709 12:12:18.370469 23200 leader_election.cc:343] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:18.376161 23809 leader_election.cc:290] T d8c320c6212b4bb187e8d32cb79479a8 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:18.376545 23200 leader_election.cc:304] T a51c8a6c6cfe460fadc0694a71805ba6 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:18.381703 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923f193f1d2d4e61ae30850183122635" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:18.369474 23960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bd92608bfe43d784e7596be01b388e" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:18.384382 23232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50bd92608bfe43d784e7596be01b388e" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:18.389504 23232 raft_consensus.cc:3060] T 50bd92608bfe43d784e7596be01b388e P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:18.384613 23380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fb0ec62373d4b39bd83ded02981c6dc" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:18.383667 24014 raft_consensus.cc:2804] T a51c8a6c6cfe460fadc0694a71805ba6 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:18.397790 24014 raft_consensus.cc:493] T a51c8a6c6cfe460fadc0694a71805ba6 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3824bca1df8e4020b18c7989f7758391)
I20260709 12:12:18.398200 24014 raft_consensus.cc:3060] T a51c8a6c6cfe460fadc0694a71805ba6 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:18.399818 23957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c320c6212b4bb187e8d32cb79479a8" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:18.400492 23957 raft_consensus.cc:3060] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:18.400547 23889 leader_election.cc:290] T d8c320c6212b4bb187e8d32cb79479a8 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 2 election: Requested vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:18.362845 23306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c320c6212b4bb187e8d32cb79479a8" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:18.401996 23058 catalog_manager.cc:5697] T d2d3a5114a7842179f9957c7f5660f7e P a9d87b20401744c7bd0c491f60cf0689 reported cstate change: term changed from 1 to 2, leader changed from 3824bca1df8e4020b18c7989f7758391 (127.16.98.193) to a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195). New cstate: current_term: 2 leader_uuid: "a9d87b20401744c7bd0c491f60cf0689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:18.403096 23306 raft_consensus.cc:2393] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 48bc58ace75f40e995efc1edcefe79fa in current term 2: Already voted for candidate a9d87b20401744c7bd0c491f60cf0689 in this term.
I20260709 12:12:18.386893 24016 leader_election.cc:290] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 2 election: Requested vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:18.387444 23383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c320c6212b4bb187e8d32cb79479a8" candidate_uuid: "a9d87b20401744c7bd0c491f60cf0689" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:18.404294 23383 raft_consensus.cc:2393] T d8c320c6212b4bb187e8d32cb79479a8 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a9d87b20401744c7bd0c491f60cf0689 in current term 2: Already voted for candidate 48bc58ace75f40e995efc1edcefe79fa in this term.
I20260709 12:12:18.397790 23380 raft_consensus.cc:3060] T 8fb0ec62373d4b39bd83ded02981c6dc P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:18.394251 23961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "162d91be31a64ad688b7b433392ed1a2" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:18.408103 23961 raft_consensus.cc:2393] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48bc58ace75f40e995efc1edcefe79fa in current term 2: Already voted for candidate abe65f4962e147ac841608b6c30f7e1b in this term.
I20260709 12:12:18.414455 23348 leader_election.cc:304] T 162d91be31a64ad688b7b433392ed1a2 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa; no voters: 3824bca1df8e4020b18c7989f7758391, abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:18.395314 23201 leader_election.cc:304] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b; no voters: 3824bca1df8e4020b18c7989f7758391
I20260709 12:12:18.396051 23960 raft_consensus.cc:3060] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:18.416862 23843 raft_consensus.cc:2804] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:12:18.418218 23843 raft_consensus.cc:493] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3824bca1df8e4020b18c7989f7758391)
I20260709 12:12:18.418731 23843 raft_consensus.cc:3060] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:12:18.417003 23201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.195:41253, user_credentials={real_user=slave}} blocked reactor thread for 46190.6us
I20260709 12:12:18.420356 23809 raft_consensus.cc:3060] T 162d91be31a64ad688b7b433392ed1a2 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:18.411640 23232 raft_consensus.cc:2468] T 50bd92608bfe43d784e7596be01b388e P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 2.
I20260709 12:12:18.423260 23959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c320c6212b4bb187e8d32cb79479a8" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:18.423648 23276 leader_election.cc:304] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:18.425922 24014 raft_consensus.cc:515] T a51c8a6c6cfe460fadc0694a71805ba6 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:18.452638 23890 raft_consensus.cc:2804] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:18.453470 23890 raft_consensus.cc:697] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689 [term 2 LEADER]: Becoming Leader. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Running, Role: LEADER
I20260709 12:12:18.454847 23890 consensus_queue.cc:237] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:18.471076 24014 leader_election.cc:290] T a51c8a6c6cfe460fadc0694a71805ba6 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 election: Requested vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:18.450978 24015 raft_consensus.cc:493] T d2d3a5114a7842179f9957c7f5660f7e P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3824bca1df8e4020b18c7989f7758391)
I20260709 12:12:18.471784 24015 raft_consensus.cc:515] T d2d3a5114a7842179f9957c7f5660f7e P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:18.473757 24015 leader_election.cc:290] T d2d3a5114a7842179f9957c7f5660f7e P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:18.483042 23843 raft_consensus.cc:515] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:18.462265 23809 raft_consensus.cc:2749] T 162d91be31a64ad688b7b433392ed1a2 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:18.493079 23843 leader_election.cc:290] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 election: Requested vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:18.489763 23916 leader_election.cc:290] T a51c8a6c6cfe460fadc0694a71805ba6 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:18.486017 23961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c320c6212b4bb187e8d32cb79479a8" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:18.497807 23380 raft_consensus.cc:2468] T 8fb0ec62373d4b39bd83ded02981c6dc P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 2.
W20260709 12:12:18.515570 23348 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.16.98.193:42187, user_credentials={real_user=slave}} blocked reactor thread for 101221us
I20260709 12:12:18.544720 23307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2d3a5114a7842179f9957c7f5660f7e" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:18.550732 23307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51c8a6c6cfe460fadc0694a71805ba6" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:18.551313 23307 raft_consensus.cc:2468] T a51c8a6c6cfe460fadc0694a71805ba6 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 1.
I20260709 12:12:18.554484 23273 leader_election.cc:304] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689; no voters: 3824bca1df8e4020b18c7989f7758391
I20260709 12:12:18.556221 23307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c6d6433d204aa3b5fa3a304e66dd7e" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:18.557027 23307 raft_consensus.cc:3060] T d8c6d6433d204aa3b5fa3a304e66dd7e P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:18.564692 23307 raft_consensus.cc:2468] T d8c6d6433d204aa3b5fa3a304e66dd7e P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 2.
I20260709 12:12:18.566254 23201 leader_election.cc:304] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:18.573410 24015 raft_consensus.cc:2804] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:18.570039 23058 catalog_manager.cc:5697] T 85dca37fe4fc46b792220de05fc68749 P 48bc58ace75f40e995efc1edcefe79fa reported cstate change: term changed from 1 to 2, leader changed from 3824bca1df8e4020b18c7989f7758391 (127.16.98.193) to 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196). New cstate: current_term: 2 leader_uuid: "48bc58ace75f40e995efc1edcefe79fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:18.581494 23914 tablet_bootstrap.cc:492] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:18.575060 23306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51c8a6c6cfe460fadc0694a71805ba6" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:18.584805 23306 raft_consensus.cc:3060] T a51c8a6c6cfe460fadc0694a71805ba6 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:18.585078 24015 raft_consensus.cc:697] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b [term 2 LEADER]: Becoming Leader. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Running, Role: LEADER
I20260709 12:12:18.585978 24015 consensus_queue.cc:237] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:18.591996 23306 raft_consensus.cc:2468] T a51c8a6c6cfe460fadc0694a71805ba6 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 2.
I20260709 12:12:18.622300 23059 catalog_manager.cc:5697] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689 reported cstate change: term changed from 1 to 2, leader changed from 3824bca1df8e4020b18c7989f7758391 (127.16.98.193) to a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195). New cstate: current_term: 2 leader_uuid: "a9d87b20401744c7bd0c491f60cf0689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:18.625579 23059 catalog_manager.cc:5697] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 reported cstate change: term changed from 3 to 4, leader changed from 3824bca1df8e4020b18c7989f7758391 (127.16.98.193) to a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195). New cstate: current_term: 4 leader_uuid: "a9d87b20401744c7bd0c491f60cf0689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:18.627926 23201 leader_election.cc:304] T a51c8a6c6cfe460fadc0694a71805ba6 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:18.628861 23795 raft_consensus.cc:2804] T a51c8a6c6cfe460fadc0694a71805ba6 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:18.629350 23795 raft_consensus.cc:697] T a51c8a6c6cfe460fadc0694a71805ba6 P abe65f4962e147ac841608b6c30f7e1b [term 2 LEADER]: Becoming Leader. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Running, Role: LEADER
I20260709 12:12:18.630172 23795 consensus_queue.cc:237] T a51c8a6c6cfe460fadc0694a71805ba6 P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:18.594488 24017 raft_consensus.cc:2804] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:18.603276 23348 leader_election.cc:304] T d8c320c6212b4bb187e8d32cb79479a8 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa; no voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689
I20260709 12:12:18.634009 24017 raft_consensus.cc:697] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689 [term 2 LEADER]: Becoming Leader. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Running, Role: LEADER
I20260709 12:12:18.605235 23956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c6d6433d204aa3b5fa3a304e66dd7e" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:18.636730 23809 raft_consensus.cc:2749] T d8c320c6212b4bb187e8d32cb79479a8 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:12:18.607638 23959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2d3a5114a7842179f9957c7f5660f7e" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:18.643311 23959 raft_consensus.cc:2393] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abe65f4962e147ac841608b6c30f7e1b in current term 2: Already voted for candidate a9d87b20401744c7bd0c491f60cf0689 in this term.
I20260709 12:12:18.613867 23889 raft_consensus.cc:493] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3824bca1df8e4020b18c7989f7758391)
I20260709 12:12:18.644126 23889 raft_consensus.cc:515] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:18.646106 23889 leader_election.cc:290] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:18.647040 24017 consensus_queue.cc:237] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:18.649624 23952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923f193f1d2d4e61ae30850183122635" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391" is_pre_election: true
I20260709 12:12:18.650430 23952 raft_consensus.cc:2393] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48bc58ace75f40e995efc1edcefe79fa in current term 4: Already voted for candidate a9d87b20401744c7bd0c491f60cf0689 in this term.
I20260709 12:12:18.655510 23914 tablet_bootstrap.cc:492] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:18.656275 23914 ts_tablet_manager.cc:1403] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.368s	user 0.028s	sys 0.052s
I20260709 12:12:18.659221 23914 raft_consensus.cc:359] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:18.660568 23961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51c8a6c6cfe460fadc0694a71805ba6" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3824bca1df8e4020b18c7989f7758391"
I20260709 12:12:18.708431 23914 raft_consensus.cc:740] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:18.708745 23961 raft_consensus.cc:3060] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:18.709228 23914 consensus_queue.cc:260] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:18.661118 23957 raft_consensus.cc:2468] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 2.
I20260709 12:12:18.711102 23914 ts_tablet_manager.cc:1434] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.000s
I20260709 12:12:18.673241 23308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "923f193f1d2d4e61ae30850183122635" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a9d87b20401744c7bd0c491f60cf0689" is_pre_election: true
I20260709 12:12:18.715467 23059 catalog_manager.cc:5697] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b reported cstate change: term changed from 1 to 2, leader changed from 3824bca1df8e4020b18c7989f7758391 (127.16.98.193) to abe65f4962e147ac841608b6c30f7e1b (127.16.98.194). New cstate: current_term: 2 leader_uuid: "abe65f4962e147ac841608b6c30f7e1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:18.681354 23960 raft_consensus.cc:2468] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9d87b20401744c7bd0c491f60cf0689 in term 2.
I20260709 12:12:18.684826 23384 raft_consensus.cc:1275] T 162d91be31a64ad688b7b433392ed1a2 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Refusing update from remote peer abe65f4962e147ac841608b6c30f7e1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:12:18.695178 23200 leader_election.cc:343] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:18.717988 23795 consensus_queue.cc:1048] T 162d91be31a64ad688b7b433392ed1a2 P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:18.718410 23200 leader_election.cc:304] T d2d3a5114a7842179f9957c7f5660f7e P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abe65f4962e147ac841608b6c30f7e1b; no voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689
I20260709 12:12:18.696478 23952 raft_consensus.cc:1275] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Refusing update from remote peer abe65f4962e147ac841608b6c30f7e1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:18.727273 23380 raft_consensus.cc:1275] T 058e9aef198f48b8956a676b6f12b2e1 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Refusing update from remote peer abe65f4962e147ac841608b6c30f7e1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:18.727376 23349 leader_election.cc:304] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa; no voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689
I20260709 12:12:18.728510 23809 raft_consensus.cc:3060] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:18.729342 24015 consensus_queue.cc:1048] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:18.720359 23914 tablet_bootstrap.cc:492] T fba757d381304cc0bcbb4f9dbcfc812c P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:18.736016 23809 raft_consensus.cc:2749] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:12:18.740356 23350 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.194:41907, user_credentials={real_user=slave}} blocked reactor thread for 162822us
I20260709 12:12:18.722074 23795 raft_consensus.cc:3060] T d2d3a5114a7842179f9957c7f5660f7e P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:18.752147 24027 consensus_queue.cc:1048] T 162d91be31a64ad688b7b433392ed1a2 P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:18.753407 23960 raft_consensus.cc:1275] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Refusing update from remote peer a9d87b20401744c7bd0c491f60cf0689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:18.760390 23914 tablet_bootstrap.cc:492] T fba757d381304cc0bcbb4f9dbcfc812c P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:18.761380 23914 tablet_bootstrap.cc:492] T fba757d381304cc0bcbb4f9dbcfc812c P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:18.762033 23914 ts_tablet_manager.cc:1403] T fba757d381304cc0bcbb4f9dbcfc812c P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.010s
I20260709 12:12:18.764616 23914 raft_consensus.cc:359] T fba757d381304cc0bcbb4f9dbcfc812c P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:18.765286 23914 raft_consensus.cc:740] T fba757d381304cc0bcbb4f9dbcfc812c P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:18.765944 23914 consensus_queue.cc:260] T fba757d381304cc0bcbb4f9dbcfc812c P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:18.770138 23914 ts_tablet_manager.cc:1434] T fba757d381304cc0bcbb4f9dbcfc812c P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:12:18.771783 23914 tablet_bootstrap.cc:492] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:18.772284 23961 raft_consensus.cc:2468] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 2.
I20260709 12:12:18.772040 23058 catalog_manager.cc:5697] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689 reported cstate change: term changed from 1 to 2, leader changed from 3824bca1df8e4020b18c7989f7758391 (127.16.98.193) to a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195). New cstate: current_term: 2 leader_uuid: "a9d87b20401744c7bd0c491f60cf0689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:18.762458 23274 leader_election.cc:304] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689; no voters: 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:18.786736 24021 raft_consensus.cc:2804] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:18.788013 24021 raft_consensus.cc:697] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689 [term 2 LEADER]: Becoming Leader. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Running, Role: LEADER
I20260709 12:12:18.788839 24021 consensus_queue.cc:237] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:18.795722 23306 raft_consensus.cc:1275] T 85dca37fe4fc46b792220de05fc68749 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Refusing update from remote peer 48bc58ace75f40e995efc1edcefe79fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:18.797086 23059 catalog_manager.cc:5697] T a51c8a6c6cfe460fadc0694a71805ba6 P abe65f4962e147ac841608b6c30f7e1b reported cstate change: term changed from 1 to 2, leader changed from 3824bca1df8e4020b18c7989f7758391 (127.16.98.193) to abe65f4962e147ac841608b6c30f7e1b (127.16.98.194). New cstate: current_term: 2 leader_uuid: "abe65f4962e147ac841608b6c30f7e1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:18.797868 23914 tablet_bootstrap.cc:492] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:12:18.798532 23200 consensus_peers.cc:597] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:18.799639 23809 consensus_queue.cc:1048] T 85dca37fe4fc46b792220de05fc68749 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:18.799047 23914 tablet_bootstrap.cc:492] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:18.801769 23914 ts_tablet_manager.cc:1403] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.011s
I20260709 12:12:18.804488 23914 raft_consensus.cc:359] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:18.805188 23914 raft_consensus.cc:740] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:18.805888 23914 consensus_queue.cc:260] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:18.811493 23914 ts_tablet_manager.cc:1434] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:12:18.812382 23914 tablet_bootstrap.cc:492] T 9ffb43b95dbe424d89c123a2179445ec P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
W20260709 12:12:18.825524 23348 consensus_peers.cc:597] T 85dca37fe4fc46b792220de05fc68749 P 48bc58ace75f40e995efc1edcefe79fa -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:18.839823 23795 raft_consensus.cc:2749] T d2d3a5114a7842179f9957c7f5660f7e P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:18.852556 23056 catalog_manager.cc:5697] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689 reported cstate change: term changed from 1 to 2, leader changed from 3824bca1df8e4020b18c7989f7758391 (127.16.98.193) to a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195). New cstate: current_term: 2 leader_uuid: "a9d87b20401744c7bd0c491f60cf0689" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:18.870378 23234 raft_consensus.cc:1275] T d2d3a5114a7842179f9957c7f5660f7e P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Refusing update from remote peer a9d87b20401744c7bd0c491f60cf0689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:18.872078 24017 consensus_queue.cc:1048] T d2d3a5114a7842179f9957c7f5660f7e P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:18.892408 23915 consensus_queue.cc:1048] T d2d3a5114a7842179f9957c7f5660f7e P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:18.897763 23234 raft_consensus.cc:1275] T 50bd92608bfe43d784e7596be01b388e P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Refusing update from remote peer a9d87b20401744c7bd0c491f60cf0689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:18.901343 24021 consensus_queue.cc:1048] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:18.905159 23960 raft_consensus.cc:1275] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [term 4 FOLLOWER]: Refusing update from remote peer a9d87b20401744c7bd0c491f60cf0689: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:12:18.910753 24017 consensus_queue.cc:1048] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:18.947974 23953 raft_consensus.cc:1275] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Refusing update from remote peer a9d87b20401744c7bd0c491f60cf0689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:18.953526 23384 raft_consensus.cc:1275] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa [term 4 FOLLOWER]: Refusing update from remote peer a9d87b20401744c7bd0c491f60cf0689: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:12:18.955858 24021 consensus_queue.cc:1048] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:18.961621 23914 tablet_bootstrap.cc:492] T 9ffb43b95dbe424d89c123a2179445ec P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:18.962667 23914 tablet_bootstrap.cc:492] T 9ffb43b95dbe424d89c123a2179445ec P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:18.963297 23914 ts_tablet_manager.cc:1403] T 9ffb43b95dbe424d89c123a2179445ec P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.151s	user 0.050s	sys 0.056s
I20260709 12:12:18.966230 23914 raft_consensus.cc:359] T 9ffb43b95dbe424d89c123a2179445ec P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:18.967141 23914 raft_consensus.cc:740] T 9ffb43b95dbe424d89c123a2179445ec P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:18.967938 23914 consensus_queue.cc:260] T 9ffb43b95dbe424d89c123a2179445ec P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:18.970238 23914 ts_tablet_manager.cc:1434] T 9ffb43b95dbe424d89c123a2179445ec P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:12:18.971072 23914 tablet_bootstrap.cc:492] T 9aa8c90489d54dc6b2684d1970165a8a P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:18.976487 24016 consensus_queue.cc:1048] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:18.988368 23914 tablet_bootstrap.cc:492] T 9aa8c90489d54dc6b2684d1970165a8a P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:18.989295 23914 tablet_bootstrap.cc:492] T 9aa8c90489d54dc6b2684d1970165a8a P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:18.989902 23914 ts_tablet_manager.cc:1403] T 9aa8c90489d54dc6b2684d1970165a8a P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.000s
I20260709 12:12:18.992848 23914 raft_consensus.cc:359] T 9aa8c90489d54dc6b2684d1970165a8a P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:18.993486 23914 raft_consensus.cc:740] T 9aa8c90489d54dc6b2684d1970165a8a P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:18.994251 23914 consensus_queue.cc:260] T 9aa8c90489d54dc6b2684d1970165a8a P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:18.997002 23914 ts_tablet_manager.cc:1434] T 9aa8c90489d54dc6b2684d1970165a8a P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 12:12:18.997738 23914 tablet_bootstrap.cc:492] T 3243e85ef0e741d696af414124ca96bd P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
W20260709 12:12:19.006785 23200 consensus_peers.cc:597] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:19.022579 23914 tablet_bootstrap.cc:492] T 3243e85ef0e741d696af414124ca96bd P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:19.023425 23914 tablet_bootstrap.cc:492] T 3243e85ef0e741d696af414124ca96bd P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:19.023953 23914 ts_tablet_manager.cc:1403] T 3243e85ef0e741d696af414124ca96bd P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.006s
I20260709 12:12:19.025864 23914 raft_consensus.cc:359] T 3243e85ef0e741d696af414124ca96bd P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:19.026391 23914 raft_consensus.cc:740] T 3243e85ef0e741d696af414124ca96bd P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:19.027127 23914 consensus_queue.cc:260] T 3243e85ef0e741d696af414124ca96bd P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:19.029477 23914 ts_tablet_manager.cc:1434] T 3243e85ef0e741d696af414124ca96bd P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.006s
I20260709 12:12:19.030424 23914 tablet_bootstrap.cc:492] T e3b19b20feb045058cd1cfbd684ff05f P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:19.043223 23914 tablet_bootstrap.cc:492] T e3b19b20feb045058cd1cfbd684ff05f P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:19.043903 23914 tablet_bootstrap.cc:492] T e3b19b20feb045058cd1cfbd684ff05f P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:19.044410 23914 ts_tablet_manager.cc:1403] T e3b19b20feb045058cd1cfbd684ff05f P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:12:19.046039 23914 raft_consensus.cc:359] T e3b19b20feb045058cd1cfbd684ff05f P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:19.046545 23914 raft_consensus.cc:740] T e3b19b20feb045058cd1cfbd684ff05f P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:19.047106 23914 consensus_queue.cc:260] T e3b19b20feb045058cd1cfbd684ff05f P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:19.048799 23914 ts_tablet_manager.cc:1434] T e3b19b20feb045058cd1cfbd684ff05f P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:12:19.049715 23914 tablet_bootstrap.cc:492] T 058e9aef198f48b8956a676b6f12b2e1 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:19.064281 23914 tablet_bootstrap.cc:492] T 058e9aef198f48b8956a676b6f12b2e1 P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:19.065145 23914 tablet_bootstrap.cc:492] T 058e9aef198f48b8956a676b6f12b2e1 P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:19.065479 23306 raft_consensus.cc:1275] T d8c6d6433d204aa3b5fa3a304e66dd7e P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Refusing update from remote peer abe65f4962e147ac841608b6c30f7e1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:19.065699 23914 ts_tablet_manager.cc:1403] T 058e9aef198f48b8956a676b6f12b2e1 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 12:12:19.067009 23916 consensus_queue.cc:1048] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:19.068080 23914 raft_consensus.cc:359] T 058e9aef198f48b8956a676b6f12b2e1 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:19.068765 23914 raft_consensus.cc:740] T 058e9aef198f48b8956a676b6f12b2e1 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:19.069435 23914 consensus_queue.cc:260] T 058e9aef198f48b8956a676b6f12b2e1 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:19.071480 23914 ts_tablet_manager.cc:1434] T 058e9aef198f48b8956a676b6f12b2e1 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:12:19.072317 23914 tablet_bootstrap.cc:492] T 89d4b46113284ecc9db8b0e3c2b46f89 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:19.081377 23306 raft_consensus.cc:1275] T a51c8a6c6cfe460fadc0694a71805ba6 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Refusing update from remote peer abe65f4962e147ac841608b6c30f7e1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:19.088752 23914 tablet_bootstrap.cc:492] T 89d4b46113284ecc9db8b0e3c2b46f89 P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:19.089679 23914 tablet_bootstrap.cc:492] T 89d4b46113284ecc9db8b0e3c2b46f89 P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:19.090302 23914 ts_tablet_manager.cc:1403] T 89d4b46113284ecc9db8b0e3c2b46f89 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.004s
I20260709 12:12:19.092772 23914 raft_consensus.cc:359] T 89d4b46113284ecc9db8b0e3c2b46f89 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:19.093429 23914 raft_consensus.cc:740] T 89d4b46113284ecc9db8b0e3c2b46f89 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:19.094076 23914 consensus_queue.cc:260] T 89d4b46113284ecc9db8b0e3c2b46f89 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:19.094785 23795 consensus_queue.cc:1048] T a51c8a6c6cfe460fadc0694a71805ba6 P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:19.095530 23914 ts_tablet_manager.cc:1434] T 89d4b46113284ecc9db8b0e3c2b46f89 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.003s
I20260709 12:12:19.096396 23914 tablet_bootstrap.cc:492] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:19.096710 23384 raft_consensus.cc:1275] T 8fb0ec62373d4b39bd83ded02981c6dc P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Refusing update from remote peer a9d87b20401744c7bd0c491f60cf0689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:19.097990 24010 consensus_queue.cc:1048] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:19.136406 23953 raft_consensus.cc:1275] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Refusing update from remote peer abe65f4962e147ac841608b6c30f7e1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:19.138352 23795 consensus_queue.cc:1048] T a51c8a6c6cfe460fadc0694a71805ba6 P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:19.180485 23952 raft_consensus.cc:3060] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:12:19.184863 23200 consensus_peers.cc:597] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:19.186857 23960 raft_consensus.cc:3060] T 058e9aef198f48b8956a676b6f12b2e1 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:19.207834 23952 raft_consensus.cc:1275] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Refusing update from remote peer a9d87b20401744c7bd0c491f60cf0689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:19.219973 24010 consensus_queue.cc:1048] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:19.220603 23914 tablet_bootstrap.cc:492] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:19.221833 23914 tablet_bootstrap.cc:492] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:19.222422 23914 ts_tablet_manager.cc:1403] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.126s	user 0.042s	sys 0.063s
I20260709 12:12:19.224738 23914 raft_consensus.cc:359] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:19.225354 23914 raft_consensus.cc:740] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:19.226081 23914 consensus_queue.cc:260] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:19.228091 23914 ts_tablet_manager.cc:1434] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:12:19.228852 23914 tablet_bootstrap.cc:492] T 1f5cfd203dcc43d4a86864c2eaaf234c P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:19.266412 23914 tablet_bootstrap.cc:492] T 1f5cfd203dcc43d4a86864c2eaaf234c P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:19.267325 23914 tablet_bootstrap.cc:492] T 1f5cfd203dcc43d4a86864c2eaaf234c P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:19.267961 23914 ts_tablet_manager.cc:1403] T 1f5cfd203dcc43d4a86864c2eaaf234c P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.039s	user 0.021s	sys 0.008s
I20260709 12:12:19.269918 23914 raft_consensus.cc:359] T 1f5cfd203dcc43d4a86864c2eaaf234c P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:19.270512 23914 raft_consensus.cc:740] T 1f5cfd203dcc43d4a86864c2eaaf234c P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:19.271167 23914 consensus_queue.cc:260] T 1f5cfd203dcc43d4a86864c2eaaf234c P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:19.273164 23914 ts_tablet_manager.cc:1434] T 1f5cfd203dcc43d4a86864c2eaaf234c P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:12:19.273887 23914 tablet_bootstrap.cc:492] T f55cb07c30bc42a0930276baefc1d4b7 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:19.286166 23914 tablet_bootstrap.cc:492] T f55cb07c30bc42a0930276baefc1d4b7 P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:19.287053 23914 tablet_bootstrap.cc:492] T f55cb07c30bc42a0930276baefc1d4b7 P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:19.287693 23914 ts_tablet_manager.cc:1403] T f55cb07c30bc42a0930276baefc1d4b7 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:12:19.290391 23914 raft_consensus.cc:359] T f55cb07c30bc42a0930276baefc1d4b7 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:19.291090 23914 raft_consensus.cc:740] T f55cb07c30bc42a0930276baefc1d4b7 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:19.291720 23914 consensus_queue.cc:260] T f55cb07c30bc42a0930276baefc1d4b7 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:19.293727 23914 ts_tablet_manager.cc:1434] T f55cb07c30bc42a0930276baefc1d4b7 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:12:19.294482 23914 tablet_bootstrap.cc:492] T c113311e527c47578f8c136d335aa87f P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:19.314543 23952 raft_consensus.cc:1275] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Refusing update from remote peer a9d87b20401744c7bd0c491f60cf0689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:19.316521 23915 consensus_queue.cc:1048] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:19.330924 23914 tablet_bootstrap.cc:492] T c113311e527c47578f8c136d335aa87f P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:19.331928 23914 tablet_bootstrap.cc:492] T c113311e527c47578f8c136d335aa87f P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:19.332526 23914 ts_tablet_manager.cc:1403] T c113311e527c47578f8c136d335aa87f P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.038s	user 0.017s	sys 0.019s
I20260709 12:12:19.334874 23914 raft_consensus.cc:359] T c113311e527c47578f8c136d335aa87f P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:19.335510 23914 raft_consensus.cc:740] T c113311e527c47578f8c136d335aa87f P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:19.336251 23914 consensus_queue.cc:260] T c113311e527c47578f8c136d335aa87f P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:19.338197 23914 ts_tablet_manager.cc:1434] T c113311e527c47578f8c136d335aa87f P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:12:19.338967 23914 tablet_bootstrap.cc:492] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:19.351272 23380 raft_consensus.cc:1275] T d8c320c6212b4bb187e8d32cb79479a8 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Refusing update from remote peer a9d87b20401744c7bd0c491f60cf0689: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:19.361007 24010 consensus_queue.cc:1048] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:19.361387 23914 tablet_bootstrap.cc:492] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:19.362861 23914 tablet_bootstrap.cc:492] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:19.363552 23914 ts_tablet_manager.cc:1403] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.006s
I20260709 12:12:19.365895 23914 raft_consensus.cc:359] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:19.366596 23914 raft_consensus.cc:740] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:19.367368 23914 consensus_queue.cc:260] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:19.369300 23914 ts_tablet_manager.cc:1434] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 12:12:19.370046 23914 tablet_bootstrap.cc:492] T bda09a1e5c59409c96c419b65061c1dc P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:19.390661 23914 tablet_bootstrap.cc:492] T bda09a1e5c59409c96c419b65061c1dc P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:19.391607 23914 tablet_bootstrap.cc:492] T bda09a1e5c59409c96c419b65061c1dc P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:19.392230 23914 ts_tablet_manager.cc:1403] T bda09a1e5c59409c96c419b65061c1dc P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 12:12:19.392879 23952 raft_consensus.cc:3060] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:19.394575 23914 raft_consensus.cc:359] T bda09a1e5c59409c96c419b65061c1dc P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:19.395308 23914 raft_consensus.cc:740] T bda09a1e5c59409c96c419b65061c1dc P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:19.395995 23914 consensus_queue.cc:260] T bda09a1e5c59409c96c419b65061c1dc P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:19.398105 23914 ts_tablet_manager.cc:1434] T bda09a1e5c59409c96c419b65061c1dc P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 12:12:19.398309 23961 raft_consensus.cc:3060] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:19.399837 23914 tablet_bootstrap.cc:492] T 3fb3705cd5724f208798f30d9ab01bda P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:19.437222 23914 tablet_bootstrap.cc:492] T 3fb3705cd5724f208798f30d9ab01bda P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:19.438117 23914 tablet_bootstrap.cc:492] T 3fb3705cd5724f208798f30d9ab01bda P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:19.438887 23914 ts_tablet_manager.cc:1403] T 3fb3705cd5724f208798f30d9ab01bda P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.040s	user 0.021s	sys 0.013s
I20260709 12:12:19.440522 23914 raft_consensus.cc:359] T 3fb3705cd5724f208798f30d9ab01bda P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:19.441105 23914 raft_consensus.cc:740] T 3fb3705cd5724f208798f30d9ab01bda P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:19.441783 23914 consensus_queue.cc:260] T 3fb3705cd5724f208798f30d9ab01bda P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:19.443799 23914 ts_tablet_manager.cc:1434] T 3fb3705cd5724f208798f30d9ab01bda P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:12:19.447350 23914 tablet_bootstrap.cc:492] T e53f580024c14b33b72266b89a1ab8e3 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
W20260709 12:12:19.456545 23348 consensus_peers.cc:597] T d12a070001934296ba81c85f9ba61e27 P 48bc58ace75f40e995efc1edcefe79fa -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:19.461721 23914 tablet_bootstrap.cc:492] T e53f580024c14b33b72266b89a1ab8e3 P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:19.462762 23914 tablet_bootstrap.cc:492] T e53f580024c14b33b72266b89a1ab8e3 P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:19.463392 23914 ts_tablet_manager.cc:1403] T e53f580024c14b33b72266b89a1ab8e3 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.003s
I20260709 12:12:19.465673 23914 raft_consensus.cc:359] T e53f580024c14b33b72266b89a1ab8e3 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:19.466315 23914 raft_consensus.cc:740] T e53f580024c14b33b72266b89a1ab8e3 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:19.466953 23914 consensus_queue.cc:260] T e53f580024c14b33b72266b89a1ab8e3 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:19.468400 23914 ts_tablet_manager.cc:1434] T e53f580024c14b33b72266b89a1ab8e3 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:12:19.469125 23914 tablet_bootstrap.cc:492] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:19.484680 23914 tablet_bootstrap.cc:492] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:19.485576 23914 tablet_bootstrap.cc:492] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:19.486199 23914 ts_tablet_manager.cc:1403] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 12:12:19.488374 23914 raft_consensus.cc:359] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:19.489042 23914 raft_consensus.cc:740] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:19.489657 23914 consensus_queue.cc:260] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:19.491570 23914 ts_tablet_manager.cc:1434] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:12:19.492548 23914 tablet_bootstrap.cc:492] T d12a070001934296ba81c85f9ba61e27 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:19.503201 23914 tablet_bootstrap.cc:492] T d12a070001934296ba81c85f9ba61e27 P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:19.504069 23914 tablet_bootstrap.cc:492] T d12a070001934296ba81c85f9ba61e27 P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:19.504683 23914 ts_tablet_manager.cc:1403] T d12a070001934296ba81c85f9ba61e27 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.012s	user 0.006s	sys 0.004s
I20260709 12:12:19.506896 23914 raft_consensus.cc:359] T d12a070001934296ba81c85f9ba61e27 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:19.507527 23914 raft_consensus.cc:740] T d12a070001934296ba81c85f9ba61e27 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:19.508180 23914 consensus_queue.cc:260] T d12a070001934296ba81c85f9ba61e27 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:19.511806 23914 ts_tablet_manager.cc:1434] T d12a070001934296ba81c85f9ba61e27 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:12:19.512588 23914 tablet_bootstrap.cc:492] T 7193dd2dee9c4d1c9992ad4eff434b59 P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:19.528293 23914 tablet_bootstrap.cc:492] T 7193dd2dee9c4d1c9992ad4eff434b59 P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:19.529000 23914 tablet_bootstrap.cc:492] T 7193dd2dee9c4d1c9992ad4eff434b59 P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:19.529531 23914 ts_tablet_manager.cc:1403] T 7193dd2dee9c4d1c9992ad4eff434b59 P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.003s
I20260709 12:12:19.531402 23914 raft_consensus.cc:359] T 7193dd2dee9c4d1c9992ad4eff434b59 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:19.531932 23914 raft_consensus.cc:740] T 7193dd2dee9c4d1c9992ad4eff434b59 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:19.532454 23914 consensus_queue.cc:260] T 7193dd2dee9c4d1c9992ad4eff434b59 P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:19.534109 23914 ts_tablet_manager.cc:1434] T 7193dd2dee9c4d1c9992ad4eff434b59 P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:12:19.535158 23914 tablet_bootstrap.cc:492] T 6c03bbe73aee42039c1f868590838eaf P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:19.550311 23914 tablet_bootstrap.cc:492] T 6c03bbe73aee42039c1f868590838eaf P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:19.551230 23914 tablet_bootstrap.cc:492] T 6c03bbe73aee42039c1f868590838eaf P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:19.551873 23914 ts_tablet_manager.cc:1403] T 6c03bbe73aee42039c1f868590838eaf P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.002s
I20260709 12:12:19.554162 23914 raft_consensus.cc:359] T 6c03bbe73aee42039c1f868590838eaf P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:19.554843 23914 raft_consensus.cc:740] T 6c03bbe73aee42039c1f868590838eaf P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:19.555382 23914 consensus_queue.cc:260] T 6c03bbe73aee42039c1f868590838eaf P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:19.556794 23914 ts_tablet_manager.cc:1434] T 6c03bbe73aee42039c1f868590838eaf P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:12:19.557536 23914 tablet_bootstrap.cc:492] T da47bda397e2471388bcab5069dd7edc P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:19.570048 23914 tablet_bootstrap.cc:492] T da47bda397e2471388bcab5069dd7edc P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:19.571142 23914 tablet_bootstrap.cc:492] T da47bda397e2471388bcab5069dd7edc P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:19.571774 23914 ts_tablet_manager.cc:1403] T da47bda397e2471388bcab5069dd7edc P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 12:12:19.573724 23914 raft_consensus.cc:359] T da47bda397e2471388bcab5069dd7edc P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:19.574175 23914 raft_consensus.cc:740] T da47bda397e2471388bcab5069dd7edc P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:19.574734 23914 consensus_queue.cc:260] T da47bda397e2471388bcab5069dd7edc P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:19.576627 23914 ts_tablet_manager.cc:1434] T da47bda397e2471388bcab5069dd7edc P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:12:19.579149 23914 tablet_bootstrap.cc:492] T 9d57b510cd3745fabb0748a6f9008fca P 3824bca1df8e4020b18c7989f7758391: Bootstrap starting.
I20260709 12:12:19.593034 23914 tablet_bootstrap.cc:492] T 9d57b510cd3745fabb0748a6f9008fca P 3824bca1df8e4020b18c7989f7758391: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:19.594022 23914 tablet_bootstrap.cc:492] T 9d57b510cd3745fabb0748a6f9008fca P 3824bca1df8e4020b18c7989f7758391: Bootstrap complete.
I20260709 12:12:19.594740 23914 ts_tablet_manager.cc:1403] T 9d57b510cd3745fabb0748a6f9008fca P 3824bca1df8e4020b18c7989f7758391: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.001s
I20260709 12:12:19.597062 23914 raft_consensus.cc:359] T 9d57b510cd3745fabb0748a6f9008fca P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:19.597726 23914 raft_consensus.cc:740] T 9d57b510cd3745fabb0748a6f9008fca P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Initialized, Role: FOLLOWER
I20260709 12:12:19.598357 23914 consensus_queue.cc:260] T 9d57b510cd3745fabb0748a6f9008fca P 3824bca1df8e4020b18c7989f7758391 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:19.600692 23914 ts_tablet_manager.cc:1434] T 9d57b510cd3745fabb0748a6f9008fca P 3824bca1df8e4020b18c7989f7758391: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:12:27.887884 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:27.939333 23233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d0efec949fc4455838db7fb01259d69"
dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
mode: GRACEFUL
new_leader_uuid: "3824bca1df8e4020b18c7989f7758391"
 from {username='slave'} at 127.0.0.1:51296
I20260709 12:12:27.940348 23233 raft_consensus.cc:606] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b [term 1 LEADER]: Received request to transfer leadership to TS 3824bca1df8e4020b18c7989f7758391
I20260709 12:12:27.970429 23307 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c03bbe73aee42039c1f868590838eaf"
dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
mode: GRACEFUL
new_leader_uuid: "3824bca1df8e4020b18c7989f7758391"
 from {username='slave'} at 127.0.0.1:34296
I20260709 12:12:27.971027 23307 raft_consensus.cc:606] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Received request to transfer leadership to TS 3824bca1df8e4020b18c7989f7758391
I20260709 12:12:28.000859 23380 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7193dd2dee9c4d1c9992ad4eff434b59"
dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
mode: GRACEFUL
new_leader_uuid: "3824bca1df8e4020b18c7989f7758391"
 from {username='slave'} at 127.0.0.1:58240
I20260709 12:12:28.001487 23380 raft_consensus.cc:606] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Received request to transfer leadership to TS 3824bca1df8e4020b18c7989f7758391
I20260709 12:12:28.004215 23380 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d57b510cd3745fabb0748a6f9008fca"
dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
mode: GRACEFUL
new_leader_uuid: "3824bca1df8e4020b18c7989f7758391"
 from {username='slave'} at 127.0.0.1:58240
I20260709 12:12:28.004698 23380 raft_consensus.cc:606] T 9d57b510cd3745fabb0748a6f9008fca P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Received request to transfer leadership to TS 3824bca1df8e4020b18c7989f7758391
I20260709 12:12:28.006950 23380 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d12a070001934296ba81c85f9ba61e27"
dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
mode: GRACEFUL
new_leader_uuid: "3824bca1df8e4020b18c7989f7758391"
 from {username='slave'} at 127.0.0.1:58240
I20260709 12:12:28.007447 23380 raft_consensus.cc:606] T d12a070001934296ba81c85f9ba61e27 P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Received request to transfer leadership to TS 3824bca1df8e4020b18c7989f7758391
I20260709 12:12:28.010769 23384 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec1028a2affb45679aede72149f857f5"
dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
mode: GRACEFUL
new_leader_uuid: "abe65f4962e147ac841608b6c30f7e1b"
 from {username='slave'} at 127.0.0.1:58240
I20260709 12:12:28.011278 23384 raft_consensus.cc:606] T ec1028a2affb45679aede72149f857f5 P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Received request to transfer leadership to TS abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:28.012356 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:12:28.013525 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:28.014345 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:28.071437 24096 raft_consensus.cc:993] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b: : Instructing follower 3824bca1df8e4020b18c7989f7758391 to start an election
I20260709 12:12:28.072079 24105 raft_consensus.cc:1081] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b [term 1 LEADER]: Signalling peer 3824bca1df8e4020b18c7989f7758391 to start an election
I20260709 12:12:28.073444 23957 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d0efec949fc4455838db7fb01259d69"
dest_uuid: "3824bca1df8e4020b18c7989f7758391"
 from {username='slave'} at 127.0.0.1:49642
I20260709 12:12:28.073943 23957 raft_consensus.cc:493] T 5d0efec949fc4455838db7fb01259d69 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:28.074340 23957 raft_consensus.cc:3060] T 5d0efec949fc4455838db7fb01259d69 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:28.081676 23957 raft_consensus.cc:515] T 5d0efec949fc4455838db7fb01259d69 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:28.083846 23957 leader_election.cc:290] T 5d0efec949fc4455838db7fb01259d69 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 2 election: Requested vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:28.095762 23384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0efec949fc4455838db7fb01259d69" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:28.096644 23384 raft_consensus.cc:3060] T 5d0efec949fc4455838db7fb01259d69 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:28.104691 23384 raft_consensus.cc:2468] T 5d0efec949fc4455838db7fb01259d69 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 2.
I20260709 12:12:28.104964 23233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0efec949fc4455838db7fb01259d69" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:28.105602 23233 raft_consensus.cc:3055] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:28.105911 23233 raft_consensus.cc:740] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Running, Role: LEADER
I20260709 12:12:28.106009 23908 leader_election.cc:304] T 5d0efec949fc4455838db7fb01259d69 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, 48bc58ace75f40e995efc1edcefe79fa; no voters: 
I20260709 12:12:28.106758 23233 consensus_queue.cc:260] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:28.107796 24113 raft_consensus.cc:2804] T 5d0efec949fc4455838db7fb01259d69 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:28.108099 23233 raft_consensus.cc:3060] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:28.109005 24113 raft_consensus.cc:697] T 5d0efec949fc4455838db7fb01259d69 P 3824bca1df8e4020b18c7989f7758391 [term 2 LEADER]: Becoming Leader. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Running, Role: LEADER
I20260709 12:12:28.110045 24113 consensus_queue.cc:237] T 5d0efec949fc4455838db7fb01259d69 P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:28.114154 23233 raft_consensus.cc:2468] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 2.
I20260709 12:12:28.124555 23056 catalog_manager.cc:5697] T 5d0efec949fc4455838db7fb01259d69 P 3824bca1df8e4020b18c7989f7758391 reported cstate change: term changed from 1 to 2, leader changed from abe65f4962e147ac841608b6c30f7e1b (127.16.98.194) to 3824bca1df8e4020b18c7989f7758391 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "3824bca1df8e4020b18c7989f7758391" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:28.165115 24094 raft_consensus.cc:993] T ec1028a2affb45679aede72149f857f5 P 48bc58ace75f40e995efc1edcefe79fa: : Instructing follower abe65f4962e147ac841608b6c30f7e1b to start an election
I20260709 12:12:28.165570 24094 raft_consensus.cc:1081] T ec1028a2affb45679aede72149f857f5 P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Signalling peer abe65f4962e147ac841608b6c30f7e1b to start an election
I20260709 12:12:28.168182 23233 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec1028a2affb45679aede72149f857f5"
dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
 from {username='slave'} at 127.0.0.1:45192
I20260709 12:12:28.168712 23233 raft_consensus.cc:493] T ec1028a2affb45679aede72149f857f5 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:28.169039 23233 raft_consensus.cc:3060] T ec1028a2affb45679aede72149f857f5 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:28.176646 23233 raft_consensus.cc:515] T ec1028a2affb45679aede72149f857f5 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:28.178458 23233 leader_election.cc:290] T ec1028a2affb45679aede72149f857f5 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 election: Requested vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:28.179100 23307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1028a2affb45679aede72149f857f5" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:28.179353 23384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1028a2affb45679aede72149f857f5" candidate_uuid: "abe65f4962e147ac841608b6c30f7e1b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:28.179740 23307 raft_consensus.cc:3060] T ec1028a2affb45679aede72149f857f5 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:28.179867 23384 raft_consensus.cc:3055] T ec1028a2affb45679aede72149f857f5 P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:28.180261 23384 raft_consensus.cc:740] T ec1028a2affb45679aede72149f857f5 P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Running, Role: LEADER
I20260709 12:12:28.181105 23384 consensus_queue.cc:260] T ec1028a2affb45679aede72149f857f5 P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:28.182533 23384 raft_consensus.cc:3060] T ec1028a2affb45679aede72149f857f5 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:28.186215 23307 raft_consensus.cc:2468] T ec1028a2affb45679aede72149f857f5 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 2.
I20260709 12:12:28.187521 23201 leader_election.cc:304] T ec1028a2affb45679aede72149f857f5 P abe65f4962e147ac841608b6c30f7e1b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9d87b20401744c7bd0c491f60cf0689, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:28.188226 24105 raft_consensus.cc:2804] T ec1028a2affb45679aede72149f857f5 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:28.188649 24105 raft_consensus.cc:697] T ec1028a2affb45679aede72149f857f5 P abe65f4962e147ac841608b6c30f7e1b [term 2 LEADER]: Becoming Leader. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Running, Role: LEADER
I20260709 12:12:28.188741 23384 raft_consensus.cc:2468] T ec1028a2affb45679aede72149f857f5 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abe65f4962e147ac841608b6c30f7e1b in term 2.
I20260709 12:12:28.189616 24105 consensus_queue.cc:237] T ec1028a2affb45679aede72149f857f5 P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:28.199923 23056 catalog_manager.cc:5697] T ec1028a2affb45679aede72149f857f5 P abe65f4962e147ac841608b6c30f7e1b reported cstate change: term changed from 1 to 2, leader changed from 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196) to abe65f4962e147ac841608b6c30f7e1b (127.16.98.194). New cstate: current_term: 2 leader_uuid: "abe65f4962e147ac841608b6c30f7e1b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:28.209823 24094 raft_consensus.cc:993] T d12a070001934296ba81c85f9ba61e27 P 48bc58ace75f40e995efc1edcefe79fa: : Instructing follower 3824bca1df8e4020b18c7989f7758391 to start an election
I20260709 12:12:28.210245 24094 raft_consensus.cc:1081] T d12a070001934296ba81c85f9ba61e27 P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Signalling peer 3824bca1df8e4020b18c7989f7758391 to start an election
I20260709 12:12:28.211879 23952 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d12a070001934296ba81c85f9ba61e27"
dest_uuid: "3824bca1df8e4020b18c7989f7758391"
 from {username='slave'} at 127.0.0.1:49662
I20260709 12:12:28.212404 23952 raft_consensus.cc:493] T d12a070001934296ba81c85f9ba61e27 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:28.212728 23952 raft_consensus.cc:3060] T d12a070001934296ba81c85f9ba61e27 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:28.217479 24104 raft_consensus.cc:993] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa: : Instructing follower 3824bca1df8e4020b18c7989f7758391 to start an election
I20260709 12:12:28.218032 24094 raft_consensus.cc:1081] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Signalling peer 3824bca1df8e4020b18c7989f7758391 to start an election
I20260709 12:12:28.219425 23952 raft_consensus.cc:515] T d12a070001934296ba81c85f9ba61e27 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:28.219533 23953 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7193dd2dee9c4d1c9992ad4eff434b59"
dest_uuid: "3824bca1df8e4020b18c7989f7758391"
 from {username='slave'} at 127.0.0.1:49662
I20260709 12:12:28.220238 23953 raft_consensus.cc:493] T 7193dd2dee9c4d1c9992ad4eff434b59 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:28.220606 23953 raft_consensus.cc:3060] T 7193dd2dee9c4d1c9992ad4eff434b59 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:28.221293 23952 leader_election.cc:290] T d12a070001934296ba81c85f9ba61e27 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 2 election: Requested vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:28.223022 23384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12a070001934296ba81c85f9ba61e27" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:28.223631 23233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12a070001934296ba81c85f9ba61e27" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:28.224198 23233 raft_consensus.cc:3060] T d12a070001934296ba81c85f9ba61e27 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:28.223644 23384 raft_consensus.cc:3055] T d12a070001934296ba81c85f9ba61e27 P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:28.226776 23384 raft_consensus.cc:740] T d12a070001934296ba81c85f9ba61e27 P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Running, Role: LEADER
I20260709 12:12:28.227456 23384 consensus_queue.cc:260] T d12a070001934296ba81c85f9ba61e27 P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:28.228631 23384 raft_consensus.cc:3060] T d12a070001934296ba81c85f9ba61e27 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:28.228444 23953 raft_consensus.cc:515] T 7193dd2dee9c4d1c9992ad4eff434b59 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:28.231184 23380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7193dd2dee9c4d1c9992ad4eff434b59" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:28.231694 23380 raft_consensus.cc:3055] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:28.231976 23380 raft_consensus.cc:740] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Running, Role: LEADER
I20260709 12:12:28.231899 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7193dd2dee9c4d1c9992ad4eff434b59" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:28.232327 23953 leader_election.cc:290] T 7193dd2dee9c4d1c9992ad4eff434b59 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 2 election: Requested vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:28.232697 23236 raft_consensus.cc:3060] T 7193dd2dee9c4d1c9992ad4eff434b59 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:28.232969 23380 consensus_queue.cc:260] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:28.234092 23380 raft_consensus.cc:3060] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:28.237057 23233 raft_consensus.cc:2468] T d12a070001934296ba81c85f9ba61e27 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 2.
I20260709 12:12:28.238575 23911 leader_election.cc:304] T d12a070001934296ba81c85f9ba61e27 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:28.239404 24113 raft_consensus.cc:2804] T d12a070001934296ba81c85f9ba61e27 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:28.239864 24113 raft_consensus.cc:697] T d12a070001934296ba81c85f9ba61e27 P 3824bca1df8e4020b18c7989f7758391 [term 2 LEADER]: Becoming Leader. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Running, Role: LEADER
I20260709 12:12:28.240685 24113 consensus_queue.cc:237] T d12a070001934296ba81c85f9ba61e27 P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:28.241185 23380 raft_consensus.cc:2468] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 2.
I20260709 12:12:28.241411 23384 raft_consensus.cc:2468] T d12a070001934296ba81c85f9ba61e27 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 2.
I20260709 12:12:28.242412 23908 leader_election.cc:304] T 7193dd2dee9c4d1c9992ad4eff434b59 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, 48bc58ace75f40e995efc1edcefe79fa; no voters: 
I20260709 12:12:28.243310 24114 raft_consensus.cc:2804] T 7193dd2dee9c4d1c9992ad4eff434b59 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:28.244215 23236 raft_consensus.cc:2468] T 7193dd2dee9c4d1c9992ad4eff434b59 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 2.
I20260709 12:12:28.245823 24114 raft_consensus.cc:697] T 7193dd2dee9c4d1c9992ad4eff434b59 P 3824bca1df8e4020b18c7989f7758391 [term 2 LEADER]: Becoming Leader. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Running, Role: LEADER
I20260709 12:12:28.247987 24114 consensus_queue.cc:237] T 7193dd2dee9c4d1c9992ad4eff434b59 P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:28.262445 23056 catalog_manager.cc:5697] T d12a070001934296ba81c85f9ba61e27 P 3824bca1df8e4020b18c7989f7758391 reported cstate change: term changed from 1 to 2, leader changed from 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196) to 3824bca1df8e4020b18c7989f7758391 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "3824bca1df8e4020b18c7989f7758391" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:28.279635 23056 catalog_manager.cc:5697] T 7193dd2dee9c4d1c9992ad4eff434b59 P 3824bca1df8e4020b18c7989f7758391 reported cstate change: term changed from 1 to 2, leader changed from 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196) to 3824bca1df8e4020b18c7989f7758391 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "3824bca1df8e4020b18c7989f7758391" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:28.306476 24104 raft_consensus.cc:993] T 9d57b510cd3745fabb0748a6f9008fca P 48bc58ace75f40e995efc1edcefe79fa: : Instructing follower 3824bca1df8e4020b18c7989f7758391 to start an election
I20260709 12:12:28.307027 24094 raft_consensus.cc:1081] T 9d57b510cd3745fabb0748a6f9008fca P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Signalling peer 3824bca1df8e4020b18c7989f7758391 to start an election
I20260709 12:12:28.308375 23953 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d57b510cd3745fabb0748a6f9008fca"
dest_uuid: "3824bca1df8e4020b18c7989f7758391"
 from {username='slave'} at 127.0.0.1:49662
I20260709 12:12:28.308902 23953 raft_consensus.cc:493] T 9d57b510cd3745fabb0748a6f9008fca P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:28.309263 23953 raft_consensus.cc:3060] T 9d57b510cd3745fabb0748a6f9008fca P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:28.314299 23953 raft_consensus.cc:515] T 9d57b510cd3745fabb0748a6f9008fca P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:28.315937 23953 leader_election.cc:290] T 9d57b510cd3745fabb0748a6f9008fca P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 2 election: Requested vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:28.317008 23380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d57b510cd3745fabb0748a6f9008fca" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:28.317518 23380 raft_consensus.cc:3055] T 9d57b510cd3745fabb0748a6f9008fca P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:28.317800 23380 raft_consensus.cc:740] T 9d57b510cd3745fabb0748a6f9008fca P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Running, Role: LEADER
I20260709 12:12:28.318692 23380 consensus_queue.cc:260] T 9d57b510cd3745fabb0748a6f9008fca P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:28.319840 23380 raft_consensus.cc:3060] T 9d57b510cd3745fabb0748a6f9008fca P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:28.325623 23380 raft_consensus.cc:2468] T 9d57b510cd3745fabb0748a6f9008fca P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 2.
I20260709 12:12:28.325731 23307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d57b510cd3745fabb0748a6f9008fca" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:28.326364 23307 raft_consensus.cc:3060] T 9d57b510cd3745fabb0748a6f9008fca P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:28.326767 23908 leader_election.cc:304] T 9d57b510cd3745fabb0748a6f9008fca P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, 48bc58ace75f40e995efc1edcefe79fa; no voters: 
I20260709 12:12:28.327466 24114 raft_consensus.cc:2804] T 9d57b510cd3745fabb0748a6f9008fca P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:28.327927 24114 raft_consensus.cc:697] T 9d57b510cd3745fabb0748a6f9008fca P 3824bca1df8e4020b18c7989f7758391 [term 2 LEADER]: Becoming Leader. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Running, Role: LEADER
I20260709 12:12:28.328791 24114 consensus_queue.cc:237] T 9d57b510cd3745fabb0748a6f9008fca P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:28.332319 23307 raft_consensus.cc:2468] T 9d57b510cd3745fabb0748a6f9008fca P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 2.
I20260709 12:12:28.337823 23056 catalog_manager.cc:5697] T 9d57b510cd3745fabb0748a6f9008fca P 3824bca1df8e4020b18c7989f7758391 reported cstate change: term changed from 1 to 2, leader changed from 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196) to 3824bca1df8e4020b18c7989f7758391 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "3824bca1df8e4020b18c7989f7758391" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:28.488857 24103 raft_consensus.cc:993] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689: : Instructing follower 3824bca1df8e4020b18c7989f7758391 to start an election
I20260709 12:12:28.489382 24106 raft_consensus.cc:1081] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Signalling peer 3824bca1df8e4020b18c7989f7758391 to start an election
I20260709 12:12:28.490970 23953 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c03bbe73aee42039c1f868590838eaf"
dest_uuid: "3824bca1df8e4020b18c7989f7758391"
 from {username='slave'} at 127.0.0.1:49656
I20260709 12:12:28.491456 23953 raft_consensus.cc:493] T 6c03bbe73aee42039c1f868590838eaf P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:28.491732 23953 raft_consensus.cc:3060] T 6c03bbe73aee42039c1f868590838eaf P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:28.496068 23953 raft_consensus.cc:515] T 6c03bbe73aee42039c1f868590838eaf P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:28.497615 23953 leader_election.cc:290] T 6c03bbe73aee42039c1f868590838eaf P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 2 election: Requested vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:28.498289 23236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c03bbe73aee42039c1f868590838eaf" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:28.498540 23307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c03bbe73aee42039c1f868590838eaf" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:28.498831 23236 raft_consensus.cc:3060] T 6c03bbe73aee42039c1f868590838eaf P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:28.499125 23307 raft_consensus.cc:3055] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:28.499408 23307 raft_consensus.cc:740] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Running, Role: LEADER
I20260709 12:12:28.500138 23307 consensus_queue.cc:260] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:28.501202 23307 raft_consensus.cc:3060] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:28.504626 23236 raft_consensus.cc:2468] T 6c03bbe73aee42039c1f868590838eaf P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 2.
I20260709 12:12:28.505584 23307 raft_consensus.cc:2468] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 2.
I20260709 12:12:28.505744 23911 leader_election.cc:304] T 6c03bbe73aee42039c1f868590838eaf P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:28.506564 24114 raft_consensus.cc:2804] T 6c03bbe73aee42039c1f868590838eaf P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:28.507097 24114 raft_consensus.cc:697] T 6c03bbe73aee42039c1f868590838eaf P 3824bca1df8e4020b18c7989f7758391 [term 2 LEADER]: Becoming Leader. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Running, Role: LEADER
I20260709 12:12:28.507839 24114 consensus_queue.cc:237] T 6c03bbe73aee42039c1f868590838eaf P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:28.516291 23056 catalog_manager.cc:5697] T 6c03bbe73aee42039c1f868590838eaf P 3824bca1df8e4020b18c7989f7758391 reported cstate change: term changed from 1 to 2, leader changed from a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195) to 3824bca1df8e4020b18c7989f7758391 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "3824bca1df8e4020b18c7989f7758391" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:28.537537 23384 raft_consensus.cc:1275] T 5d0efec949fc4455838db7fb01259d69 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Refusing update from remote peer 3824bca1df8e4020b18c7989f7758391: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:28.538821 24114 consensus_queue.cc:1048] T 5d0efec949fc4455838db7fb01259d69 P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:28.550267 23236 raft_consensus.cc:1275] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Refusing update from remote peer 3824bca1df8e4020b18c7989f7758391: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:28.574771 24122 consensus_queue.cc:1048] T 5d0efec949fc4455838db7fb01259d69 P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:28.778934 23308 raft_consensus.cc:1275] T ec1028a2affb45679aede72149f857f5 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Refusing update from remote peer abe65f4962e147ac841608b6c30f7e1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:28.780004 24096 consensus_queue.cc:1048] T ec1028a2affb45679aede72149f857f5 P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:28.795351 23384 raft_consensus.cc:1275] T ec1028a2affb45679aede72149f857f5 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Refusing update from remote peer abe65f4962e147ac841608b6c30f7e1b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:28.797076 24105 consensus_queue.cc:1048] T ec1028a2affb45679aede72149f857f5 P abe65f4962e147ac841608b6c30f7e1b [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:28.815641 23236 raft_consensus.cc:1275] T 7193dd2dee9c4d1c9992ad4eff434b59 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Refusing update from remote peer 3824bca1df8e4020b18c7989f7758391: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:28.816882 24122 consensus_queue.cc:1048] T 7193dd2dee9c4d1c9992ad4eff434b59 P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:28.824295 23384 raft_consensus.cc:1275] T 9d57b510cd3745fabb0748a6f9008fca P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Refusing update from remote peer 3824bca1df8e4020b18c7989f7758391: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:28.835937 24114 consensus_queue.cc:1048] T 9d57b510cd3745fabb0748a6f9008fca P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:28.839968 23380 raft_consensus.cc:1275] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Refusing update from remote peer 3824bca1df8e4020b18c7989f7758391: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:28.841425 24122 consensus_queue.cc:1048] T 7193dd2dee9c4d1c9992ad4eff434b59 P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:28.859704 23381 raft_consensus.cc:1275] T d12a070001934296ba81c85f9ba61e27 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Refusing update from remote peer 3824bca1df8e4020b18c7989f7758391: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:28.860078 23233 raft_consensus.cc:1275] T d12a070001934296ba81c85f9ba61e27 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Refusing update from remote peer 3824bca1df8e4020b18c7989f7758391: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:28.864634 24114 consensus_queue.cc:1048] T d12a070001934296ba81c85f9ba61e27 P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:28.870716 24140 consensus_queue.cc:1048] T d12a070001934296ba81c85f9ba61e27 P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:28.879477 23308 raft_consensus.cc:1275] T 9d57b510cd3745fabb0748a6f9008fca P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Refusing update from remote peer 3824bca1df8e4020b18c7989f7758391: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:28.881541 24140 consensus_queue.cc:1048] T 9d57b510cd3745fabb0748a6f9008fca P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:29.036358 23233 raft_consensus.cc:1275] T 6c03bbe73aee42039c1f868590838eaf P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Refusing update from remote peer 3824bca1df8e4020b18c7989f7758391: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:29.037533 24140 consensus_queue.cc:1048] T 6c03bbe73aee42039c1f868590838eaf P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:29.048238 23307 raft_consensus.cc:1275] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Refusing update from remote peer 3824bca1df8e4020b18c7989f7758391: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:29.053064 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:29.055208 24114 consensus_queue.cc:1048] T 6c03bbe73aee42039c1f868590838eaf P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:29.105947 23307 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b4285f9faa34fc595e0b7db3f7f0946"
dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
mode: GRACEFUL
new_leader_uuid: "3824bca1df8e4020b18c7989f7758391"
 from {username='slave'} at 127.0.0.1:34296
I20260709 12:12:29.106539 23307 raft_consensus.cc:606] T 1b4285f9faa34fc595e0b7db3f7f0946 P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Received request to transfer leadership to TS 3824bca1df8e4020b18c7989f7758391
I20260709 12:12:29.109056 23307 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f5cfd203dcc43d4a86864c2eaaf234c"
dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
mode: GRACEFUL
new_leader_uuid: "3824bca1df8e4020b18c7989f7758391"
 from {username='slave'} at 127.0.0.1:34296
I20260709 12:12:29.109577 23307 raft_consensus.cc:606] T 1f5cfd203dcc43d4a86864c2eaaf234c P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Received request to transfer leadership to TS 3824bca1df8e4020b18c7989f7758391
I20260709 12:12:29.112632 23308 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2954a8837137444496d21a25638b3f2a"
dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
mode: GRACEFUL
new_leader_uuid: "3824bca1df8e4020b18c7989f7758391"
 from {username='slave'} at 127.0.0.1:34296
I20260709 12:12:29.113132 23308 raft_consensus.cc:606] T 2954a8837137444496d21a25638b3f2a P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Received request to transfer leadership to TS 3824bca1df8e4020b18c7989f7758391
I20260709 12:12:29.115517 23308 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72855efda9164489afb0f46a7f8da834"
dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
mode: GRACEFUL
new_leader_uuid: "3824bca1df8e4020b18c7989f7758391"
 from {username='slave'} at 127.0.0.1:34296
I20260709 12:12:29.115983 23308 raft_consensus.cc:606] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Received request to transfer leadership to TS 3824bca1df8e4020b18c7989f7758391
I20260709 12:12:29.118270 23308 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ac0ace3682c4f29b9e5ecad75f783f7"
dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
mode: GRACEFUL
new_leader_uuid: "3824bca1df8e4020b18c7989f7758391"
 from {username='slave'} at 127.0.0.1:34296
I20260709 12:12:29.118880 23308 raft_consensus.cc:606] T 8ac0ace3682c4f29b9e5ecad75f783f7 P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Received request to transfer leadership to TS 3824bca1df8e4020b18c7989f7758391
I20260709 12:12:29.121420 23233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae5efc2770bb4bc7a09585a220a45131"
dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
mode: GRACEFUL
new_leader_uuid: "48bc58ace75f40e995efc1edcefe79fa"
 from {username='slave'} at 127.0.0.1:51296
I20260709 12:12:29.121948 23233 raft_consensus.cc:606] T ae5efc2770bb4bc7a09585a220a45131 P abe65f4962e147ac841608b6c30f7e1b [term 1 LEADER]: Received request to transfer leadership to TS 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:29.122956 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:12:29.124143 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:29.124825 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:29.126721 24106 raft_consensus.cc:993] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689: : Instructing follower 3824bca1df8e4020b18c7989f7758391 to start an election
I20260709 12:12:29.127224 24144 raft_consensus.cc:1081] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Signalling peer 3824bca1df8e4020b18c7989f7758391 to start an election
I20260709 12:12:29.128508 23957 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72855efda9164489afb0f46a7f8da834"
dest_uuid: "3824bca1df8e4020b18c7989f7758391"
 from {username='slave'} at 127.0.0.1:49656
I20260709 12:12:29.128908 23957 raft_consensus.cc:493] T 72855efda9164489afb0f46a7f8da834 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:29.129168 23957 raft_consensus.cc:3060] T 72855efda9164489afb0f46a7f8da834 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:29.133608 23957 raft_consensus.cc:515] T 72855efda9164489afb0f46a7f8da834 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:29.135087 23957 leader_election.cc:290] T 72855efda9164489afb0f46a7f8da834 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 2 election: Requested vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:29.135675 23233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72855efda9164489afb0f46a7f8da834" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:29.136246 23233 raft_consensus.cc:3060] T 72855efda9164489afb0f46a7f8da834 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:29.136143 23308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72855efda9164489afb0f46a7f8da834" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:29.136844 23308 raft_consensus.cc:3055] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:29.137156 23308 raft_consensus.cc:740] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Running, Role: LEADER
I20260709 12:12:29.137840 23308 consensus_queue.cc:260] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:29.139012 23308 raft_consensus.cc:3060] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:29.146996 23308 raft_consensus.cc:2468] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 2.
I20260709 12:12:29.148371 23910 leader_election.cc:304] T 72855efda9164489afb0f46a7f8da834 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689; no voters: 
I20260709 12:12:29.149272 24114 raft_consensus.cc:2804] T 72855efda9164489afb0f46a7f8da834 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:29.149758 24114 raft_consensus.cc:697] T 72855efda9164489afb0f46a7f8da834 P 3824bca1df8e4020b18c7989f7758391 [term 2 LEADER]: Becoming Leader. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Running, Role: LEADER
I20260709 12:12:29.150506 24114 consensus_queue.cc:237] T 72855efda9164489afb0f46a7f8da834 P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:29.152685 23233 raft_consensus.cc:2468] T 72855efda9164489afb0f46a7f8da834 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 2.
I20260709 12:12:29.173153 23058 catalog_manager.cc:5697] T 72855efda9164489afb0f46a7f8da834 P 3824bca1df8e4020b18c7989f7758391 reported cstate change: term changed from 1 to 2, leader changed from a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195) to 3824bca1df8e4020b18c7989f7758391 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "3824bca1df8e4020b18c7989f7758391" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:29.295431 24132 raft_consensus.cc:993] T ae5efc2770bb4bc7a09585a220a45131 P abe65f4962e147ac841608b6c30f7e1b: : Instructing follower 48bc58ace75f40e995efc1edcefe79fa to start an election
I20260709 12:12:29.296008 24131 raft_consensus.cc:1081] T ae5efc2770bb4bc7a09585a220a45131 P abe65f4962e147ac841608b6c30f7e1b [term 1 LEADER]: Signalling peer 48bc58ace75f40e995efc1edcefe79fa to start an election
I20260709 12:12:29.297483 23380 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae5efc2770bb4bc7a09585a220a45131"
dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
 from {username='slave'} at 127.0.0.1:34038
I20260709 12:12:29.297931 23380 raft_consensus.cc:493] T ae5efc2770bb4bc7a09585a220a45131 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:29.298319 23380 raft_consensus.cc:3060] T ae5efc2770bb4bc7a09585a220a45131 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:29.303685 23380 raft_consensus.cc:515] T ae5efc2770bb4bc7a09585a220a45131 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:29.305527 23380 leader_election.cc:290] T ae5efc2770bb4bc7a09585a220a45131 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 2 election: Requested vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:29.306150 23233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae5efc2770bb4bc7a09585a220a45131" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:29.306535 23308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae5efc2770bb4bc7a09585a220a45131" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:29.306844 23233 raft_consensus.cc:3055] T ae5efc2770bb4bc7a09585a220a45131 P abe65f4962e147ac841608b6c30f7e1b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:29.307119 23308 raft_consensus.cc:3060] T ae5efc2770bb4bc7a09585a220a45131 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:29.307194 23233 raft_consensus.cc:740] T ae5efc2770bb4bc7a09585a220a45131 P abe65f4962e147ac841608b6c30f7e1b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Running, Role: LEADER
I20260709 12:12:29.308869 23233 consensus_queue.cc:260] T ae5efc2770bb4bc7a09585a220a45131 P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:29.309904 23233 raft_consensus.cc:3060] T ae5efc2770bb4bc7a09585a220a45131 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:29.314582 23308 raft_consensus.cc:2468] T ae5efc2770bb4bc7a09585a220a45131 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 2.
I20260709 12:12:29.315267 23307 raft_consensus.cc:1240] T ae5efc2770bb4bc7a09585a220a45131 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Rejecting Update request from peer abe65f4962e147ac841608b6c30f7e1b for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:29.315948 23349 leader_election.cc:304] T ae5efc2770bb4bc7a09585a220a45131 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689; no voters: 
I20260709 12:12:29.317170 24129 raft_consensus.cc:2804] T ae5efc2770bb4bc7a09585a220a45131 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:29.317399 23233 raft_consensus.cc:2468] T ae5efc2770bb4bc7a09585a220a45131 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 2.
I20260709 12:12:29.317701 24129 raft_consensus.cc:697] T ae5efc2770bb4bc7a09585a220a45131 P 48bc58ace75f40e995efc1edcefe79fa [term 2 LEADER]: Becoming Leader. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Running, Role: LEADER
I20260709 12:12:29.319161 24129 consensus_queue.cc:237] T ae5efc2770bb4bc7a09585a220a45131 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:29.329602 23058 catalog_manager.cc:5697] T ae5efc2770bb4bc7a09585a220a45131 P 48bc58ace75f40e995efc1edcefe79fa reported cstate change: term changed from 1 to 2, leader changed from abe65f4962e147ac841608b6c30f7e1b (127.16.98.194) to 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196). New cstate: current_term: 2 leader_uuid: "48bc58ace75f40e995efc1edcefe79fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:29.384259 24144 raft_consensus.cc:993] T 1f5cfd203dcc43d4a86864c2eaaf234c P a9d87b20401744c7bd0c491f60cf0689: : Instructing follower 3824bca1df8e4020b18c7989f7758391 to start an election
I20260709 12:12:29.384735 24106 raft_consensus.cc:1081] T 1f5cfd203dcc43d4a86864c2eaaf234c P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Signalling peer 3824bca1df8e4020b18c7989f7758391 to start an election
I20260709 12:12:29.386279 23957 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f5cfd203dcc43d4a86864c2eaaf234c"
dest_uuid: "3824bca1df8e4020b18c7989f7758391"
 from {username='slave'} at 127.0.0.1:49656
I20260709 12:12:29.386754 23957 raft_consensus.cc:493] T 1f5cfd203dcc43d4a86864c2eaaf234c P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:29.387048 23957 raft_consensus.cc:3060] T 1f5cfd203dcc43d4a86864c2eaaf234c P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:29.392078 23957 raft_consensus.cc:515] T 1f5cfd203dcc43d4a86864c2eaaf234c P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:29.394701 23233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5cfd203dcc43d4a86864c2eaaf234c" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:29.395440 23957 leader_election.cc:290] T 1f5cfd203dcc43d4a86864c2eaaf234c P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 2 election: Requested vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:29.395915 23307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f5cfd203dcc43d4a86864c2eaaf234c" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:29.396492 23233 raft_consensus.cc:3060] T 1f5cfd203dcc43d4a86864c2eaaf234c P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:29.396649 23307 raft_consensus.cc:3055] T 1f5cfd203dcc43d4a86864c2eaaf234c P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:29.397112 23307 raft_consensus.cc:740] T 1f5cfd203dcc43d4a86864c2eaaf234c P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Running, Role: LEADER
I20260709 12:12:29.397826 23307 consensus_queue.cc:260] T 1f5cfd203dcc43d4a86864c2eaaf234c P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:29.399168 23307 raft_consensus.cc:3060] T 1f5cfd203dcc43d4a86864c2eaaf234c P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:29.403293 23233 raft_consensus.cc:2468] T 1f5cfd203dcc43d4a86864c2eaaf234c P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 2.
I20260709 12:12:29.404387 23911 leader_election.cc:304] T 1f5cfd203dcc43d4a86864c2eaaf234c P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:29.404855 23307 raft_consensus.cc:2468] T 1f5cfd203dcc43d4a86864c2eaaf234c P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 2.
I20260709 12:12:29.405224 24114 raft_consensus.cc:2804] T 1f5cfd203dcc43d4a86864c2eaaf234c P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:29.405705 24114 raft_consensus.cc:697] T 1f5cfd203dcc43d4a86864c2eaaf234c P 3824bca1df8e4020b18c7989f7758391 [term 2 LEADER]: Becoming Leader. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Running, Role: LEADER
I20260709 12:12:29.406508 24114 consensus_queue.cc:237] T 1f5cfd203dcc43d4a86864c2eaaf234c P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:29.416612 23058 catalog_manager.cc:5697] T 1f5cfd203dcc43d4a86864c2eaaf234c P 3824bca1df8e4020b18c7989f7758391 reported cstate change: term changed from 1 to 2, leader changed from a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195) to 3824bca1df8e4020b18c7989f7758391 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "3824bca1df8e4020b18c7989f7758391" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:29.434206 24088 raft_consensus.cc:993] T 1b4285f9faa34fc595e0b7db3f7f0946 P a9d87b20401744c7bd0c491f60cf0689: : Instructing follower 3824bca1df8e4020b18c7989f7758391 to start an election
I20260709 12:12:29.434710 24088 raft_consensus.cc:1081] T 1b4285f9faa34fc595e0b7db3f7f0946 P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Signalling peer 3824bca1df8e4020b18c7989f7758391 to start an election
I20260709 12:12:29.436026 23957 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b4285f9faa34fc595e0b7db3f7f0946"
dest_uuid: "3824bca1df8e4020b18c7989f7758391"
 from {username='slave'} at 127.0.0.1:49656
I20260709 12:12:29.436439 23957 raft_consensus.cc:493] T 1b4285f9faa34fc595e0b7db3f7f0946 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:29.436758 23957 raft_consensus.cc:3060] T 1b4285f9faa34fc595e0b7db3f7f0946 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:29.440125 24144 raft_consensus.cc:993] T 2954a8837137444496d21a25638b3f2a P a9d87b20401744c7bd0c491f60cf0689: : Instructing follower 3824bca1df8e4020b18c7989f7758391 to start an election
I20260709 12:12:29.440604 24144 raft_consensus.cc:1081] T 2954a8837137444496d21a25638b3f2a P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Signalling peer 3824bca1df8e4020b18c7989f7758391 to start an election
I20260709 12:12:29.442036 23952 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2954a8837137444496d21a25638b3f2a"
dest_uuid: "3824bca1df8e4020b18c7989f7758391"
 from {username='slave'} at 127.0.0.1:49656
I20260709 12:12:29.442459 23952 raft_consensus.cc:493] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:29.442799 23952 raft_consensus.cc:3060] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:29.443032 23957 raft_consensus.cc:515] T 1b4285f9faa34fc595e0b7db3f7f0946 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:29.444823 23957 leader_election.cc:290] T 1b4285f9faa34fc595e0b7db3f7f0946 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 2 election: Requested vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:29.445405 23380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4285f9faa34fc595e0b7db3f7f0946" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:29.445503 23307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4285f9faa34fc595e0b7db3f7f0946" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:29.446061 23307 raft_consensus.cc:3055] T 1b4285f9faa34fc595e0b7db3f7f0946 P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:29.446242 23307 raft_consensus.cc:740] T 1b4285f9faa34fc595e0b7db3f7f0946 P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Running, Role: LEADER
I20260709 12:12:29.447090 23307 consensus_queue.cc:260] T 1b4285f9faa34fc595e0b7db3f7f0946 P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:29.447894 23307 raft_consensus.cc:3060] T 1b4285f9faa34fc595e0b7db3f7f0946 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:29.448480 23952 raft_consensus.cc:515] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:29.450964 23233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2954a8837137444496d21a25638b3f2a" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:29.451205 23308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2954a8837137444496d21a25638b3f2a" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:29.451478 23233 raft_consensus.cc:3060] T 2954a8837137444496d21a25638b3f2a P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:29.451742 23308 raft_consensus.cc:3055] T 2954a8837137444496d21a25638b3f2a P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:29.452028 23308 raft_consensus.cc:740] T 2954a8837137444496d21a25638b3f2a P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Running, Role: LEADER
I20260709 12:12:29.452651 23307 raft_consensus.cc:2468] T 1b4285f9faa34fc595e0b7db3f7f0946 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 2.
I20260709 12:12:29.457196 23380 raft_consensus.cc:3060] T 1b4285f9faa34fc595e0b7db3f7f0946 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:29.457398 23233 raft_consensus.cc:2468] T 2954a8837137444496d21a25638b3f2a P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 2.
I20260709 12:12:29.458107 23952 leader_election.cc:290] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 2 election: Requested vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:29.458588 23911 leader_election.cc:304] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:29.459450 24114 raft_consensus.cc:2804] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:29.459896 24114 raft_consensus.cc:697] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391 [term 2 LEADER]: Becoming Leader. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Running, Role: LEADER
I20260709 12:12:29.460719 24114 consensus_queue.cc:237] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:29.462576 23380 raft_consensus.cc:2468] T 1b4285f9faa34fc595e0b7db3f7f0946 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 2.
I20260709 12:12:29.463635 23308 consensus_queue.cc:260] T 2954a8837137444496d21a25638b3f2a P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:29.463919 23908 leader_election.cc:304] T 1b4285f9faa34fc595e0b7db3f7f0946 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, 48bc58ace75f40e995efc1edcefe79fa; no voters: 
I20260709 12:12:29.464881 24122 raft_consensus.cc:2804] T 1b4285f9faa34fc595e0b7db3f7f0946 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:29.465052 23308 raft_consensus.cc:3060] T 2954a8837137444496d21a25638b3f2a P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:29.465425 24122 raft_consensus.cc:697] T 1b4285f9faa34fc595e0b7db3f7f0946 P 3824bca1df8e4020b18c7989f7758391 [term 2 LEADER]: Becoming Leader. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Running, Role: LEADER
I20260709 12:12:29.466353 24122 consensus_queue.cc:237] T 1b4285f9faa34fc595e0b7db3f7f0946 P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:29.474815 23308 raft_consensus.cc:2468] T 2954a8837137444496d21a25638b3f2a P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 2.
I20260709 12:12:29.481205 23058 catalog_manager.cc:5697] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391 reported cstate change: term changed from 1 to 2, leader changed from a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195) to 3824bca1df8e4020b18c7989f7758391 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "3824bca1df8e4020b18c7989f7758391" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:29.496376 23058 catalog_manager.cc:5697] T 1b4285f9faa34fc595e0b7db3f7f0946 P 3824bca1df8e4020b18c7989f7758391 reported cstate change: term changed from 1 to 2, leader changed from a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195) to 3824bca1df8e4020b18c7989f7758391 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "3824bca1df8e4020b18c7989f7758391" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:29.536101 24106 raft_consensus.cc:993] T 8ac0ace3682c4f29b9e5ecad75f783f7 P a9d87b20401744c7bd0c491f60cf0689: : Instructing follower 3824bca1df8e4020b18c7989f7758391 to start an election
I20260709 12:12:29.536641 24088 raft_consensus.cc:1081] T 8ac0ace3682c4f29b9e5ecad75f783f7 P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Signalling peer 3824bca1df8e4020b18c7989f7758391 to start an election
I20260709 12:12:29.538086 23952 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ac0ace3682c4f29b9e5ecad75f783f7"
dest_uuid: "3824bca1df8e4020b18c7989f7758391"
 from {username='slave'} at 127.0.0.1:49656
I20260709 12:12:29.538508 23952 raft_consensus.cc:493] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:29.538823 23952 raft_consensus.cc:3060] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:29.543671 23952 raft_consensus.cc:515] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:29.545421 23952 leader_election.cc:290] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 2 election: Requested vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:29.546124 23233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac0ace3682c4f29b9e5ecad75f783f7" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:29.546725 23233 raft_consensus.cc:3060] T 8ac0ace3682c4f29b9e5ecad75f783f7 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:29.547789 23308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac0ace3682c4f29b9e5ecad75f783f7" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:29.548343 23308 raft_consensus.cc:3055] T 8ac0ace3682c4f29b9e5ecad75f783f7 P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:29.548604 23308 raft_consensus.cc:740] T 8ac0ace3682c4f29b9e5ecad75f783f7 P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Running, Role: LEADER
I20260709 12:12:29.549427 23308 consensus_queue.cc:260] T 8ac0ace3682c4f29b9e5ecad75f783f7 P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:29.550448 23308 raft_consensus.cc:3060] T 8ac0ace3682c4f29b9e5ecad75f783f7 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:29.552809 23233 raft_consensus.cc:2468] T 8ac0ace3682c4f29b9e5ecad75f783f7 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 2.
I20260709 12:12:29.554045 23911 leader_election.cc:304] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:29.555244 24114 raft_consensus.cc:2804] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:29.555691 24114 raft_consensus.cc:697] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391 [term 2 LEADER]: Becoming Leader. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Running, Role: LEADER
I20260709 12:12:29.556484 24114 consensus_queue.cc:237] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:29.557773 23308 raft_consensus.cc:2468] T 8ac0ace3682c4f29b9e5ecad75f783f7 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 2.
I20260709 12:12:29.569924 23058 catalog_manager.cc:5697] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391 reported cstate change: term changed from 1 to 2, leader changed from a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195) to 3824bca1df8e4020b18c7989f7758391 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "3824bca1df8e4020b18c7989f7758391" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:29.685063 23233 raft_consensus.cc:1275] T 72855efda9164489afb0f46a7f8da834 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Refusing update from remote peer 3824bca1df8e4020b18c7989f7758391: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:29.686285 24114 consensus_queue.cc:1048] T 72855efda9164489afb0f46a7f8da834 P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:29.695580 23308 raft_consensus.cc:1275] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Refusing update from remote peer 3824bca1df8e4020b18c7989f7758391: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:29.697333 24140 consensus_queue.cc:1048] T 72855efda9164489afb0f46a7f8da834 P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:29.841132 23307 raft_consensus.cc:1275] T ae5efc2770bb4bc7a09585a220a45131 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Refusing update from remote peer 48bc58ace75f40e995efc1edcefe79fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:29.842214 24104 consensus_queue.cc:1048] T ae5efc2770bb4bc7a09585a220a45131 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:29.849392 23307 raft_consensus.cc:1275] T 2954a8837137444496d21a25638b3f2a P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Refusing update from remote peer 3824bca1df8e4020b18c7989f7758391: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:29.851861 23233 raft_consensus.cc:1275] T ae5efc2770bb4bc7a09585a220a45131 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Refusing update from remote peer 48bc58ace75f40e995efc1edcefe79fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:29.853308 24129 consensus_queue.cc:1048] T ae5efc2770bb4bc7a09585a220a45131 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:29.857863 24140 consensus_queue.cc:1048] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:29.871527 23236 raft_consensus.cc:1275] T 2954a8837137444496d21a25638b3f2a P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Refusing update from remote peer 3824bca1df8e4020b18c7989f7758391: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:29.876157 24140 consensus_queue.cc:1048] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:29.914762 23308 raft_consensus.cc:1275] T 1b4285f9faa34fc595e0b7db3f7f0946 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Refusing update from remote peer 3824bca1df8e4020b18c7989f7758391: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:29.915997 24140 consensus_queue.cc:1048] T 1b4285f9faa34fc595e0b7db3f7f0946 P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:29.926272 23384 raft_consensus.cc:1275] T 1b4285f9faa34fc595e0b7db3f7f0946 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Refusing update from remote peer 3824bca1df8e4020b18c7989f7758391: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:29.927969 24113 consensus_queue.cc:1048] T 1b4285f9faa34fc595e0b7db3f7f0946 P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:29.966112 23234 raft_consensus.cc:1275] T 1f5cfd203dcc43d4a86864c2eaaf234c P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Refusing update from remote peer 3824bca1df8e4020b18c7989f7758391: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:29.967347 24140 consensus_queue.cc:1048] T 1f5cfd203dcc43d4a86864c2eaaf234c P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:29.972589 23308 raft_consensus.cc:1275] T 8ac0ace3682c4f29b9e5ecad75f783f7 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Refusing update from remote peer 3824bca1df8e4020b18c7989f7758391: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:29.974001 24113 consensus_queue.cc:1048] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:29.980695 23308 raft_consensus.cc:1275] T 1f5cfd203dcc43d4a86864c2eaaf234c P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Refusing update from remote peer 3824bca1df8e4020b18c7989f7758391: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:29.986308 24140 consensus_queue.cc:1048] T 1f5cfd203dcc43d4a86864c2eaaf234c P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:30.007002 23233 raft_consensus.cc:1275] T 8ac0ace3682c4f29b9e5ecad75f783f7 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Refusing update from remote peer 3824bca1df8e4020b18c7989f7758391: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:30.008426 24140 consensus_queue.cc:1048] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:30.176441 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:30.217381 23384 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "541dc3e21d4e461b8c299d0186a42e7f"
dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
mode: GRACEFUL
new_leader_uuid: "3824bca1df8e4020b18c7989f7758391"
 from {username='slave'} at 127.0.0.1:58240
I20260709 12:12:30.217869 23384 raft_consensus.cc:606] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa [term 2 LEADER]: Received request to transfer leadership to TS 3824bca1df8e4020b18c7989f7758391
I20260709 12:12:30.220228 23308 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9be6b80356b0415ba28a56482e13d24f"
dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
mode: GRACEFUL
new_leader_uuid: "48bc58ace75f40e995efc1edcefe79fa"
 from {username='slave'} at 127.0.0.1:34296
I20260709 12:12:30.220794 23308 raft_consensus.cc:606] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [term 3 LEADER]: Received request to transfer leadership to TS 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:30.223119 23308 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0348215bfbf4d0bb5ffd2ddc86a4279"
dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
mode: GRACEFUL
new_leader_uuid: "48bc58ace75f40e995efc1edcefe79fa"
 from {username='slave'} at 127.0.0.1:34296
I20260709 12:12:30.223539 23308 raft_consensus.cc:606] T b0348215bfbf4d0bb5ffd2ddc86a4279 P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Received request to transfer leadership to TS 48bc58ace75f40e995efc1edcefe79fa
I20260709 12:12:30.225925 23234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8c6d6433d204aa3b5fa3a304e66dd7e"
dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
mode: GRACEFUL
new_leader_uuid: "3824bca1df8e4020b18c7989f7758391"
 from {username='slave'} at 127.0.0.1:51296
I20260709 12:12:30.226413 23234 raft_consensus.cc:606] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b [term 2 LEADER]: Received request to transfer leadership to TS 3824bca1df8e4020b18c7989f7758391
I20260709 12:12:30.227516 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:12:30.228641 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:30.229327 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:30.257383 24106 raft_consensus.cc:993] T b0348215bfbf4d0bb5ffd2ddc86a4279 P a9d87b20401744c7bd0c491f60cf0689: : Instructing follower 48bc58ace75f40e995efc1edcefe79fa to start an election
I20260709 12:12:30.258039 24088 raft_consensus.cc:1081] T b0348215bfbf4d0bb5ffd2ddc86a4279 P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Signalling peer 48bc58ace75f40e995efc1edcefe79fa to start an election
I20260709 12:12:30.259421 23384 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b0348215bfbf4d0bb5ffd2ddc86a4279"
dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
 from {username='slave'} at 127.0.0.1:34022
I20260709 12:12:30.259850 23384 raft_consensus.cc:493] T b0348215bfbf4d0bb5ffd2ddc86a4279 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:30.260136 23384 raft_consensus.cc:3060] T b0348215bfbf4d0bb5ffd2ddc86a4279 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:30.265625 23384 raft_consensus.cc:515] T b0348215bfbf4d0bb5ffd2ddc86a4279 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:30.267174 23384 leader_election.cc:290] T b0348215bfbf4d0bb5ffd2ddc86a4279 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 2 election: Requested vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:30.267777 23234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0348215bfbf4d0bb5ffd2ddc86a4279" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:30.268162 23308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0348215bfbf4d0bb5ffd2ddc86a4279" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:30.268390 23234 raft_consensus.cc:3060] T b0348215bfbf4d0bb5ffd2ddc86a4279 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:30.268720 23308 raft_consensus.cc:3055] T b0348215bfbf4d0bb5ffd2ddc86a4279 P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:30.268997 23308 raft_consensus.cc:740] T b0348215bfbf4d0bb5ffd2ddc86a4279 P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Running, Role: LEADER
I20260709 12:12:30.269626 23308 consensus_queue.cc:260] T b0348215bfbf4d0bb5ffd2ddc86a4279 P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:30.270543 23308 raft_consensus.cc:3060] T b0348215bfbf4d0bb5ffd2ddc86a4279 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:30.273594 23234 raft_consensus.cc:2468] T b0348215bfbf4d0bb5ffd2ddc86a4279 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 2.
I20260709 12:12:30.274932 23350 leader_election.cc:304] T b0348215bfbf4d0bb5ffd2ddc86a4279 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:30.275646 24104 raft_consensus.cc:2804] T b0348215bfbf4d0bb5ffd2ddc86a4279 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:30.276072 24104 raft_consensus.cc:697] T b0348215bfbf4d0bb5ffd2ddc86a4279 P 48bc58ace75f40e995efc1edcefe79fa [term 2 LEADER]: Becoming Leader. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Running, Role: LEADER
I20260709 12:12:30.276773 24104 consensus_queue.cc:237] T b0348215bfbf4d0bb5ffd2ddc86a4279 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:30.280264 23308 raft_consensus.cc:2468] T b0348215bfbf4d0bb5ffd2ddc86a4279 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 2.
I20260709 12:12:30.285521 23059 catalog_manager.cc:5697] T b0348215bfbf4d0bb5ffd2ddc86a4279 P 48bc58ace75f40e995efc1edcefe79fa reported cstate change: term changed from 1 to 2, leader changed from a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195) to 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196). New cstate: current_term: 2 leader_uuid: "48bc58ace75f40e995efc1edcefe79fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:30.330314 24132 raft_consensus.cc:993] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b: : Instructing follower 3824bca1df8e4020b18c7989f7758391 to start an election
I20260709 12:12:30.330868 24131 raft_consensus.cc:1081] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b [term 2 LEADER]: Signalling peer 3824bca1df8e4020b18c7989f7758391 to start an election
I20260709 12:12:30.332244 23952 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8c6d6433d204aa3b5fa3a304e66dd7e"
dest_uuid: "3824bca1df8e4020b18c7989f7758391"
 from {username='slave'} at 127.0.0.1:49642
I20260709 12:12:30.332667 23952 raft_consensus.cc:493] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:30.332935 23952 raft_consensus.cc:3060] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:30.337270 23952 raft_consensus.cc:515] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:30.338732 23952 leader_election.cc:290] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 3 election: Requested vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:30.339421 23234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c6d6433d204aa3b5fa3a304e66dd7e" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:30.339636 23308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8c6d6433d204aa3b5fa3a304e66dd7e" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:30.340070 23234 raft_consensus.cc:3055] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:30.340137 23308 raft_consensus.cc:3060] T d8c6d6433d204aa3b5fa3a304e66dd7e P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:30.340440 23234 raft_consensus.cc:740] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: abe65f4962e147ac841608b6c30f7e1b, State: Running, Role: LEADER
I20260709 12:12:30.341180 23234 consensus_queue.cc:260] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:30.342343 23234 raft_consensus.cc:3060] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:30.346596 24106 raft_consensus.cc:993] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689: : Instructing follower 48bc58ace75f40e995efc1edcefe79fa to start an election
I20260709 12:12:30.347160 24088 raft_consensus.cc:1081] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [term 3 LEADER]: Signalling peer 48bc58ace75f40e995efc1edcefe79fa to start an election
I20260709 12:12:30.348451 23384 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9be6b80356b0415ba28a56482e13d24f"
dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
 from {username='slave'} at 127.0.0.1:34022
I20260709 12:12:30.348971 23384 raft_consensus.cc:493] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:30.349329 23384 raft_consensus.cc:3060] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:30.349813 23308 raft_consensus.cc:2468] T d8c6d6433d204aa3b5fa3a304e66dd7e P a9d87b20401744c7bd0c491f60cf0689 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 3.
I20260709 12:12:30.350939 23910 leader_election.cc:304] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689; no voters: 
I20260709 12:12:30.352941 24113 raft_consensus.cc:2804] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:30.353369 24113 raft_consensus.cc:697] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391 [term 3 LEADER]: Becoming Leader. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Running, Role: LEADER
I20260709 12:12:30.354235 24113 consensus_queue.cc:237] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } }
I20260709 12:12:30.355448 23384 raft_consensus.cc:515] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:30.357035 23384 leader_election.cc:290] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 4 election: Requested vote from peers abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907), a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253)
I20260709 12:12:30.357904 23307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be6b80356b0415ba28a56482e13d24f" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:30.358460 23307 raft_consensus.cc:3055] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:30.358800 23307 raft_consensus.cc:740] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a9d87b20401744c7bd0c491f60cf0689, State: Running, Role: LEADER
I20260709 12:12:30.359522 23307 consensus_queue.cc:260] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:30.360625 23307 raft_consensus.cc:3060] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:30.361094 23233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9be6b80356b0415ba28a56482e13d24f" candidate_uuid: "48bc58ace75f40e995efc1edcefe79fa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:30.361730 23233 raft_consensus.cc:3060] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:30.373886 23307 raft_consensus.cc:2468] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 4.
I20260709 12:12:30.375463 23349 leader_election.cc:304] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa, a9d87b20401744c7bd0c491f60cf0689; no voters: 
I20260709 12:12:30.375871 23233 raft_consensus.cc:2468] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48bc58ace75f40e995efc1edcefe79fa in term 4.
I20260709 12:12:30.376152 24129 raft_consensus.cc:2804] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:30.376778 24129 raft_consensus.cc:697] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [term 4 LEADER]: Becoming Leader. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Running, Role: LEADER
I20260709 12:12:30.377646 24129 consensus_queue.cc:237] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } }
I20260709 12:12:30.386952 23059 catalog_manager.cc:5697] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391 reported cstate change: term changed from 2 to 3, leader changed from abe65f4962e147ac841608b6c30f7e1b (127.16.98.194) to 3824bca1df8e4020b18c7989f7758391 (127.16.98.193). New cstate: current_term: 3 leader_uuid: "3824bca1df8e4020b18c7989f7758391" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:30.401962 23058 catalog_manager.cc:5697] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa reported cstate change: term changed from 3 to 4, leader changed from a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195) to 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196). New cstate: current_term: 4 leader_uuid: "48bc58ace75f40e995efc1edcefe79fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:30.402407 23234 raft_consensus.cc:2468] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 3.
I20260709 12:12:30.625403 24129 raft_consensus.cc:993] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa: : Instructing follower 3824bca1df8e4020b18c7989f7758391 to start an election
I20260709 12:12:30.625917 24104 raft_consensus.cc:1081] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa [term 2 LEADER]: Signalling peer 3824bca1df8e4020b18c7989f7758391 to start an election
I20260709 12:12:30.627332 23953 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "541dc3e21d4e461b8c299d0186a42e7f"
dest_uuid: "3824bca1df8e4020b18c7989f7758391"
 from {username='slave'} at 127.0.0.1:49662
I20260709 12:12:30.627717 23953 raft_consensus.cc:493] T 541dc3e21d4e461b8c299d0186a42e7f P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:30.627934 23953 raft_consensus.cc:3060] T 541dc3e21d4e461b8c299d0186a42e7f P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:30.632197 23953 raft_consensus.cc:515] T 541dc3e21d4e461b8c299d0186a42e7f P 3824bca1df8e4020b18c7989f7758391 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:30.633592 23953 leader_election.cc:290] T 541dc3e21d4e461b8c299d0186a42e7f P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 3 election: Requested vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:30.634222 23307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541dc3e21d4e461b8c299d0186a42e7f" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:30.634500 23384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "541dc3e21d4e461b8c299d0186a42e7f" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:30.634814 23307 raft_consensus.cc:3060] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:30.635082 23384 raft_consensus.cc:3055] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:30.635361 23384 raft_consensus.cc:740] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Running, Role: LEADER
I20260709 12:12:30.635973 23384 consensus_queue.cc:260] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:30.636816 23384 raft_consensus.cc:3060] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:30.639279 23307 raft_consensus.cc:2468] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 3.
I20260709 12:12:30.640326 23910 leader_election.cc:304] T 541dc3e21d4e461b8c299d0186a42e7f P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689; no voters: 
I20260709 12:12:30.641021 24113 raft_consensus.cc:2804] T 541dc3e21d4e461b8c299d0186a42e7f P 3824bca1df8e4020b18c7989f7758391 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:30.641149 23384 raft_consensus.cc:2468] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 3.
I20260709 12:12:30.641553 24113 raft_consensus.cc:697] T 541dc3e21d4e461b8c299d0186a42e7f P 3824bca1df8e4020b18c7989f7758391 [term 3 LEADER]: Becoming Leader. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Running, Role: LEADER
I20260709 12:12:30.642472 24113 consensus_queue.cc:237] T 541dc3e21d4e461b8c299d0186a42e7f P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:30.653770 23058 catalog_manager.cc:5697] T 541dc3e21d4e461b8c299d0186a42e7f P 3824bca1df8e4020b18c7989f7758391 reported cstate change: term changed from 2 to 3, leader changed from 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196) to 3824bca1df8e4020b18c7989f7758391 (127.16.98.193). New cstate: current_term: 3 leader_uuid: "3824bca1df8e4020b18c7989f7758391" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:30.768647 23307 raft_consensus.cc:1275] T d8c6d6433d204aa3b5fa3a304e66dd7e P a9d87b20401744c7bd0c491f60cf0689 [term 3 FOLLOWER]: Refusing update from remote peer 3824bca1df8e4020b18c7989f7758391: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:30.769948 24113 consensus_queue.cc:1048] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:30.779450 23234 raft_consensus.cc:1275] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b [term 3 FOLLOWER]: Refusing update from remote peer 3824bca1df8e4020b18c7989f7758391: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:30.780972 24113 consensus_queue.cc:1048] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:30.787281 23233 raft_consensus.cc:1275] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [term 4 FOLLOWER]: Refusing update from remote peer 48bc58ace75f40e995efc1edcefe79fa: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:12:30.788826 24104 consensus_queue.cc:1048] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:30.813853 23234 raft_consensus.cc:1275] T b0348215bfbf4d0bb5ffd2ddc86a4279 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Refusing update from remote peer 48bc58ace75f40e995efc1edcefe79fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:30.815912 24104 consensus_queue.cc:1048] T b0348215bfbf4d0bb5ffd2ddc86a4279 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:30.821008 23307 raft_consensus.cc:1275] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [term 4 FOLLOWER]: Refusing update from remote peer 48bc58ace75f40e995efc1edcefe79fa: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:12:30.823040 24104 consensus_queue.cc:1048] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:30.843689 23307 raft_consensus.cc:1275] T b0348215bfbf4d0bb5ffd2ddc86a4279 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Refusing update from remote peer 48bc58ace75f40e995efc1edcefe79fa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:30.845474 24165 consensus_queue.cc:1048] T b0348215bfbf4d0bb5ffd2ddc86a4279 P 48bc58ace75f40e995efc1edcefe79fa [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:31.045912 23380 raft_consensus.cc:1275] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa [term 3 FOLLOWER]: Refusing update from remote peer 3824bca1df8e4020b18c7989f7758391: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:31.047151 24114 consensus_queue.cc:1048] T 541dc3e21d4e461b8c299d0186a42e7f P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:31.048430 23307 raft_consensus.cc:1275] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689 [term 3 FOLLOWER]: Refusing update from remote peer 3824bca1df8e4020b18c7989f7758391: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:31.049826 24114 consensus_queue.cc:1048] T 541dc3e21d4e461b8c299d0186a42e7f P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:31.265858 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:31.302353 23380 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e53f580024c14b33b72266b89a1ab8e3"
dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
mode: GRACEFUL
new_leader_uuid: "3824bca1df8e4020b18c7989f7758391"
 from {username='slave'} at 127.0.0.1:58240
I20260709 12:12:31.302862 23380 raft_consensus.cc:606] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Received request to transfer leadership to TS 3824bca1df8e4020b18c7989f7758391
I20260709 12:12:31.305469 23384 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fba757d381304cc0bcbb4f9dbcfc812c"
dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
mode: GRACEFUL
new_leader_uuid: "3824bca1df8e4020b18c7989f7758391"
 from {username='slave'} at 127.0.0.1:58240
I20260709 12:12:31.305933 23384 raft_consensus.cc:606] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Received request to transfer leadership to TS 3824bca1df8e4020b18c7989f7758391
I20260709 12:12:31.306972 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:12:31.307998 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:31.308552 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:31.366223 24129 raft_consensus.cc:993] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa: : Instructing follower 3824bca1df8e4020b18c7989f7758391 to start an election
I20260709 12:12:31.366727 24129 raft_consensus.cc:1081] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Signalling peer 3824bca1df8e4020b18c7989f7758391 to start an election
I20260709 12:12:31.368348 23953 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fba757d381304cc0bcbb4f9dbcfc812c"
dest_uuid: "3824bca1df8e4020b18c7989f7758391"
 from {username='slave'} at 127.0.0.1:49662
I20260709 12:12:31.368865 23953 raft_consensus.cc:493] T fba757d381304cc0bcbb4f9dbcfc812c P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:31.369146 23953 raft_consensus.cc:3060] T fba757d381304cc0bcbb4f9dbcfc812c P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:31.375876 23953 raft_consensus.cc:515] T fba757d381304cc0bcbb4f9dbcfc812c P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:31.377590 23953 leader_election.cc:290] T fba757d381304cc0bcbb4f9dbcfc812c P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 2 election: Requested vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599)
I20260709 12:12:31.378396 23307 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba757d381304cc0bcbb4f9dbcfc812c" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a9d87b20401744c7bd0c491f60cf0689"
I20260709 12:12:31.378504 23384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fba757d381304cc0bcbb4f9dbcfc812c" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:31.379179 23307 raft_consensus.cc:3060] T fba757d381304cc0bcbb4f9dbcfc812c P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:31.379215 23384 raft_consensus.cc:3055] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:31.379720 23384 raft_consensus.cc:740] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Running, Role: LEADER
I20260709 12:12:31.380460 23384 consensus_queue.cc:260] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:31.381651 23384 raft_consensus.cc:3060] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:31.386485 23307 raft_consensus.cc:2468] T fba757d381304cc0bcbb4f9dbcfc812c P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 2.
I20260709 12:12:31.387527 23910 leader_election.cc:304] T fba757d381304cc0bcbb4f9dbcfc812c P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689; no voters: 
I20260709 12:12:31.388231 24194 raft_consensus.cc:2804] T fba757d381304cc0bcbb4f9dbcfc812c P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:31.389022 24194 raft_consensus.cc:697] T fba757d381304cc0bcbb4f9dbcfc812c P 3824bca1df8e4020b18c7989f7758391 [term 2 LEADER]: Becoming Leader. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Running, Role: LEADER
I20260709 12:12:31.389925 24194 consensus_queue.cc:237] T fba757d381304cc0bcbb4f9dbcfc812c P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:31.393872 23384 raft_consensus.cc:2468] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 2.
I20260709 12:12:31.401129 23058 catalog_manager.cc:5697] T fba757d381304cc0bcbb4f9dbcfc812c P 3824bca1df8e4020b18c7989f7758391 reported cstate change: term changed from 1 to 2, leader changed from 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196) to 3824bca1df8e4020b18c7989f7758391 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "3824bca1df8e4020b18c7989f7758391" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:31.772118 24129 raft_consensus.cc:993] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa: : Instructing follower 3824bca1df8e4020b18c7989f7758391 to start an election
I20260709 12:12:31.772579 24104 raft_consensus.cc:1081] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Signalling peer 3824bca1df8e4020b18c7989f7758391 to start an election
I20260709 12:12:31.773775 23953 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e53f580024c14b33b72266b89a1ab8e3"
dest_uuid: "3824bca1df8e4020b18c7989f7758391"
 from {username='slave'} at 127.0.0.1:49662
I20260709 12:12:31.774209 23953 raft_consensus.cc:493] T e53f580024c14b33b72266b89a1ab8e3 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:31.774483 23953 raft_consensus.cc:3060] T e53f580024c14b33b72266b89a1ab8e3 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:31.780520 23953 raft_consensus.cc:515] T e53f580024c14b33b72266b89a1ab8e3 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:31.783900 23953 leader_election.cc:290] T e53f580024c14b33b72266b89a1ab8e3 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 2 election: Requested vote from peers 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196:37599), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
I20260709 12:12:31.784346 23384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e53f580024c14b33b72266b89a1ab8e3" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48bc58ace75f40e995efc1edcefe79fa"
I20260709 12:12:31.785004 23384 raft_consensus.cc:3055] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:31.785284 23384 raft_consensus.cc:740] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48bc58ace75f40e995efc1edcefe79fa, State: Running, Role: LEADER
I20260709 12:12:31.785710 23233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e53f580024c14b33b72266b89a1ab8e3" candidate_uuid: "3824bca1df8e4020b18c7989f7758391" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abe65f4962e147ac841608b6c30f7e1b"
I20260709 12:12:31.785876 23384 consensus_queue.cc:260] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:31.786211 23233 raft_consensus.cc:3060] T e53f580024c14b33b72266b89a1ab8e3 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:31.786913 23384 raft_consensus.cc:3060] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:31.790558 23233 raft_consensus.cc:2468] T e53f580024c14b33b72266b89a1ab8e3 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 2.
I20260709 12:12:31.790959 23384 raft_consensus.cc:2468] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3824bca1df8e4020b18c7989f7758391 in term 2.
I20260709 12:12:31.791508 23911 leader_election.cc:304] T e53f580024c14b33b72266b89a1ab8e3 P 3824bca1df8e4020b18c7989f7758391 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3824bca1df8e4020b18c7989f7758391, abe65f4962e147ac841608b6c30f7e1b; no voters: 
I20260709 12:12:31.792677 24194 raft_consensus.cc:2804] T e53f580024c14b33b72266b89a1ab8e3 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:31.793964 24194 raft_consensus.cc:697] T e53f580024c14b33b72266b89a1ab8e3 P 3824bca1df8e4020b18c7989f7758391 [term 2 LEADER]: Becoming Leader. State: Replica: 3824bca1df8e4020b18c7989f7758391, State: Running, Role: LEADER
I20260709 12:12:31.794867 24194 consensus_queue.cc:237] T e53f580024c14b33b72266b89a1ab8e3 P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:31.803469 23058 catalog_manager.cc:5697] T e53f580024c14b33b72266b89a1ab8e3 P 3824bca1df8e4020b18c7989f7758391 reported cstate change: term changed from 1 to 2, leader changed from 48bc58ace75f40e995efc1edcefe79fa (127.16.98.196) to 3824bca1df8e4020b18c7989f7758391 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "3824bca1df8e4020b18c7989f7758391" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:31.862249 23384 raft_consensus.cc:1275] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Refusing update from remote peer 3824bca1df8e4020b18c7989f7758391: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:31.863513 24194 consensus_queue.cc:1048] T fba757d381304cc0bcbb4f9dbcfc812c P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:31.877885 23306 raft_consensus.cc:1275] T fba757d381304cc0bcbb4f9dbcfc812c P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Refusing update from remote peer 3824bca1df8e4020b18c7989f7758391: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:31.883952 24122 consensus_queue.cc:1048] T fba757d381304cc0bcbb4f9dbcfc812c P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:32.180418 23380 raft_consensus.cc:1275] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Refusing update from remote peer 3824bca1df8e4020b18c7989f7758391: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:32.181670 24194 consensus_queue.cc:1048] T e53f580024c14b33b72266b89a1ab8e3 P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:32.191443 23234 raft_consensus.cc:1275] T e53f580024c14b33b72266b89a1ab8e3 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Refusing update from remote peer 3824bca1df8e4020b18c7989f7758391: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:32.192791 24122 consensus_queue.cc:1048] T e53f580024c14b33b72266b89a1ab8e3 P 3824bca1df8e4020b18c7989f7758391 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:32.346463 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:32.388310 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:12:32.389380 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:32.389860 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:32.425526 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:32.457751 16779 tablet_server.cc:179] TabletServer@127.16.98.193:42187 shutting down...
W20260709 12:12:32.464186 23348 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 70 similar messages]
W20260709 12:12:32.469496 23348 consensus_peers.cc:597] T e3b19b20feb045058cd1cfbd684ff05f P 48bc58ace75f40e995efc1edcefe79fa -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:32.476083 23274 consensus_peers.cc:597] T 64daa90835844e619fa313a9d91a83cc P a9d87b20401744c7bd0c491f60cf0689 -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:32.491375 16779 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:32.493286 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.494199 16779 raft_consensus.cc:2243] T 7193dd2dee9c4d1c9992ad4eff434b59 P 3824bca1df8e4020b18c7989f7758391 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:32.495090 16779 raft_consensus.cc:2272] T 7193dd2dee9c4d1c9992ad4eff434b59 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:32.497345 23200 consensus_peers.cc:597] T 162d91be31a64ad688b7b433392ed1a2 P abe65f4962e147ac841608b6c30f7e1b -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:32.498445 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.499334 16779 raft_consensus.cc:2243] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:32.499758 16779 raft_consensus.cc:2272] T 77c07af998424a59b0e3cb3d0b63579a P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.502463 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.503299 16779 raft_consensus.cc:2243] T e53f580024c14b33b72266b89a1ab8e3 P 3824bca1df8e4020b18c7989f7758391 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:32.504177 16779 raft_consensus.cc:2272] T e53f580024c14b33b72266b89a1ab8e3 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.507184 16779 tablet_replica.cc:333] stopping tablet replica
W20260709 12:12:32.507972 23348 consensus_peers.cc:597] T 85dca37fe4fc46b792220de05fc68749 P 48bc58ace75f40e995efc1edcefe79fa -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:32.508075 16779 raft_consensus.cc:2243] T da47bda397e2471388bcab5069dd7edc P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:32.508764 16779 raft_consensus.cc:2272] T da47bda397e2471388bcab5069dd7edc P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.511466 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.512230 16779 raft_consensus.cc:2243] T f55cb07c30bc42a0930276baefc1d4b7 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:32.512658 16779 raft_consensus.cc:2272] T f55cb07c30bc42a0930276baefc1d4b7 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.515096 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.515964 16779 raft_consensus.cc:2243] T 1f5cfd203dcc43d4a86864c2eaaf234c P 3824bca1df8e4020b18c7989f7758391 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:32.516713 16779 raft_consensus.cc:2272] T 1f5cfd203dcc43d4a86864c2eaaf234c P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.519572 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.520359 16779 raft_consensus.cc:2243] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:32.521229 16779 raft_consensus.cc:2272] T d8c6d6433d204aa3b5fa3a304e66dd7e P 3824bca1df8e4020b18c7989f7758391 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.523734 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.524528 16779 raft_consensus.cc:2243] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:32.525028 16779 raft_consensus.cc:2272] T 85dca37fe4fc46b792220de05fc68749 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.527732 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.528466 16779 raft_consensus.cc:2243] T 058e9aef198f48b8956a676b6f12b2e1 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:32.529011 16779 raft_consensus.cc:2272] T 058e9aef198f48b8956a676b6f12b2e1 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.531831 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.532562 16779 raft_consensus.cc:2243] T 89d4b46113284ecc9db8b0e3c2b46f89 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:32.533077 16779 raft_consensus.cc:2272] T 89d4b46113284ecc9db8b0e3c2b46f89 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.535403 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.536005 16779 raft_consensus.cc:2243] T e3b19b20feb045058cd1cfbd684ff05f P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:32.536368 16779 raft_consensus.cc:2272] T e3b19b20feb045058cd1cfbd684ff05f P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.538609 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.539343 16779 raft_consensus.cc:2243] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:32.540378 16779 raft_consensus.cc:2272] T 2954a8837137444496d21a25638b3f2a P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.542491 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.543053 16779 raft_consensus.cc:2243] T fba757d381304cc0bcbb4f9dbcfc812c P 3824bca1df8e4020b18c7989f7758391 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:32.543768 16779 raft_consensus.cc:2272] T fba757d381304cc0bcbb4f9dbcfc812c P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.548558 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.549353 16779 raft_consensus.cc:2243] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:32.549903 16779 raft_consensus.cc:2272] T 8fb0ec62373d4b39bd83ded02981c6dc P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.552676 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.553467 16779 raft_consensus.cc:2243] T 36d2201b0b3d4f07abf9c901453cda82 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:32.553874 16779 raft_consensus.cc:2272] T 36d2201b0b3d4f07abf9c901453cda82 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.556198 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.557092 16779 raft_consensus.cc:2243] T 9ffb43b95dbe424d89c123a2179445ec P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:32.557585 16779 raft_consensus.cc:2272] T 9ffb43b95dbe424d89c123a2179445ec P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.559641 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.560227 16779 raft_consensus.cc:2243] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:32.560616 16779 raft_consensus.cc:2272] T a51c8a6c6cfe460fadc0694a71805ba6 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.562551 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.563109 16779 raft_consensus.cc:2243] T 7f25493a942c4d96ad5fed839ad58386 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:32.563525 16779 raft_consensus.cc:2272] T 7f25493a942c4d96ad5fed839ad58386 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.565465 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.566124 16779 raft_consensus.cc:2243] T 98439efe5217407d95ff24969e5b4083 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:32.566552 16779 raft_consensus.cc:2272] T 98439efe5217407d95ff24969e5b4083 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.569062 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.569850 16779 raft_consensus.cc:2243] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:32.570375 23274 consensus_peers.cc:597] T d2d3a5114a7842179f9957c7f5660f7e P a9d87b20401744c7bd0c491f60cf0689 -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:32.570405 16779 raft_consensus.cc:2272] T 50bd92608bfe43d784e7596be01b388e P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.572837 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.573519 16779 raft_consensus.cc:2243] T a7d44e74deb341179f886489282ced2f P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:32.574025 16779 raft_consensus.cc:2272] T a7d44e74deb341179f886489282ced2f P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.576450 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.577023 16779 raft_consensus.cc:2243] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:32.577780 16779 raft_consensus.cc:2272] T 8ac0ace3682c4f29b9e5ecad75f783f7 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.579875 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.580446 16779 raft_consensus.cc:2243] T d12a070001934296ba81c85f9ba61e27 P 3824bca1df8e4020b18c7989f7758391 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:32.581125 16779 raft_consensus.cc:2272] T d12a070001934296ba81c85f9ba61e27 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.583081 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.583621 16779 raft_consensus.cc:2243] T 3fb3705cd5724f208798f30d9ab01bda P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:32.583988 16779 raft_consensus.cc:2272] T 3fb3705cd5724f208798f30d9ab01bda P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.585767 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.586371 16779 raft_consensus.cc:2243] T 1b4285f9faa34fc595e0b7db3f7f0946 P 3824bca1df8e4020b18c7989f7758391 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:32.587201 16779 raft_consensus.cc:2272] T 1b4285f9faa34fc595e0b7db3f7f0946 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.589366 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.589903 16779 raft_consensus.cc:2243] T c880cf7f327c4b709c29dd91c8645c18 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:32.590348 16779 raft_consensus.cc:2272] T c880cf7f327c4b709c29dd91c8645c18 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.592829 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.593569 16779 raft_consensus.cc:2243] T 72855efda9164489afb0f46a7f8da834 P 3824bca1df8e4020b18c7989f7758391 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:32.594502 16779 raft_consensus.cc:2272] T 72855efda9164489afb0f46a7f8da834 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:32.596421 23200 consensus_peers.cc:597] T 98439efe5217407d95ff24969e5b4083 P abe65f4962e147ac841608b6c30f7e1b -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:32.597198 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.597965 16779 raft_consensus.cc:2243] T 9d57b510cd3745fabb0748a6f9008fca P 3824bca1df8e4020b18c7989f7758391 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:32.598749 16779 raft_consensus.cc:2272] T 9d57b510cd3745fabb0748a6f9008fca P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.601161 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.601688 16779 raft_consensus.cc:2243] T c113311e527c47578f8c136d335aa87f P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:32.602039 16779 raft_consensus.cc:2272] T c113311e527c47578f8c136d335aa87f P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.603950 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.604470 16779 raft_consensus.cc:2243] T 5002a306b4474c909091a65333c74939 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:32.604867 16779 raft_consensus.cc:2272] T 5002a306b4474c909091a65333c74939 P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.606690 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.607319 16779 raft_consensus.cc:2243] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:32.607749 16779 raft_consensus.cc:2272] T 162d91be31a64ad688b7b433392ed1a2 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.609916 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.610594 16779 raft_consensus.cc:2243] T 9aa8c90489d54dc6b2684d1970165a8a P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:32.611070 16779 raft_consensus.cc:2272] T 9aa8c90489d54dc6b2684d1970165a8a P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.613597 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.614140 16779 raft_consensus.cc:2243] T 11b1c6ca5b8b4d61a6e200744c543ede P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:32.614602 16779 raft_consensus.cc:2272] T 11b1c6ca5b8b4d61a6e200744c543ede P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.616655 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.617338 16779 raft_consensus.cc:2243] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:32.617869 16779 raft_consensus.cc:2272] T d8c320c6212b4bb187e8d32cb79479a8 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:32.620267 23200 consensus_peers.cc:597] T a51c8a6c6cfe460fadc0694a71805ba6 P abe65f4962e147ac841608b6c30f7e1b -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:32.620306 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.621214 16779 raft_consensus.cc:2243] T 6c03bbe73aee42039c1f868590838eaf P 3824bca1df8e4020b18c7989f7758391 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:12:32.621821 23200 consensus_peers.cc:597] T da47bda397e2471388bcab5069dd7edc P abe65f4962e147ac841608b6c30f7e1b -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:32.622048 16779 raft_consensus.cc:2272] T 6c03bbe73aee42039c1f868590838eaf P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.624392 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.625059 16779 raft_consensus.cc:2243] T 6b891c5848b248d8a1830e801c7dce9a P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:32.625479 16779 raft_consensus.cc:2272] T 6b891c5848b248d8a1830e801c7dce9a P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.627933 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.628548 16779 raft_consensus.cc:2243] T 5d0efec949fc4455838db7fb01259d69 P 3824bca1df8e4020b18c7989f7758391 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:32.629272 16779 raft_consensus.cc:2272] T 5d0efec949fc4455838db7fb01259d69 P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.631726 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.632382 16779 raft_consensus.cc:2243] T bda09a1e5c59409c96c419b65061c1dc P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:32.632742 16779 raft_consensus.cc:2272] T bda09a1e5c59409c96c419b65061c1dc P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.634716 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.635183 16779 raft_consensus.cc:2243] T 541dc3e21d4e461b8c299d0186a42e7f P 3824bca1df8e4020b18c7989f7758391 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:32.635917 16779 raft_consensus.cc:2272] T 541dc3e21d4e461b8c299d0186a42e7f P 3824bca1df8e4020b18c7989f7758391 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.638152 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.638698 16779 raft_consensus.cc:2243] T 64daa90835844e619fa313a9d91a83cc P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:32.639070 16779 raft_consensus.cc:2272] T 64daa90835844e619fa313a9d91a83cc P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.641274 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.641813 16779 raft_consensus.cc:2243] T 2693b48366d0430b9db7d8cc90d9667c P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:32.642252 16779 raft_consensus.cc:2272] T 2693b48366d0430b9db7d8cc90d9667c P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:32.642542 23274 consensus_peers.cc:597] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:32.644783 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.645331 16779 raft_consensus.cc:2243] T 3243e85ef0e741d696af414124ca96bd P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:32.645699 16779 raft_consensus.cc:2272] T 3243e85ef0e741d696af414124ca96bd P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:32.651871 23274 consensus_peers.cc:597] T 11b1c6ca5b8b4d61a6e200744c543ede P a9d87b20401744c7bd0c491f60cf0689 -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:32.673362 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.676301 16779 raft_consensus.cc:2243] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:32.684376 16779 raft_consensus.cc:2272] T d2d3a5114a7842179f9957c7f5660f7e P 3824bca1df8e4020b18c7989f7758391 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.698745 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:32.700258 16779 raft_consensus.cc:2243] T d53aaedd982440259b3ef5d84cddcbed P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:32.701637 16779 raft_consensus.cc:2272] T d53aaedd982440259b3ef5d84cddcbed P 3824bca1df8e4020b18c7989f7758391 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:32.707172 16779 tablet_replica.cc:333] stopping tablet replica
W20260709 12:12:32.707640 23348 consensus_peers.cc:597] T 9ffb43b95dbe424d89c123a2179445ec P 48bc58ace75f40e995efc1edcefe79fa -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:32.708140 16779 raft_consensus.cc:2243] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [term 4 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:32.708449 23348 consensus_peers.cc:597] T 9aa8c90489d54dc6b2684d1970165a8a P 48bc58ace75f40e995efc1edcefe79fa -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:32.709358 16779 raft_consensus.cc:2272] T 923f193f1d2d4e61ae30850183122635 P 3824bca1df8e4020b18c7989f7758391 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:32.712247 23200 consensus_peers.cc:597] T f55cb07c30bc42a0930276baefc1d4b7 P abe65f4962e147ac841608b6c30f7e1b -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:32.750361 23348 consensus_peers.cc:597] T bda09a1e5c59409c96c419b65061c1dc P 48bc58ace75f40e995efc1edcefe79fa -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:32.752950 23274 consensus_peers.cc:597] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689 -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:32.754483 23274 consensus_peers.cc:597] T 6b891c5848b248d8a1830e801c7dce9a P a9d87b20401744c7bd0c491f60cf0689 -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:32.762403 23200 consensus_peers.cc:597] T c113311e527c47578f8c136d335aa87f P abe65f4962e147ac841608b6c30f7e1b -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:32.767417 23200 consensus_peers.cc:597] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:32.799640 23200 consensus_peers.cc:597] T 7f25493a942c4d96ad5fed839ad58386 P abe65f4962e147ac841608b6c30f7e1b -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:32.799898 23274 consensus_peers.cc:597] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689 -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:32.801666 23274 consensus_peers.cc:597] T 89d4b46113284ecc9db8b0e3c2b46f89 P a9d87b20401744c7bd0c491f60cf0689 -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:32.825165 23274 consensus_peers.cc:597] T c880cf7f327c4b709c29dd91c8645c18 P a9d87b20401744c7bd0c491f60cf0689 -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:32.834255 23200 consensus_peers.cc:597] T 36d2201b0b3d4f07abf9c901453cda82 P abe65f4962e147ac841608b6c30f7e1b -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:32.862272 23274 consensus_peers.cc:597] T 3fb3705cd5724f208798f30d9ab01bda P a9d87b20401744c7bd0c491f60cf0689 -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:42187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:32.864751 16779 tablet_server.cc:196] TabletServer@127.16.98.193:42187 shutdown complete.
W20260709 12:12:32.895974 23348 consensus_peers.cc:597] T a7d44e74deb341179f886489282ced2f P 48bc58ace75f40e995efc1edcefe79fa -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:42187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:32.898447 23200 consensus_peers.cc:597] T d53aaedd982440259b3ef5d84cddcbed P abe65f4962e147ac841608b6c30f7e1b -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:42187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:32.903366 23274 consensus_peers.cc:597] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689 -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:42187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:32.906124 23274 consensus_peers.cc:597] T 3243e85ef0e741d696af414124ca96bd P a9d87b20401744c7bd0c491f60cf0689 -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:42187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:32.913687 23348 consensus_peers.cc:597] T 5002a306b4474c909091a65333c74939 P 48bc58ace75f40e995efc1edcefe79fa -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:42187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:32.921583 23200 consensus_peers.cc:597] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:42187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:32.993562 16779 tablet_server.cc:179] TabletServer@127.16.98.194:0 shutting down...
W20260709 12:12:33.003517 23350 consensus_peers.cc:597] T b4c15adbbcbc4dbb9162ef9af4e14477 P 48bc58ace75f40e995efc1edcefe79fa -> Peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Couldn't send request to peer abe65f4962e147ac841608b6c30f7e1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:33.007774 23276 consensus_peers.cc:597] T 6b891c5848b248d8a1830e801c7dce9a P a9d87b20401744c7bd0c491f60cf0689 -> Peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Couldn't send request to peer abe65f4962e147ac841608b6c30f7e1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:33.022246 23350 consensus_peers.cc:597] T af6b6c7f82544d968d77f359f1a34403 P 48bc58ace75f40e995efc1edcefe79fa -> Peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Couldn't send request to peer abe65f4962e147ac841608b6c30f7e1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:33.035296 23276 consensus_peers.cc:597] T c880cf7f327c4b709c29dd91c8645c18 P a9d87b20401744c7bd0c491f60cf0689 -> Peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Couldn't send request to peer abe65f4962e147ac841608b6c30f7e1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:33.048838 23274 consensus_peers.cc:597] T 2693b48366d0430b9db7d8cc90d9667c P a9d87b20401744c7bd0c491f60cf0689 -> Peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Couldn't send request to peer 3824bca1df8e4020b18c7989f7758391. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:42187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:33.058000 16779 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:33.059017 16779 tablet_replica.cc:333] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.060212 16779 raft_consensus.cc:2243] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.061029 16779 raft_consensus.cc:2272] T d8c6d6433d204aa3b5fa3a304e66dd7e P abe65f4962e147ac841608b6c30f7e1b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.063864 16779 tablet_replica.cc:333] T 4bffc92cd6c84709bd0335a988eeef96 P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.064543 16779 raft_consensus.cc:2243] T 4bffc92cd6c84709bd0335a988eeef96 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:33.064585 23350 consensus_peers.cc:597] T b0348215bfbf4d0bb5ffd2ddc86a4279 P 48bc58ace75f40e995efc1edcefe79fa -> Peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Couldn't send request to peer abe65f4962e147ac841608b6c30f7e1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:33.065088 16779 raft_consensus.cc:2272] T 4bffc92cd6c84709bd0335a988eeef96 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.067446 16779 tablet_replica.cc:333] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.068112 16779 raft_consensus.cc:2243] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.069029 16779 raft_consensus.cc:2272] T 058e9aef198f48b8956a676b6f12b2e1 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.071727 16779 tablet_replica.cc:333] T ae5efc2770bb4bc7a09585a220a45131 P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.072395 16779 raft_consensus.cc:2243] T ae5efc2770bb4bc7a09585a220a45131 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.072979 16779 raft_consensus.cc:2272] T ae5efc2770bb4bc7a09585a220a45131 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.075294 16779 tablet_replica.cc:333] T 36d2201b0b3d4f07abf9c901453cda82 P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.075903 16779 raft_consensus.cc:2243] T 36d2201b0b3d4f07abf9c901453cda82 P abe65f4962e147ac841608b6c30f7e1b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.076810 16779 raft_consensus.cc:2272] T 36d2201b0b3d4f07abf9c901453cda82 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.079916 16779 tablet_replica.cc:333] T 72855efda9164489afb0f46a7f8da834 P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.080969 16779 raft_consensus.cc:2243] T 72855efda9164489afb0f46a7f8da834 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.081753 16779 raft_consensus.cc:2272] T 72855efda9164489afb0f46a7f8da834 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.084870 16779 tablet_replica.cc:333] T b71f710147be434e8d790a50e145def8 P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.085721 16779 raft_consensus.cc:2243] T b71f710147be434e8d790a50e145def8 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.086326 16779 raft_consensus.cc:2272] T b71f710147be434e8d790a50e145def8 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.089092 16779 tablet_replica.cc:333] T 6b891c5848b248d8a1830e801c7dce9a P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.089815 16779 raft_consensus.cc:2243] T 6b891c5848b248d8a1830e801c7dce9a P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.090466 16779 raft_consensus.cc:2272] T 6b891c5848b248d8a1830e801c7dce9a P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.093664 16779 tablet_replica.cc:333] T 6c03bbe73aee42039c1f868590838eaf P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.094504 16779 raft_consensus.cc:2243] T 6c03bbe73aee42039c1f868590838eaf P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.095156 16779 raft_consensus.cc:2272] T 6c03bbe73aee42039c1f868590838eaf P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.097903 16779 tablet_replica.cc:333] T 50bd92608bfe43d784e7596be01b388e P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.098690 16779 raft_consensus.cc:2243] T 50bd92608bfe43d784e7596be01b388e P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.099345 16779 raft_consensus.cc:2272] T 50bd92608bfe43d784e7596be01b388e P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:33.100890 23350 consensus_peers.cc:597] T b71f710147be434e8d790a50e145def8 P 48bc58ace75f40e995efc1edcefe79fa -> Peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Couldn't send request to peer abe65f4962e147ac841608b6c30f7e1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:33.102295 16779 tablet_replica.cc:333] T cd128874f9674cb7802ec50ad0b65026 P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.103366 16779 raft_consensus.cc:2243] T cd128874f9674cb7802ec50ad0b65026 P abe65f4962e147ac841608b6c30f7e1b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.104538 16779 raft_consensus.cc:2272] T cd128874f9674cb7802ec50ad0b65026 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.107365 16779 tablet_replica.cc:333] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.108225 16779 raft_consensus.cc:2243] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.109458 16779 raft_consensus.cc:2272] T 77c07af998424a59b0e3cb3d0b63579a P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.112320 16779 tablet_replica.cc:333] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.112987 16779 raft_consensus.cc:2243] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.113618 16779 raft_consensus.cc:2272] T 7db21ddd040d409a9154cbe649864397 P abe65f4962e147ac841608b6c30f7e1b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.116621 16779 tablet_replica.cc:333] T 9ffb43b95dbe424d89c123a2179445ec P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.117211 16779 raft_consensus.cc:2243] T 9ffb43b95dbe424d89c123a2179445ec P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.117870 16779 raft_consensus.cc:2272] T 9ffb43b95dbe424d89c123a2179445ec P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.120796 16779 tablet_replica.cc:333] T a51c8a6c6cfe460fadc0694a71805ba6 P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.121526 16779 raft_consensus.cc:2243] T a51c8a6c6cfe460fadc0694a71805ba6 P abe65f4962e147ac841608b6c30f7e1b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.122907 16779 raft_consensus.cc:2272] T a51c8a6c6cfe460fadc0694a71805ba6 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:33.123308 23276 consensus_peers.cc:597] T 89d4b46113284ecc9db8b0e3c2b46f89 P a9d87b20401744c7bd0c491f60cf0689 -> Peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Couldn't send request to peer abe65f4962e147ac841608b6c30f7e1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:33.125883 16779 tablet_replica.cc:333] T c113311e527c47578f8c136d335aa87f P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.126785 16779 raft_consensus.cc:2243] T c113311e527c47578f8c136d335aa87f P abe65f4962e147ac841608b6c30f7e1b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.127858 16779 raft_consensus.cc:2272] T c113311e527c47578f8c136d335aa87f P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.130004 16779 tablet_replica.cc:333] T 162d91be31a64ad688b7b433392ed1a2 P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.130577 16779 raft_consensus.cc:2243] T 162d91be31a64ad688b7b433392ed1a2 P abe65f4962e147ac841608b6c30f7e1b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.131706 16779 raft_consensus.cc:2272] T 162d91be31a64ad688b7b433392ed1a2 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.133709 16779 tablet_replica.cc:333] T 07201eb1b13e4b54af9c1c18752a9edf P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.134266 16779 raft_consensus.cc:2243] T 07201eb1b13e4b54af9c1c18752a9edf P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.134743 16779 raft_consensus.cc:2272] T 07201eb1b13e4b54af9c1c18752a9edf P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.136989 16779 tablet_replica.cc:333] T c880cf7f327c4b709c29dd91c8645c18 P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.137809 16779 raft_consensus.cc:2243] T c880cf7f327c4b709c29dd91c8645c18 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.138378 16779 raft_consensus.cc:2272] T c880cf7f327c4b709c29dd91c8645c18 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.141382 16779 tablet_replica.cc:333] T e53f580024c14b33b72266b89a1ab8e3 P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.142102 16779 raft_consensus.cc:2243] T e53f580024c14b33b72266b89a1ab8e3 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.142791 16779 raft_consensus.cc:2272] T e53f580024c14b33b72266b89a1ab8e3 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:33.143078 23276 consensus_peers.cc:597] T 64daa90835844e619fa313a9d91a83cc P a9d87b20401744c7bd0c491f60cf0689 -> Peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Couldn't send request to peer abe65f4962e147ac841608b6c30f7e1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:33.145884 16779 tablet_replica.cc:333] T af6b6c7f82544d968d77f359f1a34403 P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.146488 16779 raft_consensus.cc:2243] T af6b6c7f82544d968d77f359f1a34403 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.147109 16779 raft_consensus.cc:2272] T af6b6c7f82544d968d77f359f1a34403 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.149956 16779 tablet_replica.cc:333] T 024ae14c007f4c469b22ad43f153b12e P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.150599 16779 raft_consensus.cc:2243] T 024ae14c007f4c469b22ad43f153b12e P abe65f4962e147ac841608b6c30f7e1b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.151718 16779 raft_consensus.cc:2272] T 024ae14c007f4c469b22ad43f153b12e P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:33.153457 23350 consensus_peers.cc:597] T 4bffc92cd6c84709bd0335a988eeef96 P 48bc58ace75f40e995efc1edcefe79fa -> Peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Couldn't send request to peer abe65f4962e147ac841608b6c30f7e1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:33.154783 16779 tablet_replica.cc:333] T f55cb07c30bc42a0930276baefc1d4b7 P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.155462 16779 raft_consensus.cc:2243] T f55cb07c30bc42a0930276baefc1d4b7 P abe65f4962e147ac841608b6c30f7e1b [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:12:33.155524 23276 consensus_peers.cc:597] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689 -> Peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Couldn't send request to peer abe65f4962e147ac841608b6c30f7e1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:33.156531 16779 raft_consensus.cc:2272] T f55cb07c30bc42a0930276baefc1d4b7 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.159304 16779 tablet_replica.cc:333] T da47bda397e2471388bcab5069dd7edc P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.159893 16779 raft_consensus.cc:2243] T da47bda397e2471388bcab5069dd7edc P abe65f4962e147ac841608b6c30f7e1b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.160737 16779 raft_consensus.cc:2272] T da47bda397e2471388bcab5069dd7edc P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.162976 16779 tablet_replica.cc:333] T 1f5cfd203dcc43d4a86864c2eaaf234c P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.163564 16779 raft_consensus.cc:2243] T 1f5cfd203dcc43d4a86864c2eaaf234c P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.164077 16779 raft_consensus.cc:2272] T 1f5cfd203dcc43d4a86864c2eaaf234c P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.166167 16779 tablet_replica.cc:333] T d12a070001934296ba81c85f9ba61e27 P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.166823 16779 raft_consensus.cc:2243] T d12a070001934296ba81c85f9ba61e27 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.167305 16779 raft_consensus.cc:2272] T d12a070001934296ba81c85f9ba61e27 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.169291 16779 tablet_replica.cc:333] T ec1028a2affb45679aede72149f857f5 P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.169811 16779 raft_consensus.cc:2243] T ec1028a2affb45679aede72149f857f5 P abe65f4962e147ac841608b6c30f7e1b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.170637 16779 raft_consensus.cc:2272] T ec1028a2affb45679aede72149f857f5 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.172684 16779 tablet_replica.cc:333] T d2d3a5114a7842179f9957c7f5660f7e P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.173399 16779 raft_consensus.cc:2243] T d2d3a5114a7842179f9957c7f5660f7e P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.173923 16779 raft_consensus.cc:2272] T d2d3a5114a7842179f9957c7f5660f7e P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.175941 16779 tablet_replica.cc:333] T 3243e85ef0e741d696af414124ca96bd P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.176513 16779 raft_consensus.cc:2243] T 3243e85ef0e741d696af414124ca96bd P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.176944 16779 raft_consensus.cc:2272] T 3243e85ef0e741d696af414124ca96bd P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.179540 16779 tablet_replica.cc:333] T 2954a8837137444496d21a25638b3f2a P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.180173 16779 raft_consensus.cc:2243] T 2954a8837137444496d21a25638b3f2a P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.180907 16779 raft_consensus.cc:2272] T 2954a8837137444496d21a25638b3f2a P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.183530 16779 tablet_replica.cc:333] T 89d4b46113284ecc9db8b0e3c2b46f89 P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.184166 16779 raft_consensus.cc:2243] T 89d4b46113284ecc9db8b0e3c2b46f89 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.184558 16779 raft_consensus.cc:2272] T 89d4b46113284ecc9db8b0e3c2b46f89 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.186762 16779 tablet_replica.cc:333] T 2d308deadcb9416c9b0b16ef4891e6eb P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.187283 16779 raft_consensus.cc:2243] T 2d308deadcb9416c9b0b16ef4891e6eb P abe65f4962e147ac841608b6c30f7e1b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.188185 16779 raft_consensus.cc:2272] T 2d308deadcb9416c9b0b16ef4891e6eb P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:33.188335 23276 consensus_peers.cc:597] T 07201eb1b13e4b54af9c1c18752a9edf P a9d87b20401744c7bd0c491f60cf0689 -> Peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Couldn't send request to peer abe65f4962e147ac841608b6c30f7e1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:33.190117 16779 tablet_replica.cc:333] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.190960 16779 raft_consensus.cc:2243] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.191507 16779 raft_consensus.cc:2272] T 9be6b80356b0415ba28a56482e13d24f P abe65f4962e147ac841608b6c30f7e1b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.193338 16779 tablet_replica.cc:333] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.193843 16779 raft_consensus.cc:2243] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.194310 16779 raft_consensus.cc:2272] T 5d0efec949fc4455838db7fb01259d69 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.196347 16779 tablet_replica.cc:333] T 98439efe5217407d95ff24969e5b4083 P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.196894 16779 raft_consensus.cc:2243] T 98439efe5217407d95ff24969e5b4083 P abe65f4962e147ac841608b6c30f7e1b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.197978 16779 raft_consensus.cc:2272] T 98439efe5217407d95ff24969e5b4083 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.201004 16779 tablet_replica.cc:333] T 7f25493a942c4d96ad5fed839ad58386 P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.201691 16779 raft_consensus.cc:2243] T 7f25493a942c4d96ad5fed839ad58386 P abe65f4962e147ac841608b6c30f7e1b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.202498 16779 raft_consensus.cc:2272] T 7f25493a942c4d96ad5fed839ad58386 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.205049 16779 tablet_replica.cc:333] T b4c15adbbcbc4dbb9162ef9af4e14477 P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.205761 16779 raft_consensus.cc:2243] T b4c15adbbcbc4dbb9162ef9af4e14477 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.206283 16779 raft_consensus.cc:2272] T b4c15adbbcbc4dbb9162ef9af4e14477 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.209127 16779 tablet_replica.cc:333] T 7193dd2dee9c4d1c9992ad4eff434b59 P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.209934 16779 raft_consensus.cc:2243] T 7193dd2dee9c4d1c9992ad4eff434b59 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.210608 16779 raft_consensus.cc:2272] T 7193dd2dee9c4d1c9992ad4eff434b59 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.213192 16779 tablet_replica.cc:333] T 1a2d000d8737420cbb2ee80189092814 P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.213752 16779 raft_consensus.cc:2243] T 1a2d000d8737420cbb2ee80189092814 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.214233 16779 raft_consensus.cc:2272] T 1a2d000d8737420cbb2ee80189092814 P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:33.214579 23350 consensus_peers.cc:597] T 9ffb43b95dbe424d89c123a2179445ec P 48bc58ace75f40e995efc1edcefe79fa -> Peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Couldn't send request to peer abe65f4962e147ac841608b6c30f7e1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:33.216286 16779 tablet_replica.cc:333] T b0348215bfbf4d0bb5ffd2ddc86a4279 P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.216902 16779 raft_consensus.cc:2243] T b0348215bfbf4d0bb5ffd2ddc86a4279 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.217344 16779 raft_consensus.cc:2272] T b0348215bfbf4d0bb5ffd2ddc86a4279 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.219169 16779 tablet_replica.cc:333] T d53aaedd982440259b3ef5d84cddcbed P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.219658 16779 raft_consensus.cc:2243] T d53aaedd982440259b3ef5d84cddcbed P abe65f4962e147ac841608b6c30f7e1b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.220489 16779 raft_consensus.cc:2272] T d53aaedd982440259b3ef5d84cddcbed P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.222347 16779 tablet_replica.cc:333] T 8ac0ace3682c4f29b9e5ecad75f783f7 P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.222934 16779 raft_consensus.cc:2243] T 8ac0ace3682c4f29b9e5ecad75f783f7 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.223349 16779 raft_consensus.cc:2272] T 8ac0ace3682c4f29b9e5ecad75f783f7 P abe65f4962e147ac841608b6c30f7e1b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.226256 16779 tablet_replica.cc:333] T 64daa90835844e619fa313a9d91a83cc P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.226950 16779 raft_consensus.cc:2243] T 64daa90835844e619fa313a9d91a83cc P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.227455 16779 raft_consensus.cc:2272] T 64daa90835844e619fa313a9d91a83cc P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:33.228248 23350 consensus_peers.cc:597] T ae5efc2770bb4bc7a09585a220a45131 P 48bc58ace75f40e995efc1edcefe79fa -> Peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Couldn't send request to peer abe65f4962e147ac841608b6c30f7e1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:33.230013 16779 tablet_replica.cc:333] T 2693b48366d0430b9db7d8cc90d9667c P abe65f4962e147ac841608b6c30f7e1b: stopping tablet replica
I20260709 12:12:33.230820 16779 raft_consensus.cc:2243] T 2693b48366d0430b9db7d8cc90d9667c P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.231361 16779 raft_consensus.cc:2272] T 2693b48366d0430b9db7d8cc90d9667c P abe65f4962e147ac841608b6c30f7e1b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:33.264586 23276 consensus_peers.cc:597] T 3243e85ef0e741d696af414124ca96bd P a9d87b20401744c7bd0c491f60cf0689 -> Peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Couldn't send request to peer abe65f4962e147ac841608b6c30f7e1b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:33.325372 16779 tablet_server.cc:196] TabletServer@127.16.98.194:0 shutdown complete.
W20260709 12:12:33.374169 23276 consensus_peers.cc:597] T 1a2d000d8737420cbb2ee80189092814 P a9d87b20401744c7bd0c491f60cf0689 -> Peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Couldn't send request to peer abe65f4962e147ac841608b6c30f7e1b. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.194:41907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:33.379936 23350 consensus_peers.cc:597] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa -> Peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Couldn't send request to peer abe65f4962e147ac841608b6c30f7e1b. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.194:41907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:33.387215 23276 consensus_peers.cc:597] T d2d3a5114a7842179f9957c7f5660f7e P a9d87b20401744c7bd0c491f60cf0689 -> Peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Couldn't send request to peer abe65f4962e147ac841608b6c30f7e1b. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.194:41907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:33.419581 16779 tablet_server.cc:179] TabletServer@127.16.98.195:0 shutting down...
I20260709 12:12:33.467192 16779 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:33.467970 16779 tablet_replica.cc:333] T 4bffc92cd6c84709bd0335a988eeef96 P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.468755 16779 raft_consensus.cc:2243] T 4bffc92cd6c84709bd0335a988eeef96 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.469225 16779 raft_consensus.cc:2272] T 4bffc92cd6c84709bd0335a988eeef96 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.471436 16779 tablet_replica.cc:333] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.472002 16779 raft_consensus.cc:2243] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.472767 16779 raft_consensus.cc:2272] T 8fb0ec62373d4b39bd83ded02981c6dc P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.474711 16779 tablet_replica.cc:333] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.475270 16779 raft_consensus.cc:2243] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.475708 16779 raft_consensus.cc:2272] T 72855efda9164489afb0f46a7f8da834 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.477502 16779 tablet_replica.cc:333] T d8c6d6433d204aa3b5fa3a304e66dd7e P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.478328 16779 raft_consensus.cc:2243] T d8c6d6433d204aa3b5fa3a304e66dd7e P a9d87b20401744c7bd0c491f60cf0689 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.478897 16779 raft_consensus.cc:2272] T d8c6d6433d204aa3b5fa3a304e66dd7e P a9d87b20401744c7bd0c491f60cf0689 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.480820 16779 tablet_replica.cc:333] T 85dca37fe4fc46b792220de05fc68749 P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.481352 16779 raft_consensus.cc:2243] T 85dca37fe4fc46b792220de05fc68749 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.481753 16779 raft_consensus.cc:2272] T 85dca37fe4fc46b792220de05fc68749 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.483530 16779 tablet_replica.cc:333] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.484069 16779 raft_consensus.cc:2243] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.484851 16779 raft_consensus.cc:2272] T d8c320c6212b4bb187e8d32cb79479a8 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.486768 16779 tablet_replica.cc:333] T b0348215bfbf4d0bb5ffd2ddc86a4279 P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.487689 16779 raft_consensus.cc:2243] T b0348215bfbf4d0bb5ffd2ddc86a4279 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.488168 16779 raft_consensus.cc:2272] T b0348215bfbf4d0bb5ffd2ddc86a4279 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.490473 16779 tablet_replica.cc:333] T b71f710147be434e8d790a50e145def8 P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.491056 16779 raft_consensus.cc:2243] T b71f710147be434e8d790a50e145def8 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.491436 16779 raft_consensus.cc:2272] T b71f710147be434e8d790a50e145def8 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.493181 16779 tablet_replica.cc:333] T ae5efc2770bb4bc7a09585a220a45131 P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.493671 16779 raft_consensus.cc:2243] T ae5efc2770bb4bc7a09585a220a45131 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.494053 16779 raft_consensus.cc:2272] T ae5efc2770bb4bc7a09585a220a45131 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.495818 16779 tablet_replica.cc:333] T fba757d381304cc0bcbb4f9dbcfc812c P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.496315 16779 raft_consensus.cc:2243] T fba757d381304cc0bcbb4f9dbcfc812c P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.496672 16779 raft_consensus.cc:2272] T fba757d381304cc0bcbb4f9dbcfc812c P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.498548 16779 tablet_replica.cc:333] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.499084 16779 raft_consensus.cc:2243] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.499830 16779 raft_consensus.cc:2272] T 50bd92608bfe43d784e7596be01b388e P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.501574 16779 tablet_replica.cc:333] T cd128874f9674cb7802ec50ad0b65026 P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.502045 16779 raft_consensus.cc:2243] T cd128874f9674cb7802ec50ad0b65026 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.502564 16779 raft_consensus.cc:2272] T cd128874f9674cb7802ec50ad0b65026 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.505049 16779 tablet_replica.cc:333] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.505616 16779 raft_consensus.cc:2243] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.506134 16779 raft_consensus.cc:2272] T 541dc3e21d4e461b8c299d0186a42e7f P a9d87b20401744c7bd0c491f60cf0689 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:33.506681 23276 consensus_peers.cc:597] T 2693b48366d0430b9db7d8cc90d9667c P a9d87b20401744c7bd0c491f60cf0689 -> Peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Couldn't send request to peer abe65f4962e147ac841608b6c30f7e1b. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.194:41907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:33.508100 16779 tablet_replica.cc:333] T bda09a1e5c59409c96c419b65061c1dc P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.508715 16779 raft_consensus.cc:2243] T bda09a1e5c59409c96c419b65061c1dc P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.509111 16779 raft_consensus.cc:2272] T bda09a1e5c59409c96c419b65061c1dc P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.510916 16779 tablet_replica.cc:333] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.511453 16779 raft_consensus.cc:2243] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.511953 16779 raft_consensus.cc:2272] T 7db21ddd040d409a9154cbe649864397 P a9d87b20401744c7bd0c491f60cf0689 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.514200 16779 tablet_replica.cc:333] T 6b891c5848b248d8a1830e801c7dce9a P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.514954 16779 raft_consensus.cc:2243] T 6b891c5848b248d8a1830e801c7dce9a P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:12:33.515175 23349 consensus_peers.cc:597] T b71f710147be434e8d790a50e145def8 P 48bc58ace75f40e995efc1edcefe79fa -> Peer a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253): Couldn't send request to peer a9d87b20401744c7bd0c491f60cf0689. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:33.515723 16779 raft_consensus.cc:2272] T 6b891c5848b248d8a1830e801c7dce9a P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.517727 16779 tablet_replica.cc:333] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.518301 16779 raft_consensus.cc:2243] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.518862 16779 raft_consensus.cc:2272] T 6c03bbe73aee42039c1f868590838eaf P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:33.520834 23350 consensus_peers.cc:597] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa -> Peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Couldn't send request to peer abe65f4962e147ac841608b6c30f7e1b. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.194:41907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:33.521281 16779 tablet_replica.cc:333] T 89d4b46113284ecc9db8b0e3c2b46f89 P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.521852 16779 raft_consensus.cc:2243] T 89d4b46113284ecc9db8b0e3c2b46f89 P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.522553 16779 raft_consensus.cc:2272] T 89d4b46113284ecc9db8b0e3c2b46f89 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.524478 16779 tablet_replica.cc:333] T e3b19b20feb045058cd1cfbd684ff05f P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.525007 16779 raft_consensus.cc:2243] T e3b19b20feb045058cd1cfbd684ff05f P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.525359 16779 raft_consensus.cc:2272] T e3b19b20feb045058cd1cfbd684ff05f P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.527371 16779 tablet_replica.cc:333] T a51c8a6c6cfe460fadc0694a71805ba6 P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.528014 16779 raft_consensus.cc:2243] T a51c8a6c6cfe460fadc0694a71805ba6 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.528399 16779 raft_consensus.cc:2272] T a51c8a6c6cfe460fadc0694a71805ba6 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.530855 16779 tablet_replica.cc:333] T ec1028a2affb45679aede72149f857f5 P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.531539 16779 raft_consensus.cc:2243] T ec1028a2affb45679aede72149f857f5 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.532069 16779 raft_consensus.cc:2272] T ec1028a2affb45679aede72149f857f5 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.534832 16779 tablet_replica.cc:333] T 3fb3705cd5724f208798f30d9ab01bda P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.535568 16779 raft_consensus.cc:2243] T 3fb3705cd5724f208798f30d9ab01bda P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.536495 16779 raft_consensus.cc:2272] T 3fb3705cd5724f208798f30d9ab01bda P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.539314 16779 tablet_replica.cc:333] T 1b4285f9faa34fc595e0b7db3f7f0946 P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.539819 16779 raft_consensus.cc:2243] T 1b4285f9faa34fc595e0b7db3f7f0946 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.540361 16779 raft_consensus.cc:2272] T 1b4285f9faa34fc595e0b7db3f7f0946 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.542526 16779 tablet_replica.cc:333] T 024ae14c007f4c469b22ad43f153b12e P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.543128 16779 raft_consensus.cc:2243] T 024ae14c007f4c469b22ad43f153b12e P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.543551 16779 raft_consensus.cc:2272] T 024ae14c007f4c469b22ad43f153b12e P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.545379 16779 tablet_replica.cc:333] T af6b6c7f82544d968d77f359f1a34403 P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.545894 16779 raft_consensus.cc:2243] T af6b6c7f82544d968d77f359f1a34403 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.546299 16779 raft_consensus.cc:2272] T af6b6c7f82544d968d77f359f1a34403 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.547976 16779 tablet_replica.cc:333] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.548483 16779 raft_consensus.cc:2243] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.549211 16779 raft_consensus.cc:2272] T 923f193f1d2d4e61ae30850183122635 P a9d87b20401744c7bd0c491f60cf0689 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.551067 16779 tablet_replica.cc:333] T b4c15adbbcbc4dbb9162ef9af4e14477 P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.551607 16779 raft_consensus.cc:2243] T b4c15adbbcbc4dbb9162ef9af4e14477 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.552014 16779 raft_consensus.cc:2272] T b4c15adbbcbc4dbb9162ef9af4e14477 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.553812 16779 tablet_replica.cc:333] T a7d44e74deb341179f886489282ced2f P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.554293 16779 raft_consensus.cc:2243] T a7d44e74deb341179f886489282ced2f P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.554730 16779 raft_consensus.cc:2272] T a7d44e74deb341179f886489282ced2f P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.556519 16779 tablet_replica.cc:333] T 8ac0ace3682c4f29b9e5ecad75f783f7 P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.557015 16779 raft_consensus.cc:2243] T 8ac0ace3682c4f29b9e5ecad75f783f7 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.557569 16779 raft_consensus.cc:2272] T 8ac0ace3682c4f29b9e5ecad75f783f7 P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.559741 16779 tablet_replica.cc:333] T 64daa90835844e619fa313a9d91a83cc P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.560276 16779 raft_consensus.cc:2243] T 64daa90835844e619fa313a9d91a83cc P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.561025 16779 raft_consensus.cc:2272] T 64daa90835844e619fa313a9d91a83cc P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.562932 16779 tablet_replica.cc:333] T 2693b48366d0430b9db7d8cc90d9667c P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.563519 16779 raft_consensus.cc:2243] T 2693b48366d0430b9db7d8cc90d9667c P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.564397 16779 raft_consensus.cc:2272] T 2693b48366d0430b9db7d8cc90d9667c P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.566573 16779 tablet_replica.cc:333] T 2d308deadcb9416c9b0b16ef4891e6eb P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
W20260709 12:12:33.566597 23349 consensus_peers.cc:597] T 5002a306b4474c909091a65333c74939 P 48bc58ace75f40e995efc1edcefe79fa -> Peer a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253): Couldn't send request to peer a9d87b20401744c7bd0c491f60cf0689. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:33.567303 16779 raft_consensus.cc:2243] T 2d308deadcb9416c9b0b16ef4891e6eb P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.567776 16779 raft_consensus.cc:2272] T 2d308deadcb9416c9b0b16ef4891e6eb P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.569664 16779 tablet_replica.cc:333] T 07201eb1b13e4b54af9c1c18752a9edf P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.570204 16779 raft_consensus.cc:2243] T 07201eb1b13e4b54af9c1c18752a9edf P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.571048 16779 raft_consensus.cc:2272] T 07201eb1b13e4b54af9c1c18752a9edf P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.572842 16779 tablet_replica.cc:333] T c880cf7f327c4b709c29dd91c8645c18 P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.573338 16779 raft_consensus.cc:2243] T c880cf7f327c4b709c29dd91c8645c18 P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.574031 16779 raft_consensus.cc:2272] T c880cf7f327c4b709c29dd91c8645c18 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.575773 16779 tablet_replica.cc:333] T 9aa8c90489d54dc6b2684d1970165a8a P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.576264 16779 raft_consensus.cc:2243] T 9aa8c90489d54dc6b2684d1970165a8a P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.576670 16779 raft_consensus.cc:2272] T 9aa8c90489d54dc6b2684d1970165a8a P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.578981 16779 tablet_replica.cc:333] T 11b1c6ca5b8b4d61a6e200744c543ede P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.579468 16779 raft_consensus.cc:2243] T 11b1c6ca5b8b4d61a6e200744c543ede P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.580152 16779 raft_consensus.cc:2272] T 11b1c6ca5b8b4d61a6e200744c543ede P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.581884 16779 tablet_replica.cc:333] T 1f5cfd203dcc43d4a86864c2eaaf234c P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.582425 16779 raft_consensus.cc:2243] T 1f5cfd203dcc43d4a86864c2eaaf234c P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.582924 16779 raft_consensus.cc:2272] T 1f5cfd203dcc43d4a86864c2eaaf234c P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.585067 16779 tablet_replica.cc:333] T d2d3a5114a7842179f9957c7f5660f7e P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.585723 16779 raft_consensus.cc:2243] T d2d3a5114a7842179f9957c7f5660f7e P a9d87b20401744c7bd0c491f60cf0689 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:12:33.586126 23349 consensus_peers.cc:597] T 4bffc92cd6c84709bd0335a988eeef96 P 48bc58ace75f40e995efc1edcefe79fa -> Peer a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253): Couldn't send request to peer a9d87b20401744c7bd0c491f60cf0689. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:33.586696 16779 raft_consensus.cc:2272] T d2d3a5114a7842179f9957c7f5660f7e P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.588605 16779 tablet_replica.cc:333] T 3243e85ef0e741d696af414124ca96bd P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.589066 16779 raft_consensus.cc:2243] T 3243e85ef0e741d696af414124ca96bd P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.589707 16779 raft_consensus.cc:2272] T 3243e85ef0e741d696af414124ca96bd P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.591789 16779 tablet_replica.cc:333] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.592434 16779 raft_consensus.cc:2243] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.592959 16779 raft_consensus.cc:2272] T 9be6b80356b0415ba28a56482e13d24f P a9d87b20401744c7bd0c491f60cf0689 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.595445 16779 tablet_replica.cc:333] T 1a2d000d8737420cbb2ee80189092814 P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.596064 16779 raft_consensus.cc:2243] T 1a2d000d8737420cbb2ee80189092814 P a9d87b20401744c7bd0c491f60cf0689 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.596999 16779 raft_consensus.cc:2272] T 1a2d000d8737420cbb2ee80189092814 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.599463 16779 tablet_replica.cc:333] T 2954a8837137444496d21a25638b3f2a P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.600072 16779 raft_consensus.cc:2243] T 2954a8837137444496d21a25638b3f2a P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.600653 16779 raft_consensus.cc:2272] T 2954a8837137444496d21a25638b3f2a P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.603241 16779 tablet_replica.cc:333] T 5002a306b4474c909091a65333c74939 P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.603878 16779 raft_consensus.cc:2243] T 5002a306b4474c909091a65333c74939 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.604351 16779 raft_consensus.cc:2272] T 5002a306b4474c909091a65333c74939 P a9d87b20401744c7bd0c491f60cf0689 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.606024 16779 tablet_replica.cc:333] T 9d57b510cd3745fabb0748a6f9008fca P a9d87b20401744c7bd0c491f60cf0689: stopping tablet replica
I20260709 12:12:33.606418 16779 raft_consensus.cc:2243] T 9d57b510cd3745fabb0748a6f9008fca P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.606848 16779 raft_consensus.cc:2272] T 9d57b510cd3745fabb0748a6f9008fca P a9d87b20401744c7bd0c491f60cf0689 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:33.645903 23349 consensus_peers.cc:597] T 85dca37fe4fc46b792220de05fc68749 P 48bc58ace75f40e995efc1edcefe79fa -> Peer a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253): Couldn't send request to peer a9d87b20401744c7bd0c491f60cf0689. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:33.663365 23349 consensus_peers.cc:597] T ae5efc2770bb4bc7a09585a220a45131 P 48bc58ace75f40e995efc1edcefe79fa -> Peer a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253): Couldn't send request to peer a9d87b20401744c7bd0c491f60cf0689. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:33.664397 23349 consensus_peers.cc:597] T af6b6c7f82544d968d77f359f1a34403 P 48bc58ace75f40e995efc1edcefe79fa -> Peer a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253): Couldn't send request to peer a9d87b20401744c7bd0c491f60cf0689. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:33.688706 16779 tablet_server.cc:196] TabletServer@127.16.98.195:0 shutdown complete.
I20260709 12:12:33.702359 24213 raft_consensus.cc:493] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3824bca1df8e4020b18c7989f7758391)
I20260709 12:12:33.703152 24213 raft_consensus.cc:515] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:33.705888 24213 leader_election.cc:290] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
W20260709 12:12:33.709905 23348 leader_election.cc:336] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Network error: Client connection negotiation failed: client connection to 127.16.98.193:42187: connect: Connection refused (error 111)
W20260709 12:12:33.710459 23350 leader_election.cc:336] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Network error: Client connection negotiation failed: client connection to 127.16.98.194:41907: connect: Connection refused (error 111)
I20260709 12:12:33.710908 23350 leader_election.cc:304] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa; no voters: 3824bca1df8e4020b18c7989f7758391, abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:33.711551 24213 raft_consensus.cc:2749] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:12:33.722479 23349 consensus_peers.cc:597] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa -> Peer a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253): Couldn't send request to peer a9d87b20401744c7bd0c491f60cf0689. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.195:41253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:33.725521 24213 raft_consensus.cc:493] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3824bca1df8e4020b18c7989f7758391)
I20260709 12:12:33.726051 24213 raft_consensus.cc:515] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "abe65f4962e147ac841608b6c30f7e1b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 41907 } }
I20260709 12:12:33.728641 24213 leader_election.cc:290] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187), abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907)
W20260709 12:12:33.733197 23348 leader_election.cc:336] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Network error: Client connection negotiation failed: client connection to 127.16.98.193:42187: connect: Connection refused (error 111)
W20260709 12:12:33.733690 23350 leader_election.cc:336] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer abe65f4962e147ac841608b6c30f7e1b (127.16.98.194:41907): Network error: Client connection negotiation failed: client connection to 127.16.98.194:41907: connect: Connection refused (error 111)
I20260709 12:12:33.734040 23350 leader_election.cc:304] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa; no voters: 3824bca1df8e4020b18c7989f7758391, abe65f4962e147ac841608b6c30f7e1b
I20260709 12:12:33.734622 24213 raft_consensus.cc:2749] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:33.767558 16779 tablet_server.cc:179] TabletServer@127.16.98.196:0 shutting down...
W20260709 12:12:33.773980 23349 consensus_peers.cc:597] T 9aa8c90489d54dc6b2684d1970165a8a P 48bc58ace75f40e995efc1edcefe79fa -> Peer a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253): Couldn't send request to peer a9d87b20401744c7bd0c491f60cf0689. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.195:41253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:33.787736 23349 consensus_peers.cc:597] T b4c15adbbcbc4dbb9162ef9af4e14477 P 48bc58ace75f40e995efc1edcefe79fa -> Peer a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253): Couldn't send request to peer a9d87b20401744c7bd0c491f60cf0689. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.195:41253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:33.798337 23349 consensus_peers.cc:597] T e3b19b20feb045058cd1cfbd684ff05f P 48bc58ace75f40e995efc1edcefe79fa -> Peer a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253): Couldn't send request to peer a9d87b20401744c7bd0c491f60cf0689. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.195:41253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:33.803352 16779 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:33.804303 16779 tablet_replica.cc:333] T 8fb0ec62373d4b39bd83ded02981c6dc P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.805344 16779 raft_consensus.cc:2243] T 8fb0ec62373d4b39bd83ded02981c6dc P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.805781 16779 raft_consensus.cc:2272] T 8fb0ec62373d4b39bd83ded02981c6dc P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.807785 16779 tablet_replica.cc:333] T 058e9aef198f48b8956a676b6f12b2e1 P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.808511 16779 raft_consensus.cc:2243] T 058e9aef198f48b8956a676b6f12b2e1 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.809052 16779 raft_consensus.cc:2272] T 058e9aef198f48b8956a676b6f12b2e1 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.811033 16779 tablet_replica.cc:333] T 4bffc92cd6c84709bd0335a988eeef96 P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.811569 16779 raft_consensus.cc:2243] T 4bffc92cd6c84709bd0335a988eeef96 P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.812315 16779 raft_consensus.cc:2272] T 4bffc92cd6c84709bd0335a988eeef96 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.814098 16779 tablet_replica.cc:333] T 85dca37fe4fc46b792220de05fc68749 P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.814625 16779 raft_consensus.cc:2243] T 85dca37fe4fc46b792220de05fc68749 P 48bc58ace75f40e995efc1edcefe79fa [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.815362 16779 raft_consensus.cc:2272] T 85dca37fe4fc46b792220de05fc68749 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.817094 16779 tablet_replica.cc:333] T 36d2201b0b3d4f07abf9c901453cda82 P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.817602 16779 raft_consensus.cc:2243] T 36d2201b0b3d4f07abf9c901453cda82 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.817992 16779 raft_consensus.cc:2272] T 36d2201b0b3d4f07abf9c901453cda82 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.819880 16779 tablet_replica.cc:333] T d8c320c6212b4bb187e8d32cb79479a8 P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.820405 16779 raft_consensus.cc:2243] T d8c320c6212b4bb187e8d32cb79479a8 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.820814 16779 raft_consensus.cc:2272] T d8c320c6212b4bb187e8d32cb79479a8 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.822965 16779 tablet_replica.cc:333] T b71f710147be434e8d790a50e145def8 P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.823518 16779 raft_consensus.cc:2243] T b71f710147be434e8d790a50e145def8 P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.824342 16779 raft_consensus.cc:2272] T b71f710147be434e8d790a50e145def8 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.826439 16779 tablet_replica.cc:333] T 07201eb1b13e4b54af9c1c18752a9edf P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.827005 16779 raft_consensus.cc:2243] T 07201eb1b13e4b54af9c1c18752a9edf P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.827360 16779 raft_consensus.cc:2272] T 07201eb1b13e4b54af9c1c18752a9edf P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.829246 16779 tablet_replica.cc:333] T ae5efc2770bb4bc7a09585a220a45131 P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.829713 16779 raft_consensus.cc:2243] T ae5efc2770bb4bc7a09585a220a45131 P 48bc58ace75f40e995efc1edcefe79fa [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.830545 24129 raft_consensus.cc:493] T 1b4285f9faa34fc595e0b7db3f7f0946 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3824bca1df8e4020b18c7989f7758391)
I20260709 12:12:33.830569 16779 raft_consensus.cc:2272] T ae5efc2770bb4bc7a09585a220a45131 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.831101 24129 raft_consensus.cc:515] T 1b4285f9faa34fc595e0b7db3f7f0946 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d87b20401744c7bd0c491f60cf0689" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41253 } } peers { permanent_uuid: "48bc58ace75f40e995efc1edcefe79fa" member_type: VOTER last_known_addr { host: "127.16.98.196" port: 37599 } } peers { permanent_uuid: "3824bca1df8e4020b18c7989f7758391" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 42187 } }
I20260709 12:12:33.832760 24129 leader_election.cc:290] T 1b4285f9faa34fc595e0b7db3f7f0946 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253), 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187)
I20260709 12:12:33.833299 16779 tablet_replica.cc:333] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.834228 16779 raft_consensus.cc:2243] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.834818 16779 raft_consensus.cc:2272] T fba757d381304cc0bcbb4f9dbcfc812c P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:33.836872 23349 leader_election.cc:336] T 1b4285f9faa34fc595e0b7db3f7f0946 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253): Network error: Client connection negotiation failed: client connection to 127.16.98.195:41253: connect: Connection refused (error 111)
W20260709 12:12:33.837387 23349 consensus_peers.cc:597] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa -> Peer a9d87b20401744c7bd0c491f60cf0689 (127.16.98.195:41253): Couldn't send request to peer a9d87b20401744c7bd0c491f60cf0689. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.195:41253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:33.837735 16779 tablet_replica.cc:333] T 77c07af998424a59b0e3cb3d0b63579a P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.838519 16779 raft_consensus.cc:2243] T 77c07af998424a59b0e3cb3d0b63579a P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:12:33.838445 23348 leader_election.cc:336] T 1b4285f9faa34fc595e0b7db3f7f0946 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3824bca1df8e4020b18c7989f7758391 (127.16.98.193:42187): Network error: Client connection negotiation failed: client connection to 127.16.98.193:42187: connect: Connection refused (error 111)
I20260709 12:12:33.839082 23348 leader_election.cc:304] T 1b4285f9faa34fc595e0b7db3f7f0946 P 48bc58ace75f40e995efc1edcefe79fa [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48bc58ace75f40e995efc1edcefe79fa; no voters: 3824bca1df8e4020b18c7989f7758391, a9d87b20401744c7bd0c491f60cf0689
I20260709 12:12:33.839262 16779 raft_consensus.cc:2272] T 77c07af998424a59b0e3cb3d0b63579a P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.839884 24104 raft_consensus.cc:2749] T 1b4285f9faa34fc595e0b7db3f7f0946 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:12:33.841588 16779 tablet_replica.cc:333] T 9ffb43b95dbe424d89c123a2179445ec P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.842183 16779 raft_consensus.cc:2243] T 9ffb43b95dbe424d89c123a2179445ec P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.842991 16779 raft_consensus.cc:2272] T 9ffb43b95dbe424d89c123a2179445ec P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.844895 16779 tablet_replica.cc:333] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.845403 16779 raft_consensus.cc:2243] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.846110 16779 raft_consensus.cc:2272] T 7db21ddd040d409a9154cbe649864397 P 48bc58ace75f40e995efc1edcefe79fa [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.847985 16779 tablet_replica.cc:333] T cd128874f9674cb7802ec50ad0b65026 P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.848533 16779 raft_consensus.cc:2243] T cd128874f9674cb7802ec50ad0b65026 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.848944 16779 raft_consensus.cc:2272] T cd128874f9674cb7802ec50ad0b65026 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.850680 16779 tablet_replica.cc:333] T e3b19b20feb045058cd1cfbd684ff05f P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.851191 16779 raft_consensus.cc:2243] T e3b19b20feb045058cd1cfbd684ff05f P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.851893 16779 raft_consensus.cc:2272] T e3b19b20feb045058cd1cfbd684ff05f P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.853696 16779 tablet_replica.cc:333] T d12a070001934296ba81c85f9ba61e27 P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.854209 16779 raft_consensus.cc:2243] T d12a070001934296ba81c85f9ba61e27 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.854624 16779 raft_consensus.cc:2272] T d12a070001934296ba81c85f9ba61e27 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.856386 16779 tablet_replica.cc:333] T 3fb3705cd5724f208798f30d9ab01bda P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.856897 16779 raft_consensus.cc:2243] T 3fb3705cd5724f208798f30d9ab01bda P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.857296 16779 raft_consensus.cc:2272] T 3fb3705cd5724f208798f30d9ab01bda P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.859016 16779 tablet_replica.cc:333] T ec1028a2affb45679aede72149f857f5 P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.859532 16779 raft_consensus.cc:2243] T ec1028a2affb45679aede72149f857f5 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.860137 16779 raft_consensus.cc:2272] T ec1028a2affb45679aede72149f857f5 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.862277 16779 tablet_replica.cc:333] T 1b4285f9faa34fc595e0b7db3f7f0946 P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.863080 16779 raft_consensus.cc:2243] T 1b4285f9faa34fc595e0b7db3f7f0946 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.863677 16779 raft_consensus.cc:2272] T 1b4285f9faa34fc595e0b7db3f7f0946 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.866271 16779 tablet_replica.cc:333] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.866845 16779 raft_consensus.cc:2243] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.867333 16779 raft_consensus.cc:2272] T 541dc3e21d4e461b8c299d0186a42e7f P 48bc58ace75f40e995efc1edcefe79fa [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.869679 16779 tablet_replica.cc:333] T bda09a1e5c59409c96c419b65061c1dc P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.870252 16779 raft_consensus.cc:2243] T bda09a1e5c59409c96c419b65061c1dc P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.871101 16779 raft_consensus.cc:2272] T bda09a1e5c59409c96c419b65061c1dc P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.872890 16779 tablet_replica.cc:333] T a7d44e74deb341179f886489282ced2f P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.873587 16779 raft_consensus.cc:2243] T a7d44e74deb341179f886489282ced2f P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.874308 16779 raft_consensus.cc:2272] T a7d44e74deb341179f886489282ced2f P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.876132 16779 tablet_replica.cc:333] T b0348215bfbf4d0bb5ffd2ddc86a4279 P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.876636 16779 raft_consensus.cc:2243] T b0348215bfbf4d0bb5ffd2ddc86a4279 P 48bc58ace75f40e995efc1edcefe79fa [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.877308 16779 raft_consensus.cc:2272] T b0348215bfbf4d0bb5ffd2ddc86a4279 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.879171 16779 tablet_replica.cc:333] T d53aaedd982440259b3ef5d84cddcbed P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.879664 16779 raft_consensus.cc:2243] T d53aaedd982440259b3ef5d84cddcbed P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.880020 16779 raft_consensus.cc:2272] T d53aaedd982440259b3ef5d84cddcbed P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.881870 16779 tablet_replica.cc:333] T 1a2d000d8737420cbb2ee80189092814 P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.882344 16779 raft_consensus.cc:2243] T 1a2d000d8737420cbb2ee80189092814 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.882762 16779 raft_consensus.cc:2272] T 1a2d000d8737420cbb2ee80189092814 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.884708 16779 tablet_replica.cc:333] T b4c15adbbcbc4dbb9162ef9af4e14477 P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.885160 16779 raft_consensus.cc:2243] T b4c15adbbcbc4dbb9162ef9af4e14477 P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.885788 16779 raft_consensus.cc:2272] T b4c15adbbcbc4dbb9162ef9af4e14477 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.887547 16779 tablet_replica.cc:333] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.888019 16779 raft_consensus.cc:2243] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.888366 16779 raft_consensus.cc:2272] T 923f193f1d2d4e61ae30850183122635 P 48bc58ace75f40e995efc1edcefe79fa [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.890069 16779 tablet_replica.cc:333] T 5d0efec949fc4455838db7fb01259d69 P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.890547 16779 raft_consensus.cc:2243] T 5d0efec949fc4455838db7fb01259d69 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.890915 16779 raft_consensus.cc:2272] T 5d0efec949fc4455838db7fb01259d69 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.892633 16779 tablet_replica.cc:333] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.893086 16779 raft_consensus.cc:2243] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.893721 16779 raft_consensus.cc:2272] T 9be6b80356b0415ba28a56482e13d24f P 48bc58ace75f40e995efc1edcefe79fa [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.895414 16779 tablet_replica.cc:333] T af6b6c7f82544d968d77f359f1a34403 P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.895884 16779 raft_consensus.cc:2243] T af6b6c7f82544d968d77f359f1a34403 P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.896533 16779 raft_consensus.cc:2272] T af6b6c7f82544d968d77f359f1a34403 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.898200 16779 tablet_replica.cc:333] T 024ae14c007f4c469b22ad43f153b12e P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.898695 16779 raft_consensus.cc:2243] T 024ae14c007f4c469b22ad43f153b12e P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.899040 16779 raft_consensus.cc:2272] T 024ae14c007f4c469b22ad43f153b12e P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.900669 16779 tablet_replica.cc:333] T f55cb07c30bc42a0930276baefc1d4b7 P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.901120 16779 raft_consensus.cc:2243] T f55cb07c30bc42a0930276baefc1d4b7 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.901460 16779 raft_consensus.cc:2272] T f55cb07c30bc42a0930276baefc1d4b7 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.903301 16779 tablet_replica.cc:333] T da47bda397e2471388bcab5069dd7edc P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.903785 16779 raft_consensus.cc:2243] T da47bda397e2471388bcab5069dd7edc P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.904105 16779 raft_consensus.cc:2272] T da47bda397e2471388bcab5069dd7edc P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.905794 16779 tablet_replica.cc:333] T c113311e527c47578f8c136d335aa87f P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.906256 16779 raft_consensus.cc:2243] T c113311e527c47578f8c136d335aa87f P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.906616 16779 raft_consensus.cc:2272] T c113311e527c47578f8c136d335aa87f P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.908387 16779 tablet_replica.cc:333] T 5002a306b4474c909091a65333c74939 P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.908862 16779 raft_consensus.cc:2243] T 5002a306b4474c909091a65333c74939 P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.909528 16779 raft_consensus.cc:2272] T 5002a306b4474c909091a65333c74939 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.911294 16779 tablet_replica.cc:333] T 9d57b510cd3745fabb0748a6f9008fca P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.911753 16779 raft_consensus.cc:2243] T 9d57b510cd3745fabb0748a6f9008fca P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.912088 16779 raft_consensus.cc:2272] T 9d57b510cd3745fabb0748a6f9008fca P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.913859 16779 tablet_replica.cc:333] T 162d91be31a64ad688b7b433392ed1a2 P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.914294 16779 raft_consensus.cc:2243] T 162d91be31a64ad688b7b433392ed1a2 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.914629 16779 raft_consensus.cc:2272] T 162d91be31a64ad688b7b433392ed1a2 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.916366 16779 tablet_replica.cc:333] T 9aa8c90489d54dc6b2684d1970165a8a P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.916802 16779 raft_consensus.cc:2243] T 9aa8c90489d54dc6b2684d1970165a8a P 48bc58ace75f40e995efc1edcefe79fa [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:33.917420 16779 raft_consensus.cc:2272] T 9aa8c90489d54dc6b2684d1970165a8a P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.919220 16779 tablet_replica.cc:333] T 11b1c6ca5b8b4d61a6e200744c543ede P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.919656 16779 raft_consensus.cc:2243] T 11b1c6ca5b8b4d61a6e200744c543ede P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.919984 16779 raft_consensus.cc:2272] T 11b1c6ca5b8b4d61a6e200744c543ede P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.921679 16779 tablet_replica.cc:333] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.922134 16779 raft_consensus.cc:2243] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.922499 16779 raft_consensus.cc:2272] T e53f580024c14b33b72266b89a1ab8e3 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.924190 16779 tablet_replica.cc:333] T 2d308deadcb9416c9b0b16ef4891e6eb P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.924626 16779 raft_consensus.cc:2243] T 2d308deadcb9416c9b0b16ef4891e6eb P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.924971 16779 raft_consensus.cc:2272] T 2d308deadcb9416c9b0b16ef4891e6eb P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.926750 16779 tablet_replica.cc:333] T 98439efe5217407d95ff24969e5b4083 P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.927176 16779 raft_consensus.cc:2243] T 98439efe5217407d95ff24969e5b4083 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.927532 16779 raft_consensus.cc:2272] T 98439efe5217407d95ff24969e5b4083 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.929358 16779 tablet_replica.cc:333] T 7f25493a942c4d96ad5fed839ad58386 P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.929811 16779 raft_consensus.cc:2243] T 7f25493a942c4d96ad5fed839ad58386 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.930153 16779 raft_consensus.cc:2272] T 7f25493a942c4d96ad5fed839ad58386 P 48bc58ace75f40e995efc1edcefe79fa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.932001 16779 tablet_replica.cc:333] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa: stopping tablet replica
I20260709 12:12:33.932590 16779 raft_consensus.cc:2243] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:33.932945 16779 raft_consensus.cc:2272] T 7193dd2dee9c4d1c9992ad4eff434b59 P 48bc58ace75f40e995efc1edcefe79fa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:33.997493 16779 tablet_server.cc:196] TabletServer@127.16.98.196:0 shutdown complete.
I20260709 12:12:34.061818 16779 master.cc:562] Master@127.16.98.254:44847 shutting down...
I20260709 12:12:34.091841 16779 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 45f78d5d7b2d427b81472bf434f46b33 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:34.092415 16779 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 45f78d5d7b2d427b81472bf434f46b33 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:34.092732 16779 tablet_replica.cc:333] T 00000000000000000000000000000000 P 45f78d5d7b2d427b81472bf434f46b33: stopping tablet replica
I20260709 12:12:34.114223 16779 master.cc:584] Master@127.16.98.254:44847 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (28266 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:12:34.200237 16779 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.98.254:34979
I20260709 12:12:34.201382 16779 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:34.207892 24221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:34.209157 24222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:34.215387 16779 server_base.cc:1061] running on GCE node
W20260709 12:12:34.215420 24224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:34.216868 16779 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:34.217124 16779 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:34.217290 16779 hybrid_clock.cc:648] HybridClock initialized: now 1783599154217275 us; error 0 us; skew 500 ppm
I20260709 12:12:34.217943 16779 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:34.221165 16779 webserver.cc:533] Webserver started at http://127.16.98.254:33039/ using document root <none> and password file <none>
I20260709 12:12:34.221724 16779 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:34.221973 16779 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:34.222333 16779 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:34.223526 16779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895573690-16779-0/minicluster-data/master-0-root/instance:
uuid: "e09457092b2d49d786ccbb7f9131bc87"
format_stamp: "Formatted at 2026-07-09 12:12:34 on dist-test-slave-9bv4"
I20260709 12:12:34.228012 16779 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:12:34.231618 24229 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:34.232513 16779 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:12:34.232770 16779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895573690-16779-0/minicluster-data/master-0-root
uuid: "e09457092b2d49d786ccbb7f9131bc87"
format_stamp: "Formatted at 2026-07-09 12:12:34 on dist-test-slave-9bv4"
I20260709 12:12:34.233001 16779 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895573690-16779-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895573690-16779-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895573690-16779-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:34.251502 16779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:34.252699 16779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:34.289306 16779 rpc_server.cc:307] RPC server started. Bound to: 127.16.98.254:34979
I20260709 12:12:34.289412 24280 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.98.254:34979 every 8 connection(s)
I20260709 12:12:34.293170 24281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:34.303313 24281 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e09457092b2d49d786ccbb7f9131bc87: Bootstrap starting.
I20260709 12:12:34.307876 24281 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e09457092b2d49d786ccbb7f9131bc87: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:34.312127 24281 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e09457092b2d49d786ccbb7f9131bc87: No bootstrap required, opened a new log
I20260709 12:12:34.314232 24281 raft_consensus.cc:359] T 00000000000000000000000000000000 P e09457092b2d49d786ccbb7f9131bc87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e09457092b2d49d786ccbb7f9131bc87" member_type: VOTER }
I20260709 12:12:34.314597 24281 raft_consensus.cc:385] T 00000000000000000000000000000000 P e09457092b2d49d786ccbb7f9131bc87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:34.314801 24281 raft_consensus.cc:740] T 00000000000000000000000000000000 P e09457092b2d49d786ccbb7f9131bc87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e09457092b2d49d786ccbb7f9131bc87, State: Initialized, Role: FOLLOWER
I20260709 12:12:34.315364 24281 consensus_queue.cc:260] T 00000000000000000000000000000000 P e09457092b2d49d786ccbb7f9131bc87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e09457092b2d49d786ccbb7f9131bc87" member_type: VOTER }
I20260709 12:12:34.315789 24281 raft_consensus.cc:399] T 00000000000000000000000000000000 P e09457092b2d49d786ccbb7f9131bc87 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:12:34.315977 24281 raft_consensus.cc:493] T 00000000000000000000000000000000 P e09457092b2d49d786ccbb7f9131bc87 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:12:34.316186 24281 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e09457092b2d49d786ccbb7f9131bc87 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:34.320600 24281 raft_consensus.cc:515] T 00000000000000000000000000000000 P e09457092b2d49d786ccbb7f9131bc87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e09457092b2d49d786ccbb7f9131bc87" member_type: VOTER }
I20260709 12:12:34.321063 24281 leader_election.cc:304] T 00000000000000000000000000000000 P e09457092b2d49d786ccbb7f9131bc87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e09457092b2d49d786ccbb7f9131bc87; no voters: 
I20260709 12:12:34.322130 24281 leader_election.cc:290] T 00000000000000000000000000000000 P e09457092b2d49d786ccbb7f9131bc87 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:12:34.322508 24284 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e09457092b2d49d786ccbb7f9131bc87 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:34.323915 24284 raft_consensus.cc:697] T 00000000000000000000000000000000 P e09457092b2d49d786ccbb7f9131bc87 [term 1 LEADER]: Becoming Leader. State: Replica: e09457092b2d49d786ccbb7f9131bc87, State: Running, Role: LEADER
I20260709 12:12:34.324610 24284 consensus_queue.cc:237] T 00000000000000000000000000000000 P e09457092b2d49d786ccbb7f9131bc87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e09457092b2d49d786ccbb7f9131bc87" member_type: VOTER }
I20260709 12:12:34.325265 24281 sys_catalog.cc:565] T 00000000000000000000000000000000 P e09457092b2d49d786ccbb7f9131bc87 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:12:34.331579 24286 sys_catalog.cc:455] T 00000000000000000000000000000000 P e09457092b2d49d786ccbb7f9131bc87 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e09457092b2d49d786ccbb7f9131bc87. Latest consensus state: current_term: 1 leader_uuid: "e09457092b2d49d786ccbb7f9131bc87" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e09457092b2d49d786ccbb7f9131bc87" member_type: VOTER } }
I20260709 12:12:34.331544 24285 sys_catalog.cc:455] T 00000000000000000000000000000000 P e09457092b2d49d786ccbb7f9131bc87 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e09457092b2d49d786ccbb7f9131bc87" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e09457092b2d49d786ccbb7f9131bc87" member_type: VOTER } }
I20260709 12:12:34.332383 24286 sys_catalog.cc:458] T 00000000000000000000000000000000 P e09457092b2d49d786ccbb7f9131bc87 [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:34.332676 24285 sys_catalog.cc:458] T 00000000000000000000000000000000 P e09457092b2d49d786ccbb7f9131bc87 [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:34.335126 24294 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:12:34.342803 24294 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:12:34.343819 16779 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:12:34.351413 24294 catalog_manager.cc:1383] Generated new cluster ID: de956ed3a1944e76ac2b6bd88f76cae9
I20260709 12:12:34.351699 24294 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:12:34.379534 24294 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:12:34.380853 24294 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:12:34.398736 24294 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e09457092b2d49d786ccbb7f9131bc87: Generated new TSK 0
I20260709 12:12:34.399291 24294 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:12:34.410415 16779 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:34.416469 24302 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:34.417385 24303 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:34.420197 16779 server_base.cc:1061] running on GCE node
W20260709 12:12:34.420302 24305 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:34.421398 16779 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:34.421597 16779 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:34.421721 16779 hybrid_clock.cc:648] HybridClock initialized: now 1783599154421710 us; error 0 us; skew 500 ppm
I20260709 12:12:34.422174 16779 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:34.424342 16779 webserver.cc:533] Webserver started at http://127.16.98.193:35659/ using document root <none> and password file <none>
I20260709 12:12:34.424798 16779 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:34.424952 16779 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:34.425171 16779 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:34.426230 16779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895573690-16779-0/minicluster-data/ts-0-root/instance:
uuid: "9c4b72a25dd84163aad122cbdb994f4f"
format_stamp: "Formatted at 2026-07-09 12:12:34 on dist-test-slave-9bv4"
I20260709 12:12:34.430759 16779 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:12:34.434058 24310 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:34.434985 16779 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:12:34.435273 16779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895573690-16779-0/minicluster-data/ts-0-root
uuid: "9c4b72a25dd84163aad122cbdb994f4f"
format_stamp: "Formatted at 2026-07-09 12:12:34 on dist-test-slave-9bv4"
I20260709 12:12:34.435519 16779 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895573690-16779-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895573690-16779-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895573690-16779-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:34.449602 16779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:34.450862 16779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:34.452219 16779 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:34.454413 16779 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:34.454592 16779 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:34.454879 16779 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:34.455065 16779 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:34.495769 16779 rpc_server.cc:307] RPC server started. Bound to: 127.16.98.193:41193
I20260709 12:12:34.495883 24372 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.98.193:41193 every 8 connection(s)
I20260709 12:12:34.500952 16779 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:34.510047 24377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:34.514585 24378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:34.517887 24380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:34.519239 16779 server_base.cc:1061] running on GCE node
I20260709 12:12:34.520807 16779 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:12:34.521018 24373 heartbeater.cc:344] Connected to a master server at 127.16.98.254:34979
W20260709 12:12:34.521054 16779 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:34.521447 16779 hybrid_clock.cc:648] HybridClock initialized: now 1783599154521424 us; error 0 us; skew 500 ppm
I20260709 12:12:34.521508 24373 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:34.522080 16779 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:34.522374 24373 heartbeater.cc:507] Master 127.16.98.254:34979 requested a full tablet report, sending...
I20260709 12:12:34.524618 24246 ts_manager.cc:194] Registered new tserver with Master: 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193)
I20260709 12:12:34.524844 16779 webserver.cc:533] Webserver started at http://127.16.98.194:36315/ using document root <none> and password file <none>
I20260709 12:12:34.525362 16779 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:34.525545 16779 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:34.525831 16779 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:34.527184 16779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895573690-16779-0/minicluster-data/ts-1-root/instance:
uuid: "39d829a384984eecb2eafc10dc296454"
format_stamp: "Formatted at 2026-07-09 12:12:34 on dist-test-slave-9bv4"
I20260709 12:12:34.527552 24246 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34246
I20260709 12:12:34.532018 16779 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:12:34.535557 24385 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:34.536399 16779 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:12:34.536639 16779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895573690-16779-0/minicluster-data/ts-1-root
uuid: "39d829a384984eecb2eafc10dc296454"
format_stamp: "Formatted at 2026-07-09 12:12:34 on dist-test-slave-9bv4"
I20260709 12:12:34.536903 16779 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895573690-16779-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895573690-16779-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895573690-16779-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:34.554432 16779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:34.555665 16779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:34.557070 16779 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:34.559309 16779 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:34.559485 16779 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:34.559742 16779 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:34.559932 16779 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:34.602561 16779 rpc_server.cc:307] RPC server started. Bound to: 127.16.98.194:36921
I20260709 12:12:34.602707 24447 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.98.194:36921 every 8 connection(s)
I20260709 12:12:34.607875 16779 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:34.615031 24451 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:34.616425 24452 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:34.619375 24454 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:34.619935 16779 server_base.cc:1061] running on GCE node
I20260709 12:12:34.620846 24448 heartbeater.cc:344] Connected to a master server at 127.16.98.254:34979
I20260709 12:12:34.621207 16779 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:12:34.621229 24448 heartbeater.cc:461] Registering TS with master...
W20260709 12:12:34.621562 16779 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:34.621829 16779 hybrid_clock.cc:648] HybridClock initialized: now 1783599154621813 us; error 0 us; skew 500 ppm
I20260709 12:12:34.622354 24448 heartbeater.cc:507] Master 127.16.98.254:34979 requested a full tablet report, sending...
I20260709 12:12:34.622421 16779 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:34.624567 24246 ts_manager.cc:194] Registered new tserver with Master: 39d829a384984eecb2eafc10dc296454 (127.16.98.194:36921)
I20260709 12:12:34.625524 16779 webserver.cc:533] Webserver started at http://127.16.98.195:45763/ using document root <none> and password file <none>
I20260709 12:12:34.625981 24246 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34248
I20260709 12:12:34.626086 16779 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:34.626394 16779 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:34.626730 16779 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:34.628083 16779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895573690-16779-0/minicluster-data/ts-2-root/instance:
uuid: "e47ae041170d47e2886bbd47c2fafb29"
format_stamp: "Formatted at 2026-07-09 12:12:34 on dist-test-slave-9bv4"
I20260709 12:12:34.632570 16779 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:12:34.636106 24459 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:34.637051 16779 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:12:34.637420 16779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895573690-16779-0/minicluster-data/ts-2-root
uuid: "e47ae041170d47e2886bbd47c2fafb29"
format_stamp: "Formatted at 2026-07-09 12:12:34 on dist-test-slave-9bv4"
I20260709 12:12:34.637773 16779 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895573690-16779-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895573690-16779-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895573690-16779-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:34.654889 16779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:34.656090 16779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:34.657491 16779 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:34.660390 16779 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:34.660737 16779 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:34.661051 16779 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:34.661293 16779 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:34.703485 16779 rpc_server.cc:307] RPC server started. Bound to: 127.16.98.195:39005
I20260709 12:12:34.703588 24521 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.98.195:39005 every 8 connection(s)
I20260709 12:12:34.718334 24522 heartbeater.cc:344] Connected to a master server at 127.16.98.254:34979
I20260709 12:12:34.718825 24522 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:34.719565 24522 heartbeater.cc:507] Master 127.16.98.254:34979 requested a full tablet report, sending...
I20260709 12:12:34.721804 24246 ts_manager.cc:194] Registered new tserver with Master: e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195:39005)
I20260709 12:12:34.722265 16779 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014997402s
I20260709 12:12:34.723235 24246 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34254
I20260709 12:12:34.749051 24246 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34256:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:12:34.752152 24246 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:12:34.828234 24485 tablet_service.cc:1511] Processing CreateTablet for tablet 2a39cf3544aa4abbab194a49bb9f25b4 (DEFAULT_TABLE table=test-workload [id=107c0ea28f224d1a979c40ca9ec74828]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:12:34.828685 24487 tablet_service.cc:1511] Processing CreateTablet for tablet 08e3d6296f2f457b8e190f2cf367f3ce (DEFAULT_TABLE table=test-workload [id=107c0ea28f224d1a979c40ca9ec74828]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:12:34.829769 24485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a39cf3544aa4abbab194a49bb9f25b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:34.831327 24486 tablet_service.cc:1511] Processing CreateTablet for tablet dacd7f79e6cd4d09a8cc8df8ec88f32c (DEFAULT_TABLE table=test-workload [id=107c0ea28f224d1a979c40ca9ec74828]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:12:34.831422 24484 tablet_service.cc:1511] Processing CreateTablet for tablet 548496e2da9c4999857fbd2bbfbd65b9 (DEFAULT_TABLE table=test-workload [id=107c0ea28f224d1a979c40ca9ec74828]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:12:34.832875 24486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dacd7f79e6cd4d09a8cc8df8ec88f32c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:34.833595 24484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 548496e2da9c4999857fbd2bbfbd65b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:34.836373 24483 tablet_service.cc:1511] Processing CreateTablet for tablet a8b1a3981dc94695a0930fb24a989e12 (DEFAULT_TABLE table=test-workload [id=107c0ea28f224d1a979c40ca9ec74828]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:12:34.837819 24483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8b1a3981dc94695a0930fb24a989e12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:34.837944 24409 tablet_service.cc:1511] Processing CreateTablet for tablet a8b1a3981dc94695a0930fb24a989e12 (DEFAULT_TABLE table=test-workload [id=107c0ea28f224d1a979c40ca9ec74828]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:12:34.839412 24409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8b1a3981dc94695a0930fb24a989e12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:34.839819 24412 tablet_service.cc:1511] Processing CreateTablet for tablet dacd7f79e6cd4d09a8cc8df8ec88f32c (DEFAULT_TABLE table=test-workload [id=107c0ea28f224d1a979c40ca9ec74828]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:12:34.841776 24408 tablet_service.cc:1511] Processing CreateTablet for tablet 52ca12c9e5314f109c3a0cf87037aa82 (DEFAULT_TABLE table=test-workload [id=107c0ea28f224d1a979c40ca9ec74828]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:12:34.841974 24411 tablet_service.cc:1511] Processing CreateTablet for tablet 2a39cf3544aa4abbab194a49bb9f25b4 (DEFAULT_TABLE table=test-workload [id=107c0ea28f224d1a979c40ca9ec74828]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:12:34.838498 24413 tablet_service.cc:1511] Processing CreateTablet for tablet 08e3d6296f2f457b8e190f2cf367f3ce (DEFAULT_TABLE table=test-workload [id=107c0ea28f224d1a979c40ca9ec74828]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:12:34.844756 24487 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08e3d6296f2f457b8e190f2cf367f3ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:34.843992 24410 tablet_service.cc:1511] Processing CreateTablet for tablet 548496e2da9c4999857fbd2bbfbd65b9 (DEFAULT_TABLE table=test-workload [id=107c0ea28f224d1a979c40ca9ec74828]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:12:34.843991 24482 tablet_service.cc:1511] Processing CreateTablet for tablet 52ca12c9e5314f109c3a0cf87037aa82 (DEFAULT_TABLE table=test-workload [id=107c0ea28f224d1a979c40ca9ec74828]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:12:34.846102 24411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a39cf3544aa4abbab194a49bb9f25b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:34.846768 24407 tablet_service.cc:1511] Processing CreateTablet for tablet cf1f14b4d6d744f4bb57e6ec43bd3a15 (DEFAULT_TABLE table=test-workload [id=107c0ea28f224d1a979c40ca9ec74828]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:12:34.847991 24412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dacd7f79e6cd4d09a8cc8df8ec88f32c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:34.849567 24413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08e3d6296f2f457b8e190f2cf367f3ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:34.851786 24482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52ca12c9e5314f109c3a0cf87037aa82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:34.853435 24481 tablet_service.cc:1511] Processing CreateTablet for tablet cf1f14b4d6d744f4bb57e6ec43bd3a15 (DEFAULT_TABLE table=test-workload [id=107c0ea28f224d1a979c40ca9ec74828]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:12:34.854796 24481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf1f14b4d6d744f4bb57e6ec43bd3a15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:34.856382 24407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf1f14b4d6d744f4bb57e6ec43bd3a15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:34.857867 24410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 548496e2da9c4999857fbd2bbfbd65b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:34.859355 24408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52ca12c9e5314f109c3a0cf87037aa82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:34.902658 24537 tablet_bootstrap.cc:492] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29: Bootstrap starting.
I20260709 12:12:34.916563 24485 tablet_service.cc:1511] Processing CreateTablet for tablet 10e58961518a493dbae703a1ce1eaefb (DEFAULT_TABLE table=test-workload [id=107c0ea28f224d1a979c40ca9ec74828]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:12:34.919061 24485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10e58961518a493dbae703a1ce1eaefb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:34.919862 24408 tablet_service.cc:1511] Processing CreateTablet for tablet 10e58961518a493dbae703a1ce1eaefb (DEFAULT_TABLE table=test-workload [id=107c0ea28f224d1a979c40ca9ec74828]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:12:34.921187 24408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10e58961518a493dbae703a1ce1eaefb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:34.928169 24536 tablet_bootstrap.cc:492] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454: Bootstrap starting.
I20260709 12:12:34.934995 24338 tablet_service.cc:1511] Processing CreateTablet for tablet 08e3d6296f2f457b8e190f2cf367f3ce (DEFAULT_TABLE table=test-workload [id=107c0ea28f224d1a979c40ca9ec74828]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:12:34.935281 24333 tablet_service.cc:1511] Processing CreateTablet for tablet 52ca12c9e5314f109c3a0cf87037aa82 (DEFAULT_TABLE table=test-workload [id=107c0ea28f224d1a979c40ca9ec74828]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:12:34.937763 24332 tablet_service.cc:1511] Processing CreateTablet for tablet cf1f14b4d6d744f4bb57e6ec43bd3a15 (DEFAULT_TABLE table=test-workload [id=107c0ea28f224d1a979c40ca9ec74828]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:12:34.935501 24331 tablet_service.cc:1511] Processing CreateTablet for tablet 10e58961518a493dbae703a1ce1eaefb (DEFAULT_TABLE table=test-workload [id=107c0ea28f224d1a979c40ca9ec74828]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:12:34.940660 24484 tablet_service.cc:1511] Processing CreateTablet for tablet 41e2f06b670f429ea32f5113440d391e (DEFAULT_TABLE table=test-workload [id=107c0ea28f224d1a979c40ca9ec74828]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:12:34.941975 24484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41e2f06b670f429ea32f5113440d391e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:34.943212 24334 tablet_service.cc:1511] Processing CreateTablet for tablet a8b1a3981dc94695a0930fb24a989e12 (DEFAULT_TABLE table=test-workload [id=107c0ea28f224d1a979c40ca9ec74828]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:12:34.943953 24537 tablet_bootstrap.cc:654] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:34.941599 24335 tablet_service.cc:1511] Processing CreateTablet for tablet 548496e2da9c4999857fbd2bbfbd65b9 (DEFAULT_TABLE table=test-workload [id=107c0ea28f224d1a979c40ca9ec74828]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:12:34.952028 24536 tablet_bootstrap.cc:654] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:34.939859 24337 tablet_service.cc:1511] Processing CreateTablet for tablet dacd7f79e6cd4d09a8cc8df8ec88f32c (DEFAULT_TABLE table=test-workload [id=107c0ea28f224d1a979c40ca9ec74828]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:12:34.953490 24329 tablet_service.cc:1511] Processing CreateTablet for tablet 5820fb1bb4be48e0ad3288d8f5e2964a (DEFAULT_TABLE table=test-workload [id=107c0ea28f224d1a979c40ca9ec74828]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:12:34.954124 24336 tablet_service.cc:1511] Processing CreateTablet for tablet 2a39cf3544aa4abbab194a49bb9f25b4 (DEFAULT_TABLE table=test-workload [id=107c0ea28f224d1a979c40ca9ec74828]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:12:34.938028 24330 tablet_service.cc:1511] Processing CreateTablet for tablet 41e2f06b670f429ea32f5113440d391e (DEFAULT_TABLE table=test-workload [id=107c0ea28f224d1a979c40ca9ec74828]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:12:34.958204 24409 tablet_service.cc:1511] Processing CreateTablet for tablet 5820fb1bb4be48e0ad3288d8f5e2964a (DEFAULT_TABLE table=test-workload [id=107c0ea28f224d1a979c40ca9ec74828]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:12:34.959851 24482 tablet_service.cc:1511] Processing CreateTablet for tablet 5820fb1bb4be48e0ad3288d8f5e2964a (DEFAULT_TABLE table=test-workload [id=107c0ea28f224d1a979c40ca9ec74828]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:12:34.960304 24409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5820fb1bb4be48e0ad3288d8f5e2964a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:34.961066 24482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5820fb1bb4be48e0ad3288d8f5e2964a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:34.936518 24338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08e3d6296f2f457b8e190f2cf367f3ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:34.963531 24335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 548496e2da9c4999857fbd2bbfbd65b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:34.964171 24336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a39cf3544aa4abbab194a49bb9f25b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:34.966555 24337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dacd7f79e6cd4d09a8cc8df8ec88f32c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:34.967240 24332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf1f14b4d6d744f4bb57e6ec43bd3a15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:34.967911 24330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41e2f06b670f429ea32f5113440d391e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:34.968555 24334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8b1a3981dc94695a0930fb24a989e12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:34.971028 24329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5820fb1bb4be48e0ad3288d8f5e2964a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:34.973317 24333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52ca12c9e5314f109c3a0cf87037aa82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:34.983650 24407 tablet_service.cc:1511] Processing CreateTablet for tablet 41e2f06b670f429ea32f5113440d391e (DEFAULT_TABLE table=test-workload [id=107c0ea28f224d1a979c40ca9ec74828]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:12:34.985002 24407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41e2f06b670f429ea32f5113440d391e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:34.987005 24331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10e58961518a493dbae703a1ce1eaefb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:35.015862 24538 tablet_bootstrap.cc:492] T 2a39cf3544aa4abbab194a49bb9f25b4 P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap starting.
I20260709 12:12:35.032302 24538 tablet_bootstrap.cc:654] T 2a39cf3544aa4abbab194a49bb9f25b4 P 9c4b72a25dd84163aad122cbdb994f4f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:35.038895 24537 tablet_bootstrap.cc:492] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29: No bootstrap required, opened a new log
I20260709 12:12:35.040115 24537 ts_tablet_manager.cc:1403] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29: Time spent bootstrapping tablet: real 0.138s	user 0.016s	sys 0.000s
I20260709 12:12:35.040365 24536 tablet_bootstrap.cc:492] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454: No bootstrap required, opened a new log
I20260709 12:12:35.040850 24536 ts_tablet_manager.cc:1403] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454: Time spent bootstrapping tablet: real 0.113s	user 0.004s	sys 0.016s
I20260709 12:12:35.043023 24537 raft_consensus.cc:359] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.043215 24536 raft_consensus.cc:359] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.043785 24537 raft_consensus.cc:385] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:35.046923 24537 raft_consensus.cc:740] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47ae041170d47e2886bbd47c2fafb29, State: Initialized, Role: FOLLOWER
I20260709 12:12:35.044010 24536 raft_consensus.cc:385] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:35.047722 24536 raft_consensus.cc:740] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39d829a384984eecb2eafc10dc296454, State: Initialized, Role: FOLLOWER
I20260709 12:12:35.048496 24536 consensus_queue.cc:260] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.048921 24538 tablet_bootstrap.cc:492] T 2a39cf3544aa4abbab194a49bb9f25b4 P 9c4b72a25dd84163aad122cbdb994f4f: No bootstrap required, opened a new log
I20260709 12:12:35.049543 24538 ts_tablet_manager.cc:1403] T 2a39cf3544aa4abbab194a49bb9f25b4 P 9c4b72a25dd84163aad122cbdb994f4f: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.000s
I20260709 12:12:35.049947 24537 consensus_queue.cc:260] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.052587 24448 heartbeater.cc:499] Master 127.16.98.254:34979 was elected leader, sending a full tablet report...
I20260709 12:12:35.052807 24538 raft_consensus.cc:359] T 2a39cf3544aa4abbab194a49bb9f25b4 P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.053586 24538 raft_consensus.cc:385] T 2a39cf3544aa4abbab194a49bb9f25b4 P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:35.053581 24536 ts_tablet_manager.cc:1434] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:12:35.053947 24538 raft_consensus.cc:740] T 2a39cf3544aa4abbab194a49bb9f25b4 P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c4b72a25dd84163aad122cbdb994f4f, State: Initialized, Role: FOLLOWER
I20260709 12:12:35.055047 24538 consensus_queue.cc:260] T 2a39cf3544aa4abbab194a49bb9f25b4 P 9c4b72a25dd84163aad122cbdb994f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.055469 24536 tablet_bootstrap.cc:492] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454: Bootstrap starting.
I20260709 12:12:35.057279 24537 ts_tablet_manager.cc:1434] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.005s
I20260709 12:12:35.057247 24522 heartbeater.cc:499] Master 127.16.98.254:34979 was elected leader, sending a full tablet report...
I20260709 12:12:35.059181 24373 heartbeater.cc:499] Master 127.16.98.254:34979 was elected leader, sending a full tablet report...
I20260709 12:12:35.059800 24538 ts_tablet_manager.cc:1434] T 2a39cf3544aa4abbab194a49bb9f25b4 P 9c4b72a25dd84163aad122cbdb994f4f: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:12:35.060835 24538 tablet_bootstrap.cc:492] T 41e2f06b670f429ea32f5113440d391e P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap starting.
I20260709 12:12:35.063227 24536 tablet_bootstrap.cc:654] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:35.067481 24538 tablet_bootstrap.cc:654] T 41e2f06b670f429ea32f5113440d391e P 9c4b72a25dd84163aad122cbdb994f4f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:35.070282 24536 tablet_bootstrap.cc:492] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454: No bootstrap required, opened a new log
I20260709 12:12:35.070796 24536 ts_tablet_manager.cc:1403] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.002s
I20260709 12:12:35.073257 24538 tablet_bootstrap.cc:492] T 41e2f06b670f429ea32f5113440d391e P 9c4b72a25dd84163aad122cbdb994f4f: No bootstrap required, opened a new log
I20260709 12:12:35.073794 24538 ts_tablet_manager.cc:1403] T 41e2f06b670f429ea32f5113440d391e P 9c4b72a25dd84163aad122cbdb994f4f: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.003s
I20260709 12:12:35.073714 24536 raft_consensus.cc:359] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } }
I20260709 12:12:35.074630 24536 raft_consensus.cc:385] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:35.074981 24536 raft_consensus.cc:740] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39d829a384984eecb2eafc10dc296454, State: Initialized, Role: FOLLOWER
I20260709 12:12:35.075755 24537 tablet_bootstrap.cc:492] T dacd7f79e6cd4d09a8cc8df8ec88f32c P e47ae041170d47e2886bbd47c2fafb29: Bootstrap starting.
I20260709 12:12:35.075919 24536 consensus_queue.cc:260] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } }
I20260709 12:12:35.078792 24536 ts_tablet_manager.cc:1434] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:12:35.079787 24536 tablet_bootstrap.cc:492] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454: Bootstrap starting.
I20260709 12:12:35.079932 24538 raft_consensus.cc:359] T 41e2f06b670f429ea32f5113440d391e P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.080674 24538 raft_consensus.cc:385] T 41e2f06b670f429ea32f5113440d391e P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:35.080981 24538 raft_consensus.cc:740] T 41e2f06b670f429ea32f5113440d391e P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c4b72a25dd84163aad122cbdb994f4f, State: Initialized, Role: FOLLOWER
I20260709 12:12:35.081768 24538 consensus_queue.cc:260] T 41e2f06b670f429ea32f5113440d391e P 9c4b72a25dd84163aad122cbdb994f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.083186 24537 tablet_bootstrap.cc:654] T dacd7f79e6cd4d09a8cc8df8ec88f32c P e47ae041170d47e2886bbd47c2fafb29: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:35.084223 24538 ts_tablet_manager.cc:1434] T 41e2f06b670f429ea32f5113440d391e P 9c4b72a25dd84163aad122cbdb994f4f: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:12:35.085278 24538 tablet_bootstrap.cc:492] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap starting.
I20260709 12:12:35.086782 24536 tablet_bootstrap.cc:654] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:35.092231 24538 tablet_bootstrap.cc:654] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:35.099200 24537 tablet_bootstrap.cc:492] T dacd7f79e6cd4d09a8cc8df8ec88f32c P e47ae041170d47e2886bbd47c2fafb29: No bootstrap required, opened a new log
I20260709 12:12:35.099416 24536 tablet_bootstrap.cc:492] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454: No bootstrap required, opened a new log
I20260709 12:12:35.099843 24537 ts_tablet_manager.cc:1403] T dacd7f79e6cd4d09a8cc8df8ec88f32c P e47ae041170d47e2886bbd47c2fafb29: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.005s
I20260709 12:12:35.100137 24536 ts_tablet_manager.cc:1403] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.011s
I20260709 12:12:35.103139 24537 raft_consensus.cc:359] T dacd7f79e6cd4d09a8cc8df8ec88f32c P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.104115 24536 raft_consensus.cc:359] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.105141 24536 raft_consensus.cc:385] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:35.105515 24536 raft_consensus.cc:740] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39d829a384984eecb2eafc10dc296454, State: Initialized, Role: FOLLOWER
I20260709 12:12:35.104146 24537 raft_consensus.cc:385] T dacd7f79e6cd4d09a8cc8df8ec88f32c P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:35.106860 24537 raft_consensus.cc:740] T dacd7f79e6cd4d09a8cc8df8ec88f32c P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47ae041170d47e2886bbd47c2fafb29, State: Initialized, Role: FOLLOWER
I20260709 12:12:35.106518 24536 consensus_queue.cc:260] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.107777 24537 consensus_queue.cc:260] T dacd7f79e6cd4d09a8cc8df8ec88f32c P e47ae041170d47e2886bbd47c2fafb29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.108821 24538 tablet_bootstrap.cc:492] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f: No bootstrap required, opened a new log
I20260709 12:12:35.109356 24538 ts_tablet_manager.cc:1403] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.009s
I20260709 12:12:35.110069 24537 ts_tablet_manager.cc:1434] T dacd7f79e6cd4d09a8cc8df8ec88f32c P e47ae041170d47e2886bbd47c2fafb29: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:12:35.110110 24536 ts_tablet_manager.cc:1434] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:12:35.111217 24537 tablet_bootstrap.cc:492] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29: Bootstrap starting.
I20260709 12:12:35.111268 24536 tablet_bootstrap.cc:492] T 52ca12c9e5314f109c3a0cf87037aa82 P 39d829a384984eecb2eafc10dc296454: Bootstrap starting.
I20260709 12:12:35.112475 24538 raft_consensus.cc:359] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } }
I20260709 12:12:35.113219 24538 raft_consensus.cc:385] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:35.113517 24538 raft_consensus.cc:740] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c4b72a25dd84163aad122cbdb994f4f, State: Initialized, Role: FOLLOWER
I20260709 12:12:35.114326 24538 consensus_queue.cc:260] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } }
I20260709 12:12:35.116578 24538 ts_tablet_manager.cc:1434] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 12:12:35.117566 24538 tablet_bootstrap.cc:492] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap starting.
I20260709 12:12:35.118383 24537 tablet_bootstrap.cc:654] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:35.118383 24536 tablet_bootstrap.cc:654] T 52ca12c9e5314f109c3a0cf87037aa82 P 39d829a384984eecb2eafc10dc296454: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:35.124420 24538 tablet_bootstrap.cc:654] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 9c4b72a25dd84163aad122cbdb994f4f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:35.130366 24537 tablet_bootstrap.cc:492] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29: No bootstrap required, opened a new log
I20260709 12:12:35.130381 24536 tablet_bootstrap.cc:492] T 52ca12c9e5314f109c3a0cf87037aa82 P 39d829a384984eecb2eafc10dc296454: No bootstrap required, opened a new log
I20260709 12:12:35.131028 24537 ts_tablet_manager.cc:1403] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.009s
I20260709 12:12:35.131100 24536 ts_tablet_manager.cc:1403] T 52ca12c9e5314f109c3a0cf87037aa82 P 39d829a384984eecb2eafc10dc296454: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 12:12:35.134086 24537 raft_consensus.cc:359] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.134259 24536 raft_consensus.cc:359] T 52ca12c9e5314f109c3a0cf87037aa82 P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.135061 24537 raft_consensus.cc:385] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:35.135159 24536 raft_consensus.cc:385] T 52ca12c9e5314f109c3a0cf87037aa82 P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:35.135494 24537 raft_consensus.cc:740] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47ae041170d47e2886bbd47c2fafb29, State: Initialized, Role: FOLLOWER
I20260709 12:12:35.135551 24536 raft_consensus.cc:740] T 52ca12c9e5314f109c3a0cf87037aa82 P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39d829a384984eecb2eafc10dc296454, State: Initialized, Role: FOLLOWER
I20260709 12:12:35.136494 24536 consensus_queue.cc:260] T 52ca12c9e5314f109c3a0cf87037aa82 P 39d829a384984eecb2eafc10dc296454 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.136494 24537 consensus_queue.cc:260] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.141060 24542 raft_consensus.cc:493] T 52ca12c9e5314f109c3a0cf87037aa82 P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.141952 24537 ts_tablet_manager.cc:1434] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:12:35.139546 24536 ts_tablet_manager.cc:1434] T 52ca12c9e5314f109c3a0cf87037aa82 P 39d829a384984eecb2eafc10dc296454: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:12:35.141597 24542 raft_consensus.cc:515] T 52ca12c9e5314f109c3a0cf87037aa82 P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.143035 24537 tablet_bootstrap.cc:492] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29: Bootstrap starting.
I20260709 12:12:35.144359 24542 leader_election.cc:290] T 52ca12c9e5314f109c3a0cf87037aa82 P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193), e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195:39005)
I20260709 12:12:35.145586 24536 tablet_bootstrap.cc:492] T 548496e2da9c4999857fbd2bbfbd65b9 P 39d829a384984eecb2eafc10dc296454: Bootstrap starting.
I20260709 12:12:35.150061 24537 tablet_bootstrap.cc:654] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:35.152534 24536 tablet_bootstrap.cc:654] T 548496e2da9c4999857fbd2bbfbd65b9 P 39d829a384984eecb2eafc10dc296454: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:35.141218 24538 tablet_bootstrap.cc:492] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 9c4b72a25dd84163aad122cbdb994f4f: No bootstrap required, opened a new log
I20260709 12:12:35.155141 24538 ts_tablet_manager.cc:1403] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 9c4b72a25dd84163aad122cbdb994f4f: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.008s
I20260709 12:12:35.159171 24538 raft_consensus.cc:359] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.160166 24538 raft_consensus.cc:385] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:35.160543 24538 raft_consensus.cc:740] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c4b72a25dd84163aad122cbdb994f4f, State: Initialized, Role: FOLLOWER
I20260709 12:12:35.161634 24538 consensus_queue.cc:260] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 9c4b72a25dd84163aad122cbdb994f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.164595 24538 ts_tablet_manager.cc:1434] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 9c4b72a25dd84163aad122cbdb994f4f: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 12:12:35.166003 24538 tablet_bootstrap.cc:492] T 5820fb1bb4be48e0ad3288d8f5e2964a P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap starting.
I20260709 12:12:35.174628 24538 tablet_bootstrap.cc:654] T 5820fb1bb4be48e0ad3288d8f5e2964a P 9c4b72a25dd84163aad122cbdb994f4f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:35.188279 24538 tablet_bootstrap.cc:492] T 5820fb1bb4be48e0ad3288d8f5e2964a P 9c4b72a25dd84163aad122cbdb994f4f: No bootstrap required, opened a new log
I20260709 12:12:35.189005 24538 ts_tablet_manager.cc:1403] T 5820fb1bb4be48e0ad3288d8f5e2964a P 9c4b72a25dd84163aad122cbdb994f4f: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.008s
I20260709 12:12:35.193241 24538 raft_consensus.cc:359] T 5820fb1bb4be48e0ad3288d8f5e2964a P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.194940 24544 raft_consensus.cc:493] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.195725 24544 raft_consensus.cc:515] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } }
I20260709 12:12:35.198827 24542 raft_consensus.cc:493] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.199580 24542 raft_consensus.cc:515] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.202351 24542 leader_election.cc:290] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193), e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195:39005)
I20260709 12:12:35.205293 24544 leader_election.cc:290] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195:39005), 39d829a384984eecb2eafc10dc296454 (127.16.98.194:36921)
I20260709 12:12:35.211336 24543 raft_consensus.cc:493] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.212069 24543 raft_consensus.cc:515] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.213181 24542 raft_consensus.cc:493] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.213687 24542 raft_consensus.cc:515] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.214721 24536 tablet_bootstrap.cc:492] T 548496e2da9c4999857fbd2bbfbd65b9 P 39d829a384984eecb2eafc10dc296454: No bootstrap required, opened a new log
I20260709 12:12:35.214912 24543 leader_election.cc:290] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193), 39d829a384984eecb2eafc10dc296454 (127.16.98.194:36921)
I20260709 12:12:35.215397 24536 ts_tablet_manager.cc:1403] T 548496e2da9c4999857fbd2bbfbd65b9 P 39d829a384984eecb2eafc10dc296454: Time spent bootstrapping tablet: real 0.070s	user 0.022s	sys 0.030s
I20260709 12:12:35.215701 24542 leader_election.cc:290] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193), e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195:39005)
I20260709 12:12:35.194262 24538 raft_consensus.cc:385] T 5820fb1bb4be48e0ad3288d8f5e2964a P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:35.216809 24538 raft_consensus.cc:740] T 5820fb1bb4be48e0ad3288d8f5e2964a P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c4b72a25dd84163aad122cbdb994f4f, State: Initialized, Role: FOLLOWER
I20260709 12:12:35.217546 24538 consensus_queue.cc:260] T 5820fb1bb4be48e0ad3288d8f5e2964a P 9c4b72a25dd84163aad122cbdb994f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.219669 24538 ts_tablet_manager.cc:1434] T 5820fb1bb4be48e0ad3288d8f5e2964a P 9c4b72a25dd84163aad122cbdb994f4f: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.004s
I20260709 12:12:35.219148 24536 raft_consensus.cc:359] T 548496e2da9c4999857fbd2bbfbd65b9 P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.220139 24536 raft_consensus.cc:385] T 548496e2da9c4999857fbd2bbfbd65b9 P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:35.220659 24538 tablet_bootstrap.cc:492] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap starting.
I20260709 12:12:35.220512 24536 raft_consensus.cc:740] T 548496e2da9c4999857fbd2bbfbd65b9 P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39d829a384984eecb2eafc10dc296454, State: Initialized, Role: FOLLOWER
I20260709 12:12:35.221652 24536 consensus_queue.cc:260] T 548496e2da9c4999857fbd2bbfbd65b9 P 39d829a384984eecb2eafc10dc296454 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.224227 24536 ts_tablet_manager.cc:1434] T 548496e2da9c4999857fbd2bbfbd65b9 P 39d829a384984eecb2eafc10dc296454: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:12:35.225292 24536 tablet_bootstrap.cc:492] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454: Bootstrap starting.
I20260709 12:12:35.229498 24537 tablet_bootstrap.cc:492] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29: No bootstrap required, opened a new log
I20260709 12:12:35.233008 24537 ts_tablet_manager.cc:1403] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29: Time spent bootstrapping tablet: real 0.090s	user 0.036s	sys 0.026s
I20260709 12:12:35.234947 24496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a39cf3544aa4abbab194a49bb9f25b4" candidate_uuid: "39d829a384984eecb2eafc10dc296454" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47ae041170d47e2886bbd47c2fafb29" is_pre_election: true
I20260709 12:12:35.234043 24497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca12c9e5314f109c3a0cf87037aa82" candidate_uuid: "39d829a384984eecb2eafc10dc296454" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47ae041170d47e2886bbd47c2fafb29" is_pre_election: true
I20260709 12:12:35.235683 24496 raft_consensus.cc:2468] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39d829a384984eecb2eafc10dc296454 in term 0.
I20260709 12:12:35.231702 24536 tablet_bootstrap.cc:654] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:35.238451 24495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dacd7f79e6cd4d09a8cc8df8ec88f32c" candidate_uuid: "39d829a384984eecb2eafc10dc296454" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47ae041170d47e2886bbd47c2fafb29" is_pre_election: true
I20260709 12:12:35.238770 24538 tablet_bootstrap.cc:654] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 9c4b72a25dd84163aad122cbdb994f4f: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:35.240229 24386 leader_election.cc:343] T 52ca12c9e5314f109c3a0cf87037aa82 P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195:39005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:35.240461 24495 raft_consensus.cc:2468] T dacd7f79e6cd4d09a8cc8df8ec88f32c P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39d829a384984eecb2eafc10dc296454 in term 0.
I20260709 12:12:35.244411 24537 raft_consensus.cc:359] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.245201 24537 raft_consensus.cc:385] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:35.245322 24386 leader_election.cc:304] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39d829a384984eecb2eafc10dc296454, e47ae041170d47e2886bbd47c2fafb29; no voters: 
I20260709 12:12:35.246481 24386 leader_election.cc:304] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39d829a384984eecb2eafc10dc296454, e47ae041170d47e2886bbd47c2fafb29; no voters: 
I20260709 12:12:35.246584 24347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a39cf3544aa4abbab194a49bb9f25b4" candidate_uuid: "39d829a384984eecb2eafc10dc296454" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c4b72a25dd84163aad122cbdb994f4f" is_pre_election: true
I20260709 12:12:35.247057 24348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca12c9e5314f109c3a0cf87037aa82" candidate_uuid: "39d829a384984eecb2eafc10dc296454" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c4b72a25dd84163aad122cbdb994f4f" is_pre_election: true
I20260709 12:12:35.247313 24347 raft_consensus.cc:2468] T 2a39cf3544aa4abbab194a49bb9f25b4 P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39d829a384984eecb2eafc10dc296454 in term 0.
I20260709 12:12:35.245517 24537 raft_consensus.cc:740] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47ae041170d47e2886bbd47c2fafb29, State: Initialized, Role: FOLLOWER
I20260709 12:12:35.246340 24542 raft_consensus.cc:2804] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:35.249660 24542 raft_consensus.cc:493] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:35.250456 24542 raft_consensus.cc:3060] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:35.253060 24346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dacd7f79e6cd4d09a8cc8df8ec88f32c" candidate_uuid: "39d829a384984eecb2eafc10dc296454" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c4b72a25dd84163aad122cbdb994f4f" is_pre_election: true
I20260709 12:12:35.253786 24346 raft_consensus.cc:2468] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39d829a384984eecb2eafc10dc296454 in term 0.
W20260709 12:12:35.259054 24388 leader_election.cc:343] T 52ca12c9e5314f109c3a0cf87037aa82 P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:35.259584 24388 leader_election.cc:304] T 52ca12c9e5314f109c3a0cf87037aa82 P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39d829a384984eecb2eafc10dc296454; no voters: 9c4b72a25dd84163aad122cbdb994f4f, e47ae041170d47e2886bbd47c2fafb29
I20260709 12:12:35.268095 24563 raft_consensus.cc:2804] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:35.268669 24563 raft_consensus.cc:493] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:35.269117 24563 raft_consensus.cc:3060] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:35.278540 24542 raft_consensus.cc:515] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.259763 24537 consensus_queue.cc:260] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.280766 24542 leader_election.cc:290] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 1 election: Requested vote from peers 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193), e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195:39005)
I20260709 12:12:35.281910 24543 raft_consensus.cc:493] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.282945 24562 raft_consensus.cc:2749] T 52ca12c9e5314f109c3a0cf87037aa82 P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:35.282986 24543 raft_consensus.cc:515] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.286335 24495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a39cf3544aa4abbab194a49bb9f25b4" candidate_uuid: "39d829a384984eecb2eafc10dc296454" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47ae041170d47e2886bbd47c2fafb29"
I20260709 12:12:35.287078 24495 raft_consensus.cc:3060] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:35.286355 24543 leader_election.cc:290] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193), 39d829a384984eecb2eafc10dc296454 (127.16.98.194:36921)
I20260709 12:12:35.296380 24536 tablet_bootstrap.cc:492] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454: No bootstrap required, opened a new log
I20260709 12:12:35.297137 24536 ts_tablet_manager.cc:1403] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454: Time spent bootstrapping tablet: real 0.072s	user 0.017s	sys 0.024s
I20260709 12:12:35.287552 24563 raft_consensus.cc:515] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.300722 24347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a39cf3544aa4abbab194a49bb9f25b4" candidate_uuid: "39d829a384984eecb2eafc10dc296454" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c4b72a25dd84163aad122cbdb994f4f"
I20260709 12:12:35.302165 24347 raft_consensus.cc:3060] T 2a39cf3544aa4abbab194a49bb9f25b4 P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:35.305008 24423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e3d6296f2f457b8e190f2cf367f3ce" candidate_uuid: "9c4b72a25dd84163aad122cbdb994f4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39d829a384984eecb2eafc10dc296454" is_pre_election: true
I20260709 12:12:35.305766 24423 raft_consensus.cc:2468] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c4b72a25dd84163aad122cbdb994f4f in term 0.
I20260709 12:12:35.308117 24313 leader_election.cc:304] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39d829a384984eecb2eafc10dc296454, 9c4b72a25dd84163aad122cbdb994f4f; no voters: 
I20260709 12:12:35.308918 24544 raft_consensus.cc:2804] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:35.309276 24544 raft_consensus.cc:493] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:35.309620 24544 raft_consensus.cc:3060] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:35.312125 24563 leader_election.cc:290] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 1 election: Requested vote from peers 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193), e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195:39005)
I20260709 12:12:35.312901 24346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dacd7f79e6cd4d09a8cc8df8ec88f32c" candidate_uuid: "39d829a384984eecb2eafc10dc296454" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c4b72a25dd84163aad122cbdb994f4f"
I20260709 12:12:35.313519 24496 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e3d6296f2f457b8e190f2cf367f3ce" candidate_uuid: "9c4b72a25dd84163aad122cbdb994f4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47ae041170d47e2886bbd47c2fafb29" is_pre_election: true
I20260709 12:12:35.313519 24346 raft_consensus.cc:3060] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:35.314160 24497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dacd7f79e6cd4d09a8cc8df8ec88f32c" candidate_uuid: "39d829a384984eecb2eafc10dc296454" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47ae041170d47e2886bbd47c2fafb29"
I20260709 12:12:35.315346 24497 raft_consensus.cc:3060] T dacd7f79e6cd4d09a8cc8df8ec88f32c P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:35.316174 24537 ts_tablet_manager.cc:1434] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29: Time spent starting tablet: real 0.081s	user 0.012s	sys 0.017s
I20260709 12:12:35.317406 24537 tablet_bootstrap.cc:492] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29: Bootstrap starting.
I20260709 12:12:35.320710 24538 tablet_bootstrap.cc:492] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 9c4b72a25dd84163aad122cbdb994f4f: No bootstrap required, opened a new log
I20260709 12:12:35.321358 24538 ts_tablet_manager.cc:1403] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 9c4b72a25dd84163aad122cbdb994f4f: Time spent bootstrapping tablet: real 0.101s	user 0.013s	sys 0.008s
I20260709 12:12:35.321756 24544 raft_consensus.cc:515] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } }
I20260709 12:12:35.324340 24537 tablet_bootstrap.cc:654] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:35.324352 24536 raft_consensus.cc:359] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.325435 24536 raft_consensus.cc:385] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:35.311265 24495 raft_consensus.cc:2468] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39d829a384984eecb2eafc10dc296454 in term 1.
I20260709 12:12:35.325770 24536 raft_consensus.cc:740] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39d829a384984eecb2eafc10dc296454, State: Initialized, Role: FOLLOWER
I20260709 12:12:35.331362 24536 consensus_queue.cc:260] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.328869 24423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e3d6296f2f457b8e190f2cf367f3ce" candidate_uuid: "9c4b72a25dd84163aad122cbdb994f4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39d829a384984eecb2eafc10dc296454"
I20260709 12:12:35.336156 24423 raft_consensus.cc:3060] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:35.338848 24346 raft_consensus.cc:2468] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39d829a384984eecb2eafc10dc296454 in term 1.
I20260709 12:12:35.340873 24536 ts_tablet_manager.cc:1434] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.003s
I20260709 12:12:35.342041 24536 tablet_bootstrap.cc:492] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 39d829a384984eecb2eafc10dc296454: Bootstrap starting.
I20260709 12:12:35.332307 24347 raft_consensus.cc:2468] T 2a39cf3544aa4abbab194a49bb9f25b4 P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39d829a384984eecb2eafc10dc296454 in term 1.
I20260709 12:12:35.333587 24495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e3d6296f2f457b8e190f2cf367f3ce" candidate_uuid: "9c4b72a25dd84163aad122cbdb994f4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47ae041170d47e2886bbd47c2fafb29"
I20260709 12:12:35.322527 24497 raft_consensus.cc:2468] T dacd7f79e6cd4d09a8cc8df8ec88f32c P e47ae041170d47e2886bbd47c2fafb29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39d829a384984eecb2eafc10dc296454 in term 1.
I20260709 12:12:35.348959 24347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a39cf3544aa4abbab194a49bb9f25b4" candidate_uuid: "e47ae041170d47e2886bbd47c2fafb29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c4b72a25dd84163aad122cbdb994f4f" is_pre_election: true
W20260709 12:12:35.335419 24293 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:35.328652 24544 leader_election.cc:290] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f [CANDIDATE]: Term 1 election: Requested vote from peers e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195:39005), 39d829a384984eecb2eafc10dc296454 (127.16.98.194:36921)
I20260709 12:12:35.350245 24536 tablet_bootstrap.cc:654] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 39d829a384984eecb2eafc10dc296454: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:35.351114 24386 leader_election.cc:304] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39d829a384984eecb2eafc10dc296454, e47ae041170d47e2886bbd47c2fafb29; no voters: 
I20260709 12:12:35.351429 24346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f14b4d6d744f4bb57e6ec43bd3a15" candidate_uuid: "e47ae041170d47e2886bbd47c2fafb29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c4b72a25dd84163aad122cbdb994f4f" is_pre_election: true
I20260709 12:12:35.352035 24563 raft_consensus.cc:2804] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:35.352183 24386 leader_election.cc:304] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39d829a384984eecb2eafc10dc296454, e47ae041170d47e2886bbd47c2fafb29; no voters: 
I20260709 12:12:35.352608 24563 raft_consensus.cc:697] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 [term 1 LEADER]: Becoming Leader. State: Replica: 39d829a384984eecb2eafc10dc296454, State: Running, Role: LEADER
I20260709 12:12:35.353101 24562 raft_consensus.cc:2804] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:35.353562 24562 raft_consensus.cc:697] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454 [term 1 LEADER]: Becoming Leader. State: Replica: 39d829a384984eecb2eafc10dc296454, State: Running, Role: LEADER
I20260709 12:12:35.353458 24563 consensus_queue.cc:237] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.329478 24538 raft_consensus.cc:359] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.350092 24347 raft_consensus.cc:2393] T 2a39cf3544aa4abbab194a49bb9f25b4 P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e47ae041170d47e2886bbd47c2fafb29 in current term 1: Already voted for candidate 39d829a384984eecb2eafc10dc296454 in this term.
I20260709 12:12:35.354519 24562 consensus_queue.cc:237] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
W20260709 12:12:35.331874 24311 leader_election.cc:343] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195:39005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:35.354390 24423 raft_consensus.cc:2468] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c4b72a25dd84163aad122cbdb994f4f in term 1.
I20260709 12:12:35.357141 24313 leader_election.cc:304] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39d829a384984eecb2eafc10dc296454, 9c4b72a25dd84163aad122cbdb994f4f; no voters: 
I20260709 12:12:35.358027 24544 raft_consensus.cc:2804] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:35.356024 24538 raft_consensus.cc:385] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:35.360267 24538 raft_consensus.cc:740] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c4b72a25dd84163aad122cbdb994f4f, State: Initialized, Role: FOLLOWER
I20260709 12:12:35.357766 24542 raft_consensus.cc:493] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.362337 24542 raft_consensus.cc:515] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.365247 24542 leader_election.cc:290] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193), e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195:39005)
W20260709 12:12:35.357774 24311 leader_election.cc:343] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195:39005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:35.361701 24538 consensus_queue.cc:260] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 9c4b72a25dd84163aad122cbdb994f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.366508 24497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1a3981dc94695a0930fb24a989e12" candidate_uuid: "39d829a384984eecb2eafc10dc296454" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47ae041170d47e2886bbd47c2fafb29" is_pre_election: true
I20260709 12:12:35.366947 24346 raft_consensus.cc:2468] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47ae041170d47e2886bbd47c2fafb29 in term 0.
W20260709 12:12:35.368453 24386 leader_election.cc:343] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195:39005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:35.370761 24537 tablet_bootstrap.cc:492] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29: No bootstrap required, opened a new log
I20260709 12:12:35.371423 24537 ts_tablet_manager.cc:1403] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29: Time spent bootstrapping tablet: real 0.054s	user 0.026s	sys 0.011s
I20260709 12:12:35.374218 24462 leader_election.cc:304] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c4b72a25dd84163aad122cbdb994f4f, e47ae041170d47e2886bbd47c2fafb29; no voters: 
I20260709 12:12:35.376528 24565 raft_consensus.cc:2804] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:35.377044 24565 raft_consensus.cc:493] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:35.377429 24565 raft_consensus.cc:3060] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:35.385211 24574 raft_consensus.cc:493] T 41e2f06b670f429ea32f5113440d391e P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.388849 24422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f14b4d6d744f4bb57e6ec43bd3a15" candidate_uuid: "e47ae041170d47e2886bbd47c2fafb29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39d829a384984eecb2eafc10dc296454" is_pre_election: true
I20260709 12:12:35.389324 24574 raft_consensus.cc:515] T 41e2f06b670f429ea32f5113440d391e P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.387749 24346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1a3981dc94695a0930fb24a989e12" candidate_uuid: "39d829a384984eecb2eafc10dc296454" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c4b72a25dd84163aad122cbdb994f4f" is_pre_election: true
I20260709 12:12:35.388195 24543 raft_consensus.cc:493] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.388867 24544 raft_consensus.cc:697] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f [term 1 LEADER]: Becoming Leader. State: Replica: 9c4b72a25dd84163aad122cbdb994f4f, State: Running, Role: LEADER
I20260709 12:12:35.389911 24537 raft_consensus.cc:359] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } }
I20260709 12:12:35.390755 24537 raft_consensus.cc:385] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:35.386919 24245 catalog_manager.cc:5697] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 reported cstate change: term changed from 0 to 1, leader changed from <none> to 39d829a384984eecb2eafc10dc296454 (127.16.98.194). New cstate: current_term: 1 leader_uuid: "39d829a384984eecb2eafc10dc296454" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:35.386365 24538 ts_tablet_manager.cc:1434] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 9c4b72a25dd84163aad122cbdb994f4f: Time spent starting tablet: real 0.065s	user 0.013s	sys 0.000s
I20260709 12:12:35.391090 24537 raft_consensus.cc:740] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47ae041170d47e2886bbd47c2fafb29, State: Initialized, Role: FOLLOWER
W20260709 12:12:35.391198 24388 leader_election.cc:343] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:35.391144 24544 consensus_queue.cc:237] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } }
I20260709 12:12:35.391942 24388 leader_election.cc:304] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 39d829a384984eecb2eafc10dc296454; no voters: 9c4b72a25dd84163aad122cbdb994f4f, e47ae041170d47e2886bbd47c2fafb29
I20260709 12:12:35.393088 24538 tablet_bootstrap.cc:492] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap starting.
I20260709 12:12:35.390332 24543 raft_consensus.cc:515] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.398387 24543 leader_election.cc:290] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193), 39d829a384984eecb2eafc10dc296454 (127.16.98.194:36921)
I20260709 12:12:35.392885 24537 consensus_queue.cc:260] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } }
I20260709 12:12:35.394088 24569 raft_consensus.cc:2749] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:35.395249 24574 leader_election.cc:290] T 41e2f06b670f429ea32f5113440d391e P 9c4b72a25dd84163aad122cbdb994f4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39d829a384984eecb2eafc10dc296454 (127.16.98.194:36921), e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195:39005)
I20260709 12:12:35.395303 24422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e2f06b670f429ea32f5113440d391e" candidate_uuid: "9c4b72a25dd84163aad122cbdb994f4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39d829a384984eecb2eafc10dc296454" is_pre_election: true
W20260709 12:12:35.402483 24313 leader_election.cc:343] T 41e2f06b670f429ea32f5113440d391e P 9c4b72a25dd84163aad122cbdb994f4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39d829a384984eecb2eafc10dc296454 (127.16.98.194:36921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:35.395896 24536 tablet_bootstrap.cc:492] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 39d829a384984eecb2eafc10dc296454: No bootstrap required, opened a new log
I20260709 12:12:35.403549 24536 ts_tablet_manager.cc:1403] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 39d829a384984eecb2eafc10dc296454: Time spent bootstrapping tablet: real 0.062s	user 0.007s	sys 0.008s
W20260709 12:12:35.390312 24462 leader_election.cc:343] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39d829a384984eecb2eafc10dc296454 (127.16.98.194:36921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:35.405439 24243 catalog_manager.cc:5697] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193). New cstate: current_term: 1 leader_uuid: "9c4b72a25dd84163aad122cbdb994f4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:35.406360 24497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e2f06b670f429ea32f5113440d391e" candidate_uuid: "9c4b72a25dd84163aad122cbdb994f4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47ae041170d47e2886bbd47c2fafb29" is_pre_election: true
I20260709 12:12:35.406826 24536 raft_consensus.cc:359] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.407835 24536 raft_consensus.cc:385] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:35.408210 24536 raft_consensus.cc:740] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39d829a384984eecb2eafc10dc296454, State: Initialized, Role: FOLLOWER
I20260709 12:12:35.406718 24423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a39cf3544aa4abbab194a49bb9f25b4" candidate_uuid: "e47ae041170d47e2886bbd47c2fafb29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39d829a384984eecb2eafc10dc296454" is_pre_election: true
I20260709 12:12:35.409538 24537 ts_tablet_manager.cc:1434] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.000s
I20260709 12:12:35.409902 24422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "548496e2da9c4999857fbd2bbfbd65b9" candidate_uuid: "e47ae041170d47e2886bbd47c2fafb29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39d829a384984eecb2eafc10dc296454" is_pre_election: true
I20260709 12:12:35.410591 24537 tablet_bootstrap.cc:492] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29: Bootstrap starting.
I20260709 12:12:35.410609 24422 raft_consensus.cc:2468] T 548496e2da9c4999857fbd2bbfbd65b9 P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47ae041170d47e2886bbd47c2fafb29 in term 0.
W20260709 12:12:35.411216 24311 leader_election.cc:343] T 41e2f06b670f429ea32f5113440d391e P 9c4b72a25dd84163aad122cbdb994f4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195:39005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:35.410902 24536 consensus_queue.cc:260] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 39d829a384984eecb2eafc10dc296454 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.411717 24311 leader_election.cc:304] T 41e2f06b670f429ea32f5113440d391e P 9c4b72a25dd84163aad122cbdb994f4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9c4b72a25dd84163aad122cbdb994f4f; no voters: 39d829a384984eecb2eafc10dc296454, e47ae041170d47e2886bbd47c2fafb29
I20260709 12:12:35.412667 24544 raft_consensus.cc:2749] T 41e2f06b670f429ea32f5113440d391e P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:35.413280 24462 leader_election.cc:304] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47ae041170d47e2886bbd47c2fafb29; no voters: 39d829a384984eecb2eafc10dc296454, 9c4b72a25dd84163aad122cbdb994f4f
I20260709 12:12:35.414273 24543 raft_consensus.cc:2749] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:35.414659 24462 leader_election.cc:304] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39d829a384984eecb2eafc10dc296454, e47ae041170d47e2886bbd47c2fafb29; no voters: 
I20260709 12:12:35.415170 24536 ts_tablet_manager.cc:1434] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 39d829a384984eecb2eafc10dc296454: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 12:12:35.410679 24538 tablet_bootstrap.cc:654] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:35.415457 24543 raft_consensus.cc:2804] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:35.416015 24543 raft_consensus.cc:493] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:35.386504 24565 raft_consensus.cc:515] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.416373 24536 tablet_bootstrap.cc:492] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454: Bootstrap starting.
I20260709 12:12:35.416546 24543 raft_consensus.cc:3060] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:35.418047 24565 leader_election.cc:290] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 1 election: Requested vote from peers 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193), 39d829a384984eecb2eafc10dc296454 (127.16.98.194:36921)
I20260709 12:12:35.419821 24422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f14b4d6d744f4bb57e6ec43bd3a15" candidate_uuid: "e47ae041170d47e2886bbd47c2fafb29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39d829a384984eecb2eafc10dc296454"
I20260709 12:12:35.420430 24422 raft_consensus.cc:3060] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:35.424405 24536 tablet_bootstrap.cc:654] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:35.424765 24543 raft_consensus.cc:515] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.427084 24543 leader_election.cc:290] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 1 election: Requested vote from peers 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193), 39d829a384984eecb2eafc10dc296454 (127.16.98.194:36921)
I20260709 12:12:35.427759 24574 raft_consensus.cc:493] T 5820fb1bb4be48e0ad3288d8f5e2964a P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.428475 24423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "548496e2da9c4999857fbd2bbfbd65b9" candidate_uuid: "e47ae041170d47e2886bbd47c2fafb29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39d829a384984eecb2eafc10dc296454"
I20260709 12:12:35.428421 24574 raft_consensus.cc:515] T 5820fb1bb4be48e0ad3288d8f5e2964a P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.429289 24423 raft_consensus.cc:3060] T 548496e2da9c4999857fbd2bbfbd65b9 P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:35.430097 24422 raft_consensus.cc:2468] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 39d829a384984eecb2eafc10dc296454 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47ae041170d47e2886bbd47c2fafb29 in term 1.
I20260709 12:12:35.431305 24462 leader_election.cc:304] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39d829a384984eecb2eafc10dc296454, e47ae041170d47e2886bbd47c2fafb29; no voters: 
I20260709 12:12:35.432439 24543 raft_consensus.cc:2804] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:35.432869 24421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5820fb1bb4be48e0ad3288d8f5e2964a" candidate_uuid: "9c4b72a25dd84163aad122cbdb994f4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39d829a384984eecb2eafc10dc296454" is_pre_election: true
I20260709 12:12:35.433133 24543 raft_consensus.cc:697] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29 [term 1 LEADER]: Becoming Leader. State: Replica: e47ae041170d47e2886bbd47c2fafb29, State: Running, Role: LEADER
W20260709 12:12:35.434850 24313 leader_election.cc:343] T 5820fb1bb4be48e0ad3288d8f5e2964a P 9c4b72a25dd84163aad122cbdb994f4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 39d829a384984eecb2eafc10dc296454 (127.16.98.194:36921): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:35.434816 24543 consensus_queue.cc:237] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.436620 24574 leader_election.cc:290] T 5820fb1bb4be48e0ad3288d8f5e2964a P 9c4b72a25dd84163aad122cbdb994f4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39d829a384984eecb2eafc10dc296454 (127.16.98.194:36921), e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195:39005)
I20260709 12:12:35.438143 24497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5820fb1bb4be48e0ad3288d8f5e2964a" candidate_uuid: "9c4b72a25dd84163aad122cbdb994f4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47ae041170d47e2886bbd47c2fafb29" is_pre_election: true
I20260709 12:12:35.440727 24538 tablet_bootstrap.cc:492] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f: No bootstrap required, opened a new log
I20260709 12:12:35.441277 24538 ts_tablet_manager.cc:1403] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f: Time spent bootstrapping tablet: real 0.048s	user 0.014s	sys 0.000s
I20260709 12:12:35.444320 24538 raft_consensus.cc:359] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.444999 24538 raft_consensus.cc:385] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:35.445329 24538 raft_consensus.cc:740] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c4b72a25dd84163aad122cbdb994f4f, State: Initialized, Role: FOLLOWER
I20260709 12:12:35.445513 24423 raft_consensus.cc:2468] T 548496e2da9c4999857fbd2bbfbd65b9 P 39d829a384984eecb2eafc10dc296454 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47ae041170d47e2886bbd47c2fafb29 in term 1.
I20260709 12:12:35.445950 24537 tablet_bootstrap.cc:654] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:35.447120 24311 leader_election.cc:343] T 5820fb1bb4be48e0ad3288d8f5e2964a P 9c4b72a25dd84163aad122cbdb994f4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195:39005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:35.447661 24311 leader_election.cc:304] T 5820fb1bb4be48e0ad3288d8f5e2964a P 9c4b72a25dd84163aad122cbdb994f4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9c4b72a25dd84163aad122cbdb994f4f; no voters: 39d829a384984eecb2eafc10dc296454, e47ae041170d47e2886bbd47c2fafb29
I20260709 12:12:35.447925 24346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "548496e2da9c4999857fbd2bbfbd65b9" candidate_uuid: "e47ae041170d47e2886bbd47c2fafb29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c4b72a25dd84163aad122cbdb994f4f" is_pre_election: true
I20260709 12:12:35.449445 24536 tablet_bootstrap.cc:492] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454: No bootstrap required, opened a new log
I20260709 12:12:35.449608 24346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f14b4d6d744f4bb57e6ec43bd3a15" candidate_uuid: "e47ae041170d47e2886bbd47c2fafb29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c4b72a25dd84163aad122cbdb994f4f"
I20260709 12:12:35.450001 24536 ts_tablet_manager.cc:1403] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.003s
I20260709 12:12:35.449849 24462 leader_election.cc:304] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39d829a384984eecb2eafc10dc296454, e47ae041170d47e2886bbd47c2fafb29; no voters: 
I20260709 12:12:35.450246 24346 raft_consensus.cc:3060] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:35.451341 24347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "548496e2da9c4999857fbd2bbfbd65b9" candidate_uuid: "e47ae041170d47e2886bbd47c2fafb29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c4b72a25dd84163aad122cbdb994f4f"
I20260709 12:12:35.453061 24536 raft_consensus.cc:359] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.453840 24536 raft_consensus.cc:385] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:35.454571 24536 raft_consensus.cc:740] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39d829a384984eecb2eafc10dc296454, State: Initialized, Role: FOLLOWER
I20260709 12:12:35.455498 24536 consensus_queue.cc:260] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.457950 24536 ts_tablet_manager.cc:1434] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:12:35.458913 24536 tablet_bootstrap.cc:492] T 41e2f06b670f429ea32f5113440d391e P 39d829a384984eecb2eafc10dc296454: Bootstrap starting.
I20260709 12:12:35.459097 24575 raft_consensus.cc:2749] T 5820fb1bb4be48e0ad3288d8f5e2964a P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:35.460417 24565 raft_consensus.cc:2804] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:35.462064 24565 raft_consensus.cc:697] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [term 1 LEADER]: Becoming Leader. State: Replica: e47ae041170d47e2886bbd47c2fafb29, State: Running, Role: LEADER
I20260709 12:12:35.463135 24565 consensus_queue.cc:237] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.464941 24536 tablet_bootstrap.cc:654] T 41e2f06b670f429ea32f5113440d391e P 39d829a384984eecb2eafc10dc296454: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:35.468154 24462 leader_election.cc:343] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:35.468607 24569 raft_consensus.cc:493] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:12:35.469311 24462 leader_election.cc:343] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:35.469127 24569 raft_consensus.cc:515] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.472043 24346 raft_consensus.cc:2468] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47ae041170d47e2886bbd47c2fafb29 in term 1.
I20260709 12:12:35.473165 24497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5820fb1bb4be48e0ad3288d8f5e2964a" candidate_uuid: "39d829a384984eecb2eafc10dc296454" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47ae041170d47e2886bbd47c2fafb29" is_pre_election: true
I20260709 12:12:35.446110 24538 consensus_queue.cc:260] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
W20260709 12:12:35.474560 24386 leader_election.cc:343] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195:39005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:35.475685 24569 leader_election.cc:290] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193), e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195:39005)
I20260709 12:12:35.475939 24538 ts_tablet_manager.cc:1434] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.004s
I20260709 12:12:35.476502 24346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5820fb1bb4be48e0ad3288d8f5e2964a" candidate_uuid: "39d829a384984eecb2eafc10dc296454" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c4b72a25dd84163aad122cbdb994f4f" is_pre_election: true
I20260709 12:12:35.477161 24346 raft_consensus.cc:2468] T 5820fb1bb4be48e0ad3288d8f5e2964a P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39d829a384984eecb2eafc10dc296454 in term 0.
I20260709 12:12:35.478196 24388 leader_election.cc:304] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39d829a384984eecb2eafc10dc296454, 9c4b72a25dd84163aad122cbdb994f4f; no voters: e47ae041170d47e2886bbd47c2fafb29
I20260709 12:12:35.479430 24569 raft_consensus.cc:2804] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:35.479856 24569 raft_consensus.cc:493] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:35.480243 24569 raft_consensus.cc:3060] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:35.480412 24538 tablet_bootstrap.cc:492] T 548496e2da9c4999857fbd2bbfbd65b9 P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap starting.
I20260709 12:12:35.486547 24536 tablet_bootstrap.cc:492] T 41e2f06b670f429ea32f5113440d391e P 39d829a384984eecb2eafc10dc296454: No bootstrap required, opened a new log
I20260709 12:12:35.487146 24536 ts_tablet_manager.cc:1403] T 41e2f06b670f429ea32f5113440d391e P 39d829a384984eecb2eafc10dc296454: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.002s
I20260709 12:12:35.487409 24538 tablet_bootstrap.cc:654] T 548496e2da9c4999857fbd2bbfbd65b9 P 9c4b72a25dd84163aad122cbdb994f4f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:35.487905 24245 catalog_manager.cc:5697] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454 reported cstate change: term changed from 0 to 1, leader changed from <none> to 39d829a384984eecb2eafc10dc296454 (127.16.98.194). New cstate: current_term: 1 leader_uuid: "39d829a384984eecb2eafc10dc296454" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:35.488328 24569 raft_consensus.cc:515] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.489795 24536 raft_consensus.cc:359] T 41e2f06b670f429ea32f5113440d391e P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.490475 24536 raft_consensus.cc:385] T 41e2f06b670f429ea32f5113440d391e P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:35.490857 24536 raft_consensus.cc:740] T 41e2f06b670f429ea32f5113440d391e P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39d829a384984eecb2eafc10dc296454, State: Initialized, Role: FOLLOWER
I20260709 12:12:35.491767 24346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5820fb1bb4be48e0ad3288d8f5e2964a" candidate_uuid: "39d829a384984eecb2eafc10dc296454" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c4b72a25dd84163aad122cbdb994f4f"
I20260709 12:12:35.492355 24346 raft_consensus.cc:3060] T 5820fb1bb4be48e0ad3288d8f5e2964a P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:35.493335 24569 leader_election.cc:290] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 1 election: Requested vote from peers 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193), e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195:39005)
I20260709 12:12:35.495039 24497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5820fb1bb4be48e0ad3288d8f5e2964a" candidate_uuid: "39d829a384984eecb2eafc10dc296454" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47ae041170d47e2886bbd47c2fafb29"
W20260709 12:12:35.496309 24386 leader_election.cc:343] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195:39005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:35.500303 24537 tablet_bootstrap.cc:492] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29: No bootstrap required, opened a new log
I20260709 12:12:35.500838 24537 ts_tablet_manager.cc:1403] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29: Time spent bootstrapping tablet: real 0.090s	user 0.012s	sys 0.000s
I20260709 12:12:35.501650 24346 raft_consensus.cc:2468] T 5820fb1bb4be48e0ad3288d8f5e2964a P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39d829a384984eecb2eafc10dc296454 in term 1.
I20260709 12:12:35.502614 24536 consensus_queue.cc:260] T 41e2f06b670f429ea32f5113440d391e P 39d829a384984eecb2eafc10dc296454 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.503885 24537 raft_consensus.cc:359] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.504603 24537 raft_consensus.cc:385] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:35.504869 24537 raft_consensus.cc:740] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47ae041170d47e2886bbd47c2fafb29, State: Initialized, Role: FOLLOWER
I20260709 12:12:35.504925 24536 ts_tablet_manager.cc:1434] T 41e2f06b670f429ea32f5113440d391e P 39d829a384984eecb2eafc10dc296454: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:12:35.506035 24536 tablet_bootstrap.cc:492] T 10e58961518a493dbae703a1ce1eaefb P 39d829a384984eecb2eafc10dc296454: Bootstrap starting.
I20260709 12:12:35.505652 24537 consensus_queue.cc:260] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.506439 24388 leader_election.cc:304] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39d829a384984eecb2eafc10dc296454, 9c4b72a25dd84163aad122cbdb994f4f; no voters: e47ae041170d47e2886bbd47c2fafb29
I20260709 12:12:35.507342 24569 raft_consensus.cc:2804] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:35.507803 24569 raft_consensus.cc:697] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454 [term 1 LEADER]: Becoming Leader. State: Replica: 39d829a384984eecb2eafc10dc296454, State: Running, Role: LEADER
I20260709 12:12:35.507921 24537 ts_tablet_manager.cc:1434] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:12:35.508955 24537 tablet_bootstrap.cc:492] T 10e58961518a493dbae703a1ce1eaefb P e47ae041170d47e2886bbd47c2fafb29: Bootstrap starting.
I20260709 12:12:35.508665 24569 consensus_queue.cc:237] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.509516 24538 tablet_bootstrap.cc:492] T 548496e2da9c4999857fbd2bbfbd65b9 P 9c4b72a25dd84163aad122cbdb994f4f: No bootstrap required, opened a new log
I20260709 12:12:35.509979 24538 ts_tablet_manager.cc:1403] T 548496e2da9c4999857fbd2bbfbd65b9 P 9c4b72a25dd84163aad122cbdb994f4f: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.004s
I20260709 12:12:35.512499 24538 raft_consensus.cc:359] T 548496e2da9c4999857fbd2bbfbd65b9 P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.513168 24538 raft_consensus.cc:385] T 548496e2da9c4999857fbd2bbfbd65b9 P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:35.513422 24538 raft_consensus.cc:740] T 548496e2da9c4999857fbd2bbfbd65b9 P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c4b72a25dd84163aad122cbdb994f4f, State: Initialized, Role: FOLLOWER
I20260709 12:12:35.514045 24538 consensus_queue.cc:260] T 548496e2da9c4999857fbd2bbfbd65b9 P 9c4b72a25dd84163aad122cbdb994f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.516023 24538 ts_tablet_manager.cc:1434] T 548496e2da9c4999857fbd2bbfbd65b9 P 9c4b72a25dd84163aad122cbdb994f4f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:12:35.516947 24538 tablet_bootstrap.cc:492] T 10e58961518a493dbae703a1ce1eaefb P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap starting.
I20260709 12:12:35.517442 24537 tablet_bootstrap.cc:654] T 10e58961518a493dbae703a1ce1eaefb P e47ae041170d47e2886bbd47c2fafb29: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:35.519742 24536 tablet_bootstrap.cc:654] T 10e58961518a493dbae703a1ce1eaefb P 39d829a384984eecb2eafc10dc296454: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:35.522341 24538 tablet_bootstrap.cc:654] T 10e58961518a493dbae703a1ce1eaefb P 9c4b72a25dd84163aad122cbdb994f4f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:35.524871 24244 catalog_manager.cc:5697] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29 reported cstate change: term changed from 0 to 1, leader changed from <none> to e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "e47ae041170d47e2886bbd47c2fafb29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:35.528263 24244 catalog_manager.cc:5697] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 reported cstate change: term changed from 0 to 1, leader changed from <none> to e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "e47ae041170d47e2886bbd47c2fafb29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:35.537281 24243 catalog_manager.cc:5697] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454 reported cstate change: term changed from 0 to 1, leader changed from <none> to 39d829a384984eecb2eafc10dc296454 (127.16.98.194). New cstate: current_term: 1 leader_uuid: "39d829a384984eecb2eafc10dc296454" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:35.566720 24537 tablet_bootstrap.cc:492] T 10e58961518a493dbae703a1ce1eaefb P e47ae041170d47e2886bbd47c2fafb29: No bootstrap required, opened a new log
I20260709 12:12:35.567566 24537 ts_tablet_manager.cc:1403] T 10e58961518a493dbae703a1ce1eaefb P e47ae041170d47e2886bbd47c2fafb29: Time spent bootstrapping tablet: real 0.059s	user 0.026s	sys 0.004s
I20260709 12:12:35.572813 24537 raft_consensus.cc:359] T 10e58961518a493dbae703a1ce1eaefb P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.573825 24537 raft_consensus.cc:385] T 10e58961518a493dbae703a1ce1eaefb P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:35.574213 24537 raft_consensus.cc:740] T 10e58961518a493dbae703a1ce1eaefb P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47ae041170d47e2886bbd47c2fafb29, State: Initialized, Role: FOLLOWER
I20260709 12:12:35.575433 24537 consensus_queue.cc:260] T 10e58961518a493dbae703a1ce1eaefb P e47ae041170d47e2886bbd47c2fafb29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.578929 24537 ts_tablet_manager.cc:1434] T 10e58961518a493dbae703a1ce1eaefb P e47ae041170d47e2886bbd47c2fafb29: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.004s
I20260709 12:12:35.580381 24537 tablet_bootstrap.cc:492] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29: Bootstrap starting.
I20260709 12:12:35.589782 24538 tablet_bootstrap.cc:492] T 10e58961518a493dbae703a1ce1eaefb P 9c4b72a25dd84163aad122cbdb994f4f: No bootstrap required, opened a new log
I20260709 12:12:35.590345 24538 ts_tablet_manager.cc:1403] T 10e58961518a493dbae703a1ce1eaefb P 9c4b72a25dd84163aad122cbdb994f4f: Time spent bootstrapping tablet: real 0.074s	user 0.035s	sys 0.036s
I20260709 12:12:35.590431 24537 tablet_bootstrap.cc:654] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:35.590437 24536 tablet_bootstrap.cc:492] T 10e58961518a493dbae703a1ce1eaefb P 39d829a384984eecb2eafc10dc296454: No bootstrap required, opened a new log
I20260709 12:12:35.591208 24536 ts_tablet_manager.cc:1403] T 10e58961518a493dbae703a1ce1eaefb P 39d829a384984eecb2eafc10dc296454: Time spent bootstrapping tablet: real 0.085s	user 0.032s	sys 0.039s
I20260709 12:12:35.592984 24538 raft_consensus.cc:359] T 10e58961518a493dbae703a1ce1eaefb P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.593765 24538 raft_consensus.cc:385] T 10e58961518a493dbae703a1ce1eaefb P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:35.594100 24538 raft_consensus.cc:740] T 10e58961518a493dbae703a1ce1eaefb P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c4b72a25dd84163aad122cbdb994f4f, State: Initialized, Role: FOLLOWER
I20260709 12:12:35.593863 24536 raft_consensus.cc:359] T 10e58961518a493dbae703a1ce1eaefb P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.594628 24536 raft_consensus.cc:385] T 10e58961518a493dbae703a1ce1eaefb P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:35.594938 24536 raft_consensus.cc:740] T 10e58961518a493dbae703a1ce1eaefb P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39d829a384984eecb2eafc10dc296454, State: Initialized, Role: FOLLOWER
I20260709 12:12:35.594915 24538 consensus_queue.cc:260] T 10e58961518a493dbae703a1ce1eaefb P 9c4b72a25dd84163aad122cbdb994f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.595451 24537 tablet_bootstrap.cc:492] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29: No bootstrap required, opened a new log
I20260709 12:12:35.595937 24537 ts_tablet_manager.cc:1403] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 12:12:35.595760 24536 consensus_queue.cc:260] T 10e58961518a493dbae703a1ce1eaefb P 39d829a384984eecb2eafc10dc296454 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.597193 24538 ts_tablet_manager.cc:1434] T 10e58961518a493dbae703a1ce1eaefb P 9c4b72a25dd84163aad122cbdb994f4f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:12:35.597734 24536 ts_tablet_manager.cc:1434] T 10e58961518a493dbae703a1ce1eaefb P 39d829a384984eecb2eafc10dc296454: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:12:35.598117 24538 tablet_bootstrap.cc:492] T a8b1a3981dc94695a0930fb24a989e12 P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap starting.
I20260709 12:12:35.600385 24537 raft_consensus.cc:359] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.601043 24537 raft_consensus.cc:385] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:35.601306 24537 raft_consensus.cc:740] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47ae041170d47e2886bbd47c2fafb29, State: Initialized, Role: FOLLOWER
I20260709 12:12:35.602097 24537 consensus_queue.cc:260] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.604398 24537 ts_tablet_manager.cc:1434] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:12:35.604517 24538 tablet_bootstrap.cc:654] T a8b1a3981dc94695a0930fb24a989e12 P 9c4b72a25dd84163aad122cbdb994f4f: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:35.605297 24537 tablet_bootstrap.cc:492] T 41e2f06b670f429ea32f5113440d391e P e47ae041170d47e2886bbd47c2fafb29: Bootstrap starting.
I20260709 12:12:35.611980 24537 tablet_bootstrap.cc:654] T 41e2f06b670f429ea32f5113440d391e P e47ae041170d47e2886bbd47c2fafb29: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:35.614943 24538 tablet_bootstrap.cc:492] T a8b1a3981dc94695a0930fb24a989e12 P 9c4b72a25dd84163aad122cbdb994f4f: No bootstrap required, opened a new log
I20260709 12:12:35.615445 24538 ts_tablet_manager.cc:1403] T a8b1a3981dc94695a0930fb24a989e12 P 9c4b72a25dd84163aad122cbdb994f4f: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.003s
I20260709 12:12:35.617115 24537 tablet_bootstrap.cc:492] T 41e2f06b670f429ea32f5113440d391e P e47ae041170d47e2886bbd47c2fafb29: No bootstrap required, opened a new log
I20260709 12:12:35.617624 24537 ts_tablet_manager.cc:1403] T 41e2f06b670f429ea32f5113440d391e P e47ae041170d47e2886bbd47c2fafb29: Time spent bootstrapping tablet: real 0.013s	user 0.005s	sys 0.006s
I20260709 12:12:35.618016 24538 raft_consensus.cc:359] T a8b1a3981dc94695a0930fb24a989e12 P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.618743 24538 raft_consensus.cc:385] T a8b1a3981dc94695a0930fb24a989e12 P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:35.618988 24538 raft_consensus.cc:740] T a8b1a3981dc94695a0930fb24a989e12 P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c4b72a25dd84163aad122cbdb994f4f, State: Initialized, Role: FOLLOWER
I20260709 12:12:35.619725 24538 consensus_queue.cc:260] T a8b1a3981dc94695a0930fb24a989e12 P 9c4b72a25dd84163aad122cbdb994f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.620296 24537 raft_consensus.cc:359] T 41e2f06b670f429ea32f5113440d391e P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.620980 24537 raft_consensus.cc:385] T 41e2f06b670f429ea32f5113440d391e P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:35.621258 24537 raft_consensus.cc:740] T 41e2f06b670f429ea32f5113440d391e P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47ae041170d47e2886bbd47c2fafb29, State: Initialized, Role: FOLLOWER
I20260709 12:12:35.621687 24538 ts_tablet_manager.cc:1434] T a8b1a3981dc94695a0930fb24a989e12 P 9c4b72a25dd84163aad122cbdb994f4f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:12:35.622012 24537 consensus_queue.cc:260] T 41e2f06b670f429ea32f5113440d391e P e47ae041170d47e2886bbd47c2fafb29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.623970 24537 ts_tablet_manager.cc:1434] T 41e2f06b670f429ea32f5113440d391e P e47ae041170d47e2886bbd47c2fafb29: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:12:35.624884 24537 tablet_bootstrap.cc:492] T 5820fb1bb4be48e0ad3288d8f5e2964a P e47ae041170d47e2886bbd47c2fafb29: Bootstrap starting.
I20260709 12:12:35.626317 24543 raft_consensus.cc:493] T 10e58961518a493dbae703a1ce1eaefb P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.626865 24543 raft_consensus.cc:515] T 10e58961518a493dbae703a1ce1eaefb P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.629047 24543 leader_election.cc:290] T 10e58961518a493dbae703a1ce1eaefb P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193), 39d829a384984eecb2eafc10dc296454 (127.16.98.194:36921)
I20260709 12:12:35.629709 24346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e58961518a493dbae703a1ce1eaefb" candidate_uuid: "e47ae041170d47e2886bbd47c2fafb29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c4b72a25dd84163aad122cbdb994f4f" is_pre_election: true
I20260709 12:12:35.630259 24346 raft_consensus.cc:2468] T 10e58961518a493dbae703a1ce1eaefb P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47ae041170d47e2886bbd47c2fafb29 in term 0.
I20260709 12:12:35.630559 24537 tablet_bootstrap.cc:654] T 5820fb1bb4be48e0ad3288d8f5e2964a P e47ae041170d47e2886bbd47c2fafb29: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:35.630838 24423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e58961518a493dbae703a1ce1eaefb" candidate_uuid: "e47ae041170d47e2886bbd47c2fafb29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39d829a384984eecb2eafc10dc296454" is_pre_election: true
I20260709 12:12:35.631515 24423 raft_consensus.cc:2468] T 10e58961518a493dbae703a1ce1eaefb P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47ae041170d47e2886bbd47c2fafb29 in term 0.
I20260709 12:12:35.631645 24462 leader_election.cc:304] T 10e58961518a493dbae703a1ce1eaefb P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c4b72a25dd84163aad122cbdb994f4f, e47ae041170d47e2886bbd47c2fafb29; no voters: 
I20260709 12:12:35.633343 24543 raft_consensus.cc:2804] T 10e58961518a493dbae703a1ce1eaefb P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:35.633678 24543 raft_consensus.cc:493] T 10e58961518a493dbae703a1ce1eaefb P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:35.633898 24543 raft_consensus.cc:3060] T 10e58961518a493dbae703a1ce1eaefb P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:35.638906 24537 tablet_bootstrap.cc:492] T 5820fb1bb4be48e0ad3288d8f5e2964a P e47ae041170d47e2886bbd47c2fafb29: No bootstrap required, opened a new log
I20260709 12:12:35.639519 24537 ts_tablet_manager.cc:1403] T 5820fb1bb4be48e0ad3288d8f5e2964a P e47ae041170d47e2886bbd47c2fafb29: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 12:12:35.642112 24537 raft_consensus.cc:359] T 5820fb1bb4be48e0ad3288d8f5e2964a P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.642740 24537 raft_consensus.cc:385] T 5820fb1bb4be48e0ad3288d8f5e2964a P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:35.642997 24537 raft_consensus.cc:740] T 5820fb1bb4be48e0ad3288d8f5e2964a P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47ae041170d47e2886bbd47c2fafb29, State: Initialized, Role: FOLLOWER
I20260709 12:12:35.643613 24537 consensus_queue.cc:260] T 5820fb1bb4be48e0ad3288d8f5e2964a P e47ae041170d47e2886bbd47c2fafb29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.644917 24543 raft_consensus.cc:515] T 10e58961518a493dbae703a1ce1eaefb P e47ae041170d47e2886bbd47c2fafb29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.645571 24537 ts_tablet_manager.cc:1434] T 5820fb1bb4be48e0ad3288d8f5e2964a P e47ae041170d47e2886bbd47c2fafb29: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.003s
I20260709 12:12:35.646976 24543 leader_election.cc:290] T 10e58961518a493dbae703a1ce1eaefb P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 1 election: Requested vote from peers 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193), 39d829a384984eecb2eafc10dc296454 (127.16.98.194:36921)
I20260709 12:12:35.648033 24346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e58961518a493dbae703a1ce1eaefb" candidate_uuid: "e47ae041170d47e2886bbd47c2fafb29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c4b72a25dd84163aad122cbdb994f4f"
I20260709 12:12:35.647964 24423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e58961518a493dbae703a1ce1eaefb" candidate_uuid: "e47ae041170d47e2886bbd47c2fafb29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39d829a384984eecb2eafc10dc296454"
I20260709 12:12:35.648676 24346 raft_consensus.cc:3060] T 10e58961518a493dbae703a1ce1eaefb P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:35.648706 24423 raft_consensus.cc:3060] T 10e58961518a493dbae703a1ce1eaefb P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:35.655774 24423 raft_consensus.cc:2468] T 10e58961518a493dbae703a1ce1eaefb P 39d829a384984eecb2eafc10dc296454 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47ae041170d47e2886bbd47c2fafb29 in term 1.
I20260709 12:12:35.655774 24346 raft_consensus.cc:2468] T 10e58961518a493dbae703a1ce1eaefb P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47ae041170d47e2886bbd47c2fafb29 in term 1.
I20260709 12:12:35.656966 24462 leader_election.cc:304] T 10e58961518a493dbae703a1ce1eaefb P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39d829a384984eecb2eafc10dc296454, e47ae041170d47e2886bbd47c2fafb29; no voters: 
I20260709 12:12:35.657618 24543 raft_consensus.cc:2804] T 10e58961518a493dbae703a1ce1eaefb P e47ae041170d47e2886bbd47c2fafb29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:35.658041 24543 raft_consensus.cc:697] T 10e58961518a493dbae703a1ce1eaefb P e47ae041170d47e2886bbd47c2fafb29 [term 1 LEADER]: Becoming Leader. State: Replica: e47ae041170d47e2886bbd47c2fafb29, State: Running, Role: LEADER
I20260709 12:12:35.658798 24543 consensus_queue.cc:237] T 10e58961518a493dbae703a1ce1eaefb P e47ae041170d47e2886bbd47c2fafb29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.665421 24245 catalog_manager.cc:5697] T 10e58961518a493dbae703a1ce1eaefb P e47ae041170d47e2886bbd47c2fafb29 reported cstate change: term changed from 0 to 1, leader changed from <none> to e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "e47ae041170d47e2886bbd47c2fafb29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:35.671022 24543 raft_consensus.cc:493] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.671514 24543 raft_consensus.cc:515] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.673836 24543 leader_election.cc:290] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193), 39d829a384984eecb2eafc10dc296454 (127.16.98.194:36921)
I20260709 12:12:35.674669 24346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1a3981dc94695a0930fb24a989e12" candidate_uuid: "e47ae041170d47e2886bbd47c2fafb29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c4b72a25dd84163aad122cbdb994f4f" is_pre_election: true
I20260709 12:12:35.674994 24423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1a3981dc94695a0930fb24a989e12" candidate_uuid: "e47ae041170d47e2886bbd47c2fafb29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39d829a384984eecb2eafc10dc296454" is_pre_election: true
I20260709 12:12:35.675302 24346 raft_consensus.cc:2468] T a8b1a3981dc94695a0930fb24a989e12 P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47ae041170d47e2886bbd47c2fafb29 in term 0.
I20260709 12:12:35.675706 24423 raft_consensus.cc:2468] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47ae041170d47e2886bbd47c2fafb29 in term 0.
I20260709 12:12:35.676311 24462 leader_election.cc:304] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c4b72a25dd84163aad122cbdb994f4f, e47ae041170d47e2886bbd47c2fafb29; no voters: 
I20260709 12:12:35.677145 24543 raft_consensus.cc:2804] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:35.677489 24543 raft_consensus.cc:493] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:35.677788 24543 raft_consensus.cc:3060] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:35.683938 24543 raft_consensus.cc:515] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.685556 24543 leader_election.cc:290] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 1 election: Requested vote from peers 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193), 39d829a384984eecb2eafc10dc296454 (127.16.98.194:36921)
I20260709 12:12:35.686736 24423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1a3981dc94695a0930fb24a989e12" candidate_uuid: "e47ae041170d47e2886bbd47c2fafb29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39d829a384984eecb2eafc10dc296454"
I20260709 12:12:35.686388 24346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1a3981dc94695a0930fb24a989e12" candidate_uuid: "e47ae041170d47e2886bbd47c2fafb29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c4b72a25dd84163aad122cbdb994f4f"
I20260709 12:12:35.687254 24423 raft_consensus.cc:3060] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:35.687784 24346 raft_consensus.cc:3060] T a8b1a3981dc94695a0930fb24a989e12 P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:35.692574 24423 raft_consensus.cc:2468] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47ae041170d47e2886bbd47c2fafb29 in term 1.
I20260709 12:12:35.693820 24462 leader_election.cc:304] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39d829a384984eecb2eafc10dc296454, e47ae041170d47e2886bbd47c2fafb29; no voters: 
I20260709 12:12:35.694424 24346 raft_consensus.cc:2468] T a8b1a3981dc94695a0930fb24a989e12 P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47ae041170d47e2886bbd47c2fafb29 in term 1.
I20260709 12:12:35.694608 24543 raft_consensus.cc:2804] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:35.695267 24543 raft_consensus.cc:697] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [term 1 LEADER]: Becoming Leader. State: Replica: e47ae041170d47e2886bbd47c2fafb29, State: Running, Role: LEADER
I20260709 12:12:35.696079 24543 consensus_queue.cc:237] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.696971 24569 raft_consensus.cc:493] T 41e2f06b670f429ea32f5113440d391e P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.697402 24569 raft_consensus.cc:515] T 41e2f06b670f429ea32f5113440d391e P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.699303 24569 leader_election.cc:290] T 41e2f06b670f429ea32f5113440d391e P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193), e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195:39005)
I20260709 12:12:35.700158 24346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e2f06b670f429ea32f5113440d391e" candidate_uuid: "39d829a384984eecb2eafc10dc296454" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c4b72a25dd84163aad122cbdb994f4f" is_pre_election: true
I20260709 12:12:35.700837 24346 raft_consensus.cc:2468] T 41e2f06b670f429ea32f5113440d391e P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39d829a384984eecb2eafc10dc296454 in term 0.
I20260709 12:12:35.700917 24497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e2f06b670f429ea32f5113440d391e" candidate_uuid: "39d829a384984eecb2eafc10dc296454" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47ae041170d47e2886bbd47c2fafb29" is_pre_election: true
I20260709 12:12:35.701650 24497 raft_consensus.cc:2468] T 41e2f06b670f429ea32f5113440d391e P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39d829a384984eecb2eafc10dc296454 in term 0.
I20260709 12:12:35.702376 24388 leader_election.cc:304] T 41e2f06b670f429ea32f5113440d391e P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39d829a384984eecb2eafc10dc296454, 9c4b72a25dd84163aad122cbdb994f4f; no voters: 
I20260709 12:12:35.703238 24569 raft_consensus.cc:2804] T 41e2f06b670f429ea32f5113440d391e P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:35.703646 24569 raft_consensus.cc:493] T 41e2f06b670f429ea32f5113440d391e P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:35.704044 24569 raft_consensus.cc:3060] T 41e2f06b670f429ea32f5113440d391e P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:35.705318 24245 catalog_manager.cc:5697] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 reported cstate change: term changed from 0 to 1, leader changed from <none> to e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "e47ae041170d47e2886bbd47c2fafb29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:35.710894 24569 raft_consensus.cc:515] T 41e2f06b670f429ea32f5113440d391e P 39d829a384984eecb2eafc10dc296454 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.713095 24569 leader_election.cc:290] T 41e2f06b670f429ea32f5113440d391e P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 1 election: Requested vote from peers 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193), e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195:39005)
I20260709 12:12:35.714708 24497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e2f06b670f429ea32f5113440d391e" candidate_uuid: "39d829a384984eecb2eafc10dc296454" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47ae041170d47e2886bbd47c2fafb29"
I20260709 12:12:35.714797 24346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e2f06b670f429ea32f5113440d391e" candidate_uuid: "39d829a384984eecb2eafc10dc296454" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c4b72a25dd84163aad122cbdb994f4f"
I20260709 12:12:35.715543 24497 raft_consensus.cc:3060] T 41e2f06b670f429ea32f5113440d391e P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:35.715667 24346 raft_consensus.cc:3060] T 41e2f06b670f429ea32f5113440d391e P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:35.720643 24346 raft_consensus.cc:2468] T 41e2f06b670f429ea32f5113440d391e P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39d829a384984eecb2eafc10dc296454 in term 1.
I20260709 12:12:35.720861 24497 raft_consensus.cc:2468] T 41e2f06b670f429ea32f5113440d391e P e47ae041170d47e2886bbd47c2fafb29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39d829a384984eecb2eafc10dc296454 in term 1.
I20260709 12:12:35.721644 24388 leader_election.cc:304] T 41e2f06b670f429ea32f5113440d391e P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39d829a384984eecb2eafc10dc296454, 9c4b72a25dd84163aad122cbdb994f4f; no voters: 
I20260709 12:12:35.722468 24569 raft_consensus.cc:2804] T 41e2f06b670f429ea32f5113440d391e P 39d829a384984eecb2eafc10dc296454 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:35.723037 24569 raft_consensus.cc:697] T 41e2f06b670f429ea32f5113440d391e P 39d829a384984eecb2eafc10dc296454 [term 1 LEADER]: Becoming Leader. State: Replica: 39d829a384984eecb2eafc10dc296454, State: Running, Role: LEADER
I20260709 12:12:35.723826 24569 consensus_queue.cc:237] T 41e2f06b670f429ea32f5113440d391e P 39d829a384984eecb2eafc10dc296454 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.731667 24245 catalog_manager.cc:5697] T 41e2f06b670f429ea32f5113440d391e P 39d829a384984eecb2eafc10dc296454 reported cstate change: term changed from 0 to 1, leader changed from <none> to 39d829a384984eecb2eafc10dc296454 (127.16.98.194). New cstate: current_term: 1 leader_uuid: "39d829a384984eecb2eafc10dc296454" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:35.801774 24497 raft_consensus.cc:3060] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:35.808506 24569 consensus_queue.cc:1048] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:35.808846 24575 consensus_queue.cc:1048] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:35.826557 24544 consensus_queue.cc:1048] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:35.834426 24569 consensus_queue.cc:1048] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:35.843286 24544 raft_consensus.cc:493] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.843819 24544 raft_consensus.cc:515] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.844023 24569 consensus_queue.cc:1048] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:35.845989 24544 leader_election.cc:290] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39d829a384984eecb2eafc10dc296454 (127.16.98.194:36921), e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195:39005)
I20260709 12:12:35.847534 24495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca12c9e5314f109c3a0cf87037aa82" candidate_uuid: "9c4b72a25dd84163aad122cbdb994f4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47ae041170d47e2886bbd47c2fafb29" is_pre_election: true
I20260709 12:12:35.848182 24495 raft_consensus.cc:2468] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c4b72a25dd84163aad122cbdb994f4f in term 0.
I20260709 12:12:35.849013 24311 leader_election.cc:304] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c4b72a25dd84163aad122cbdb994f4f, e47ae041170d47e2886bbd47c2fafb29; no voters: 
I20260709 12:12:35.849685 24544 raft_consensus.cc:2804] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:35.850040 24544 raft_consensus.cc:493] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:35.850402 24544 raft_consensus.cc:3060] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:35.855082 24423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca12c9e5314f109c3a0cf87037aa82" candidate_uuid: "9c4b72a25dd84163aad122cbdb994f4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39d829a384984eecb2eafc10dc296454" is_pre_election: true
I20260709 12:12:35.855840 24423 raft_consensus.cc:2468] T 52ca12c9e5314f109c3a0cf87037aa82 P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c4b72a25dd84163aad122cbdb994f4f in term 0.
I20260709 12:12:35.857087 24544 raft_consensus.cc:515] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.859349 24544 leader_election.cc:290] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f [CANDIDATE]: Term 1 election: Requested vote from peers 39d829a384984eecb2eafc10dc296454 (127.16.98.194:36921), e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195:39005)
I20260709 12:12:35.860076 24423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca12c9e5314f109c3a0cf87037aa82" candidate_uuid: "9c4b72a25dd84163aad122cbdb994f4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39d829a384984eecb2eafc10dc296454"
I20260709 12:12:35.860389 24495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca12c9e5314f109c3a0cf87037aa82" candidate_uuid: "9c4b72a25dd84163aad122cbdb994f4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47ae041170d47e2886bbd47c2fafb29"
I20260709 12:12:35.860720 24423 raft_consensus.cc:3060] T 52ca12c9e5314f109c3a0cf87037aa82 P 39d829a384984eecb2eafc10dc296454 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:35.861033 24495 raft_consensus.cc:3060] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:35.867224 24563 consensus_queue.cc:1048] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:35.868610 24495 raft_consensus.cc:2468] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c4b72a25dd84163aad122cbdb994f4f in term 1.
I20260709 12:12:35.871383 24311 leader_election.cc:304] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c4b72a25dd84163aad122cbdb994f4f, e47ae041170d47e2886bbd47c2fafb29; no voters: 
I20260709 12:12:35.872812 24574 raft_consensus.cc:2804] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:35.873287 24574 raft_consensus.cc:697] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f [term 1 LEADER]: Becoming Leader. State: Replica: 9c4b72a25dd84163aad122cbdb994f4f, State: Running, Role: LEADER
I20260709 12:12:35.874085 24574 consensus_queue.cc:237] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.879669 24423 raft_consensus.cc:2468] T 52ca12c9e5314f109c3a0cf87037aa82 P 39d829a384984eecb2eafc10dc296454 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c4b72a25dd84163aad122cbdb994f4f in term 1.
I20260709 12:12:35.885842 24245 catalog_manager.cc:5697] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193). New cstate: current_term: 1 leader_uuid: "9c4b72a25dd84163aad122cbdb994f4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:35.889262 24574 raft_consensus.cc:493] T 548496e2da9c4999857fbd2bbfbd65b9 P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:35.889870 24574 raft_consensus.cc:515] T 548496e2da9c4999857fbd2bbfbd65b9 P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:35.891778 24574 leader_election.cc:290] T 548496e2da9c4999857fbd2bbfbd65b9 P 9c4b72a25dd84163aad122cbdb994f4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39d829a384984eecb2eafc10dc296454 (127.16.98.194:36921), e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195:39005)
I20260709 12:12:35.892518 24423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "548496e2da9c4999857fbd2bbfbd65b9" candidate_uuid: "9c4b72a25dd84163aad122cbdb994f4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39d829a384984eecb2eafc10dc296454" is_pre_election: true
I20260709 12:12:35.893431 24423 raft_consensus.cc:2393] T 548496e2da9c4999857fbd2bbfbd65b9 P 39d829a384984eecb2eafc10dc296454 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9c4b72a25dd84163aad122cbdb994f4f in current term 1: Already voted for candidate e47ae041170d47e2886bbd47c2fafb29 in this term.
I20260709 12:12:35.893446 24495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "548496e2da9c4999857fbd2bbfbd65b9" candidate_uuid: "9c4b72a25dd84163aad122cbdb994f4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47ae041170d47e2886bbd47c2fafb29" is_pre_election: true
I20260709 12:12:35.894958 24311 leader_election.cc:304] T 548496e2da9c4999857fbd2bbfbd65b9 P 9c4b72a25dd84163aad122cbdb994f4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9c4b72a25dd84163aad122cbdb994f4f; no voters: 39d829a384984eecb2eafc10dc296454, e47ae041170d47e2886bbd47c2fafb29
I20260709 12:12:35.895649 24574 raft_consensus.cc:3060] T 548496e2da9c4999857fbd2bbfbd65b9 P 9c4b72a25dd84163aad122cbdb994f4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:35.902381 24574 raft_consensus.cc:2749] T 548496e2da9c4999857fbd2bbfbd65b9 P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:35.944227 24543 consensus_queue.cc:1048] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:35.946547 16779 ts_manager.cc:295] Set tserver state for 9c4b72a25dd84163aad122cbdb994f4f to MAINTENANCE_MODE
I20260709 12:12:35.947453 16779 tablet_server.cc:179] TabletServer@127.16.98.193:0 shutting down...
W20260709 12:12:35.964084 24462 consensus_peers.cc:597] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 -> Peer 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193): Couldn't send request to peer 9c4b72a25dd84163aad122cbdb994f4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:35.983428 16779 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:35.984338 16779 tablet_replica.cc:333] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f: stopping tablet replica
I20260709 12:12:35.985212 16779 raft_consensus.cc:2243] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:35.985877 16779 pending_rounds.cc:70] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f: Trying to abort 1 pending ops.
I20260709 12:12:35.986081 16779 pending_rounds.cc:77] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305622142471315456 op_type: NO_OP noop_request { }
I20260709 12:12:35.986454 16779 raft_consensus.cc:2889] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:12:35.986852 16779 raft_consensus.cc:2272] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:35.988808 24388 consensus_peers.cc:597] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454 -> Peer 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193): Couldn't send request to peer 9c4b72a25dd84163aad122cbdb994f4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:35.989256 16779 tablet_replica.cc:333] T 548496e2da9c4999857fbd2bbfbd65b9 P 9c4b72a25dd84163aad122cbdb994f4f: stopping tablet replica
I20260709 12:12:35.989861 16779 raft_consensus.cc:2243] T 548496e2da9c4999857fbd2bbfbd65b9 P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:35.990226 16779 raft_consensus.cc:2272] T 548496e2da9c4999857fbd2bbfbd65b9 P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:35.992208 16779 tablet_replica.cc:333] T 5820fb1bb4be48e0ad3288d8f5e2964a P 9c4b72a25dd84163aad122cbdb994f4f: stopping tablet replica
I20260709 12:12:35.992744 16779 raft_consensus.cc:2243] T 5820fb1bb4be48e0ad3288d8f5e2964a P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:35.993110 16779 raft_consensus.cc:2272] T 5820fb1bb4be48e0ad3288d8f5e2964a P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:35.994745 16779 tablet_replica.cc:333] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 9c4b72a25dd84163aad122cbdb994f4f: stopping tablet replica
I20260709 12:12:35.995241 16779 raft_consensus.cc:2243] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:35.995625 16779 raft_consensus.cc:2272] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:35.997630 16779 tablet_replica.cc:333] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 9c4b72a25dd84163aad122cbdb994f4f: stopping tablet replica
I20260709 12:12:35.998160 16779 raft_consensus.cc:2243] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:35.998512 16779 raft_consensus.cc:2272] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:36.000103 16779 tablet_replica.cc:333] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f: stopping tablet replica
I20260709 12:12:36.000590 16779 raft_consensus.cc:2243] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:36.001304 16779 raft_consensus.cc:2272] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:36.003223 16779 tablet_replica.cc:333] T a8b1a3981dc94695a0930fb24a989e12 P 9c4b72a25dd84163aad122cbdb994f4f: stopping tablet replica
I20260709 12:12:36.003727 16779 raft_consensus.cc:2243] T a8b1a3981dc94695a0930fb24a989e12 P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:36.004086 16779 raft_consensus.cc:2272] T a8b1a3981dc94695a0930fb24a989e12 P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:36.005759 16779 tablet_replica.cc:333] T 10e58961518a493dbae703a1ce1eaefb P 9c4b72a25dd84163aad122cbdb994f4f: stopping tablet replica
I20260709 12:12:36.006276 16779 raft_consensus.cc:2243] T 10e58961518a493dbae703a1ce1eaefb P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:36.006636 16779 raft_consensus.cc:2272] T 10e58961518a493dbae703a1ce1eaefb P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:36.008517 16779 tablet_replica.cc:333] T 41e2f06b670f429ea32f5113440d391e P 9c4b72a25dd84163aad122cbdb994f4f: stopping tablet replica
I20260709 12:12:36.009022 16779 raft_consensus.cc:2243] T 41e2f06b670f429ea32f5113440d391e P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:36.009373 16779 raft_consensus.cc:2272] T 41e2f06b670f429ea32f5113440d391e P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:36.010990 16779 tablet_replica.cc:333] T 2a39cf3544aa4abbab194a49bb9f25b4 P 9c4b72a25dd84163aad122cbdb994f4f: stopping tablet replica
I20260709 12:12:36.011428 16779 raft_consensus.cc:2243] T 2a39cf3544aa4abbab194a49bb9f25b4 P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:36.011849 16779 raft_consensus.cc:2272] T 2a39cf3544aa4abbab194a49bb9f25b4 P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:36.030952 16779 tablet_server.cc:196] TabletServer@127.16.98.193:0 shutdown complete.
W20260709 12:12:36.042827 24462 consensus_peers.cc:597] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29 -> Peer 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193): Couldn't send request to peer 9c4b72a25dd84163aad122cbdb994f4f. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:41193: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:36.067914 24543 consensus_queue.cc:1048] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:12:36.091440 24462 consensus_peers.cc:597] T 10e58961518a493dbae703a1ce1eaefb P e47ae041170d47e2886bbd47c2fafb29 -> Peer 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193): Couldn't send request to peer 9c4b72a25dd84163aad122cbdb994f4f. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:41193: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:36.121248 24495 raft_consensus.cc:3060] T 5820fb1bb4be48e0ad3288d8f5e2964a P e47ae041170d47e2886bbd47c2fafb29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:36.127578 24563 consensus_queue.cc:1048] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:36.204668 24543 consensus_queue.cc:1048] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:12:36.221570 24462 consensus_peers.cc:597] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 -> Peer 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193): Couldn't send request to peer 9c4b72a25dd84163aad122cbdb994f4f. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:41193: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:36.247473 24562 consensus_queue.cc:1048] T 41e2f06b670f429ea32f5113440d391e P 39d829a384984eecb2eafc10dc296454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:12:36.248912 24388 consensus_peers.cc:597] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454 -> Peer 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193): Couldn't send request to peer 9c4b72a25dd84163aad122cbdb994f4f. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:41193: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:36.259196 24388 consensus_peers.cc:597] T 41e2f06b670f429ea32f5113440d391e P 39d829a384984eecb2eafc10dc296454 -> Peer 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193): Couldn't send request to peer 9c4b72a25dd84163aad122cbdb994f4f. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:41193: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:36.286552 24565 consensus_queue.cc:1048] T 10e58961518a493dbae703a1ce1eaefb P e47ae041170d47e2886bbd47c2fafb29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:12:36.346349 24388 consensus_peers.cc:597] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 -> Peer 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193): Couldn't send request to peer 9c4b72a25dd84163aad122cbdb994f4f. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:41193: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:36.350545 24293 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:12:37.318775 24565 raft_consensus.cc:493] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9c4b72a25dd84163aad122cbdb994f4f)
I20260709 12:12:37.319334 24565 raft_consensus.cc:515] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } }
I20260709 12:12:37.321020 24565 leader_election.cc:290] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 39d829a384984eecb2eafc10dc296454 (127.16.98.194:36921), 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193)
I20260709 12:12:37.321921 24423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e3d6296f2f457b8e190f2cf367f3ce" candidate_uuid: "e47ae041170d47e2886bbd47c2fafb29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "39d829a384984eecb2eafc10dc296454" is_pre_election: true
W20260709 12:12:37.324906 24462 leader_election.cc:336] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193): Network error: Client connection negotiation failed: client connection to 127.16.98.193:41193: connect: Connection refused (error 111)
I20260709 12:12:37.325382 24462 leader_election.cc:304] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e47ae041170d47e2886bbd47c2fafb29; no voters: 39d829a384984eecb2eafc10dc296454, 9c4b72a25dd84163aad122cbdb994f4f
I20260709 12:12:37.326079 24565 raft_consensus.cc:2749] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:12:37.333521 24563 raft_consensus.cc:493] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9c4b72a25dd84163aad122cbdb994f4f)
I20260709 12:12:37.334002 24563 raft_consensus.cc:515] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } }
I20260709 12:12:37.335948 24563 leader_election.cc:290] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195:39005), 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193)
I20260709 12:12:37.336982 24495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e3d6296f2f457b8e190f2cf367f3ce" candidate_uuid: "39d829a384984eecb2eafc10dc296454" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47ae041170d47e2886bbd47c2fafb29" is_pre_election: true
I20260709 12:12:37.337869 24495 raft_consensus.cc:2468] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39d829a384984eecb2eafc10dc296454 in term 1.
I20260709 12:12:37.339218 24386 leader_election.cc:304] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39d829a384984eecb2eafc10dc296454, e47ae041170d47e2886bbd47c2fafb29; no voters: 
I20260709 12:12:37.340126 24563 raft_consensus.cc:2804] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:12:37.340202 24388 leader_election.cc:336] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193): Network error: Client connection negotiation failed: client connection to 127.16.98.193:41193: connect: Connection refused (error 111)
I20260709 12:12:37.340585 24563 raft_consensus.cc:493] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9c4b72a25dd84163aad122cbdb994f4f)
I20260709 12:12:37.340968 24563 raft_consensus.cc:3060] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:37.345749 24563 raft_consensus.cc:515] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } }
I20260709 12:12:37.347287 24563 leader_election.cc:290] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 2 election: Requested vote from peers e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195:39005), 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193)
I20260709 12:12:37.348075 24495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e3d6296f2f457b8e190f2cf367f3ce" candidate_uuid: "39d829a384984eecb2eafc10dc296454" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e47ae041170d47e2886bbd47c2fafb29"
I20260709 12:12:37.348595 24495 raft_consensus.cc:3060] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:12:37.351665 24293 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:12:37.350960 24388 leader_election.cc:336] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193): Network error: Client connection negotiation failed: client connection to 127.16.98.193:41193: connect: Connection refused (error 111)
I20260709 12:12:37.354853 24495 raft_consensus.cc:2468] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39d829a384984eecb2eafc10dc296454 in term 2.
I20260709 12:12:37.355897 24386 leader_election.cc:304] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39d829a384984eecb2eafc10dc296454, e47ae041170d47e2886bbd47c2fafb29; no voters: 9c4b72a25dd84163aad122cbdb994f4f
I20260709 12:12:37.356593 24563 raft_consensus.cc:2804] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:37.357038 24563 raft_consensus.cc:697] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [term 2 LEADER]: Becoming Leader. State: Replica: 39d829a384984eecb2eafc10dc296454, State: Running, Role: LEADER
I20260709 12:12:37.357722 24563 consensus_queue.cc:237] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } }
I20260709 12:12:37.365238 24244 catalog_manager.cc:5697] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 reported cstate change: term changed from 1 to 2, leader changed from 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193) to 39d829a384984eecb2eafc10dc296454 (127.16.98.194). New cstate: current_term: 2 leader_uuid: "39d829a384984eecb2eafc10dc296454" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } health_report { overall_health: UNKNOWN } } }
W20260709 12:12:37.490720 24462 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.98.193:41193: connect: Connection refused (error 111) [suppressed 136 similar messages]
I20260709 12:12:37.805145 24495 raft_consensus.cc:1275] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29 [term 2 FOLLOWER]: Refusing update from remote peer 39d829a384984eecb2eafc10dc296454: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:37.806393 24563 consensus_queue.cc:1048] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:12:37.819788 24388 consensus_peers.cc:597] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 -> Peer 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193): Couldn't send request to peer 9c4b72a25dd84163aad122cbdb994f4f. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:41193: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:38.082659 24565 raft_consensus.cc:493] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:38.083251 24565 raft_consensus.cc:515] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:38.085072 24565 leader_election.cc:290] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193), 39d829a384984eecb2eafc10dc296454 (127.16.98.194:36921)
I20260709 12:12:38.086572 24423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca12c9e5314f109c3a0cf87037aa82" candidate_uuid: "e47ae041170d47e2886bbd47c2fafb29" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39d829a384984eecb2eafc10dc296454" is_pre_election: true
I20260709 12:12:38.087327 24423 raft_consensus.cc:2468] T 52ca12c9e5314f109c3a0cf87037aa82 P 39d829a384984eecb2eafc10dc296454 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47ae041170d47e2886bbd47c2fafb29 in term 1.
I20260709 12:12:38.088341 24462 leader_election.cc:304] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39d829a384984eecb2eafc10dc296454, e47ae041170d47e2886bbd47c2fafb29; no voters: 
I20260709 12:12:38.088951 24565 raft_consensus.cc:2804] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:12:38.088982 24462 leader_election.cc:336] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193): Network error: Client connection negotiation failed: client connection to 127.16.98.193:41193: connect: Connection refused (error 111)
I20260709 12:12:38.089299 24565 raft_consensus.cc:493] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:38.089645 24565 raft_consensus.cc:3060] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:38.094312 24565 raft_consensus.cc:515] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:38.095844 24565 leader_election.cc:290] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 2 election: Requested vote from peers 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193), 39d829a384984eecb2eafc10dc296454 (127.16.98.194:36921)
I20260709 12:12:38.097527 24423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca12c9e5314f109c3a0cf87037aa82" candidate_uuid: "e47ae041170d47e2886bbd47c2fafb29" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39d829a384984eecb2eafc10dc296454"
I20260709 12:12:38.098137 24423 raft_consensus.cc:3060] T 52ca12c9e5314f109c3a0cf87037aa82 P 39d829a384984eecb2eafc10dc296454 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:12:38.099699 24462 leader_election.cc:336] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193): Network error: Client connection negotiation failed: client connection to 127.16.98.193:41193: connect: Connection refused (error 111)
I20260709 12:12:38.103338 24423 raft_consensus.cc:2468] T 52ca12c9e5314f109c3a0cf87037aa82 P 39d829a384984eecb2eafc10dc296454 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47ae041170d47e2886bbd47c2fafb29 in term 2.
I20260709 12:12:38.104185 24462 leader_election.cc:304] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 39d829a384984eecb2eafc10dc296454, e47ae041170d47e2886bbd47c2fafb29; no voters: 9c4b72a25dd84163aad122cbdb994f4f
I20260709 12:12:38.104771 24565 raft_consensus.cc:2804] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:38.105543 24565 raft_consensus.cc:697] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29 [term 2 LEADER]: Becoming Leader. State: Replica: e47ae041170d47e2886bbd47c2fafb29, State: Running, Role: LEADER
I20260709 12:12:38.106359 24565 consensus_queue.cc:237] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:38.112650 24245 catalog_manager.cc:5697] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29 reported cstate change: term changed from 1 to 2, leader changed from 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193) to e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195). New cstate: current_term: 2 leader_uuid: "e47ae041170d47e2886bbd47c2fafb29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } health_report { overall_health: HEALTHY } } }
W20260709 12:12:38.352592 24293 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:12:38.486961 24462 consensus_peers.cc:597] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 -> Peer 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193): Couldn't send request to peer 9c4b72a25dd84163aad122cbdb994f4f. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:41193: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:38.494486 24423 raft_consensus.cc:1275] T 52ca12c9e5314f109c3a0cf87037aa82 P 39d829a384984eecb2eafc10dc296454 [term 2 FOLLOWER]: Refusing update from remote peer e47ae041170d47e2886bbd47c2fafb29: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:12:38.495764 24565 consensus_queue.cc:1048] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:12:38.508631 24462 consensus_peers.cc:597] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29 -> Peer 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193): Couldn't send request to peer 9c4b72a25dd84163aad122cbdb994f4f. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:41193: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:12:38.588985 24462 consensus_peers.cc:597] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29 -> Peer 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193): Couldn't send request to peer 9c4b72a25dd84163aad122cbdb994f4f. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:41193: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:38.669090 24388 consensus_peers.cc:597] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454 -> Peer 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193): Couldn't send request to peer 9c4b72a25dd84163aad122cbdb994f4f. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:41193: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:38.763957 24388 consensus_peers.cc:597] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454 -> Peer 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193): Couldn't send request to peer 9c4b72a25dd84163aad122cbdb994f4f. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:41193: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:38.812958 24462 consensus_peers.cc:597] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 -> Peer 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193): Couldn't send request to peer 9c4b72a25dd84163aad122cbdb994f4f. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:41193: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:38.842818 24462 consensus_peers.cc:597] T 10e58961518a493dbae703a1ce1eaefb P e47ae041170d47e2886bbd47c2fafb29 -> Peer 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193): Couldn't send request to peer 9c4b72a25dd84163aad122cbdb994f4f. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:41193: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:38.936976 24388 consensus_peers.cc:597] T 41e2f06b670f429ea32f5113440d391e P 39d829a384984eecb2eafc10dc296454 -> Peer 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193): Couldn't send request to peer 9c4b72a25dd84163aad122cbdb994f4f. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:41193: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:38.937409 24388 consensus_peers.cc:597] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 -> Peer 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193): Couldn't send request to peer 9c4b72a25dd84163aad122cbdb994f4f. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:41193: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:39.353519 24293 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:12:40.275628 24388 consensus_peers.cc:597] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 -> Peer 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193): Couldn't send request to peer 9c4b72a25dd84163aad122cbdb994f4f. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:41193: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:12:40.354449 24293 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:12:40.887178 24462 consensus_peers.cc:597] T 10e58961518a493dbae703a1ce1eaefb P e47ae041170d47e2886bbd47c2fafb29 -> Peer 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193): Couldn't send request to peer 9c4b72a25dd84163aad122cbdb994f4f. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:41193: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:40.896673 24462 consensus_peers.cc:597] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 -> Peer 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193): Couldn't send request to peer 9c4b72a25dd84163aad122cbdb994f4f. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:41193: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:12:41.043792 24388 consensus_peers.cc:597] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454 -> Peer 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193): Couldn't send request to peer 9c4b72a25dd84163aad122cbdb994f4f. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:41193: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:41.049095 16779 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:41.054920 24638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:41.055436 24639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:41.056893 24641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:41.058502 16779 server_base.cc:1061] running on GCE node
I20260709 12:12:41.059979 16779 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:41.060207 16779 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:41.060411 16779 hybrid_clock.cc:648] HybridClock initialized: now 1783599161060394 us; error 0 us; skew 500 ppm
I20260709 12:12:41.060954 16779 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:41.063242 16779 webserver.cc:533] Webserver started at http://127.16.98.193:35659/ using document root <none> and password file <none>
I20260709 12:12:41.063727 16779 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:41.063884 16779 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:12:41.067281 16779 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:12:41.070959 24646 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:41.071762 16779 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:12:41.072079 16779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895573690-16779-0/minicluster-data/ts-0-root
uuid: "9c4b72a25dd84163aad122cbdb994f4f"
format_stamp: "Formatted at 2026-07-09 12:12:34 on dist-test-slave-9bv4"
I20260709 12:12:41.072346 16779 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895573690-16779-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895573690-16779-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783598895573690-16779-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:41.085408 16779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:41.086436 16779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:41.088084 16779 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:41.091413 24653 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 12:12:41.133766 24462 consensus_peers.cc:597] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29 -> Peer 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193): Couldn't send request to peer 9c4b72a25dd84163aad122cbdb994f4f. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:41193: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:12:41.137715 16779 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:12:41.138072 16779 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.048s	user 0.000s	sys 0.002s
I20260709 12:12:41.138418 16779 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:12:41.143359 24653 tablet_bootstrap.cc:492] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap starting.
I20260709 12:12:41.155241 24653 tablet_bootstrap.cc:492] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:41.156108 24653 tablet_bootstrap.cc:492] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap complete.
I20260709 12:12:41.156729 24653 ts_tablet_manager.cc:1403] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.002s
I20260709 12:12:41.159219 24653 raft_consensus.cc:359] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } }
I20260709 12:12:41.159821 24653 raft_consensus.cc:740] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c4b72a25dd84163aad122cbdb994f4f, State: Initialized, Role: FOLLOWER
W20260709 12:12:41.160485 24388 consensus_peers.cc:597] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454 -> Peer 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193): Couldn't send request to peer 9c4b72a25dd84163aad122cbdb994f4f. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:41193: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:41.160624 24653 consensus_queue.cc:260] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } }
I20260709 12:12:41.163041 24653 ts_tablet_manager.cc:1434] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.002s
I20260709 12:12:41.163682 24653 tablet_bootstrap.cc:492] T 5820fb1bb4be48e0ad3288d8f5e2964a P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap starting.
I20260709 12:12:41.173245 24653 tablet_bootstrap.cc:492] T 5820fb1bb4be48e0ad3288d8f5e2964a P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:41.173966 24653 tablet_bootstrap.cc:492] T 5820fb1bb4be48e0ad3288d8f5e2964a P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap complete.
I20260709 12:12:41.174542 24653 ts_tablet_manager.cc:1403] T 5820fb1bb4be48e0ad3288d8f5e2964a P 9c4b72a25dd84163aad122cbdb994f4f: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:12:41.176441 24653 raft_consensus.cc:359] T 5820fb1bb4be48e0ad3288d8f5e2964a P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:41.176934 24653 raft_consensus.cc:740] T 5820fb1bb4be48e0ad3288d8f5e2964a P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c4b72a25dd84163aad122cbdb994f4f, State: Initialized, Role: FOLLOWER
I20260709 12:12:41.177469 16779 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:12:41.177783 16779 ts_tablet_manager.cc:595] Time spent register tablets: real 0.039s	user 0.036s	sys 0.001s
I20260709 12:12:41.177560 24653 consensus_queue.cc:260] T 5820fb1bb4be48e0ad3288d8f5e2964a P 9c4b72a25dd84163aad122cbdb994f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:41.179453 24653 ts_tablet_manager.cc:1434] T 5820fb1bb4be48e0ad3288d8f5e2964a P 9c4b72a25dd84163aad122cbdb994f4f: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 12:12:41.180096 24653 tablet_bootstrap.cc:492] T 2a39cf3544aa4abbab194a49bb9f25b4 P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap starting.
I20260709 12:12:41.192279 24653 tablet_bootstrap.cc:492] T 2a39cf3544aa4abbab194a49bb9f25b4 P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:41.193257 24653 tablet_bootstrap.cc:492] T 2a39cf3544aa4abbab194a49bb9f25b4 P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap complete.
I20260709 12:12:41.193890 24653 ts_tablet_manager.cc:1403] T 2a39cf3544aa4abbab194a49bb9f25b4 P 9c4b72a25dd84163aad122cbdb994f4f: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.002s
I20260709 12:12:41.196161 24653 raft_consensus.cc:359] T 2a39cf3544aa4abbab194a49bb9f25b4 P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:41.196712 24653 raft_consensus.cc:740] T 2a39cf3544aa4abbab194a49bb9f25b4 P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c4b72a25dd84163aad122cbdb994f4f, State: Initialized, Role: FOLLOWER
I20260709 12:12:41.197451 24653 consensus_queue.cc:260] T 2a39cf3544aa4abbab194a49bb9f25b4 P 9c4b72a25dd84163aad122cbdb994f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:41.199393 24653 ts_tablet_manager.cc:1434] T 2a39cf3544aa4abbab194a49bb9f25b4 P 9c4b72a25dd84163aad122cbdb994f4f: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.002s
I20260709 12:12:41.200053 24653 tablet_bootstrap.cc:492] T 548496e2da9c4999857fbd2bbfbd65b9 P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap starting.
W20260709 12:12:41.208787 24462 consensus_peers.cc:597] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29 -> Peer 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193): Couldn't send request to peer 9c4b72a25dd84163aad122cbdb994f4f. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:41193: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:12:41.211987 24653 tablet_bootstrap.cc:492] T 548496e2da9c4999857fbd2bbfbd65b9 P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:41.212687 24653 tablet_bootstrap.cc:492] T 548496e2da9c4999857fbd2bbfbd65b9 P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap complete.
I20260709 12:12:41.213209 24653 ts_tablet_manager.cc:1403] T 548496e2da9c4999857fbd2bbfbd65b9 P 9c4b72a25dd84163aad122cbdb994f4f: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 12:12:41.215051 24653 raft_consensus.cc:359] T 548496e2da9c4999857fbd2bbfbd65b9 P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:41.215554 24653 raft_consensus.cc:740] T 548496e2da9c4999857fbd2bbfbd65b9 P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c4b72a25dd84163aad122cbdb994f4f, State: Initialized, Role: FOLLOWER
I20260709 12:12:41.216141 24653 consensus_queue.cc:260] T 548496e2da9c4999857fbd2bbfbd65b9 P 9c4b72a25dd84163aad122cbdb994f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:41.217567 24653 ts_tablet_manager.cc:1434] T 548496e2da9c4999857fbd2bbfbd65b9 P 9c4b72a25dd84163aad122cbdb994f4f: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:12:41.218190 24653 tablet_bootstrap.cc:492] T 10e58961518a493dbae703a1ce1eaefb P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap starting.
I20260709 12:12:41.234716 24653 tablet_bootstrap.cc:492] T 10e58961518a493dbae703a1ce1eaefb P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:41.235782 24653 tablet_bootstrap.cc:492] T 10e58961518a493dbae703a1ce1eaefb P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap complete.
I20260709 12:12:41.236528 24653 ts_tablet_manager.cc:1403] T 10e58961518a493dbae703a1ce1eaefb P 9c4b72a25dd84163aad122cbdb994f4f: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.008s
I20260709 12:12:41.239255 24653 raft_consensus.cc:359] T 10e58961518a493dbae703a1ce1eaefb P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:41.240031 24653 raft_consensus.cc:740] T 10e58961518a493dbae703a1ce1eaefb P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c4b72a25dd84163aad122cbdb994f4f, State: Initialized, Role: FOLLOWER
I20260709 12:12:41.241051 16779 rpc_server.cc:307] RPC server started. Bound to: 127.16.98.193:41193
I20260709 12:12:41.240891 24653 consensus_queue.cc:260] T 10e58961518a493dbae703a1ce1eaefb P 9c4b72a25dd84163aad122cbdb994f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:41.241127 24715 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.98.193:41193 every 8 connection(s)
I20260709 12:12:41.242864 24653 ts_tablet_manager.cc:1434] T 10e58961518a493dbae703a1ce1eaefb P 9c4b72a25dd84163aad122cbdb994f4f: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:12:41.243605 24653 tablet_bootstrap.cc:492] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap starting.
W20260709 12:12:41.245931 24717 tablet.cc:2406] T 10e58961518a493dbae703a1ce1eaefb P 9c4b72a25dd84163aad122cbdb994f4f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:12:41.246227 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:41.255930 24653 tablet_bootstrap.cc:492] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:41.257742 24653 tablet_bootstrap.cc:492] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap complete.
I20260709 12:12:41.258387 24653 ts_tablet_manager.cc:1403] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 9c4b72a25dd84163aad122cbdb994f4f: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.005s
I20260709 12:12:41.261161 24653 raft_consensus.cc:359] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:41.262038 24653 raft_consensus.cc:740] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c4b72a25dd84163aad122cbdb994f4f, State: Initialized, Role: FOLLOWER
I20260709 12:12:41.263100 24653 consensus_queue.cc:260] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 9c4b72a25dd84163aad122cbdb994f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:41.265713 24653 ts_tablet_manager.cc:1434] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 9c4b72a25dd84163aad122cbdb994f4f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:12:41.266587 24653 tablet_bootstrap.cc:492] T a8b1a3981dc94695a0930fb24a989e12 P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap starting.
I20260709 12:12:41.269698 24716 heartbeater.cc:344] Connected to a master server at 127.16.98.254:34979
I20260709 12:12:41.270304 24716 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:41.271358 24716 heartbeater.cc:507] Master 127.16.98.254:34979 requested a full tablet report, sending...
I20260709 12:12:41.278936 24244 ts_manager.cc:194] Re-registered known tserver with Master: 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193)
I20260709 12:12:41.289083 24244 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44398
I20260709 12:12:41.289850 24653 tablet_bootstrap.cc:492] T a8b1a3981dc94695a0930fb24a989e12 P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:41.290859 24653 tablet_bootstrap.cc:492] T a8b1a3981dc94695a0930fb24a989e12 P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap complete.
I20260709 12:12:41.291491 24653 ts_tablet_manager.cc:1403] T a8b1a3981dc94695a0930fb24a989e12 P 9c4b72a25dd84163aad122cbdb994f4f: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.007s
I20260709 12:12:41.292667 24716 heartbeater.cc:499] Master 127.16.98.254:34979 was elected leader, sending a full tablet report...
I20260709 12:12:41.293985 24653 raft_consensus.cc:359] T a8b1a3981dc94695a0930fb24a989e12 P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:41.294633 24653 raft_consensus.cc:740] T a8b1a3981dc94695a0930fb24a989e12 P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c4b72a25dd84163aad122cbdb994f4f, State: Initialized, Role: FOLLOWER
I20260709 12:12:41.295339 24653 consensus_queue.cc:260] T a8b1a3981dc94695a0930fb24a989e12 P 9c4b72a25dd84163aad122cbdb994f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:41.297165 24653 ts_tablet_manager.cc:1434] T a8b1a3981dc94695a0930fb24a989e12 P 9c4b72a25dd84163aad122cbdb994f4f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:12:41.297413 24495 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "548496e2da9c4999857fbd2bbfbd65b9"
dest_uuid: "e47ae041170d47e2886bbd47c2fafb29"
mode: GRACEFUL
new_leader_uuid: "39d829a384984eecb2eafc10dc296454"
 from {username='slave'} at 127.0.0.1:56422
I20260709 12:12:41.297964 24653 tablet_bootstrap.cc:492] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap starting.
I20260709 12:12:41.298146 24495 raft_consensus.cc:606] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [term 1 LEADER]: Received request to transfer leadership to TS 39d829a384984eecb2eafc10dc296454
I20260709 12:12:41.304883 24495 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8b1a3981dc94695a0930fb24a989e12"
dest_uuid: "e47ae041170d47e2886bbd47c2fafb29"
mode: GRACEFUL
new_leader_uuid: "39d829a384984eecb2eafc10dc296454"
 from {username='slave'} at 127.0.0.1:56422
I20260709 12:12:41.305440 24495 raft_consensus.cc:606] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [term 1 LEADER]: Received request to transfer leadership to TS 39d829a384984eecb2eafc10dc296454
I20260709 12:12:41.311192 24725 raft_consensus.cc:993] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29: : Instructing follower 39d829a384984eecb2eafc10dc296454 to start an election
I20260709 12:12:41.311781 24637 raft_consensus.cc:1081] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [term 1 LEADER]: Signalling peer 39d829a384984eecb2eafc10dc296454 to start an election
I20260709 12:12:41.313546 24423 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "548496e2da9c4999857fbd2bbfbd65b9"
dest_uuid: "39d829a384984eecb2eafc10dc296454"
 from {username='slave'} at 127.0.0.1:42334
I20260709 12:12:41.314229 24423 raft_consensus.cc:493] T 548496e2da9c4999857fbd2bbfbd65b9 P 39d829a384984eecb2eafc10dc296454 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:41.314556 24423 raft_consensus.cc:3060] T 548496e2da9c4999857fbd2bbfbd65b9 P 39d829a384984eecb2eafc10dc296454 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:41.322190 24423 raft_consensus.cc:515] T 548496e2da9c4999857fbd2bbfbd65b9 P 39d829a384984eecb2eafc10dc296454 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:41.324241 24423 leader_election.cc:290] T 548496e2da9c4999857fbd2bbfbd65b9 P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 2 election: Requested vote from peers 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193), e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195:39005)
I20260709 12:12:41.324970 24690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "548496e2da9c4999857fbd2bbfbd65b9" candidate_uuid: "39d829a384984eecb2eafc10dc296454" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9c4b72a25dd84163aad122cbdb994f4f"
I20260709 12:12:41.325650 24690 raft_consensus.cc:3060] T 548496e2da9c4999857fbd2bbfbd65b9 P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:41.325981 24495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "548496e2da9c4999857fbd2bbfbd65b9" candidate_uuid: "39d829a384984eecb2eafc10dc296454" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e47ae041170d47e2886bbd47c2fafb29"
I20260709 12:12:41.326586 24495 raft_consensus.cc:3055] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:41.327016 24495 raft_consensus.cc:740] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e47ae041170d47e2886bbd47c2fafb29, State: Running, Role: LEADER
I20260709 12:12:41.327175 24653 tablet_bootstrap.cc:492] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:12:41.328172 24653 tablet_bootstrap.cc:492] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap complete.
I20260709 12:12:41.327860 24495 consensus_queue.cc:260] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:41.328814 24653 ts_tablet_manager.cc:1403] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f: Time spent bootstrapping tablet: real 0.031s	user 0.022s	sys 0.005s
I20260709 12:12:41.329115 24495 raft_consensus.cc:3060] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:41.331248 24653 raft_consensus.cc:359] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:41.331775 24690 raft_consensus.cc:2468] T 548496e2da9c4999857fbd2bbfbd65b9 P 9c4b72a25dd84163aad122cbdb994f4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39d829a384984eecb2eafc10dc296454 in term 2.
I20260709 12:12:41.332141 24653 raft_consensus.cc:740] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c4b72a25dd84163aad122cbdb994f4f, State: Initialized, Role: FOLLOWER
I20260709 12:12:41.333115 24689 raft_consensus.cc:3060] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:41.332912 24653 consensus_queue.cc:260] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:41.333341 24388 leader_election.cc:304] T 548496e2da9c4999857fbd2bbfbd65b9 P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39d829a384984eecb2eafc10dc296454, 9c4b72a25dd84163aad122cbdb994f4f; no voters: 
I20260709 12:12:41.334349 24562 raft_consensus.cc:2804] T 548496e2da9c4999857fbd2bbfbd65b9 P 39d829a384984eecb2eafc10dc296454 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:41.337693 24562 raft_consensus.cc:697] T 548496e2da9c4999857fbd2bbfbd65b9 P 39d829a384984eecb2eafc10dc296454 [term 2 LEADER]: Becoming Leader. State: Replica: 39d829a384984eecb2eafc10dc296454, State: Running, Role: LEADER
I20260709 12:12:41.337838 24653 ts_tablet_manager.cc:1434] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:12:41.339020 24653 tablet_bootstrap.cc:492] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap starting.
I20260709 12:12:41.338809 24562 consensus_queue.cc:237] T 548496e2da9c4999857fbd2bbfbd65b9 P 39d829a384984eecb2eafc10dc296454 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:41.346192 24423 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dacd7f79e6cd4d09a8cc8df8ec88f32c"
dest_uuid: "39d829a384984eecb2eafc10dc296454"
mode: GRACEFUL
new_leader_uuid: "e47ae041170d47e2886bbd47c2fafb29"
 from {username='slave'} at 127.0.0.1:36810
I20260709 12:12:41.346932 24423 raft_consensus.cc:606] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454 [term 1 LEADER]: Received request to transfer leadership to TS e47ae041170d47e2886bbd47c2fafb29
I20260709 12:12:41.350183 24495 raft_consensus.cc:2468] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39d829a384984eecb2eafc10dc296454 in term 2.
I20260709 12:12:41.352501 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:12:41.353104 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:41.353804 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:12:41.355406 24293 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:12:41.362284 24244 catalog_manager.cc:5697] T 548496e2da9c4999857fbd2bbfbd65b9 P 39d829a384984eecb2eafc10dc296454 reported cstate change: term changed from 1 to 2, leader changed from e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195) to 39d829a384984eecb2eafc10dc296454 (127.16.98.194). New cstate: current_term: 2 leader_uuid: "39d829a384984eecb2eafc10dc296454" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:41.363309 24653 tablet_bootstrap.cc:492] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:41.364298 24653 tablet_bootstrap.cc:492] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap complete.
I20260709 12:12:41.364923 24653 ts_tablet_manager.cc:1403] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 9c4b72a25dd84163aad122cbdb994f4f: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.008s
I20260709 12:12:41.366993 24653 raft_consensus.cc:359] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:41.367488 24653 raft_consensus.cc:740] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c4b72a25dd84163aad122cbdb994f4f, State: Initialized, Role: FOLLOWER
I20260709 12:12:41.368278 24653 consensus_queue.cc:260] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 9c4b72a25dd84163aad122cbdb994f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:41.369836 24653 ts_tablet_manager.cc:1434] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 9c4b72a25dd84163aad122cbdb994f4f: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:12:41.370466 24653 tablet_bootstrap.cc:492] T 41e2f06b670f429ea32f5113440d391e P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap starting.
I20260709 12:12:41.382856 24653 tablet_bootstrap.cc:492] T 41e2f06b670f429ea32f5113440d391e P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:12:41.383520 24653 tablet_bootstrap.cc:492] T 41e2f06b670f429ea32f5113440d391e P 9c4b72a25dd84163aad122cbdb994f4f: Bootstrap complete.
I20260709 12:12:41.384043 24653 ts_tablet_manager.cc:1403] T 41e2f06b670f429ea32f5113440d391e P 9c4b72a25dd84163aad122cbdb994f4f: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:12:41.385682 24653 raft_consensus.cc:359] T 41e2f06b670f429ea32f5113440d391e P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:41.386140 24653 raft_consensus.cc:740] T 41e2f06b670f429ea32f5113440d391e P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c4b72a25dd84163aad122cbdb994f4f, State: Initialized, Role: FOLLOWER
I20260709 12:12:41.386767 24653 consensus_queue.cc:260] T 41e2f06b670f429ea32f5113440d391e P 9c4b72a25dd84163aad122cbdb994f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:41.388473 24653 ts_tablet_manager.cc:1434] T 41e2f06b670f429ea32f5113440d391e P 9c4b72a25dd84163aad122cbdb994f4f: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:12:41.477723 24637 raft_consensus.cc:993] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29: : Instructing follower 39d829a384984eecb2eafc10dc296454 to start an election
I20260709 12:12:41.478189 24725 raft_consensus.cc:1081] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [term 1 LEADER]: Signalling peer 39d829a384984eecb2eafc10dc296454 to start an election
I20260709 12:12:41.479549 24423 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8b1a3981dc94695a0930fb24a989e12"
dest_uuid: "39d829a384984eecb2eafc10dc296454"
 from {username='slave'} at 127.0.0.1:42334
I20260709 12:12:41.480083 24423 raft_consensus.cc:493] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:41.480444 24423 raft_consensus.cc:3060] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:41.485777 24423 raft_consensus.cc:515] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:41.487430 24423 leader_election.cc:290] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 2 election: Requested vote from peers 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193), e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195:39005)
I20260709 12:12:41.488215 24689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1a3981dc94695a0930fb24a989e12" candidate_uuid: "39d829a384984eecb2eafc10dc296454" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9c4b72a25dd84163aad122cbdb994f4f"
I20260709 12:12:41.488580 24495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1a3981dc94695a0930fb24a989e12" candidate_uuid: "39d829a384984eecb2eafc10dc296454" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e47ae041170d47e2886bbd47c2fafb29"
I20260709 12:12:41.488772 24689 raft_consensus.cc:3060] T a8b1a3981dc94695a0930fb24a989e12 P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:41.489167 24495 raft_consensus.cc:3055] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:41.489475 24495 raft_consensus.cc:740] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e47ae041170d47e2886bbd47c2fafb29, State: Running, Role: LEADER
I20260709 12:12:41.490242 24495 consensus_queue.cc:260] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:41.491343 24495 raft_consensus.cc:3060] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:41.493839 24689 raft_consensus.cc:2468] T a8b1a3981dc94695a0930fb24a989e12 P 9c4b72a25dd84163aad122cbdb994f4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39d829a384984eecb2eafc10dc296454 in term 2.
I20260709 12:12:41.494922 24388 leader_election.cc:304] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39d829a384984eecb2eafc10dc296454, 9c4b72a25dd84163aad122cbdb994f4f; no voters: 
I20260709 12:12:41.495739 24562 raft_consensus.cc:2804] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:41.496160 24562 raft_consensus.cc:697] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [term 2 LEADER]: Becoming Leader. State: Replica: 39d829a384984eecb2eafc10dc296454, State: Running, Role: LEADER
I20260709 12:12:41.496934 24562 consensus_queue.cc:237] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:41.497154 24495 raft_consensus.cc:2468] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39d829a384984eecb2eafc10dc296454 in term 2.
I20260709 12:12:41.503621 24245 catalog_manager.cc:5697] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 reported cstate change: term changed from 1 to 2, leader changed from e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195) to 39d829a384984eecb2eafc10dc296454 (127.16.98.194). New cstate: current_term: 2 leader_uuid: "39d829a384984eecb2eafc10dc296454" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:41.536228 24728 raft_consensus.cc:993] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454: : Instructing follower e47ae041170d47e2886bbd47c2fafb29 to start an election
I20260709 12:12:41.536708 24562 raft_consensus.cc:1081] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454 [term 1 LEADER]: Signalling peer e47ae041170d47e2886bbd47c2fafb29 to start an election
I20260709 12:12:41.538856 24495 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dacd7f79e6cd4d09a8cc8df8ec88f32c"
dest_uuid: "e47ae041170d47e2886bbd47c2fafb29"
 from {username='slave'} at 127.0.0.1:47194
I20260709 12:12:41.539405 24495 raft_consensus.cc:493] T dacd7f79e6cd4d09a8cc8df8ec88f32c P e47ae041170d47e2886bbd47c2fafb29 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:41.539814 24495 raft_consensus.cc:3060] T dacd7f79e6cd4d09a8cc8df8ec88f32c P e47ae041170d47e2886bbd47c2fafb29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:41.546219 24495 raft_consensus.cc:515] T dacd7f79e6cd4d09a8cc8df8ec88f32c P e47ae041170d47e2886bbd47c2fafb29 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:41.547999 24495 leader_election.cc:290] T dacd7f79e6cd4d09a8cc8df8ec88f32c P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 2 election: Requested vote from peers 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193), 39d829a384984eecb2eafc10dc296454 (127.16.98.194:36921)
I20260709 12:12:41.548695 24689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dacd7f79e6cd4d09a8cc8df8ec88f32c" candidate_uuid: "e47ae041170d47e2886bbd47c2fafb29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9c4b72a25dd84163aad122cbdb994f4f"
I20260709 12:12:41.549036 24423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dacd7f79e6cd4d09a8cc8df8ec88f32c" candidate_uuid: "e47ae041170d47e2886bbd47c2fafb29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "39d829a384984eecb2eafc10dc296454"
I20260709 12:12:41.549364 24689 raft_consensus.cc:3060] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:41.549657 24423 raft_consensus.cc:3055] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:41.550004 24423 raft_consensus.cc:740] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 39d829a384984eecb2eafc10dc296454, State: Running, Role: LEADER
I20260709 12:12:41.550777 24423 consensus_queue.cc:260] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:41.551697 24423 raft_consensus.cc:3060] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:41.555617 24689 raft_consensus.cc:2468] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 9c4b72a25dd84163aad122cbdb994f4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47ae041170d47e2886bbd47c2fafb29 in term 2.
I20260709 12:12:41.556388 24423 raft_consensus.cc:2468] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47ae041170d47e2886bbd47c2fafb29 in term 2.
I20260709 12:12:41.556535 24462 leader_election.cc:304] T dacd7f79e6cd4d09a8cc8df8ec88f32c P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c4b72a25dd84163aad122cbdb994f4f, e47ae041170d47e2886bbd47c2fafb29; no voters: 
I20260709 12:12:41.557317 24725 raft_consensus.cc:2804] T dacd7f79e6cd4d09a8cc8df8ec88f32c P e47ae041170d47e2886bbd47c2fafb29 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:41.557770 24725 raft_consensus.cc:697] T dacd7f79e6cd4d09a8cc8df8ec88f32c P e47ae041170d47e2886bbd47c2fafb29 [term 2 LEADER]: Becoming Leader. State: Replica: e47ae041170d47e2886bbd47c2fafb29, State: Running, Role: LEADER
I20260709 12:12:41.558368 24725 consensus_queue.cc:237] T dacd7f79e6cd4d09a8cc8df8ec88f32c P e47ae041170d47e2886bbd47c2fafb29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:41.565495 24245 catalog_manager.cc:5697] T dacd7f79e6cd4d09a8cc8df8ec88f32c P e47ae041170d47e2886bbd47c2fafb29 reported cstate change: term changed from 1 to 2, leader changed from 39d829a384984eecb2eafc10dc296454 (127.16.98.194) to e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195). New cstate: current_term: 2 leader_uuid: "e47ae041170d47e2886bbd47c2fafb29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:41.752696 24689 raft_consensus.cc:3060] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:41.753094 24690 raft_consensus.cc:1275] T 548496e2da9c4999857fbd2bbfbd65b9 P 9c4b72a25dd84163aad122cbdb994f4f [term 2 FOLLOWER]: Refusing update from remote peer 39d829a384984eecb2eafc10dc296454: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:41.754524 24562 consensus_queue.cc:1048] T 548496e2da9c4999857fbd2bbfbd65b9 P 39d829a384984eecb2eafc10dc296454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:41.759811 24689 pending_rounds.cc:85] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f: Aborting all ops after (but not including) 0
I20260709 12:12:41.760198 24689 pending_rounds.cc:107] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:12:41.760471 24689 raft_consensus.cc:2889] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:12:41.767344 24495 raft_consensus.cc:1275] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [term 2 FOLLOWER]: Refusing update from remote peer 39d829a384984eecb2eafc10dc296454: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:41.769253 24562 consensus_queue.cc:1048] T 548496e2da9c4999857fbd2bbfbd65b9 P 39d829a384984eecb2eafc10dc296454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:41.999269 24495 raft_consensus.cc:1275] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [term 2 FOLLOWER]: Refusing update from remote peer 39d829a384984eecb2eafc10dc296454: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:42.000571 24728 consensus_queue.cc:1048] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:42.009013 24690 raft_consensus.cc:1275] T a8b1a3981dc94695a0930fb24a989e12 P 9c4b72a25dd84163aad122cbdb994f4f [term 2 FOLLOWER]: Refusing update from remote peer 39d829a384984eecb2eafc10dc296454: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:42.010537 24562 consensus_queue.cc:1048] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:42.099112 24690 raft_consensus.cc:1275] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 9c4b72a25dd84163aad122cbdb994f4f [term 2 FOLLOWER]: Refusing update from remote peer e47ae041170d47e2886bbd47c2fafb29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:42.100436 24752 consensus_queue.cc:1048] T dacd7f79e6cd4d09a8cc8df8ec88f32c P e47ae041170d47e2886bbd47c2fafb29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:42.109038 24423 raft_consensus.cc:1275] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454 [term 2 FOLLOWER]: Refusing update from remote peer e47ae041170d47e2886bbd47c2fafb29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:42.110796 24754 consensus_queue.cc:1048] T dacd7f79e6cd4d09a8cc8df8ec88f32c P e47ae041170d47e2886bbd47c2fafb29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:12:42.356405 24293 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:12:42.365020 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:42.372818 24495 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10e58961518a493dbae703a1ce1eaefb"
dest_uuid: "e47ae041170d47e2886bbd47c2fafb29"
mode: GRACEFUL
new_leader_uuid: "39d829a384984eecb2eafc10dc296454"
 from {username='slave'} at 127.0.0.1:56422
I20260709 12:12:42.373368 24495 raft_consensus.cc:606] T 10e58961518a493dbae703a1ce1eaefb P e47ae041170d47e2886bbd47c2fafb29 [term 1 LEADER]: Received request to transfer leadership to TS 39d829a384984eecb2eafc10dc296454
I20260709 12:12:42.375825 24423 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41e2f06b670f429ea32f5113440d391e"
dest_uuid: "39d829a384984eecb2eafc10dc296454"
mode: GRACEFUL
new_leader_uuid: "e47ae041170d47e2886bbd47c2fafb29"
 from {username='slave'} at 127.0.0.1:36810
I20260709 12:12:42.376272 24423 raft_consensus.cc:606] T 41e2f06b670f429ea32f5113440d391e P 39d829a384984eecb2eafc10dc296454 [term 1 LEADER]: Received request to transfer leadership to TS e47ae041170d47e2886bbd47c2fafb29
I20260709 12:12:42.378432 24423 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8b1a3981dc94695a0930fb24a989e12"
dest_uuid: "39d829a384984eecb2eafc10dc296454"
mode: GRACEFUL
new_leader_uuid: "e47ae041170d47e2886bbd47c2fafb29"
 from {username='slave'} at 127.0.0.1:36810
I20260709 12:12:42.378942 24423 raft_consensus.cc:606] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [term 2 LEADER]: Received request to transfer leadership to TS e47ae041170d47e2886bbd47c2fafb29
I20260709 12:12:42.379829 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:12:42.380419 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:42.381055 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:42.555939 24754 raft_consensus.cc:993] T 10e58961518a493dbae703a1ce1eaefb P e47ae041170d47e2886bbd47c2fafb29: : Instructing follower 39d829a384984eecb2eafc10dc296454 to start an election
I20260709 12:12:42.556378 24637 raft_consensus.cc:1081] T 10e58961518a493dbae703a1ce1eaefb P e47ae041170d47e2886bbd47c2fafb29 [term 1 LEADER]: Signalling peer 39d829a384984eecb2eafc10dc296454 to start an election
I20260709 12:12:42.557875 24423 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10e58961518a493dbae703a1ce1eaefb"
dest_uuid: "39d829a384984eecb2eafc10dc296454"
 from {username='slave'} at 127.0.0.1:42334
I20260709 12:12:42.558386 24423 raft_consensus.cc:493] T 10e58961518a493dbae703a1ce1eaefb P 39d829a384984eecb2eafc10dc296454 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:42.558718 24423 raft_consensus.cc:3060] T 10e58961518a493dbae703a1ce1eaefb P 39d829a384984eecb2eafc10dc296454 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:42.563093 24423 raft_consensus.cc:515] T 10e58961518a493dbae703a1ce1eaefb P 39d829a384984eecb2eafc10dc296454 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:42.564435 24423 leader_election.cc:290] T 10e58961518a493dbae703a1ce1eaefb P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 2 election: Requested vote from peers 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193), e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195:39005)
I20260709 12:12:42.565253 24690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e58961518a493dbae703a1ce1eaefb" candidate_uuid: "39d829a384984eecb2eafc10dc296454" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9c4b72a25dd84163aad122cbdb994f4f"
I20260709 12:12:42.565335 24495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e58961518a493dbae703a1ce1eaefb" candidate_uuid: "39d829a384984eecb2eafc10dc296454" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e47ae041170d47e2886bbd47c2fafb29"
I20260709 12:12:42.565932 24690 raft_consensus.cc:3060] T 10e58961518a493dbae703a1ce1eaefb P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:42.566030 24495 raft_consensus.cc:3055] T 10e58961518a493dbae703a1ce1eaefb P e47ae041170d47e2886bbd47c2fafb29 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:42.566431 24495 raft_consensus.cc:740] T 10e58961518a493dbae703a1ce1eaefb P e47ae041170d47e2886bbd47c2fafb29 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e47ae041170d47e2886bbd47c2fafb29, State: Running, Role: LEADER
I20260709 12:12:42.567021 24495 consensus_queue.cc:260] T 10e58961518a493dbae703a1ce1eaefb P e47ae041170d47e2886bbd47c2fafb29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:42.567867 24495 raft_consensus.cc:3060] T 10e58961518a493dbae703a1ce1eaefb P e47ae041170d47e2886bbd47c2fafb29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:42.570930 24690 raft_consensus.cc:2468] T 10e58961518a493dbae703a1ce1eaefb P 9c4b72a25dd84163aad122cbdb994f4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39d829a384984eecb2eafc10dc296454 in term 2.
I20260709 12:12:42.572162 24495 raft_consensus.cc:2468] T 10e58961518a493dbae703a1ce1eaefb P e47ae041170d47e2886bbd47c2fafb29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39d829a384984eecb2eafc10dc296454 in term 2.
I20260709 12:12:42.572094 24388 leader_election.cc:304] T 10e58961518a493dbae703a1ce1eaefb P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39d829a384984eecb2eafc10dc296454, 9c4b72a25dd84163aad122cbdb994f4f; no voters: 
I20260709 12:12:42.573040 24562 raft_consensus.cc:2804] T 10e58961518a493dbae703a1ce1eaefb P 39d829a384984eecb2eafc10dc296454 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:42.573514 24562 raft_consensus.cc:697] T 10e58961518a493dbae703a1ce1eaefb P 39d829a384984eecb2eafc10dc296454 [term 2 LEADER]: Becoming Leader. State: Replica: 39d829a384984eecb2eafc10dc296454, State: Running, Role: LEADER
I20260709 12:12:42.574441 24562 consensus_queue.cc:237] T 10e58961518a493dbae703a1ce1eaefb P 39d829a384984eecb2eafc10dc296454 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:42.581364 24244 catalog_manager.cc:5697] T 10e58961518a493dbae703a1ce1eaefb P 39d829a384984eecb2eafc10dc296454 reported cstate change: term changed from 1 to 2, leader changed from e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195) to 39d829a384984eecb2eafc10dc296454 (127.16.98.194). New cstate: current_term: 2 leader_uuid: "39d829a384984eecb2eafc10dc296454" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:42.584846 24750 raft_consensus.cc:993] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454: : Instructing follower e47ae041170d47e2886bbd47c2fafb29 to start an election
I20260709 12:12:42.585392 24562 raft_consensus.cc:1081] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [term 2 LEADER]: Signalling peer e47ae041170d47e2886bbd47c2fafb29 to start an election
I20260709 12:12:42.586751 24495 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8b1a3981dc94695a0930fb24a989e12"
dest_uuid: "e47ae041170d47e2886bbd47c2fafb29"
 from {username='slave'} at 127.0.0.1:47194
I20260709 12:12:42.587337 24495 raft_consensus.cc:493] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:42.587634 24495 raft_consensus.cc:3060] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:42.592933 24495 raft_consensus.cc:515] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:42.594352 24495 leader_election.cc:290] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 3 election: Requested vote from peers 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193), 39d829a384984eecb2eafc10dc296454 (127.16.98.194:36921)
I20260709 12:12:42.595100 24690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1a3981dc94695a0930fb24a989e12" candidate_uuid: "e47ae041170d47e2886bbd47c2fafb29" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9c4b72a25dd84163aad122cbdb994f4f"
I20260709 12:12:42.595271 24423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1a3981dc94695a0930fb24a989e12" candidate_uuid: "e47ae041170d47e2886bbd47c2fafb29" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "39d829a384984eecb2eafc10dc296454"
I20260709 12:12:42.595705 24690 raft_consensus.cc:3060] T a8b1a3981dc94695a0930fb24a989e12 P 9c4b72a25dd84163aad122cbdb994f4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:42.595839 24423 raft_consensus.cc:3055] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:42.596189 24423 raft_consensus.cc:740] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 39d829a384984eecb2eafc10dc296454, State: Running, Role: LEADER
I20260709 12:12:42.596824 24423 consensus_queue.cc:260] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:42.597672 24423 raft_consensus.cc:3060] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:42.600529 24690 raft_consensus.cc:2468] T a8b1a3981dc94695a0930fb24a989e12 P 9c4b72a25dd84163aad122cbdb994f4f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47ae041170d47e2886bbd47c2fafb29 in term 3.
I20260709 12:12:42.601519 24462 leader_election.cc:304] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c4b72a25dd84163aad122cbdb994f4f, e47ae041170d47e2886bbd47c2fafb29; no voters: 
I20260709 12:12:42.602027 24423 raft_consensus.cc:2468] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47ae041170d47e2886bbd47c2fafb29 in term 3.
I20260709 12:12:42.602185 24637 raft_consensus.cc:2804] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:42.602674 24637 raft_consensus.cc:697] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [term 3 LEADER]: Becoming Leader. State: Replica: e47ae041170d47e2886bbd47c2fafb29, State: Running, Role: LEADER
I20260709 12:12:42.603449 24637 consensus_queue.cc:237] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:42.609292 24244 catalog_manager.cc:5697] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 reported cstate change: term changed from 2 to 3, leader changed from 39d829a384984eecb2eafc10dc296454 (127.16.98.194) to e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195). New cstate: current_term: 3 leader_uuid: "e47ae041170d47e2886bbd47c2fafb29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:42.747958 24750 raft_consensus.cc:993] T 41e2f06b670f429ea32f5113440d391e P 39d829a384984eecb2eafc10dc296454: : Instructing follower e47ae041170d47e2886bbd47c2fafb29 to start an election
I20260709 12:12:42.748689 24562 raft_consensus.cc:1081] T 41e2f06b670f429ea32f5113440d391e P 39d829a384984eecb2eafc10dc296454 [term 1 LEADER]: Signalling peer e47ae041170d47e2886bbd47c2fafb29 to start an election
I20260709 12:12:42.750602 24495 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41e2f06b670f429ea32f5113440d391e"
dest_uuid: "e47ae041170d47e2886bbd47c2fafb29"
 from {username='slave'} at 127.0.0.1:47194
I20260709 12:12:42.751281 24495 raft_consensus.cc:493] T 41e2f06b670f429ea32f5113440d391e P e47ae041170d47e2886bbd47c2fafb29 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:42.751593 24495 raft_consensus.cc:3060] T 41e2f06b670f429ea32f5113440d391e P e47ae041170d47e2886bbd47c2fafb29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:42.758492 24495 raft_consensus.cc:515] T 41e2f06b670f429ea32f5113440d391e P e47ae041170d47e2886bbd47c2fafb29 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:42.760294 24495 leader_election.cc:290] T 41e2f06b670f429ea32f5113440d391e P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 2 election: Requested vote from peers 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193), 39d829a384984eecb2eafc10dc296454 (127.16.98.194:36921)
I20260709 12:12:42.761746 24423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e2f06b670f429ea32f5113440d391e" candidate_uuid: "e47ae041170d47e2886bbd47c2fafb29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "39d829a384984eecb2eafc10dc296454"
I20260709 12:12:42.761932 24690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e2f06b670f429ea32f5113440d391e" candidate_uuid: "e47ae041170d47e2886bbd47c2fafb29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9c4b72a25dd84163aad122cbdb994f4f"
I20260709 12:12:42.762465 24423 raft_consensus.cc:3055] T 41e2f06b670f429ea32f5113440d391e P 39d829a384984eecb2eafc10dc296454 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:42.762849 24423 raft_consensus.cc:740] T 41e2f06b670f429ea32f5113440d391e P 39d829a384984eecb2eafc10dc296454 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 39d829a384984eecb2eafc10dc296454, State: Running, Role: LEADER
I20260709 12:12:42.762857 24690 raft_consensus.cc:3060] T 41e2f06b670f429ea32f5113440d391e P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:42.763805 24423 consensus_queue.cc:260] T 41e2f06b670f429ea32f5113440d391e P 39d829a384984eecb2eafc10dc296454 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:42.765553 24423 raft_consensus.cc:3060] T 41e2f06b670f429ea32f5113440d391e P 39d829a384984eecb2eafc10dc296454 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:42.773257 24690 raft_consensus.cc:2468] T 41e2f06b670f429ea32f5113440d391e P 9c4b72a25dd84163aad122cbdb994f4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47ae041170d47e2886bbd47c2fafb29 in term 2.
I20260709 12:12:42.774955 24462 leader_election.cc:304] T 41e2f06b670f429ea32f5113440d391e P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c4b72a25dd84163aad122cbdb994f4f, e47ae041170d47e2886bbd47c2fafb29; no voters: 
I20260709 12:12:42.775854 24752 raft_consensus.cc:2804] T 41e2f06b670f429ea32f5113440d391e P e47ae041170d47e2886bbd47c2fafb29 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:42.776101 24423 raft_consensus.cc:2468] T 41e2f06b670f429ea32f5113440d391e P 39d829a384984eecb2eafc10dc296454 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47ae041170d47e2886bbd47c2fafb29 in term 2.
I20260709 12:12:42.776361 24752 raft_consensus.cc:697] T 41e2f06b670f429ea32f5113440d391e P e47ae041170d47e2886bbd47c2fafb29 [term 2 LEADER]: Becoming Leader. State: Replica: e47ae041170d47e2886bbd47c2fafb29, State: Running, Role: LEADER
I20260709 12:12:42.778172 24752 consensus_queue.cc:237] T 41e2f06b670f429ea32f5113440d391e P e47ae041170d47e2886bbd47c2fafb29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:42.789747 24244 catalog_manager.cc:5697] T 41e2f06b670f429ea32f5113440d391e P e47ae041170d47e2886bbd47c2fafb29 reported cstate change: term changed from 1 to 2, leader changed from 39d829a384984eecb2eafc10dc296454 (127.16.98.194) to e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195). New cstate: current_term: 2 leader_uuid: "e47ae041170d47e2886bbd47c2fafb29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:43.121001 24423 raft_consensus.cc:1275] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [term 3 FOLLOWER]: Refusing update from remote peer e47ae041170d47e2886bbd47c2fafb29: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:43.122329 24752 consensus_queue.cc:1048] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:43.133818 24690 raft_consensus.cc:1275] T a8b1a3981dc94695a0930fb24a989e12 P 9c4b72a25dd84163aad122cbdb994f4f [term 3 FOLLOWER]: Refusing update from remote peer e47ae041170d47e2886bbd47c2fafb29: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:43.135619 24689 raft_consensus.cc:1275] T 10e58961518a493dbae703a1ce1eaefb P 9c4b72a25dd84163aad122cbdb994f4f [term 2 FOLLOWER]: Refusing update from remote peer 39d829a384984eecb2eafc10dc296454: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:43.136207 24752 consensus_queue.cc:1048] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:43.137324 24562 consensus_queue.cc:1048] T 10e58961518a493dbae703a1ce1eaefb P 39d829a384984eecb2eafc10dc296454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:43.148948 24495 raft_consensus.cc:1275] T 10e58961518a493dbae703a1ce1eaefb P e47ae041170d47e2886bbd47c2fafb29 [term 2 FOLLOWER]: Refusing update from remote peer 39d829a384984eecb2eafc10dc296454: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:43.151227 24562 consensus_queue.cc:1048] T 10e58961518a493dbae703a1ce1eaefb P 39d829a384984eecb2eafc10dc296454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:43.251034 24423 raft_consensus.cc:1275] T 41e2f06b670f429ea32f5113440d391e P 39d829a384984eecb2eafc10dc296454 [term 2 FOLLOWER]: Refusing update from remote peer e47ae041170d47e2886bbd47c2fafb29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:43.252111 24752 consensus_queue.cc:1048] T 41e2f06b670f429ea32f5113440d391e P e47ae041170d47e2886bbd47c2fafb29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:43.261752 24690 raft_consensus.cc:1275] T 41e2f06b670f429ea32f5113440d391e P 9c4b72a25dd84163aad122cbdb994f4f [term 2 FOLLOWER]: Refusing update from remote peer e47ae041170d47e2886bbd47c2fafb29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:43.264070 24774 consensus_queue.cc:1048] T 41e2f06b670f429ea32f5113440d391e P e47ae041170d47e2886bbd47c2fafb29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:12:43.357554 24293 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:12:43.388099 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:43.396656 24423 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08e3d6296f2f457b8e190f2cf367f3ce"
dest_uuid: "39d829a384984eecb2eafc10dc296454"
mode: GRACEFUL
new_leader_uuid: "e47ae041170d47e2886bbd47c2fafb29"
 from {username='slave'} at 127.0.0.1:36810
I20260709 12:12:43.397204 24423 raft_consensus.cc:606] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [term 2 LEADER]: Received request to transfer leadership to TS e47ae041170d47e2886bbd47c2fafb29
I20260709 12:12:43.399792 24495 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8b1a3981dc94695a0930fb24a989e12"
dest_uuid: "e47ae041170d47e2886bbd47c2fafb29"
mode: GRACEFUL
new_leader_uuid: "39d829a384984eecb2eafc10dc296454"
 from {username='slave'} at 127.0.0.1:56422
I20260709 12:12:43.400223 24495 raft_consensus.cc:606] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [term 3 LEADER]: Received request to transfer leadership to TS 39d829a384984eecb2eafc10dc296454
I20260709 12:12:43.402853 24495 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf1f14b4d6d744f4bb57e6ec43bd3a15"
dest_uuid: "e47ae041170d47e2886bbd47c2fafb29"
mode: GRACEFUL
new_leader_uuid: "39d829a384984eecb2eafc10dc296454"
 from {username='slave'} at 127.0.0.1:56422
I20260709 12:12:43.403316 24495 raft_consensus.cc:606] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29 [term 1 LEADER]: Received request to transfer leadership to TS 39d829a384984eecb2eafc10dc296454
I20260709 12:12:43.404527 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:12:43.405009 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:43.405704 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:43.730170 24752 raft_consensus.cc:993] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29: : Instructing follower 39d829a384984eecb2eafc10dc296454 to start an election
I20260709 12:12:43.730677 24774 raft_consensus.cc:1081] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [term 3 LEADER]: Signalling peer 39d829a384984eecb2eafc10dc296454 to start an election
I20260709 12:12:43.732100 24423 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8b1a3981dc94695a0930fb24a989e12"
dest_uuid: "39d829a384984eecb2eafc10dc296454"
 from {username='slave'} at 127.0.0.1:42334
I20260709 12:12:43.732498 24423 raft_consensus.cc:493] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:43.732721 24423 raft_consensus.cc:3060] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:43.738059 24423 raft_consensus.cc:515] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:43.739624 24423 leader_election.cc:290] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 4 election: Requested vote from peers 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193), e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195:39005)
I20260709 12:12:43.740387 24690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1a3981dc94695a0930fb24a989e12" candidate_uuid: "39d829a384984eecb2eafc10dc296454" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9c4b72a25dd84163aad122cbdb994f4f"
I20260709 12:12:43.740669 24495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b1a3981dc94695a0930fb24a989e12" candidate_uuid: "39d829a384984eecb2eafc10dc296454" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e47ae041170d47e2886bbd47c2fafb29"
I20260709 12:12:43.741031 24690 raft_consensus.cc:3060] T a8b1a3981dc94695a0930fb24a989e12 P 9c4b72a25dd84163aad122cbdb994f4f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:43.741168 24495 raft_consensus.cc:3055] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:43.741557 24495 raft_consensus.cc:740] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e47ae041170d47e2886bbd47c2fafb29, State: Running, Role: LEADER
I20260709 12:12:43.742427 24495 consensus_queue.cc:260] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:43.743674 24495 raft_consensus.cc:3060] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:43.748265 24690 raft_consensus.cc:2468] T a8b1a3981dc94695a0930fb24a989e12 P 9c4b72a25dd84163aad122cbdb994f4f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39d829a384984eecb2eafc10dc296454 in term 4.
I20260709 12:12:43.749657 24388 leader_election.cc:304] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39d829a384984eecb2eafc10dc296454, 9c4b72a25dd84163aad122cbdb994f4f; no voters: 
I20260709 12:12:43.750036 24495 raft_consensus.cc:2468] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39d829a384984eecb2eafc10dc296454 in term 4.
I20260709 12:12:43.750353 24772 raft_consensus.cc:2804] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:43.751545 24772 raft_consensus.cc:697] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [term 4 LEADER]: Becoming Leader. State: Replica: 39d829a384984eecb2eafc10dc296454, State: Running, Role: LEADER
I20260709 12:12:43.752650 24772 consensus_queue.cc:237] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:43.759547 24774 raft_consensus.cc:993] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29: : Instructing follower 39d829a384984eecb2eafc10dc296454 to start an election
I20260709 12:12:43.760269 24637 raft_consensus.cc:1081] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29 [term 1 LEADER]: Signalling peer 39d829a384984eecb2eafc10dc296454 to start an election
I20260709 12:12:43.760246 24245 catalog_manager.cc:5697] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 reported cstate change: term changed from 3 to 4, leader changed from e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195) to 39d829a384984eecb2eafc10dc296454 (127.16.98.194). New cstate: current_term: 4 leader_uuid: "39d829a384984eecb2eafc10dc296454" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:43.762138 24423 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf1f14b4d6d744f4bb57e6ec43bd3a15"
dest_uuid: "39d829a384984eecb2eafc10dc296454"
 from {username='slave'} at 127.0.0.1:42334
I20260709 12:12:43.762620 24423 raft_consensus.cc:493] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 39d829a384984eecb2eafc10dc296454 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:43.762966 24423 raft_consensus.cc:3060] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 39d829a384984eecb2eafc10dc296454 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:43.770020 24423 raft_consensus.cc:515] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 39d829a384984eecb2eafc10dc296454 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:43.771718 24423 leader_election.cc:290] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 2 election: Requested vote from peers 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193), e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195:39005)
I20260709 12:12:43.772642 24495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f14b4d6d744f4bb57e6ec43bd3a15" candidate_uuid: "39d829a384984eecb2eafc10dc296454" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e47ae041170d47e2886bbd47c2fafb29"
I20260709 12:12:43.772539 24690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf1f14b4d6d744f4bb57e6ec43bd3a15" candidate_uuid: "39d829a384984eecb2eafc10dc296454" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9c4b72a25dd84163aad122cbdb994f4f"
I20260709 12:12:43.773340 24495 raft_consensus.cc:3055] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:43.773415 24690 raft_consensus.cc:3060] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:43.773734 24495 raft_consensus.cc:740] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e47ae041170d47e2886bbd47c2fafb29, State: Running, Role: LEADER
I20260709 12:12:43.774748 24495 consensus_queue.cc:260] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:43.775962 24495 raft_consensus.cc:3060] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:43.781015 24690 raft_consensus.cc:2468] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 9c4b72a25dd84163aad122cbdb994f4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39d829a384984eecb2eafc10dc296454 in term 2.
I20260709 12:12:43.782141 24388 leader_election.cc:304] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39d829a384984eecb2eafc10dc296454, 9c4b72a25dd84163aad122cbdb994f4f; no voters: 
I20260709 12:12:43.782727 24495 raft_consensus.cc:2468] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39d829a384984eecb2eafc10dc296454 in term 2.
I20260709 12:12:43.782910 24772 raft_consensus.cc:2804] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 39d829a384984eecb2eafc10dc296454 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:43.783491 24772 raft_consensus.cc:697] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 39d829a384984eecb2eafc10dc296454 [term 2 LEADER]: Becoming Leader. State: Replica: 39d829a384984eecb2eafc10dc296454, State: Running, Role: LEADER
I20260709 12:12:43.784420 24772 consensus_queue.cc:237] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 39d829a384984eecb2eafc10dc296454 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:43.791020 24245 catalog_manager.cc:5697] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 39d829a384984eecb2eafc10dc296454 reported cstate change: term changed from 1 to 2, leader changed from e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195) to 39d829a384984eecb2eafc10dc296454 (127.16.98.194). New cstate: current_term: 2 leader_uuid: "39d829a384984eecb2eafc10dc296454" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:43.805923 24776 raft_consensus.cc:993] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454: : Instructing follower e47ae041170d47e2886bbd47c2fafb29 to start an election
I20260709 12:12:43.806375 24772 raft_consensus.cc:1081] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [term 2 LEADER]: Signalling peer e47ae041170d47e2886bbd47c2fafb29 to start an election
I20260709 12:12:43.807842 24495 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08e3d6296f2f457b8e190f2cf367f3ce"
dest_uuid: "e47ae041170d47e2886bbd47c2fafb29"
 from {username='slave'} at 127.0.0.1:47194
I20260709 12:12:43.808281 24495 raft_consensus.cc:493] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:43.808570 24495 raft_consensus.cc:3060] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:43.812852 24495 raft_consensus.cc:515] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } }
I20260709 12:12:43.814324 24495 leader_election.cc:290] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 3 election: Requested vote from peers 39d829a384984eecb2eafc10dc296454 (127.16.98.194:36921), 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193)
I20260709 12:12:43.814994 24423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e3d6296f2f457b8e190f2cf367f3ce" candidate_uuid: "e47ae041170d47e2886bbd47c2fafb29" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "39d829a384984eecb2eafc10dc296454"
I20260709 12:12:43.815394 24690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e3d6296f2f457b8e190f2cf367f3ce" candidate_uuid: "e47ae041170d47e2886bbd47c2fafb29" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9c4b72a25dd84163aad122cbdb994f4f"
I20260709 12:12:43.815644 24423 raft_consensus.cc:3055] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:43.815932 24423 raft_consensus.cc:740] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 39d829a384984eecb2eafc10dc296454, State: Running, Role: LEADER
I20260709 12:12:43.815995 24690 raft_consensus.cc:3060] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:43.816901 24423 consensus_queue.cc:260] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } }
I20260709 12:12:43.818156 24423 raft_consensus.cc:3060] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:43.823027 24690 raft_consensus.cc:2468] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47ae041170d47e2886bbd47c2fafb29 in term 3.
I20260709 12:12:43.824164 24462 leader_election.cc:304] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c4b72a25dd84163aad122cbdb994f4f, e47ae041170d47e2886bbd47c2fafb29; no voters: 
I20260709 12:12:43.824571 24423 raft_consensus.cc:2468] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47ae041170d47e2886bbd47c2fafb29 in term 3.
I20260709 12:12:43.824811 24637 raft_consensus.cc:2804] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:43.825321 24637 raft_consensus.cc:697] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29 [term 3 LEADER]: Becoming Leader. State: Replica: e47ae041170d47e2886bbd47c2fafb29, State: Running, Role: LEADER
I20260709 12:12:43.826361 24637 consensus_queue.cc:237] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } }
I20260709 12:12:43.833232 24245 catalog_manager.cc:5697] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29 reported cstate change: term changed from 2 to 3, leader changed from 39d829a384984eecb2eafc10dc296454 (127.16.98.194) to e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195). New cstate: current_term: 3 leader_uuid: "e47ae041170d47e2886bbd47c2fafb29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:44.169925 24690 raft_consensus.cc:1275] T a8b1a3981dc94695a0930fb24a989e12 P 9c4b72a25dd84163aad122cbdb994f4f [term 4 FOLLOWER]: Refusing update from remote peer 39d829a384984eecb2eafc10dc296454: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:44.171248 24772 consensus_queue.cc:1048] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:44.180326 24495 raft_consensus.cc:1275] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [term 4 FOLLOWER]: Refusing update from remote peer 39d829a384984eecb2eafc10dc296454: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:44.181970 24776 consensus_queue.cc:1048] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:12:44.261806 24690 raft_consensus.cc:1275] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 9c4b72a25dd84163aad122cbdb994f4f [term 2 FOLLOWER]: Refusing update from remote peer 39d829a384984eecb2eafc10dc296454: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:44.263448 24785 consensus_queue.cc:1048] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 39d829a384984eecb2eafc10dc296454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:44.264431 24690 raft_consensus.cc:1275] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f [term 3 FOLLOWER]: Refusing update from remote peer e47ae041170d47e2886bbd47c2fafb29: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:44.264791 24495 raft_consensus.cc:1275] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29 [term 2 FOLLOWER]: Refusing update from remote peer 39d829a384984eecb2eafc10dc296454: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:44.265803 24637 consensus_queue.cc:1048] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:44.266003 24785 consensus_queue.cc:1048] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 39d829a384984eecb2eafc10dc296454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:44.282397 24423 raft_consensus.cc:1275] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [term 3 FOLLOWER]: Refusing update from remote peer e47ae041170d47e2886bbd47c2fafb29: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:44.284576 24774 consensus_queue.cc:1048] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:12:44.358587 24293 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:12:44.415426 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:44.423329 24421 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a39cf3544aa4abbab194a49bb9f25b4"
dest_uuid: "39d829a384984eecb2eafc10dc296454"
mode: GRACEFUL
new_leader_uuid: "e47ae041170d47e2886bbd47c2fafb29"
 from {username='slave'} at 127.0.0.1:36810
I20260709 12:12:44.423895 24421 raft_consensus.cc:606] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 [term 1 LEADER]: Received request to transfer leadership to TS e47ae041170d47e2886bbd47c2fafb29
I20260709 12:12:44.426487 24495 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52ca12c9e5314f109c3a0cf87037aa82"
dest_uuid: "e47ae041170d47e2886bbd47c2fafb29"
mode: GRACEFUL
new_leader_uuid: "39d829a384984eecb2eafc10dc296454"
 from {username='slave'} at 127.0.0.1:56422
I20260709 12:12:44.427165 24495 raft_consensus.cc:606] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29 [term 2 LEADER]: Received request to transfer leadership to TS 39d829a384984eecb2eafc10dc296454
I20260709 12:12:44.429455 24421 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "548496e2da9c4999857fbd2bbfbd65b9"
dest_uuid: "39d829a384984eecb2eafc10dc296454"
mode: GRACEFUL
new_leader_uuid: "e47ae041170d47e2886bbd47c2fafb29"
 from {username='slave'} at 127.0.0.1:36810
I20260709 12:12:44.429913 24421 raft_consensus.cc:606] T 548496e2da9c4999857fbd2bbfbd65b9 P 39d829a384984eecb2eafc10dc296454 [term 2 LEADER]: Received request to transfer leadership to TS e47ae041170d47e2886bbd47c2fafb29
I20260709 12:12:44.430976 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:12:44.431455 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:44.431951 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:44.442741 24772 raft_consensus.cc:993] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454: : Instructing follower e47ae041170d47e2886bbd47c2fafb29 to start an election
I20260709 12:12:44.443246 24776 raft_consensus.cc:1081] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 [term 1 LEADER]: Signalling peer e47ae041170d47e2886bbd47c2fafb29 to start an election
I20260709 12:12:44.444568 24495 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a39cf3544aa4abbab194a49bb9f25b4"
dest_uuid: "e47ae041170d47e2886bbd47c2fafb29"
 from {username='slave'} at 127.0.0.1:47194
I20260709 12:12:44.445008 24495 raft_consensus.cc:493] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:44.445288 24495 raft_consensus.cc:3060] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:44.449625 24495 raft_consensus.cc:515] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:44.451040 24495 leader_election.cc:290] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 2 election: Requested vote from peers 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193), 39d829a384984eecb2eafc10dc296454 (127.16.98.194:36921)
I20260709 12:12:44.451848 24690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a39cf3544aa4abbab194a49bb9f25b4" candidate_uuid: "e47ae041170d47e2886bbd47c2fafb29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9c4b72a25dd84163aad122cbdb994f4f"
I20260709 12:12:44.452401 24421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a39cf3544aa4abbab194a49bb9f25b4" candidate_uuid: "e47ae041170d47e2886bbd47c2fafb29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "39d829a384984eecb2eafc10dc296454"
I20260709 12:12:44.452490 24690 raft_consensus.cc:3060] T 2a39cf3544aa4abbab194a49bb9f25b4 P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:44.452989 24421 raft_consensus.cc:3055] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:44.453336 24421 raft_consensus.cc:740] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 39d829a384984eecb2eafc10dc296454, State: Running, Role: LEADER
I20260709 12:12:44.454281 24421 consensus_queue.cc:260] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:44.455489 24421 raft_consensus.cc:3060] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:44.457939 24690 raft_consensus.cc:2468] T 2a39cf3544aa4abbab194a49bb9f25b4 P 9c4b72a25dd84163aad122cbdb994f4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47ae041170d47e2886bbd47c2fafb29 in term 2.
I20260709 12:12:44.458914 24462 leader_election.cc:304] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c4b72a25dd84163aad122cbdb994f4f, e47ae041170d47e2886bbd47c2fafb29; no voters: 
I20260709 12:12:44.459599 24637 raft_consensus.cc:2804] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:44.460080 24637 raft_consensus.cc:697] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29 [term 2 LEADER]: Becoming Leader. State: Replica: e47ae041170d47e2886bbd47c2fafb29, State: Running, Role: LEADER
I20260709 12:12:44.461043 24637 consensus_queue.cc:237] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:44.462575 24421 raft_consensus.cc:2468] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47ae041170d47e2886bbd47c2fafb29 in term 2.
I20260709 12:12:44.468335 24244 catalog_manager.cc:5697] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29 reported cstate change: term changed from 1 to 2, leader changed from 39d829a384984eecb2eafc10dc296454 (127.16.98.194) to e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195). New cstate: current_term: 2 leader_uuid: "e47ae041170d47e2886bbd47c2fafb29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:44.489830 24772 raft_consensus.cc:993] T 548496e2da9c4999857fbd2bbfbd65b9 P 39d829a384984eecb2eafc10dc296454: : Instructing follower e47ae041170d47e2886bbd47c2fafb29 to start an election
I20260709 12:12:44.490316 24776 raft_consensus.cc:1081] T 548496e2da9c4999857fbd2bbfbd65b9 P 39d829a384984eecb2eafc10dc296454 [term 2 LEADER]: Signalling peer e47ae041170d47e2886bbd47c2fafb29 to start an election
I20260709 12:12:44.491677 24495 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "548496e2da9c4999857fbd2bbfbd65b9"
dest_uuid: "e47ae041170d47e2886bbd47c2fafb29"
 from {username='slave'} at 127.0.0.1:47194
I20260709 12:12:44.492053 24495 raft_consensus.cc:493] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:44.492275 24495 raft_consensus.cc:3060] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:44.496819 24495 raft_consensus.cc:515] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:44.498112 24495 leader_election.cc:290] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 3 election: Requested vote from peers 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193), 39d829a384984eecb2eafc10dc296454 (127.16.98.194:36921)
I20260709 12:12:44.498972 24690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "548496e2da9c4999857fbd2bbfbd65b9" candidate_uuid: "e47ae041170d47e2886bbd47c2fafb29" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9c4b72a25dd84163aad122cbdb994f4f"
I20260709 12:12:44.499233 24421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "548496e2da9c4999857fbd2bbfbd65b9" candidate_uuid: "e47ae041170d47e2886bbd47c2fafb29" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "39d829a384984eecb2eafc10dc296454"
I20260709 12:12:44.499714 24690 raft_consensus.cc:3060] T 548496e2da9c4999857fbd2bbfbd65b9 P 9c4b72a25dd84163aad122cbdb994f4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:44.499787 24421 raft_consensus.cc:3055] T 548496e2da9c4999857fbd2bbfbd65b9 P 39d829a384984eecb2eafc10dc296454 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:44.500164 24421 raft_consensus.cc:740] T 548496e2da9c4999857fbd2bbfbd65b9 P 39d829a384984eecb2eafc10dc296454 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 39d829a384984eecb2eafc10dc296454, State: Running, Role: LEADER
I20260709 12:12:44.501202 24421 consensus_queue.cc:260] T 548496e2da9c4999857fbd2bbfbd65b9 P 39d829a384984eecb2eafc10dc296454 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:44.502605 24421 raft_consensus.cc:3060] T 548496e2da9c4999857fbd2bbfbd65b9 P 39d829a384984eecb2eafc10dc296454 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:44.507282 24690 raft_consensus.cc:2468] T 548496e2da9c4999857fbd2bbfbd65b9 P 9c4b72a25dd84163aad122cbdb994f4f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47ae041170d47e2886bbd47c2fafb29 in term 3.
I20260709 12:12:44.508404 24462 leader_election.cc:304] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c4b72a25dd84163aad122cbdb994f4f, e47ae041170d47e2886bbd47c2fafb29; no voters: 
I20260709 12:12:44.509193 24637 raft_consensus.cc:2804] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:44.509698 24637 raft_consensus.cc:697] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [term 3 LEADER]: Becoming Leader. State: Replica: e47ae041170d47e2886bbd47c2fafb29, State: Running, Role: LEADER
I20260709 12:12:44.509910 24421 raft_consensus.cc:2468] T 548496e2da9c4999857fbd2bbfbd65b9 P 39d829a384984eecb2eafc10dc296454 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47ae041170d47e2886bbd47c2fafb29 in term 3.
I20260709 12:12:44.510816 24637 consensus_queue.cc:237] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:44.518386 24244 catalog_manager.cc:5697] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 reported cstate change: term changed from 2 to 3, leader changed from 39d829a384984eecb2eafc10dc296454 (127.16.98.194) to e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195). New cstate: current_term: 3 leader_uuid: "e47ae041170d47e2886bbd47c2fafb29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:44.723206 24792 raft_consensus.cc:993] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29: : Instructing follower 39d829a384984eecb2eafc10dc296454 to start an election
I20260709 12:12:44.723687 24637 raft_consensus.cc:1081] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29 [term 2 LEADER]: Signalling peer 39d829a384984eecb2eafc10dc296454 to start an election
I20260709 12:12:44.724895 24421 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52ca12c9e5314f109c3a0cf87037aa82"
dest_uuid: "39d829a384984eecb2eafc10dc296454"
 from {username='slave'} at 127.0.0.1:42334
I20260709 12:12:44.725354 24421 raft_consensus.cc:493] T 52ca12c9e5314f109c3a0cf87037aa82 P 39d829a384984eecb2eafc10dc296454 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:44.725648 24421 raft_consensus.cc:3060] T 52ca12c9e5314f109c3a0cf87037aa82 P 39d829a384984eecb2eafc10dc296454 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:44.730563 24421 raft_consensus.cc:515] T 52ca12c9e5314f109c3a0cf87037aa82 P 39d829a384984eecb2eafc10dc296454 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:44.732113 24421 leader_election.cc:290] T 52ca12c9e5314f109c3a0cf87037aa82 P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 3 election: Requested vote from peers 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193), e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195:39005)
I20260709 12:12:44.732859 24690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca12c9e5314f109c3a0cf87037aa82" candidate_uuid: "39d829a384984eecb2eafc10dc296454" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "9c4b72a25dd84163aad122cbdb994f4f"
I20260709 12:12:44.733091 24495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ca12c9e5314f109c3a0cf87037aa82" candidate_uuid: "39d829a384984eecb2eafc10dc296454" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "e47ae041170d47e2886bbd47c2fafb29"
I20260709 12:12:44.733453 24690 raft_consensus.cc:3060] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:44.733613 24495 raft_consensus.cc:3055] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:44.733969 24495 raft_consensus.cc:740] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e47ae041170d47e2886bbd47c2fafb29, State: Running, Role: LEADER
I20260709 12:12:44.734850 24495 consensus_queue.cc:260] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:44.735821 24495 raft_consensus.cc:3060] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:44.738189 24690 raft_consensus.cc:2468] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39d829a384984eecb2eafc10dc296454 in term 3.
I20260709 12:12:44.739168 24388 leader_election.cc:304] T 52ca12c9e5314f109c3a0cf87037aa82 P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39d829a384984eecb2eafc10dc296454, 9c4b72a25dd84163aad122cbdb994f4f; no voters: 
I20260709 12:12:44.739842 24776 raft_consensus.cc:2804] T 52ca12c9e5314f109c3a0cf87037aa82 P 39d829a384984eecb2eafc10dc296454 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:44.740291 24776 raft_consensus.cc:697] T 52ca12c9e5314f109c3a0cf87037aa82 P 39d829a384984eecb2eafc10dc296454 [term 3 LEADER]: Becoming Leader. State: Replica: 39d829a384984eecb2eafc10dc296454, State: Running, Role: LEADER
I20260709 12:12:44.741106 24495 raft_consensus.cc:2468] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39d829a384984eecb2eafc10dc296454 in term 3.
I20260709 12:12:44.741284 24776 consensus_queue.cc:237] T 52ca12c9e5314f109c3a0cf87037aa82 P 39d829a384984eecb2eafc10dc296454 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:44.748286 24244 catalog_manager.cc:5697] T 52ca12c9e5314f109c3a0cf87037aa82 P 39d829a384984eecb2eafc10dc296454 reported cstate change: term changed from 2 to 3, leader changed from e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195) to 39d829a384984eecb2eafc10dc296454 (127.16.98.194). New cstate: current_term: 3 leader_uuid: "39d829a384984eecb2eafc10dc296454" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:44.898175 24689 raft_consensus.cc:1275] T 2a39cf3544aa4abbab194a49bb9f25b4 P 9c4b72a25dd84163aad122cbdb994f4f [term 2 FOLLOWER]: Refusing update from remote peer e47ae041170d47e2886bbd47c2fafb29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:44.899422 24637 consensus_queue.cc:1048] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:44.909915 24421 raft_consensus.cc:1275] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 [term 2 FOLLOWER]: Refusing update from remote peer e47ae041170d47e2886bbd47c2fafb29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:44.911301 24637 consensus_queue.cc:1048] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:45.073792 24689 raft_consensus.cc:1275] T 548496e2da9c4999857fbd2bbfbd65b9 P 9c4b72a25dd84163aad122cbdb994f4f [term 3 FOLLOWER]: Refusing update from remote peer e47ae041170d47e2886bbd47c2fafb29: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:45.075151 24637 consensus_queue.cc:1048] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:45.085141 24421 raft_consensus.cc:1275] T 548496e2da9c4999857fbd2bbfbd65b9 P 39d829a384984eecb2eafc10dc296454 [term 3 FOLLOWER]: Refusing update from remote peer e47ae041170d47e2886bbd47c2fafb29: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:45.086686 24774 consensus_queue.cc:1048] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:45.198616 24495 raft_consensus.cc:1275] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29 [term 3 FOLLOWER]: Refusing update from remote peer 39d829a384984eecb2eafc10dc296454: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:45.199980 24776 consensus_queue.cc:1048] T 52ca12c9e5314f109c3a0cf87037aa82 P 39d829a384984eecb2eafc10dc296454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:45.211568 24689 raft_consensus.cc:1275] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f [term 3 FOLLOWER]: Refusing update from remote peer 39d829a384984eecb2eafc10dc296454: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:12:45.212963 24785 consensus_queue.cc:1048] T 52ca12c9e5314f109c3a0cf87037aa82 P 39d829a384984eecb2eafc10dc296454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:12:45.359578 24293 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:12:45.439316 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:45.446780 24497 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08e3d6296f2f457b8e190f2cf367f3ce"
dest_uuid: "e47ae041170d47e2886bbd47c2fafb29"
mode: GRACEFUL
new_leader_uuid: "39d829a384984eecb2eafc10dc296454"
 from {username='slave'} at 127.0.0.1:56422
I20260709 12:12:45.447381 24497 raft_consensus.cc:606] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29 [term 3 LEADER]: Received request to transfer leadership to TS 39d829a384984eecb2eafc10dc296454
I20260709 12:12:45.449739 24497 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a39cf3544aa4abbab194a49bb9f25b4"
dest_uuid: "e47ae041170d47e2886bbd47c2fafb29"
mode: GRACEFUL
new_leader_uuid: "39d829a384984eecb2eafc10dc296454"
 from {username='slave'} at 127.0.0.1:56422
I20260709 12:12:45.450219 24497 raft_consensus.cc:606] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29 [term 2 LEADER]: Received request to transfer leadership to TS 39d829a384984eecb2eafc10dc296454
I20260709 12:12:45.452394 24421 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5820fb1bb4be48e0ad3288d8f5e2964a"
dest_uuid: "39d829a384984eecb2eafc10dc296454"
mode: GRACEFUL
new_leader_uuid: "e47ae041170d47e2886bbd47c2fafb29"
 from {username='slave'} at 127.0.0.1:36810
I20260709 12:12:45.452888 24421 raft_consensus.cc:606] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454 [term 1 LEADER]: Received request to transfer leadership to TS e47ae041170d47e2886bbd47c2fafb29
I20260709 12:12:45.453949 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:12:45.454403 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:45.455011 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:45.501677 24774 raft_consensus.cc:993] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29: : Instructing follower 39d829a384984eecb2eafc10dc296454 to start an election
I20260709 12:12:45.502243 24792 raft_consensus.cc:1081] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29 [term 2 LEADER]: Signalling peer 39d829a384984eecb2eafc10dc296454 to start an election
I20260709 12:12:45.503715 24421 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a39cf3544aa4abbab194a49bb9f25b4"
dest_uuid: "39d829a384984eecb2eafc10dc296454"
 from {username='slave'} at 127.0.0.1:42334
I20260709 12:12:45.504279 24421 raft_consensus.cc:493] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:45.504654 24421 raft_consensus.cc:3060] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:45.510231 24421 raft_consensus.cc:515] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:45.511729 24421 leader_election.cc:290] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 3 election: Requested vote from peers 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193), e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195:39005)
I20260709 12:12:45.512683 24497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a39cf3544aa4abbab194a49bb9f25b4" candidate_uuid: "39d829a384984eecb2eafc10dc296454" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e47ae041170d47e2886bbd47c2fafb29"
I20260709 12:12:45.512527 24689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a39cf3544aa4abbab194a49bb9f25b4" candidate_uuid: "39d829a384984eecb2eafc10dc296454" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9c4b72a25dd84163aad122cbdb994f4f"
I20260709 12:12:45.513283 24497 raft_consensus.cc:3055] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:45.513334 24689 raft_consensus.cc:3060] T 2a39cf3544aa4abbab194a49bb9f25b4 P 9c4b72a25dd84163aad122cbdb994f4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:45.513734 24497 raft_consensus.cc:740] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e47ae041170d47e2886bbd47c2fafb29, State: Running, Role: LEADER
I20260709 12:12:45.514622 24497 consensus_queue.cc:260] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:45.515997 24497 raft_consensus.cc:3060] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:45.521750 24689 raft_consensus.cc:2468] T 2a39cf3544aa4abbab194a49bb9f25b4 P 9c4b72a25dd84163aad122cbdb994f4f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39d829a384984eecb2eafc10dc296454 in term 3.
I20260709 12:12:45.523075 24388 leader_election.cc:304] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39d829a384984eecb2eafc10dc296454, 9c4b72a25dd84163aad122cbdb994f4f; no voters: 
I20260709 12:12:45.523618 24497 raft_consensus.cc:2468] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39d829a384984eecb2eafc10dc296454 in term 3.
I20260709 12:12:45.523746 24785 raft_consensus.cc:2804] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:45.524343 24785 raft_consensus.cc:697] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 [term 3 LEADER]: Becoming Leader. State: Replica: 39d829a384984eecb2eafc10dc296454, State: Running, Role: LEADER
I20260709 12:12:45.525075 24785 consensus_queue.cc:237] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:45.533690 24244 catalog_manager.cc:5697] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 reported cstate change: term changed from 2 to 3, leader changed from e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195) to 39d829a384984eecb2eafc10dc296454 (127.16.98.194). New cstate: current_term: 3 leader_uuid: "39d829a384984eecb2eafc10dc296454" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:45.612569 24774 raft_consensus.cc:993] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29: : Instructing follower 39d829a384984eecb2eafc10dc296454 to start an election
I20260709 12:12:45.613042 24792 raft_consensus.cc:1081] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29 [term 3 LEADER]: Signalling peer 39d829a384984eecb2eafc10dc296454 to start an election
I20260709 12:12:45.614396 24421 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08e3d6296f2f457b8e190f2cf367f3ce"
dest_uuid: "39d829a384984eecb2eafc10dc296454"
 from {username='slave'} at 127.0.0.1:42334
I20260709 12:12:45.614938 24421 raft_consensus.cc:493] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:45.615300 24421 raft_consensus.cc:3060] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:45.620059 24421 raft_consensus.cc:515] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } }
I20260709 12:12:45.621654 24421 leader_election.cc:290] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 4 election: Requested vote from peers e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195:39005), 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193)
I20260709 12:12:45.622514 24497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e3d6296f2f457b8e190f2cf367f3ce" candidate_uuid: "39d829a384984eecb2eafc10dc296454" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e47ae041170d47e2886bbd47c2fafb29"
I20260709 12:12:45.622865 24689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08e3d6296f2f457b8e190f2cf367f3ce" candidate_uuid: "39d829a384984eecb2eafc10dc296454" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9c4b72a25dd84163aad122cbdb994f4f"
I20260709 12:12:45.623214 24497 raft_consensus.cc:3055] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:12:45.623463 24689 raft_consensus.cc:3060] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:45.623567 24497 raft_consensus.cc:740] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e47ae041170d47e2886bbd47c2fafb29, State: Running, Role: LEADER
I20260709 12:12:45.624383 24497 consensus_queue.cc:260] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } }
I20260709 12:12:45.625295 24497 raft_consensus.cc:3060] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:12:45.628660 24689 raft_consensus.cc:2468] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39d829a384984eecb2eafc10dc296454 in term 4.
I20260709 12:12:45.629688 24388 leader_election.cc:304] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39d829a384984eecb2eafc10dc296454, 9c4b72a25dd84163aad122cbdb994f4f; no voters: 
I20260709 12:12:45.630205 24497 raft_consensus.cc:2468] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39d829a384984eecb2eafc10dc296454 in term 4.
I20260709 12:12:45.630311 24785 raft_consensus.cc:2804] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:12:45.630844 24785 raft_consensus.cc:697] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [term 4 LEADER]: Becoming Leader. State: Replica: 39d829a384984eecb2eafc10dc296454, State: Running, Role: LEADER
I20260709 12:12:45.631582 24785 consensus_queue.cc:237] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } }
I20260709 12:12:45.637817 24244 catalog_manager.cc:5697] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 reported cstate change: term changed from 3 to 4, leader changed from e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195) to 39d829a384984eecb2eafc10dc296454 (127.16.98.194). New cstate: current_term: 4 leader_uuid: "39d829a384984eecb2eafc10dc296454" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:45.897889 24776 raft_consensus.cc:993] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454: : Instructing follower e47ae041170d47e2886bbd47c2fafb29 to start an election
I20260709 12:12:45.898343 24785 raft_consensus.cc:1081] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454 [term 1 LEADER]: Signalling peer e47ae041170d47e2886bbd47c2fafb29 to start an election
I20260709 12:12:45.899794 24497 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5820fb1bb4be48e0ad3288d8f5e2964a"
dest_uuid: "e47ae041170d47e2886bbd47c2fafb29"
 from {username='slave'} at 127.0.0.1:47194
I20260709 12:12:45.900297 24497 raft_consensus.cc:493] T 5820fb1bb4be48e0ad3288d8f5e2964a P e47ae041170d47e2886bbd47c2fafb29 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:45.900594 24497 raft_consensus.cc:3060] T 5820fb1bb4be48e0ad3288d8f5e2964a P e47ae041170d47e2886bbd47c2fafb29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:45.905649 24497 raft_consensus.cc:515] T 5820fb1bb4be48e0ad3288d8f5e2964a P e47ae041170d47e2886bbd47c2fafb29 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:45.907181 24497 leader_election.cc:290] T 5820fb1bb4be48e0ad3288d8f5e2964a P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 2 election: Requested vote from peers 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193), 39d829a384984eecb2eafc10dc296454 (127.16.98.194:36921)
I20260709 12:12:45.907886 24690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5820fb1bb4be48e0ad3288d8f5e2964a" candidate_uuid: "e47ae041170d47e2886bbd47c2fafb29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9c4b72a25dd84163aad122cbdb994f4f"
I20260709 12:12:45.908157 24421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5820fb1bb4be48e0ad3288d8f5e2964a" candidate_uuid: "e47ae041170d47e2886bbd47c2fafb29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "39d829a384984eecb2eafc10dc296454"
I20260709 12:12:45.908620 24690 raft_consensus.cc:3060] T 5820fb1bb4be48e0ad3288d8f5e2964a P 9c4b72a25dd84163aad122cbdb994f4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:45.908761 24421 raft_consensus.cc:3055] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:45.909185 24421 raft_consensus.cc:740] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 39d829a384984eecb2eafc10dc296454, State: Running, Role: LEADER
I20260709 12:12:45.909868 24421 consensus_queue.cc:260] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:45.910975 24421 raft_consensus.cc:3060] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:45.913560 24690 raft_consensus.cc:2468] T 5820fb1bb4be48e0ad3288d8f5e2964a P 9c4b72a25dd84163aad122cbdb994f4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47ae041170d47e2886bbd47c2fafb29 in term 2.
I20260709 12:12:45.914482 24462 leader_election.cc:304] T 5820fb1bb4be48e0ad3288d8f5e2964a P e47ae041170d47e2886bbd47c2fafb29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c4b72a25dd84163aad122cbdb994f4f, e47ae041170d47e2886bbd47c2fafb29; no voters: 
I20260709 12:12:45.915441 24792 raft_consensus.cc:2804] T 5820fb1bb4be48e0ad3288d8f5e2964a P e47ae041170d47e2886bbd47c2fafb29 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:45.915993 24792 raft_consensus.cc:697] T 5820fb1bb4be48e0ad3288d8f5e2964a P e47ae041170d47e2886bbd47c2fafb29 [term 2 LEADER]: Becoming Leader. State: Replica: e47ae041170d47e2886bbd47c2fafb29, State: Running, Role: LEADER
I20260709 12:12:45.916471 24421 raft_consensus.cc:2468] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47ae041170d47e2886bbd47c2fafb29 in term 2.
I20260709 12:12:45.916924 24792 consensus_queue.cc:237] T 5820fb1bb4be48e0ad3288d8f5e2964a P e47ae041170d47e2886bbd47c2fafb29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } }
I20260709 12:12:45.923441 24244 catalog_manager.cc:5697] T 5820fb1bb4be48e0ad3288d8f5e2964a P e47ae041170d47e2886bbd47c2fafb29 reported cstate change: term changed from 1 to 2, leader changed from 39d829a384984eecb2eafc10dc296454 (127.16.98.194) to e47ae041170d47e2886bbd47c2fafb29 (127.16.98.195). New cstate: current_term: 2 leader_uuid: "e47ae041170d47e2886bbd47c2fafb29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:46.003230 24690 raft_consensus.cc:1275] T 2a39cf3544aa4abbab194a49bb9f25b4 P 9c4b72a25dd84163aad122cbdb994f4f [term 3 FOLLOWER]: Refusing update from remote peer 39d829a384984eecb2eafc10dc296454: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:46.004361 24785 consensus_queue.cc:1048] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:12:46.014470 24497 raft_consensus.cc:1275] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29 [term 3 FOLLOWER]: Refusing update from remote peer 39d829a384984eecb2eafc10dc296454: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:46.016160 24785 consensus_queue.cc:1048] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:12:46.043198 24690 raft_consensus.cc:1275] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f [term 4 FOLLOWER]: Refusing update from remote peer 39d829a384984eecb2eafc10dc296454: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:46.044410 24785 consensus_queue.cc:1048] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:12:46.052399 24497 raft_consensus.cc:1275] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29 [term 4 FOLLOWER]: Refusing update from remote peer 39d829a384984eecb2eafc10dc296454: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:12:46.054148 24776 consensus_queue.cc:1048] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47ae041170d47e2886bbd47c2fafb29" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 39005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:12:46.360605 24293 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:12:46.391676 24690 raft_consensus.cc:1275] T 5820fb1bb4be48e0ad3288d8f5e2964a P 9c4b72a25dd84163aad122cbdb994f4f [term 2 FOLLOWER]: Refusing update from remote peer e47ae041170d47e2886bbd47c2fafb29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:46.393023 24792 consensus_queue.cc:1048] T 5820fb1bb4be48e0ad3288d8f5e2964a P e47ae041170d47e2886bbd47c2fafb29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c4b72a25dd84163aad122cbdb994f4f" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 41193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:46.403417 24421 raft_consensus.cc:1275] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454 [term 2 FOLLOWER]: Refusing update from remote peer e47ae041170d47e2886bbd47c2fafb29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:46.404663 24825 consensus_queue.cc:1048] T 5820fb1bb4be48e0ad3288d8f5e2964a P e47ae041170d47e2886bbd47c2fafb29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39d829a384984eecb2eafc10dc296454" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:46.461315 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:46.491573 16779 tablet_server.cc:179] TabletServer@127.16.98.193:41193 shutting down...
I20260709 12:12:46.519812 16779 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:46.520494 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:46.521131 16779 raft_consensus.cc:2243] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:46.521560 16779 raft_consensus.cc:2272] T 52ca12c9e5314f109c3a0cf87037aa82 P 9c4b72a25dd84163aad122cbdb994f4f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:46.523855 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:46.524477 16779 raft_consensus.cc:2243] T 41e2f06b670f429ea32f5113440d391e P 9c4b72a25dd84163aad122cbdb994f4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:46.524971 16779 raft_consensus.cc:2272] T 41e2f06b670f429ea32f5113440d391e P 9c4b72a25dd84163aad122cbdb994f4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:46.527197 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:46.527792 16779 raft_consensus.cc:2243] T a8b1a3981dc94695a0930fb24a989e12 P 9c4b72a25dd84163aad122cbdb994f4f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:46.528184 16779 raft_consensus.cc:2272] T a8b1a3981dc94695a0930fb24a989e12 P 9c4b72a25dd84163aad122cbdb994f4f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:46.530122 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:46.530757 16779 raft_consensus.cc:2243] T 10e58961518a493dbae703a1ce1eaefb P 9c4b72a25dd84163aad122cbdb994f4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:46.531157 16779 raft_consensus.cc:2272] T 10e58961518a493dbae703a1ce1eaefb P 9c4b72a25dd84163aad122cbdb994f4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:46.533049 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:46.533576 16779 raft_consensus.cc:2243] T 2a39cf3544aa4abbab194a49bb9f25b4 P 9c4b72a25dd84163aad122cbdb994f4f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:46.534014 16779 raft_consensus.cc:2272] T 2a39cf3544aa4abbab194a49bb9f25b4 P 9c4b72a25dd84163aad122cbdb994f4f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:46.537174 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:46.537740 16779 raft_consensus.cc:2243] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 9c4b72a25dd84163aad122cbdb994f4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:46.538229 16779 raft_consensus.cc:2272] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 9c4b72a25dd84163aad122cbdb994f4f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:46.540724 24388 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 74 similar messages]
I20260709 12:12:46.541323 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:46.542387 16779 raft_consensus.cc:2243] T 548496e2da9c4999857fbd2bbfbd65b9 P 9c4b72a25dd84163aad122cbdb994f4f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:46.543012 16779 raft_consensus.cc:2272] T 548496e2da9c4999857fbd2bbfbd65b9 P 9c4b72a25dd84163aad122cbdb994f4f [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:46.544431 24388 consensus_peers.cc:597] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 -> Peer 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193): Couldn't send request to peer 9c4b72a25dd84163aad122cbdb994f4f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:46.545783 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:46.546296 16779 raft_consensus.cc:2243] T 5820fb1bb4be48e0ad3288d8f5e2964a P 9c4b72a25dd84163aad122cbdb994f4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:46.546785 16779 raft_consensus.cc:2272] T 5820fb1bb4be48e0ad3288d8f5e2964a P 9c4b72a25dd84163aad122cbdb994f4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:46.549292 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:46.549739 16779 raft_consensus.cc:2243] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 9c4b72a25dd84163aad122cbdb994f4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:46.550099 16779 raft_consensus.cc:2272] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 9c4b72a25dd84163aad122cbdb994f4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:46.552064 16779 tablet_replica.cc:333] stopping tablet replica
I20260709 12:12:46.552446 16779 raft_consensus.cc:2243] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:46.552821 16779 raft_consensus.cc:2272] T 08e3d6296f2f457b8e190f2cf367f3ce P 9c4b72a25dd84163aad122cbdb994f4f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:46.583590 16779 tablet_server.cc:196] TabletServer@127.16.98.193:41193 shutdown complete.
I20260709 12:12:46.611505 16779 tablet_server.cc:179] TabletServer@127.16.98.194:0 shutting down...
W20260709 12:12:46.636983 24388 consensus_peers.cc:597] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 -> Peer 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193): Couldn't send request to peer 9c4b72a25dd84163aad122cbdb994f4f. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:41193: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:46.637282 16779 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:12:46.637555 24388 consensus_peers.cc:597] T 52ca12c9e5314f109c3a0cf87037aa82 P 39d829a384984eecb2eafc10dc296454 -> Peer 9c4b72a25dd84163aad122cbdb994f4f (127.16.98.193:41193): Couldn't send request to peer 9c4b72a25dd84163aad122cbdb994f4f. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:41193: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:46.638854 16779 tablet_replica.cc:333] T 10e58961518a493dbae703a1ce1eaefb P 39d829a384984eecb2eafc10dc296454: stopping tablet replica
I20260709 12:12:46.639793 16779 raft_consensus.cc:2243] T 10e58961518a493dbae703a1ce1eaefb P 39d829a384984eecb2eafc10dc296454 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:46.640803 16779 raft_consensus.cc:2272] T 10e58961518a493dbae703a1ce1eaefb P 39d829a384984eecb2eafc10dc296454 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:46.640844 24462 consensus_peers.cc:597] T 41e2f06b670f429ea32f5113440d391e P e47ae041170d47e2886bbd47c2fafb29 -> Peer 39d829a384984eecb2eafc10dc296454 (127.16.98.194:36921): Couldn't send request to peer 39d829a384984eecb2eafc10dc296454. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:46.643260 16779 tablet_replica.cc:333] T 41e2f06b670f429ea32f5113440d391e P 39d829a384984eecb2eafc10dc296454: stopping tablet replica
I20260709 12:12:46.643868 16779 raft_consensus.cc:2243] T 41e2f06b670f429ea32f5113440d391e P 39d829a384984eecb2eafc10dc296454 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:46.644232 16779 raft_consensus.cc:2272] T 41e2f06b670f429ea32f5113440d391e P 39d829a384984eecb2eafc10dc296454 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:46.646246 16779 tablet_replica.cc:333] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454: stopping tablet replica
I20260709 12:12:46.646914 16779 raft_consensus.cc:2243] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:12:46.647589 16779 raft_consensus.cc:2272] T a8b1a3981dc94695a0930fb24a989e12 P 39d829a384984eecb2eafc10dc296454 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:46.649464 16779 tablet_replica.cc:333] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454: stopping tablet replica
I20260709 12:12:46.649948 16779 raft_consensus.cc:2243] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:46.650604 16779 raft_consensus.cc:2272] T 2a39cf3544aa4abbab194a49bb9f25b4 P 39d829a384984eecb2eafc10dc296454 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:46.653048 16779 tablet_replica.cc:333] T 52ca12c9e5314f109c3a0cf87037aa82 P 39d829a384984eecb2eafc10dc296454: stopping tablet replica
I20260709 12:12:46.653548 16779 raft_consensus.cc:2243] T 52ca12c9e5314f109c3a0cf87037aa82 P 39d829a384984eecb2eafc10dc296454 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:46.654186 16779 raft_consensus.cc:2272] T 52ca12c9e5314f109c3a0cf87037aa82 P 39d829a384984eecb2eafc10dc296454 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:46.656021 16779 tablet_replica.cc:333] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 39d829a384984eecb2eafc10dc296454: stopping tablet replica
I20260709 12:12:46.656553 16779 raft_consensus.cc:2243] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 39d829a384984eecb2eafc10dc296454 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:46.657413 16779 raft_consensus.cc:2272] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P 39d829a384984eecb2eafc10dc296454 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:46.659969 16779 tablet_replica.cc:333] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454: stopping tablet replica
I20260709 12:12:46.660506 16779 raft_consensus.cc:2243] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:12:46.661230 16779 raft_consensus.cc:2272] T 08e3d6296f2f457b8e190f2cf367f3ce P 39d829a384984eecb2eafc10dc296454 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:46.663671 16779 tablet_replica.cc:333] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454: stopping tablet replica
I20260709 12:12:46.664199 16779 raft_consensus.cc:2243] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:46.664608 16779 raft_consensus.cc:2272] T 5820fb1bb4be48e0ad3288d8f5e2964a P 39d829a384984eecb2eafc10dc296454 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:46.666983 16779 tablet_replica.cc:333] T 548496e2da9c4999857fbd2bbfbd65b9 P 39d829a384984eecb2eafc10dc296454: stopping tablet replica
I20260709 12:12:46.667502 16779 raft_consensus.cc:2243] T 548496e2da9c4999857fbd2bbfbd65b9 P 39d829a384984eecb2eafc10dc296454 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:46.667899 16779 raft_consensus.cc:2272] T 548496e2da9c4999857fbd2bbfbd65b9 P 39d829a384984eecb2eafc10dc296454 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:46.669766 16779 tablet_replica.cc:333] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454: stopping tablet replica
I20260709 12:12:46.670231 16779 raft_consensus.cc:2243] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:46.670744 16779 raft_consensus.cc:2272] T dacd7f79e6cd4d09a8cc8df8ec88f32c P 39d829a384984eecb2eafc10dc296454 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:46.701618 16779 tablet_server.cc:196] TabletServer@127.16.98.194:0 shutdown complete.
I20260709 12:12:46.724407 16779 tablet_server.cc:179] TabletServer@127.16.98.195:0 shutting down...
I20260709 12:12:46.747277 16779 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:46.748036 16779 tablet_replica.cc:333] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29: stopping tablet replica
I20260709 12:12:46.749192 16779 raft_consensus.cc:2243] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:46.749805 16779 raft_consensus.cc:2272] T 52ca12c9e5314f109c3a0cf87037aa82 P e47ae041170d47e2886bbd47c2fafb29 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:46.752442 16779 tablet_replica.cc:333] T 41e2f06b670f429ea32f5113440d391e P e47ae041170d47e2886bbd47c2fafb29: stopping tablet replica
I20260709 12:12:46.753087 16779 raft_consensus.cc:2243] T 41e2f06b670f429ea32f5113440d391e P e47ae041170d47e2886bbd47c2fafb29 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:46.753858 16779 raft_consensus.cc:2272] T 41e2f06b670f429ea32f5113440d391e P e47ae041170d47e2886bbd47c2fafb29 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:12:46.754118 24462 consensus_peers.cc:597] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 -> Peer 39d829a384984eecb2eafc10dc296454 (127.16.98.194:36921): Couldn't send request to peer 39d829a384984eecb2eafc10dc296454. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.194:36921: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:46.756059 16779 tablet_replica.cc:333] T 10e58961518a493dbae703a1ce1eaefb P e47ae041170d47e2886bbd47c2fafb29: stopping tablet replica
I20260709 12:12:46.756696 16779 raft_consensus.cc:2243] T 10e58961518a493dbae703a1ce1eaefb P e47ae041170d47e2886bbd47c2fafb29 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:46.757130 16779 raft_consensus.cc:2272] T 10e58961518a493dbae703a1ce1eaefb P e47ae041170d47e2886bbd47c2fafb29 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:46.759269 16779 tablet_replica.cc:333] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29: stopping tablet replica
I20260709 12:12:46.759840 16779 raft_consensus.cc:2243] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:46.760241 16779 raft_consensus.cc:2272] T a8b1a3981dc94695a0930fb24a989e12 P e47ae041170d47e2886bbd47c2fafb29 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:46.762058 16779 tablet_replica.cc:333] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29: stopping tablet replica
I20260709 12:12:46.762578 16779 raft_consensus.cc:2243] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:46.763002 16779 raft_consensus.cc:2272] T 08e3d6296f2f457b8e190f2cf367f3ce P e47ae041170d47e2886bbd47c2fafb29 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:46.765215 16779 tablet_replica.cc:333] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29: stopping tablet replica
I20260709 12:12:46.765748 16779 raft_consensus.cc:2243] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:46.766145 16779 raft_consensus.cc:2272] T cf1f14b4d6d744f4bb57e6ec43bd3a15 P e47ae041170d47e2886bbd47c2fafb29 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:46.768062 16779 tablet_replica.cc:333] T 5820fb1bb4be48e0ad3288d8f5e2964a P e47ae041170d47e2886bbd47c2fafb29: stopping tablet replica
I20260709 12:12:46.768585 16779 raft_consensus.cc:2243] T 5820fb1bb4be48e0ad3288d8f5e2964a P e47ae041170d47e2886bbd47c2fafb29 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:46.769325 16779 raft_consensus.cc:2272] T 5820fb1bb4be48e0ad3288d8f5e2964a P e47ae041170d47e2886bbd47c2fafb29 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:46.771538 16779 tablet_replica.cc:333] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29: stopping tablet replica
I20260709 12:12:46.772037 16779 raft_consensus.cc:2243] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:46.772751 16779 raft_consensus.cc:2272] T 548496e2da9c4999857fbd2bbfbd65b9 P e47ae041170d47e2886bbd47c2fafb29 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:46.774631 16779 tablet_replica.cc:333] T dacd7f79e6cd4d09a8cc8df8ec88f32c P e47ae041170d47e2886bbd47c2fafb29: stopping tablet replica
I20260709 12:12:46.775208 16779 raft_consensus.cc:2243] T dacd7f79e6cd4d09a8cc8df8ec88f32c P e47ae041170d47e2886bbd47c2fafb29 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:46.775975 16779 raft_consensus.cc:2272] T dacd7f79e6cd4d09a8cc8df8ec88f32c P e47ae041170d47e2886bbd47c2fafb29 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:46.777889 16779 tablet_replica.cc:333] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29: stopping tablet replica
I20260709 12:12:46.778398 16779 raft_consensus.cc:2243] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:46.778857 16779 raft_consensus.cc:2272] T 2a39cf3544aa4abbab194a49bb9f25b4 P e47ae041170d47e2886bbd47c2fafb29 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:46.801364 16779 tablet_server.cc:196] TabletServer@127.16.98.195:0 shutdown complete.
I20260709 12:12:46.824649 16779 master.cc:562] Master@127.16.98.254:34979 shutting down...
I20260709 12:12:46.848811 16779 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e09457092b2d49d786ccbb7f9131bc87 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:46.849323 16779 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e09457092b2d49d786ccbb7f9131bc87 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:46.849607 16779 tablet_replica.cc:333] T 00000000000000000000000000000000 P e09457092b2d49d786ccbb7f9131bc87: stopping tablet replica
I20260709 12:12:46.869917 16779 master.cc:584] Master@127.16.98.254:34979 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12712 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:12:46.912600 16779 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.98.254:35757
I20260709 12:12:46.913708 16779 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:46.919489 24833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:46.919561 24834 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:46.920454 24836 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:46.921315 16779 server_base.cc:1061] running on GCE node
I20260709 12:12:46.922204 16779 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:46.922376 16779 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:46.922562 16779 hybrid_clock.cc:648] HybridClock initialized: now 1783599166922531 us; error 0 us; skew 500 ppm
I20260709 12:12:46.923173 16779 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:46.925469 16779 webserver.cc:533] Webserver started at http://127.16.98.254:44501/ using document root <none> and password file <none>
I20260709 12:12:46.925992 16779 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:46.926179 16779 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:46.926471 16779 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:46.927856 16779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895573690-16779-0/minicluster-data/master-0-root/instance:
uuid: "6d453e7c90e142d388ba5e572b459414"
format_stamp: "Formatted at 2026-07-09 12:12:46 on dist-test-slave-9bv4"
I20260709 12:12:46.932226 16779 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:12:46.935518 24841 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:46.936405 16779 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:12:46.936704 16779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895573690-16779-0/minicluster-data/master-0-root
uuid: "6d453e7c90e142d388ba5e572b459414"
format_stamp: "Formatted at 2026-07-09 12:12:46 on dist-test-slave-9bv4"
I20260709 12:12:46.936950 16779 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895573690-16779-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895573690-16779-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895573690-16779-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:46.952651 16779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:46.953843 16779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:46.991223 16779 rpc_server.cc:307] RPC server started. Bound to: 127.16.98.254:35757
I20260709 12:12:46.991326 24892 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.98.254:35757 every 8 connection(s)
I20260709 12:12:46.994958 24893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.005585 24893 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d453e7c90e142d388ba5e572b459414: Bootstrap starting.
I20260709 12:12:47.010246 24893 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6d453e7c90e142d388ba5e572b459414: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.014215 24893 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d453e7c90e142d388ba5e572b459414: No bootstrap required, opened a new log
I20260709 12:12:47.016306 24893 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6d453e7c90e142d388ba5e572b459414 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d453e7c90e142d388ba5e572b459414" member_type: VOTER }
I20260709 12:12:47.016659 24893 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6d453e7c90e142d388ba5e572b459414 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.016830 24893 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6d453e7c90e142d388ba5e572b459414 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d453e7c90e142d388ba5e572b459414, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.017295 24893 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6d453e7c90e142d388ba5e572b459414 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d453e7c90e142d388ba5e572b459414" member_type: VOTER }
I20260709 12:12:47.017683 24893 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6d453e7c90e142d388ba5e572b459414 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:12:47.017872 24893 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6d453e7c90e142d388ba5e572b459414 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:12:47.018074 24893 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6d453e7c90e142d388ba5e572b459414 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.022595 24893 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6d453e7c90e142d388ba5e572b459414 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d453e7c90e142d388ba5e572b459414" member_type: VOTER }
I20260709 12:12:47.023109 24893 leader_election.cc:304] T 00000000000000000000000000000000 P 6d453e7c90e142d388ba5e572b459414 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6d453e7c90e142d388ba5e572b459414; no voters: 
I20260709 12:12:47.024098 24893 leader_election.cc:290] T 00000000000000000000000000000000 P 6d453e7c90e142d388ba5e572b459414 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:12:47.024432 24896 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6d453e7c90e142d388ba5e572b459414 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:47.025767 24896 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6d453e7c90e142d388ba5e572b459414 [term 1 LEADER]: Becoming Leader. State: Replica: 6d453e7c90e142d388ba5e572b459414, State: Running, Role: LEADER
I20260709 12:12:47.026422 24896 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6d453e7c90e142d388ba5e572b459414 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d453e7c90e142d388ba5e572b459414" member_type: VOTER }
I20260709 12:12:47.027089 24893 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6d453e7c90e142d388ba5e572b459414 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:12:47.029515 24898 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d453e7c90e142d388ba5e572b459414 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6d453e7c90e142d388ba5e572b459414. Latest consensus state: current_term: 1 leader_uuid: "6d453e7c90e142d388ba5e572b459414" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d453e7c90e142d388ba5e572b459414" member_type: VOTER } }
I20260709 12:12:47.029413 24897 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d453e7c90e142d388ba5e572b459414 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6d453e7c90e142d388ba5e572b459414" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d453e7c90e142d388ba5e572b459414" member_type: VOTER } }
I20260709 12:12:47.030164 24898 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d453e7c90e142d388ba5e572b459414 [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:47.030264 24897 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d453e7c90e142d388ba5e572b459414 [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:47.033048 24902 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:12:47.038043 24902 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:12:47.041873 16779 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:12:47.047147 24902 catalog_manager.cc:1383] Generated new cluster ID: 90076cfffb8b4932b240c61394aaec31
I20260709 12:12:47.047433 24902 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:12:47.062913 24902 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:12:47.064105 24902 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:12:47.076530 24902 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6d453e7c90e142d388ba5e572b459414: Generated new TSK 0
I20260709 12:12:47.077112 24902 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:12:47.109078 16779 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:47.115211 24914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:47.116285 24915 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:47.117868 24917 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:47.117913 16779 server_base.cc:1061] running on GCE node
I20260709 12:12:47.119167 16779 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:47.119366 16779 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:47.119541 16779 hybrid_clock.cc:648] HybridClock initialized: now 1783599167119523 us; error 0 us; skew 500 ppm
I20260709 12:12:47.120074 16779 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:47.122342 16779 webserver.cc:533] Webserver started at http://127.16.98.193:38533/ using document root <none> and password file <none>
I20260709 12:12:47.122879 16779 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:47.123066 16779 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:47.123358 16779 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:47.124445 16779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895573690-16779-0/minicluster-data/ts-0-root/instance:
uuid: "3885df3ab538460fbd694913a5dc20d6"
format_stamp: "Formatted at 2026-07-09 12:12:47 on dist-test-slave-9bv4"
I20260709 12:12:47.129230 16779 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:12:47.132655 24922 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:47.133468 16779 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:12:47.133771 16779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895573690-16779-0/minicluster-data/ts-0-root
uuid: "3885df3ab538460fbd694913a5dc20d6"
format_stamp: "Formatted at 2026-07-09 12:12:47 on dist-test-slave-9bv4"
I20260709 12:12:47.134019 16779 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895573690-16779-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895573690-16779-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895573690-16779-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:47.146296 16779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:47.147490 16779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:47.148903 16779 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:47.151217 16779 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:47.151389 16779 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:47.151686 16779 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:47.151863 16779 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:47.190403 16779 rpc_server.cc:307] RPC server started. Bound to: 127.16.98.193:35407
I20260709 12:12:47.190500 24984 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.98.193:35407 every 8 connection(s)
I20260709 12:12:47.195508 16779 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:47.203845 24990 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:47.204102 24992 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:47.204985 24989 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:47.207238 16779 server_base.cc:1061] running on GCE node
I20260709 12:12:47.207954 24985 heartbeater.cc:344] Connected to a master server at 127.16.98.254:35757
I20260709 12:12:47.208333 24985 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:47.208379 16779 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:47.208698 16779 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:47.208877 16779 hybrid_clock.cc:648] HybridClock initialized: now 1783599167208846 us; error 0 us; skew 500 ppm
I20260709 12:12:47.209162 24985 heartbeater.cc:507] Master 127.16.98.254:35757 requested a full tablet report, sending...
I20260709 12:12:47.209529 16779 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:47.211439 24858 ts_manager.cc:194] Registered new tserver with Master: 3885df3ab538460fbd694913a5dc20d6 (127.16.98.193:35407)
I20260709 12:12:47.213135 24858 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45878
I20260709 12:12:47.214412 16779 webserver.cc:533] Webserver started at http://127.16.98.194:40763/ using document root <none> and password file <none>
I20260709 12:12:47.215116 16779 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:47.215373 16779 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:47.215689 16779 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:47.216887 16779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895573690-16779-0/minicluster-data/ts-1-root/instance:
uuid: "74a79f73b55c4c13b1f668fcc23a0f0c"
format_stamp: "Formatted at 2026-07-09 12:12:47 on dist-test-slave-9bv4"
I20260709 12:12:47.221278 16779 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 12:12:47.224499 24997 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:47.225497 16779 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:12:47.225791 16779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895573690-16779-0/minicluster-data/ts-1-root
uuid: "74a79f73b55c4c13b1f668fcc23a0f0c"
format_stamp: "Formatted at 2026-07-09 12:12:47 on dist-test-slave-9bv4"
I20260709 12:12:47.226078 16779 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895573690-16779-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895573690-16779-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895573690-16779-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:47.253919 16779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:47.255201 16779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:47.256659 16779 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:47.258838 16779 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:47.259058 16779 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:47.259310 16779 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:47.259527 16779 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:47.298059 16779 rpc_server.cc:307] RPC server started. Bound to: 127.16.98.194:36119
I20260709 12:12:47.298167 25059 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.98.194:36119 every 8 connection(s)
I20260709 12:12:47.302943 16779 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:47.309307 25063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:47.310842 25064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:47.313983 25066 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:47.314399 25060 heartbeater.cc:344] Connected to a master server at 127.16.98.254:35757
I20260709 12:12:47.314910 16779 server_base.cc:1061] running on GCE node
I20260709 12:12:47.315131 25060 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:47.315863 16779 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:12:47.316035 25060 heartbeater.cc:507] Master 127.16.98.254:35757 requested a full tablet report, sending...
W20260709 12:12:47.316092 16779 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:47.316591 16779 hybrid_clock.cc:648] HybridClock initialized: now 1783599167316572 us; error 0 us; skew 500 ppm
I20260709 12:12:47.317175 16779 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:47.318324 24858 ts_manager.cc:194] Registered new tserver with Master: 74a79f73b55c4c13b1f668fcc23a0f0c (127.16.98.194:36119)
I20260709 12:12:47.319679 16779 webserver.cc:533] Webserver started at http://127.16.98.195:45889/ using document root <none> and password file <none>
I20260709 12:12:47.320044 24858 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45882
I20260709 12:12:47.320223 16779 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:47.320541 16779 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:47.320811 16779 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:47.322063 16779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895573690-16779-0/minicluster-data/ts-2-root/instance:
uuid: "cff10651e3524faf94f1582dd2d01079"
format_stamp: "Formatted at 2026-07-09 12:12:47 on dist-test-slave-9bv4"
I20260709 12:12:47.326458 16779 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:12:47.329897 25071 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:47.330581 16779 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 12:12:47.330946 16779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895573690-16779-0/minicluster-data/ts-2-root
uuid: "cff10651e3524faf94f1582dd2d01079"
format_stamp: "Formatted at 2026-07-09 12:12:47 on dist-test-slave-9bv4"
I20260709 12:12:47.331236 16779 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895573690-16779-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895573690-16779-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783598895573690-16779-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:47.343300 16779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:47.344383 16779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:47.345736 16779 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:47.347856 16779 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:47.348079 16779 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:47.348320 16779 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:47.348495 16779 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:47.386457 16779 rpc_server.cc:307] RPC server started. Bound to: 127.16.98.195:32925
I20260709 12:12:47.386559 25133 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.98.195:32925 every 8 connection(s)
I20260709 12:12:47.399518 25134 heartbeater.cc:344] Connected to a master server at 127.16.98.254:35757
I20260709 12:12:47.399922 25134 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:47.400559 25134 heartbeater.cc:507] Master 127.16.98.254:35757 requested a full tablet report, sending...
I20260709 12:12:47.402366 24858 ts_manager.cc:194] Registered new tserver with Master: cff10651e3524faf94f1582dd2d01079 (127.16.98.195:32925)
I20260709 12:12:47.402817 16779 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013165125s
I20260709 12:12:47.403673 24858 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45894
I20260709 12:12:47.426909 24858 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45900:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:12:47.429275 24858 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:12:47.476014 25025 tablet_service.cc:1511] Processing CreateTablet for tablet 60ef56ed9f744fd6afa7b1c125ced316 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=935e41cf15ae4b70a4a7ae025aa242c1]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:12:47.476822 24950 tablet_service.cc:1511] Processing CreateTablet for tablet 60ef56ed9f744fd6afa7b1c125ced316 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=935e41cf15ae4b70a4a7ae025aa242c1]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:12:47.477463 25025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60ef56ed9f744fd6afa7b1c125ced316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.478137 24950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60ef56ed9f744fd6afa7b1c125ced316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.479419 25024 tablet_service.cc:1511] Processing CreateTablet for tablet e4c17dde46a140269f52af4a59729c0f (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=935e41cf15ae4b70a4a7ae025aa242c1]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:12:47.480701 25024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4c17dde46a140269f52af4a59729c0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.478178 24949 tablet_service.cc:1511] Processing CreateTablet for tablet e4c17dde46a140269f52af4a59729c0f (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=935e41cf15ae4b70a4a7ae025aa242c1]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:12:47.484025 24949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4c17dde46a140269f52af4a59729c0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.486176 25099 tablet_service.cc:1511] Processing CreateTablet for tablet 60ef56ed9f744fd6afa7b1c125ced316 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=935e41cf15ae4b70a4a7ae025aa242c1]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:12:47.486850 25098 tablet_service.cc:1511] Processing CreateTablet for tablet e4c17dde46a140269f52af4a59729c0f (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=935e41cf15ae4b70a4a7ae025aa242c1]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:12:47.487429 25099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60ef56ed9f744fd6afa7b1c125ced316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.488117 25098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4c17dde46a140269f52af4a59729c0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.502777 25149 tablet_bootstrap.cc:492] T 60ef56ed9f744fd6afa7b1c125ced316 P 74a79f73b55c4c13b1f668fcc23a0f0c: Bootstrap starting.
I20260709 12:12:47.508610 25150 tablet_bootstrap.cc:492] T e4c17dde46a140269f52af4a59729c0f P cff10651e3524faf94f1582dd2d01079: Bootstrap starting.
I20260709 12:12:47.511830 25149 tablet_bootstrap.cc:654] T 60ef56ed9f744fd6afa7b1c125ced316 P 74a79f73b55c4c13b1f668fcc23a0f0c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.518985 25150 tablet_bootstrap.cc:654] T e4c17dde46a140269f52af4a59729c0f P cff10651e3524faf94f1582dd2d01079: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.522372 25149 tablet_bootstrap.cc:492] T 60ef56ed9f744fd6afa7b1c125ced316 P 74a79f73b55c4c13b1f668fcc23a0f0c: No bootstrap required, opened a new log
I20260709 12:12:47.522893 25149 ts_tablet_manager.cc:1403] T 60ef56ed9f744fd6afa7b1c125ced316 P 74a79f73b55c4c13b1f668fcc23a0f0c: Time spent bootstrapping tablet: real 0.021s	user 0.004s	sys 0.013s
I20260709 12:12:47.525857 25149 raft_consensus.cc:359] T 60ef56ed9f744fd6afa7b1c125ced316 P 74a79f73b55c4c13b1f668fcc23a0f0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:47.526597 25149 raft_consensus.cc:385] T 60ef56ed9f744fd6afa7b1c125ced316 P 74a79f73b55c4c13b1f668fcc23a0f0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.526958 25149 raft_consensus.cc:740] T 60ef56ed9f744fd6afa7b1c125ced316 P 74a79f73b55c4c13b1f668fcc23a0f0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74a79f73b55c4c13b1f668fcc23a0f0c, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.527735 25149 consensus_queue.cc:260] T 60ef56ed9f744fd6afa7b1c125ced316 P 74a79f73b55c4c13b1f668fcc23a0f0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:47.530304 25060 heartbeater.cc:499] Master 127.16.98.254:35757 was elected leader, sending a full tablet report...
I20260709 12:12:47.530874 25149 ts_tablet_manager.cc:1434] T 60ef56ed9f744fd6afa7b1c125ced316 P 74a79f73b55c4c13b1f668fcc23a0f0c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:12:47.531783 25152 tablet_bootstrap.cc:492] T e4c17dde46a140269f52af4a59729c0f P 3885df3ab538460fbd694913a5dc20d6: Bootstrap starting.
I20260709 12:12:47.532030 25149 tablet_bootstrap.cc:492] T e4c17dde46a140269f52af4a59729c0f P 74a79f73b55c4c13b1f668fcc23a0f0c: Bootstrap starting.
I20260709 12:12:47.534370 25150 tablet_bootstrap.cc:492] T e4c17dde46a140269f52af4a59729c0f P cff10651e3524faf94f1582dd2d01079: No bootstrap required, opened a new log
I20260709 12:12:47.534957 25150 ts_tablet_manager.cc:1403] T e4c17dde46a140269f52af4a59729c0f P cff10651e3524faf94f1582dd2d01079: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.014s
I20260709 12:12:47.538189 25150 raft_consensus.cc:359] T e4c17dde46a140269f52af4a59729c0f P cff10651e3524faf94f1582dd2d01079 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:47.538988 25150 raft_consensus.cc:385] T e4c17dde46a140269f52af4a59729c0f P cff10651e3524faf94f1582dd2d01079 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.539320 25150 raft_consensus.cc:740] T e4c17dde46a140269f52af4a59729c0f P cff10651e3524faf94f1582dd2d01079 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cff10651e3524faf94f1582dd2d01079, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.539631 25152 tablet_bootstrap.cc:654] T e4c17dde46a140269f52af4a59729c0f P 3885df3ab538460fbd694913a5dc20d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.540048 25149 tablet_bootstrap.cc:654] T e4c17dde46a140269f52af4a59729c0f P 74a79f73b55c4c13b1f668fcc23a0f0c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.540076 25150 consensus_queue.cc:260] T e4c17dde46a140269f52af4a59729c0f P cff10651e3524faf94f1582dd2d01079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:47.545790 25134 heartbeater.cc:499] Master 127.16.98.254:35757 was elected leader, sending a full tablet report...
I20260709 12:12:47.546310 25150 ts_tablet_manager.cc:1434] T e4c17dde46a140269f52af4a59729c0f P cff10651e3524faf94f1582dd2d01079: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:12:47.546918 25149 tablet_bootstrap.cc:492] T e4c17dde46a140269f52af4a59729c0f P 74a79f73b55c4c13b1f668fcc23a0f0c: No bootstrap required, opened a new log
I20260709 12:12:47.547411 25150 tablet_bootstrap.cc:492] T 60ef56ed9f744fd6afa7b1c125ced316 P cff10651e3524faf94f1582dd2d01079: Bootstrap starting.
I20260709 12:12:47.547447 25149 ts_tablet_manager.cc:1403] T e4c17dde46a140269f52af4a59729c0f P 74a79f73b55c4c13b1f668fcc23a0f0c: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.005s
I20260709 12:12:47.548272 25152 tablet_bootstrap.cc:492] T e4c17dde46a140269f52af4a59729c0f P 3885df3ab538460fbd694913a5dc20d6: No bootstrap required, opened a new log
I20260709 12:12:47.548825 25152 ts_tablet_manager.cc:1403] T e4c17dde46a140269f52af4a59729c0f P 3885df3ab538460fbd694913a5dc20d6: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.005s
I20260709 12:12:47.550794 25149 raft_consensus.cc:359] T e4c17dde46a140269f52af4a59729c0f P 74a79f73b55c4c13b1f668fcc23a0f0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:47.551606 25149 raft_consensus.cc:385] T e4c17dde46a140269f52af4a59729c0f P 74a79f73b55c4c13b1f668fcc23a0f0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.551973 25149 raft_consensus.cc:740] T e4c17dde46a140269f52af4a59729c0f P 74a79f73b55c4c13b1f668fcc23a0f0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74a79f73b55c4c13b1f668fcc23a0f0c, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.551975 25152 raft_consensus.cc:359] T e4c17dde46a140269f52af4a59729c0f P 3885df3ab538460fbd694913a5dc20d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:47.552942 25152 raft_consensus.cc:385] T e4c17dde46a140269f52af4a59729c0f P 3885df3ab538460fbd694913a5dc20d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.553306 25152 raft_consensus.cc:740] T e4c17dde46a140269f52af4a59729c0f P 3885df3ab538460fbd694913a5dc20d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3885df3ab538460fbd694913a5dc20d6, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.553220 25149 consensus_queue.cc:260] T e4c17dde46a140269f52af4a59729c0f P 74a79f73b55c4c13b1f668fcc23a0f0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:47.554467 25152 consensus_queue.cc:260] T e4c17dde46a140269f52af4a59729c0f P 3885df3ab538460fbd694913a5dc20d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:47.556804 25150 tablet_bootstrap.cc:654] T 60ef56ed9f744fd6afa7b1c125ced316 P cff10651e3524faf94f1582dd2d01079: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.563377 25149 ts_tablet_manager.cc:1434] T e4c17dde46a140269f52af4a59729c0f P 74a79f73b55c4c13b1f668fcc23a0f0c: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:12:47.563973 24985 heartbeater.cc:499] Master 127.16.98.254:35757 was elected leader, sending a full tablet report...
I20260709 12:12:47.564446 25152 ts_tablet_manager.cc:1434] T e4c17dde46a140269f52af4a59729c0f P 3885df3ab538460fbd694913a5dc20d6: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.005s
I20260709 12:12:47.565490 25152 tablet_bootstrap.cc:492] T 60ef56ed9f744fd6afa7b1c125ced316 P 3885df3ab538460fbd694913a5dc20d6: Bootstrap starting.
I20260709 12:12:47.566424 25150 tablet_bootstrap.cc:492] T 60ef56ed9f744fd6afa7b1c125ced316 P cff10651e3524faf94f1582dd2d01079: No bootstrap required, opened a new log
I20260709 12:12:47.567003 25150 ts_tablet_manager.cc:1403] T 60ef56ed9f744fd6afa7b1c125ced316 P cff10651e3524faf94f1582dd2d01079: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.001s
I20260709 12:12:47.569849 25150 raft_consensus.cc:359] T 60ef56ed9f744fd6afa7b1c125ced316 P cff10651e3524faf94f1582dd2d01079 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:47.570618 25150 raft_consensus.cc:385] T 60ef56ed9f744fd6afa7b1c125ced316 P cff10651e3524faf94f1582dd2d01079 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.570998 25150 raft_consensus.cc:740] T 60ef56ed9f744fd6afa7b1c125ced316 P cff10651e3524faf94f1582dd2d01079 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cff10651e3524faf94f1582dd2d01079, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.572139 25152 tablet_bootstrap.cc:654] T 60ef56ed9f744fd6afa7b1c125ced316 P 3885df3ab538460fbd694913a5dc20d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:47.571727 25150 consensus_queue.cc:260] T 60ef56ed9f744fd6afa7b1c125ced316 P cff10651e3524faf94f1582dd2d01079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:47.574514 25150 ts_tablet_manager.cc:1434] T 60ef56ed9f744fd6afa7b1c125ced316 P cff10651e3524faf94f1582dd2d01079: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 12:12:47.577721 25152 tablet_bootstrap.cc:492] T 60ef56ed9f744fd6afa7b1c125ced316 P 3885df3ab538460fbd694913a5dc20d6: No bootstrap required, opened a new log
I20260709 12:12:47.578244 25152 ts_tablet_manager.cc:1403] T 60ef56ed9f744fd6afa7b1c125ced316 P 3885df3ab538460fbd694913a5dc20d6: Time spent bootstrapping tablet: real 0.013s	user 0.002s	sys 0.008s
I20260709 12:12:47.581256 25152 raft_consensus.cc:359] T 60ef56ed9f744fd6afa7b1c125ced316 P 3885df3ab538460fbd694913a5dc20d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:47.581943 25152 raft_consensus.cc:385] T 60ef56ed9f744fd6afa7b1c125ced316 P 3885df3ab538460fbd694913a5dc20d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:47.582204 25152 raft_consensus.cc:740] T 60ef56ed9f744fd6afa7b1c125ced316 P 3885df3ab538460fbd694913a5dc20d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3885df3ab538460fbd694913a5dc20d6, State: Initialized, Role: FOLLOWER
I20260709 12:12:47.582875 25152 consensus_queue.cc:260] T 60ef56ed9f744fd6afa7b1c125ced316 P 3885df3ab538460fbd694913a5dc20d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:47.584695 25152 ts_tablet_manager.cc:1434] T 60ef56ed9f744fd6afa7b1c125ced316 P 3885df3ab538460fbd694913a5dc20d6: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:12:47.800518 25158 raft_consensus.cc:493] T 60ef56ed9f744fd6afa7b1c125ced316 P 3885df3ab538460fbd694913a5dc20d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.801054 25158 raft_consensus.cc:515] T 60ef56ed9f744fd6afa7b1c125ced316 P 3885df3ab538460fbd694913a5dc20d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:47.803332 25158 leader_election.cc:290] T 60ef56ed9f744fd6afa7b1c125ced316 P 3885df3ab538460fbd694913a5dc20d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74a79f73b55c4c13b1f668fcc23a0f0c (127.16.98.194:36119), cff10651e3524faf94f1582dd2d01079 (127.16.98.195:32925)
I20260709 12:12:47.813843 25035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ef56ed9f744fd6afa7b1c125ced316" candidate_uuid: "3885df3ab538460fbd694913a5dc20d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" is_pre_election: true
I20260709 12:12:47.814429 25109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ef56ed9f744fd6afa7b1c125ced316" candidate_uuid: "3885df3ab538460fbd694913a5dc20d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cff10651e3524faf94f1582dd2d01079" is_pre_election: true
I20260709 12:12:47.814620 25035 raft_consensus.cc:2468] T 60ef56ed9f744fd6afa7b1c125ced316 P 74a79f73b55c4c13b1f668fcc23a0f0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3885df3ab538460fbd694913a5dc20d6 in term 0.
I20260709 12:12:47.815132 25109 raft_consensus.cc:2468] T 60ef56ed9f744fd6afa7b1c125ced316 P cff10651e3524faf94f1582dd2d01079 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3885df3ab538460fbd694913a5dc20d6 in term 0.
I20260709 12:12:47.815893 24924 leader_election.cc:304] T 60ef56ed9f744fd6afa7b1c125ced316 P 3885df3ab538460fbd694913a5dc20d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3885df3ab538460fbd694913a5dc20d6, 74a79f73b55c4c13b1f668fcc23a0f0c; no voters: 
I20260709 12:12:47.816694 25158 raft_consensus.cc:2804] T 60ef56ed9f744fd6afa7b1c125ced316 P 3885df3ab538460fbd694913a5dc20d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:47.817052 25158 raft_consensus.cc:493] T 60ef56ed9f744fd6afa7b1c125ced316 P 3885df3ab538460fbd694913a5dc20d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.817335 25158 raft_consensus.cc:3060] T 60ef56ed9f744fd6afa7b1c125ced316 P 3885df3ab538460fbd694913a5dc20d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.822233 25158 raft_consensus.cc:515] T 60ef56ed9f744fd6afa7b1c125ced316 P 3885df3ab538460fbd694913a5dc20d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:47.824115 25158 leader_election.cc:290] T 60ef56ed9f744fd6afa7b1c125ced316 P 3885df3ab538460fbd694913a5dc20d6 [CANDIDATE]: Term 1 election: Requested vote from peers 74a79f73b55c4c13b1f668fcc23a0f0c (127.16.98.194:36119), cff10651e3524faf94f1582dd2d01079 (127.16.98.195:32925)
I20260709 12:12:47.824791 25035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ef56ed9f744fd6afa7b1c125ced316" candidate_uuid: "3885df3ab538460fbd694913a5dc20d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c"
I20260709 12:12:47.825117 25109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60ef56ed9f744fd6afa7b1c125ced316" candidate_uuid: "3885df3ab538460fbd694913a5dc20d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cff10651e3524faf94f1582dd2d01079"
I20260709 12:12:47.825299 25035 raft_consensus.cc:3060] T 60ef56ed9f744fd6afa7b1c125ced316 P 74a79f73b55c4c13b1f668fcc23a0f0c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.825690 25109 raft_consensus.cc:3060] T 60ef56ed9f744fd6afa7b1c125ced316 P cff10651e3524faf94f1582dd2d01079 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.827276 25157 raft_consensus.cc:493] T e4c17dde46a140269f52af4a59729c0f P cff10651e3524faf94f1582dd2d01079 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:47.827776 25157 raft_consensus.cc:515] T e4c17dde46a140269f52af4a59729c0f P cff10651e3524faf94f1582dd2d01079 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:47.830533 25157 leader_election.cc:290] T e4c17dde46a140269f52af4a59729c0f P cff10651e3524faf94f1582dd2d01079 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3885df3ab538460fbd694913a5dc20d6 (127.16.98.193:35407), 74a79f73b55c4c13b1f668fcc23a0f0c (127.16.98.194:36119)
I20260709 12:12:47.832417 25035 raft_consensus.cc:2468] T 60ef56ed9f744fd6afa7b1c125ced316 P 74a79f73b55c4c13b1f668fcc23a0f0c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3885df3ab538460fbd694913a5dc20d6 in term 1.
I20260709 12:12:47.834450 24924 leader_election.cc:304] T 60ef56ed9f744fd6afa7b1c125ced316 P 3885df3ab538460fbd694913a5dc20d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3885df3ab538460fbd694913a5dc20d6, 74a79f73b55c4c13b1f668fcc23a0f0c; no voters: 
I20260709 12:12:47.835466 25158 raft_consensus.cc:2804] T 60ef56ed9f744fd6afa7b1c125ced316 P 3885df3ab538460fbd694913a5dc20d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:47.835520 25109 raft_consensus.cc:2468] T 60ef56ed9f744fd6afa7b1c125ced316 P cff10651e3524faf94f1582dd2d01079 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3885df3ab538460fbd694913a5dc20d6 in term 1.
I20260709 12:12:47.837852 25158 raft_consensus.cc:697] T 60ef56ed9f744fd6afa7b1c125ced316 P 3885df3ab538460fbd694913a5dc20d6 [term 1 LEADER]: Becoming Leader. State: Replica: 3885df3ab538460fbd694913a5dc20d6, State: Running, Role: LEADER
I20260709 12:12:47.838835 25158 consensus_queue.cc:237] T 60ef56ed9f744fd6afa7b1c125ced316 P 3885df3ab538460fbd694913a5dc20d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:47.842067 24960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4c17dde46a140269f52af4a59729c0f" candidate_uuid: "cff10651e3524faf94f1582dd2d01079" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3885df3ab538460fbd694913a5dc20d6" is_pre_election: true
I20260709 12:12:47.842476 25035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4c17dde46a140269f52af4a59729c0f" candidate_uuid: "cff10651e3524faf94f1582dd2d01079" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" is_pre_election: true
I20260709 12:12:47.842839 24960 raft_consensus.cc:2468] T e4c17dde46a140269f52af4a59729c0f P 3885df3ab538460fbd694913a5dc20d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cff10651e3524faf94f1582dd2d01079 in term 0.
I20260709 12:12:47.843226 25035 raft_consensus.cc:2468] T e4c17dde46a140269f52af4a59729c0f P 74a79f73b55c4c13b1f668fcc23a0f0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cff10651e3524faf94f1582dd2d01079 in term 0.
I20260709 12:12:47.844470 25073 leader_election.cc:304] T e4c17dde46a140269f52af4a59729c0f P cff10651e3524faf94f1582dd2d01079 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74a79f73b55c4c13b1f668fcc23a0f0c, cff10651e3524faf94f1582dd2d01079; no voters: 
I20260709 12:12:47.845299 25157 raft_consensus.cc:2804] T e4c17dde46a140269f52af4a59729c0f P cff10651e3524faf94f1582dd2d01079 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:47.845664 25157 raft_consensus.cc:493] T e4c17dde46a140269f52af4a59729c0f P cff10651e3524faf94f1582dd2d01079 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:47.845937 25157 raft_consensus.cc:3060] T e4c17dde46a140269f52af4a59729c0f P cff10651e3524faf94f1582dd2d01079 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.847419 24858 catalog_manager.cc:5697] T 60ef56ed9f744fd6afa7b1c125ced316 P 3885df3ab538460fbd694913a5dc20d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3885df3ab538460fbd694913a5dc20d6 (127.16.98.193). New cstate: current_term: 1 leader_uuid: "3885df3ab538460fbd694913a5dc20d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:47.852589 25157 raft_consensus.cc:515] T e4c17dde46a140269f52af4a59729c0f P cff10651e3524faf94f1582dd2d01079 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:47.854409 25157 leader_election.cc:290] T e4c17dde46a140269f52af4a59729c0f P cff10651e3524faf94f1582dd2d01079 [CANDIDATE]: Term 1 election: Requested vote from peers 3885df3ab538460fbd694913a5dc20d6 (127.16.98.193:35407), 74a79f73b55c4c13b1f668fcc23a0f0c (127.16.98.194:36119)
I20260709 12:12:47.855027 24960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4c17dde46a140269f52af4a59729c0f" candidate_uuid: "cff10651e3524faf94f1582dd2d01079" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3885df3ab538460fbd694913a5dc20d6"
I20260709 12:12:47.855647 24960 raft_consensus.cc:3060] T e4c17dde46a140269f52af4a59729c0f P 3885df3ab538460fbd694913a5dc20d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.855857 25035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4c17dde46a140269f52af4a59729c0f" candidate_uuid: "cff10651e3524faf94f1582dd2d01079" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c"
I20260709 12:12:47.856417 25035 raft_consensus.cc:3060] T e4c17dde46a140269f52af4a59729c0f P 74a79f73b55c4c13b1f668fcc23a0f0c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:47.863030 24960 raft_consensus.cc:2468] T e4c17dde46a140269f52af4a59729c0f P 3885df3ab538460fbd694913a5dc20d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cff10651e3524faf94f1582dd2d01079 in term 1.
I20260709 12:12:47.863395 25035 raft_consensus.cc:2468] T e4c17dde46a140269f52af4a59729c0f P 74a79f73b55c4c13b1f668fcc23a0f0c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cff10651e3524faf94f1582dd2d01079 in term 1.
I20260709 12:12:47.864315 25072 leader_election.cc:304] T e4c17dde46a140269f52af4a59729c0f P cff10651e3524faf94f1582dd2d01079 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3885df3ab538460fbd694913a5dc20d6, cff10651e3524faf94f1582dd2d01079; no voters: 
I20260709 12:12:47.865089 25157 raft_consensus.cc:2804] T e4c17dde46a140269f52af4a59729c0f P cff10651e3524faf94f1582dd2d01079 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:47.865962 25157 raft_consensus.cc:697] T e4c17dde46a140269f52af4a59729c0f P cff10651e3524faf94f1582dd2d01079 [term 1 LEADER]: Becoming Leader. State: Replica: cff10651e3524faf94f1582dd2d01079, State: Running, Role: LEADER
I20260709 12:12:47.866634 25157 consensus_queue.cc:237] T e4c17dde46a140269f52af4a59729c0f P cff10651e3524faf94f1582dd2d01079 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:47.873342 24858 catalog_manager.cc:5697] T e4c17dde46a140269f52af4a59729c0f P cff10651e3524faf94f1582dd2d01079 reported cstate change: term changed from 0 to 1, leader changed from <none> to cff10651e3524faf94f1582dd2d01079 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "cff10651e3524faf94f1582dd2d01079" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:47.961117 24858 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45902:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:12:47.963019 24858 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:12:47.985296 24949 tablet_service.cc:1511] Processing CreateTablet for tablet 981d85084e6f4a4db386d45b6f98d2c1 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8014cc8e4b68456e850b3b1a701d2c53]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:12:47.986481 25024 tablet_service.cc:1511] Processing CreateTablet for tablet 981d85084e6f4a4db386d45b6f98d2c1 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8014cc8e4b68456e850b3b1a701d2c53]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:12:47.986579 24949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 981d85084e6f4a4db386d45b6f98d2c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.987821 25024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 981d85084e6f4a4db386d45b6f98d2c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.988088 25099 tablet_service.cc:1511] Processing CreateTablet for tablet 981d85084e6f4a4db386d45b6f98d2c1 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8014cc8e4b68456e850b3b1a701d2c53]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:12:47.989261 25099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 981d85084e6f4a4db386d45b6f98d2c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.991911 25025 tablet_service.cc:1511] Processing CreateTablet for tablet efbe5e399bd14aea986191f4d13b892e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8014cc8e4b68456e850b3b1a701d2c53]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:12:47.992810 24950 tablet_service.cc:1511] Processing CreateTablet for tablet efbe5e399bd14aea986191f4d13b892e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8014cc8e4b68456e850b3b1a701d2c53]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:12:47.991911 25098 tablet_service.cc:1511] Processing CreateTablet for tablet efbe5e399bd14aea986191f4d13b892e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8014cc8e4b68456e850b3b1a701d2c53]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:12:47.994046 24950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efbe5e399bd14aea986191f4d13b892e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.994697 25098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efbe5e399bd14aea986191f4d13b892e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:47.993177 25025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efbe5e399bd14aea986191f4d13b892e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:48.003165 25152 tablet_bootstrap.cc:492] T 981d85084e6f4a4db386d45b6f98d2c1 P 3885df3ab538460fbd694913a5dc20d6: Bootstrap starting.
I20260709 12:12:48.006246 25150 tablet_bootstrap.cc:492] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079: Bootstrap starting.
I20260709 12:12:48.012419 25150 tablet_bootstrap.cc:654] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.012498 25152 tablet_bootstrap.cc:654] T 981d85084e6f4a4db386d45b6f98d2c1 P 3885df3ab538460fbd694913a5dc20d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.025611 25149 tablet_bootstrap.cc:492] T 981d85084e6f4a4db386d45b6f98d2c1 P 74a79f73b55c4c13b1f668fcc23a0f0c: Bootstrap starting.
I20260709 12:12:48.025923 25152 tablet_bootstrap.cc:492] T 981d85084e6f4a4db386d45b6f98d2c1 P 3885df3ab538460fbd694913a5dc20d6: No bootstrap required, opened a new log
I20260709 12:12:48.026633 25152 ts_tablet_manager.cc:1403] T 981d85084e6f4a4db386d45b6f98d2c1 P 3885df3ab538460fbd694913a5dc20d6: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.008s
I20260709 12:12:48.027771 25150 tablet_bootstrap.cc:492] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079: No bootstrap required, opened a new log
I20260709 12:12:48.028388 25150 ts_tablet_manager.cc:1403] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.009s
I20260709 12:12:48.029728 25152 raft_consensus.cc:359] T 981d85084e6f4a4db386d45b6f98d2c1 P 3885df3ab538460fbd694913a5dc20d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:48.030543 25152 raft_consensus.cc:385] T 981d85084e6f4a4db386d45b6f98d2c1 P 3885df3ab538460fbd694913a5dc20d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.030889 25152 raft_consensus.cc:740] T 981d85084e6f4a4db386d45b6f98d2c1 P 3885df3ab538460fbd694913a5dc20d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3885df3ab538460fbd694913a5dc20d6, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.031529 25150 raft_consensus.cc:359] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:48.031826 25152 consensus_queue.cc:260] T 981d85084e6f4a4db386d45b6f98d2c1 P 3885df3ab538460fbd694913a5dc20d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:48.032398 25150 raft_consensus.cc:385] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.033036 25150 raft_consensus.cc:740] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cff10651e3524faf94f1582dd2d01079, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.034282 25152 ts_tablet_manager.cc:1434] T 981d85084e6f4a4db386d45b6f98d2c1 P 3885df3ab538460fbd694913a5dc20d6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:12:48.033957 25150 consensus_queue.cc:260] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:48.035364 25152 tablet_bootstrap.cc:492] T efbe5e399bd14aea986191f4d13b892e P 3885df3ab538460fbd694913a5dc20d6: Bootstrap starting.
I20260709 12:12:48.036499 25150 ts_tablet_manager.cc:1434] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:12:48.037650 25150 tablet_bootstrap.cc:492] T efbe5e399bd14aea986191f4d13b892e P cff10651e3524faf94f1582dd2d01079: Bootstrap starting.
W20260709 12:12:48.039767 24906 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:48.042603 25152 tablet_bootstrap.cc:654] T efbe5e399bd14aea986191f4d13b892e P 3885df3ab538460fbd694913a5dc20d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.044287 25150 tablet_bootstrap.cc:654] T efbe5e399bd14aea986191f4d13b892e P cff10651e3524faf94f1582dd2d01079: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.051276 25149 tablet_bootstrap.cc:654] T 981d85084e6f4a4db386d45b6f98d2c1 P 74a79f73b55c4c13b1f668fcc23a0f0c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.056838 25152 tablet_bootstrap.cc:492] T efbe5e399bd14aea986191f4d13b892e P 3885df3ab538460fbd694913a5dc20d6: No bootstrap required, opened a new log
I20260709 12:12:48.057410 25152 ts_tablet_manager.cc:1403] T efbe5e399bd14aea986191f4d13b892e P 3885df3ab538460fbd694913a5dc20d6: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.008s
I20260709 12:12:48.060468 25152 raft_consensus.cc:359] T efbe5e399bd14aea986191f4d13b892e P 3885df3ab538460fbd694913a5dc20d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:48.061268 25152 raft_consensus.cc:385] T efbe5e399bd14aea986191f4d13b892e P 3885df3ab538460fbd694913a5dc20d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.061667 25152 raft_consensus.cc:740] T efbe5e399bd14aea986191f4d13b892e P 3885df3ab538460fbd694913a5dc20d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3885df3ab538460fbd694913a5dc20d6, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.062536 25152 consensus_queue.cc:260] T efbe5e399bd14aea986191f4d13b892e P 3885df3ab538460fbd694913a5dc20d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:48.063735 25150 tablet_bootstrap.cc:492] T efbe5e399bd14aea986191f4d13b892e P cff10651e3524faf94f1582dd2d01079: No bootstrap required, opened a new log
I20260709 12:12:48.064249 25150 ts_tablet_manager.cc:1403] T efbe5e399bd14aea986191f4d13b892e P cff10651e3524faf94f1582dd2d01079: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.011s
I20260709 12:12:48.064833 25152 ts_tablet_manager.cc:1434] T efbe5e399bd14aea986191f4d13b892e P 3885df3ab538460fbd694913a5dc20d6: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:12:48.066946 25149 tablet_bootstrap.cc:492] T 981d85084e6f4a4db386d45b6f98d2c1 P 74a79f73b55c4c13b1f668fcc23a0f0c: No bootstrap required, opened a new log
I20260709 12:12:48.067410 25149 ts_tablet_manager.cc:1403] T 981d85084e6f4a4db386d45b6f98d2c1 P 74a79f73b55c4c13b1f668fcc23a0f0c: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.002s
I20260709 12:12:48.066967 25150 raft_consensus.cc:359] T efbe5e399bd14aea986191f4d13b892e P cff10651e3524faf94f1582dd2d01079 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:48.067893 25150 raft_consensus.cc:385] T efbe5e399bd14aea986191f4d13b892e P cff10651e3524faf94f1582dd2d01079 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.068207 25150 raft_consensus.cc:740] T efbe5e399bd14aea986191f4d13b892e P cff10651e3524faf94f1582dd2d01079 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cff10651e3524faf94f1582dd2d01079, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.069006 25150 consensus_queue.cc:260] T efbe5e399bd14aea986191f4d13b892e P cff10651e3524faf94f1582dd2d01079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:48.071233 25150 ts_tablet_manager.cc:1434] T efbe5e399bd14aea986191f4d13b892e P cff10651e3524faf94f1582dd2d01079: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:12:48.072273 25149 raft_consensus.cc:359] T 981d85084e6f4a4db386d45b6f98d2c1 P 74a79f73b55c4c13b1f668fcc23a0f0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:48.073017 25149 raft_consensus.cc:385] T 981d85084e6f4a4db386d45b6f98d2c1 P 74a79f73b55c4c13b1f668fcc23a0f0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.073297 25149 raft_consensus.cc:740] T 981d85084e6f4a4db386d45b6f98d2c1 P 74a79f73b55c4c13b1f668fcc23a0f0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74a79f73b55c4c13b1f668fcc23a0f0c, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.074069 25149 consensus_queue.cc:260] T 981d85084e6f4a4db386d45b6f98d2c1 P 74a79f73b55c4c13b1f668fcc23a0f0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:48.078850 25149 ts_tablet_manager.cc:1434] T 981d85084e6f4a4db386d45b6f98d2c1 P 74a79f73b55c4c13b1f668fcc23a0f0c: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 12:12:48.079903 25149 tablet_bootstrap.cc:492] T efbe5e399bd14aea986191f4d13b892e P 74a79f73b55c4c13b1f668fcc23a0f0c: Bootstrap starting.
I20260709 12:12:48.086889 25149 tablet_bootstrap.cc:654] T efbe5e399bd14aea986191f4d13b892e P 74a79f73b55c4c13b1f668fcc23a0f0c: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:48.090847 25149 tablet_bootstrap.cc:492] T efbe5e399bd14aea986191f4d13b892e P 74a79f73b55c4c13b1f668fcc23a0f0c: No bootstrap required, opened a new log
I20260709 12:12:48.091256 25149 ts_tablet_manager.cc:1403] T efbe5e399bd14aea986191f4d13b892e P 74a79f73b55c4c13b1f668fcc23a0f0c: Time spent bootstrapping tablet: real 0.012s	user 0.006s	sys 0.004s
I20260709 12:12:48.093348 25149 raft_consensus.cc:359] T efbe5e399bd14aea986191f4d13b892e P 74a79f73b55c4c13b1f668fcc23a0f0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:48.093853 25149 raft_consensus.cc:385] T efbe5e399bd14aea986191f4d13b892e P 74a79f73b55c4c13b1f668fcc23a0f0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:48.094110 25149 raft_consensus.cc:740] T efbe5e399bd14aea986191f4d13b892e P 74a79f73b55c4c13b1f668fcc23a0f0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74a79f73b55c4c13b1f668fcc23a0f0c, State: Initialized, Role: FOLLOWER
I20260709 12:12:48.094748 25149 consensus_queue.cc:260] T efbe5e399bd14aea986191f4d13b892e P 74a79f73b55c4c13b1f668fcc23a0f0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:48.096230 25149 ts_tablet_manager.cc:1434] T efbe5e399bd14aea986191f4d13b892e P 74a79f73b55c4c13b1f668fcc23a0f0c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:12:48.125135 25157 raft_consensus.cc:493] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.125610 25157 raft_consensus.cc:515] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:48.127395 25157 leader_election.cc:290] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3885df3ab538460fbd694913a5dc20d6 (127.16.98.193:35407), 74a79f73b55c4c13b1f668fcc23a0f0c (127.16.98.194:36119)
I20260709 12:12:48.128180 24960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981d85084e6f4a4db386d45b6f98d2c1" candidate_uuid: "cff10651e3524faf94f1582dd2d01079" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3885df3ab538460fbd694913a5dc20d6" is_pre_election: true
I20260709 12:12:48.128494 25035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981d85084e6f4a4db386d45b6f98d2c1" candidate_uuid: "cff10651e3524faf94f1582dd2d01079" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" is_pre_election: true
I20260709 12:12:48.128969 24960 raft_consensus.cc:2468] T 981d85084e6f4a4db386d45b6f98d2c1 P 3885df3ab538460fbd694913a5dc20d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cff10651e3524faf94f1582dd2d01079 in term 0.
I20260709 12:12:48.129096 25035 raft_consensus.cc:2468] T 981d85084e6f4a4db386d45b6f98d2c1 P 74a79f73b55c4c13b1f668fcc23a0f0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cff10651e3524faf94f1582dd2d01079 in term 0.
I20260709 12:12:48.130177 25073 leader_election.cc:304] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74a79f73b55c4c13b1f668fcc23a0f0c, cff10651e3524faf94f1582dd2d01079; no voters: 
I20260709 12:12:48.131053 25157 raft_consensus.cc:2804] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:48.131376 25157 raft_consensus.cc:493] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.131670 25157 raft_consensus.cc:3060] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.136452 25157 raft_consensus.cc:515] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:48.138109 25157 leader_election.cc:290] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [CANDIDATE]: Term 1 election: Requested vote from peers 3885df3ab538460fbd694913a5dc20d6 (127.16.98.193:35407), 74a79f73b55c4c13b1f668fcc23a0f0c (127.16.98.194:36119)
I20260709 12:12:48.138929 24960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981d85084e6f4a4db386d45b6f98d2c1" candidate_uuid: "cff10651e3524faf94f1582dd2d01079" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3885df3ab538460fbd694913a5dc20d6"
I20260709 12:12:48.139256 25035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981d85084e6f4a4db386d45b6f98d2c1" candidate_uuid: "cff10651e3524faf94f1582dd2d01079" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c"
I20260709 12:12:48.139577 24960 raft_consensus.cc:3060] T 981d85084e6f4a4db386d45b6f98d2c1 P 3885df3ab538460fbd694913a5dc20d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.139842 25035 raft_consensus.cc:3060] T 981d85084e6f4a4db386d45b6f98d2c1 P 74a79f73b55c4c13b1f668fcc23a0f0c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.146723 25035 raft_consensus.cc:2468] T 981d85084e6f4a4db386d45b6f98d2c1 P 74a79f73b55c4c13b1f668fcc23a0f0c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cff10651e3524faf94f1582dd2d01079 in term 1.
I20260709 12:12:48.146719 24960 raft_consensus.cc:2468] T 981d85084e6f4a4db386d45b6f98d2c1 P 3885df3ab538460fbd694913a5dc20d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cff10651e3524faf94f1582dd2d01079 in term 1.
I20260709 12:12:48.148058 25072 leader_election.cc:304] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3885df3ab538460fbd694913a5dc20d6, cff10651e3524faf94f1582dd2d01079; no voters: 
I20260709 12:12:48.148696 25157 raft_consensus.cc:2804] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:48.149163 25157 raft_consensus.cc:697] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [term 1 LEADER]: Becoming Leader. State: Replica: cff10651e3524faf94f1582dd2d01079, State: Running, Role: LEADER
I20260709 12:12:48.149791 25157 consensus_queue.cc:237] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:48.156808 24857 catalog_manager.cc:5697] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 reported cstate change: term changed from 0 to 1, leader changed from <none> to cff10651e3524faf94f1582dd2d01079 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "cff10651e3524faf94f1582dd2d01079" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:48.224421 25158 consensus_queue.cc:1048] T 60ef56ed9f744fd6afa7b1c125ced316 P 3885df3ab538460fbd694913a5dc20d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:48.236891 25164 consensus_queue.cc:1048] T 60ef56ed9f744fd6afa7b1c125ced316 P 3885df3ab538460fbd694913a5dc20d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:48.285003 25157 consensus_queue.cc:1048] T e4c17dde46a140269f52af4a59729c0f P cff10651e3524faf94f1582dd2d01079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:48.295394 25189 consensus_queue.cc:1048] T e4c17dde46a140269f52af4a59729c0f P cff10651e3524faf94f1582dd2d01079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:48.327175 25185 raft_consensus.cc:493] T efbe5e399bd14aea986191f4d13b892e P 3885df3ab538460fbd694913a5dc20d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.327699 25185 raft_consensus.cc:515] T efbe5e399bd14aea986191f4d13b892e P 3885df3ab538460fbd694913a5dc20d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:48.329551 25185 leader_election.cc:290] T efbe5e399bd14aea986191f4d13b892e P 3885df3ab538460fbd694913a5dc20d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74a79f73b55c4c13b1f668fcc23a0f0c (127.16.98.194:36119), cff10651e3524faf94f1582dd2d01079 (127.16.98.195:32925)
I20260709 12:12:48.330286 25035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efbe5e399bd14aea986191f4d13b892e" candidate_uuid: "3885df3ab538460fbd694913a5dc20d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" is_pre_election: true
I20260709 12:12:48.330296 25179 raft_consensus.cc:493] T efbe5e399bd14aea986191f4d13b892e P 74a79f73b55c4c13b1f668fcc23a0f0c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:48.330680 25109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efbe5e399bd14aea986191f4d13b892e" candidate_uuid: "3885df3ab538460fbd694913a5dc20d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cff10651e3524faf94f1582dd2d01079" is_pre_election: true
I20260709 12:12:48.331010 25179 raft_consensus.cc:515] T efbe5e399bd14aea986191f4d13b892e P 74a79f73b55c4c13b1f668fcc23a0f0c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:48.331338 25109 raft_consensus.cc:2468] T efbe5e399bd14aea986191f4d13b892e P cff10651e3524faf94f1582dd2d01079 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3885df3ab538460fbd694913a5dc20d6 in term 0.
I20260709 12:12:48.332002 25035 raft_consensus.cc:2468] T efbe5e399bd14aea986191f4d13b892e P 74a79f73b55c4c13b1f668fcc23a0f0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3885df3ab538460fbd694913a5dc20d6 in term 0.
I20260709 12:12:48.332504 24926 leader_election.cc:304] T efbe5e399bd14aea986191f4d13b892e P 3885df3ab538460fbd694913a5dc20d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3885df3ab538460fbd694913a5dc20d6, cff10651e3524faf94f1582dd2d01079; no voters: 
I20260709 12:12:48.333513 25185 raft_consensus.cc:2804] T efbe5e399bd14aea986191f4d13b892e P 3885df3ab538460fbd694913a5dc20d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:48.333931 25185 raft_consensus.cc:493] T efbe5e399bd14aea986191f4d13b892e P 3885df3ab538460fbd694913a5dc20d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:48.334363 25185 raft_consensus.cc:3060] T efbe5e399bd14aea986191f4d13b892e P 3885df3ab538460fbd694913a5dc20d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.334713 25179 leader_election.cc:290] T efbe5e399bd14aea986191f4d13b892e P 74a79f73b55c4c13b1f668fcc23a0f0c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3885df3ab538460fbd694913a5dc20d6 (127.16.98.193:35407), cff10651e3524faf94f1582dd2d01079 (127.16.98.195:32925)
I20260709 12:12:48.343706 25185 raft_consensus.cc:515] T efbe5e399bd14aea986191f4d13b892e P 3885df3ab538460fbd694913a5dc20d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:48.346309 25185 leader_election.cc:290] T efbe5e399bd14aea986191f4d13b892e P 3885df3ab538460fbd694913a5dc20d6 [CANDIDATE]: Term 1 election: Requested vote from peers 74a79f73b55c4c13b1f668fcc23a0f0c (127.16.98.194:36119), cff10651e3524faf94f1582dd2d01079 (127.16.98.195:32925)
I20260709 12:12:48.347065 25109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efbe5e399bd14aea986191f4d13b892e" candidate_uuid: "3885df3ab538460fbd694913a5dc20d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cff10651e3524faf94f1582dd2d01079"
I20260709 12:12:48.347671 25109 raft_consensus.cc:3060] T efbe5e399bd14aea986191f4d13b892e P cff10651e3524faf94f1582dd2d01079 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.346272 25035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efbe5e399bd14aea986191f4d13b892e" candidate_uuid: "3885df3ab538460fbd694913a5dc20d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c"
I20260709 12:12:48.348904 25035 raft_consensus.cc:3060] T efbe5e399bd14aea986191f4d13b892e P 74a79f73b55c4c13b1f668fcc23a0f0c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:48.351616 24960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efbe5e399bd14aea986191f4d13b892e" candidate_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3885df3ab538460fbd694913a5dc20d6" is_pre_election: true
I20260709 12:12:48.352416 24960 raft_consensus.cc:2393] T efbe5e399bd14aea986191f4d13b892e P 3885df3ab538460fbd694913a5dc20d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74a79f73b55c4c13b1f668fcc23a0f0c in current term 1: Already voted for candidate 3885df3ab538460fbd694913a5dc20d6 in this term.
I20260709 12:12:48.353336 25108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efbe5e399bd14aea986191f4d13b892e" candidate_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cff10651e3524faf94f1582dd2d01079" is_pre_election: true
I20260709 12:12:48.353605 25109 raft_consensus.cc:2468] T efbe5e399bd14aea986191f4d13b892e P cff10651e3524faf94f1582dd2d01079 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3885df3ab538460fbd694913a5dc20d6 in term 1.
I20260709 12:12:48.354753 25035 raft_consensus.cc:2468] T efbe5e399bd14aea986191f4d13b892e P 74a79f73b55c4c13b1f668fcc23a0f0c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3885df3ab538460fbd694913a5dc20d6 in term 1.
I20260709 12:12:48.354861 25001 leader_election.cc:304] T efbe5e399bd14aea986191f4d13b892e P 74a79f73b55c4c13b1f668fcc23a0f0c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74a79f73b55c4c13b1f668fcc23a0f0c; no voters: 3885df3ab538460fbd694913a5dc20d6, cff10651e3524faf94f1582dd2d01079
I20260709 12:12:48.354883 24926 leader_election.cc:304] T efbe5e399bd14aea986191f4d13b892e P 3885df3ab538460fbd694913a5dc20d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3885df3ab538460fbd694913a5dc20d6, cff10651e3524faf94f1582dd2d01079; no voters: 
I20260709 12:12:48.355980 25185 raft_consensus.cc:2804] T efbe5e399bd14aea986191f4d13b892e P 3885df3ab538460fbd694913a5dc20d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:48.356060 25179 raft_consensus.cc:2749] T efbe5e399bd14aea986191f4d13b892e P 74a79f73b55c4c13b1f668fcc23a0f0c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:48.356503 25185 raft_consensus.cc:697] T efbe5e399bd14aea986191f4d13b892e P 3885df3ab538460fbd694913a5dc20d6 [term 1 LEADER]: Becoming Leader. State: Replica: 3885df3ab538460fbd694913a5dc20d6, State: Running, Role: LEADER
I20260709 12:12:48.357306 25185 consensus_queue.cc:237] T efbe5e399bd14aea986191f4d13b892e P 3885df3ab538460fbd694913a5dc20d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:48.365460 24857 catalog_manager.cc:5697] T efbe5e399bd14aea986191f4d13b892e P 3885df3ab538460fbd694913a5dc20d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3885df3ab538460fbd694913a5dc20d6 (127.16.98.193). New cstate: current_term: 1 leader_uuid: "3885df3ab538460fbd694913a5dc20d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:48.429833 25109 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4c17dde46a140269f52af4a59729c0f"
dest_uuid: "cff10651e3524faf94f1582dd2d01079"
mode: GRACEFUL
new_leader_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c"
 from {username='slave'} at 127.0.0.1:59272
I20260709 12:12:48.430321 25109 raft_consensus.cc:606] T e4c17dde46a140269f52af4a59729c0f P cff10651e3524faf94f1582dd2d01079 [term 1 LEADER]: Received request to transfer leadership to TS 74a79f73b55c4c13b1f668fcc23a0f0c
I20260709 12:12:48.435801 25109 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "981d85084e6f4a4db386d45b6f98d2c1"
dest_uuid: "cff10651e3524faf94f1582dd2d01079"
mode: GRACEFUL
new_leader_uuid: "3885df3ab538460fbd694913a5dc20d6"
 from {username='slave'} at 127.0.0.1:59272
I20260709 12:12:48.436323 25109 raft_consensus.cc:606] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [term 1 LEADER]: Received request to transfer leadership to TS 3885df3ab538460fbd694913a5dc20d6
I20260709 12:12:48.579720 25189 consensus_queue.cc:1048] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:48.586869 25166 raft_consensus.cc:993] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079: : Instructing follower 3885df3ab538460fbd694913a5dc20d6 to start an election
I20260709 12:12:48.587329 25166 raft_consensus.cc:1081] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [term 1 LEADER]: Signalling peer 3885df3ab538460fbd694913a5dc20d6 to start an election
I20260709 12:12:48.590071 24959 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "981d85084e6f4a4db386d45b6f98d2c1"
dest_uuid: "3885df3ab538460fbd694913a5dc20d6"
 from {username='slave'} at 127.0.0.1:58334
I20260709 12:12:48.590668 24959 raft_consensus.cc:493] T 981d85084e6f4a4db386d45b6f98d2c1 P 3885df3ab538460fbd694913a5dc20d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:48.591048 24959 raft_consensus.cc:3060] T 981d85084e6f4a4db386d45b6f98d2c1 P 3885df3ab538460fbd694913a5dc20d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:48.592118 25189 consensus_queue.cc:1048] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:48.598786 24959 raft_consensus.cc:515] T 981d85084e6f4a4db386d45b6f98d2c1 P 3885df3ab538460fbd694913a5dc20d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:48.602538 24959 leader_election.cc:290] T 981d85084e6f4a4db386d45b6f98d2c1 P 3885df3ab538460fbd694913a5dc20d6 [CANDIDATE]: Term 2 election: Requested vote from peers 74a79f73b55c4c13b1f668fcc23a0f0c (127.16.98.194:36119), cff10651e3524faf94f1582dd2d01079 (127.16.98.195:32925)
I20260709 12:12:48.603994 25109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981d85084e6f4a4db386d45b6f98d2c1" candidate_uuid: "3885df3ab538460fbd694913a5dc20d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cff10651e3524faf94f1582dd2d01079"
I20260709 12:12:48.604699 25109 raft_consensus.cc:3055] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:48.604812 25035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981d85084e6f4a4db386d45b6f98d2c1" candidate_uuid: "3885df3ab538460fbd694913a5dc20d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c"
I20260709 12:12:48.605113 25109 raft_consensus.cc:740] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cff10651e3524faf94f1582dd2d01079, State: Running, Role: LEADER
I20260709 12:12:48.605430 25035 raft_consensus.cc:3060] T 981d85084e6f4a4db386d45b6f98d2c1 P 74a79f73b55c4c13b1f668fcc23a0f0c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:48.605991 25109 consensus_queue.cc:260] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:48.607406 25109 raft_consensus.cc:3060] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:48.611024 25035 raft_consensus.cc:2468] T 981d85084e6f4a4db386d45b6f98d2c1 P 74a79f73b55c4c13b1f668fcc23a0f0c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3885df3ab538460fbd694913a5dc20d6 in term 2.
I20260709 12:12:48.612003 24924 leader_election.cc:304] T 981d85084e6f4a4db386d45b6f98d2c1 P 3885df3ab538460fbd694913a5dc20d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3885df3ab538460fbd694913a5dc20d6, 74a79f73b55c4c13b1f668fcc23a0f0c; no voters: 
I20260709 12:12:48.612673 25185 raft_consensus.cc:2804] T 981d85084e6f4a4db386d45b6f98d2c1 P 3885df3ab538460fbd694913a5dc20d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:48.613150 25185 raft_consensus.cc:697] T 981d85084e6f4a4db386d45b6f98d2c1 P 3885df3ab538460fbd694913a5dc20d6 [term 2 LEADER]: Becoming Leader. State: Replica: 3885df3ab538460fbd694913a5dc20d6, State: Running, Role: LEADER
I20260709 12:12:48.613484 25109 raft_consensus.cc:2468] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3885df3ab538460fbd694913a5dc20d6 in term 2.
I20260709 12:12:48.613991 25185 consensus_queue.cc:237] T 981d85084e6f4a4db386d45b6f98d2c1 P 3885df3ab538460fbd694913a5dc20d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:48.620857 24858 catalog_manager.cc:5697] T 981d85084e6f4a4db386d45b6f98d2c1 P 3885df3ab538460fbd694913a5dc20d6 reported cstate change: term changed from 1 to 2, leader changed from cff10651e3524faf94f1582dd2d01079 (127.16.98.195) to 3885df3ab538460fbd694913a5dc20d6 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "3885df3ab538460fbd694913a5dc20d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:48.836673 25189 raft_consensus.cc:993] T e4c17dde46a140269f52af4a59729c0f P cff10651e3524faf94f1582dd2d01079: : Instructing follower 74a79f73b55c4c13b1f668fcc23a0f0c to start an election
I20260709 12:12:48.837211 25189 raft_consensus.cc:1081] T e4c17dde46a140269f52af4a59729c0f P cff10651e3524faf94f1582dd2d01079 [term 1 LEADER]: Signalling peer 74a79f73b55c4c13b1f668fcc23a0f0c to start an election
I20260709 12:12:48.839025 25035 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4c17dde46a140269f52af4a59729c0f"
dest_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c"
 from {username='slave'} at 127.0.0.1:52664
I20260709 12:12:48.839480 25185 consensus_queue.cc:1048] T efbe5e399bd14aea986191f4d13b892e P 3885df3ab538460fbd694913a5dc20d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:48.839622 25035 raft_consensus.cc:493] T e4c17dde46a140269f52af4a59729c0f P 74a79f73b55c4c13b1f668fcc23a0f0c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:48.840154 25035 raft_consensus.cc:3060] T e4c17dde46a140269f52af4a59729c0f P 74a79f73b55c4c13b1f668fcc23a0f0c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:48.851012 25035 raft_consensus.cc:515] T e4c17dde46a140269f52af4a59729c0f P 74a79f73b55c4c13b1f668fcc23a0f0c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:48.852972 25164 consensus_queue.cc:1048] T efbe5e399bd14aea986191f4d13b892e P 3885df3ab538460fbd694913a5dc20d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:48.853269 25035 leader_election.cc:290] T e4c17dde46a140269f52af4a59729c0f P 74a79f73b55c4c13b1f668fcc23a0f0c [CANDIDATE]: Term 2 election: Requested vote from peers 3885df3ab538460fbd694913a5dc20d6 (127.16.98.193:35407), cff10651e3524faf94f1582dd2d01079 (127.16.98.195:32925)
I20260709 12:12:48.855858 24959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4c17dde46a140269f52af4a59729c0f" candidate_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3885df3ab538460fbd694913a5dc20d6"
I20260709 12:12:48.856492 24959 raft_consensus.cc:3060] T e4c17dde46a140269f52af4a59729c0f P 3885df3ab538460fbd694913a5dc20d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:48.861879 25108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4c17dde46a140269f52af4a59729c0f" candidate_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cff10651e3524faf94f1582dd2d01079"
I20260709 12:12:48.862458 25108 raft_consensus.cc:3055] T e4c17dde46a140269f52af4a59729c0f P cff10651e3524faf94f1582dd2d01079 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:48.862738 25108 raft_consensus.cc:740] T e4c17dde46a140269f52af4a59729c0f P cff10651e3524faf94f1582dd2d01079 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cff10651e3524faf94f1582dd2d01079, State: Running, Role: LEADER
I20260709 12:12:48.863592 25108 consensus_queue.cc:260] T e4c17dde46a140269f52af4a59729c0f P cff10651e3524faf94f1582dd2d01079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:48.864612 25108 raft_consensus.cc:3060] T e4c17dde46a140269f52af4a59729c0f P cff10651e3524faf94f1582dd2d01079 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:48.864785 24959 raft_consensus.cc:2468] T e4c17dde46a140269f52af4a59729c0f P 3885df3ab538460fbd694913a5dc20d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74a79f73b55c4c13b1f668fcc23a0f0c in term 2.
I20260709 12:12:48.865931 24998 leader_election.cc:304] T e4c17dde46a140269f52af4a59729c0f P 74a79f73b55c4c13b1f668fcc23a0f0c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3885df3ab538460fbd694913a5dc20d6, 74a79f73b55c4c13b1f668fcc23a0f0c; no voters: 
I20260709 12:12:48.866797 25179 raft_consensus.cc:2804] T e4c17dde46a140269f52af4a59729c0f P 74a79f73b55c4c13b1f668fcc23a0f0c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:48.868219 25179 raft_consensus.cc:697] T e4c17dde46a140269f52af4a59729c0f P 74a79f73b55c4c13b1f668fcc23a0f0c [term 2 LEADER]: Becoming Leader. State: Replica: 74a79f73b55c4c13b1f668fcc23a0f0c, State: Running, Role: LEADER
I20260709 12:12:48.869079 25179 consensus_queue.cc:237] T e4c17dde46a140269f52af4a59729c0f P 74a79f73b55c4c13b1f668fcc23a0f0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:48.874430 25108 raft_consensus.cc:2468] T e4c17dde46a140269f52af4a59729c0f P cff10651e3524faf94f1582dd2d01079 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74a79f73b55c4c13b1f668fcc23a0f0c in term 2.
I20260709 12:12:48.878155 24857 catalog_manager.cc:5697] T e4c17dde46a140269f52af4a59729c0f P 74a79f73b55c4c13b1f668fcc23a0f0c reported cstate change: term changed from 1 to 2, leader changed from cff10651e3524faf94f1582dd2d01079 (127.16.98.195) to 74a79f73b55c4c13b1f668fcc23a0f0c (127.16.98.194). New cstate: current_term: 2 leader_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:49.168912 16779 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:12:49.170444 16779 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:12:49.170827 16779 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:12:49.183601 24959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "981d85084e6f4a4db386d45b6f98d2c1"
dest_uuid: "3885df3ab538460fbd694913a5dc20d6"
mode: GRACEFUL
new_leader_uuid: "cff10651e3524faf94f1582dd2d01079"
 from {username='slave'} at 127.0.0.1:43294
I20260709 12:12:49.184069 25108 raft_consensus.cc:1275] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [term 2 FOLLOWER]: Refusing update from remote peer 3885df3ab538460fbd694913a5dc20d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:49.184118 24959 raft_consensus.cc:606] T 981d85084e6f4a4db386d45b6f98d2c1 P 3885df3ab538460fbd694913a5dc20d6 [term 2 LEADER]: Received request to transfer leadership to TS cff10651e3524faf94f1582dd2d01079
I20260709 12:12:49.185554 16779 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:12:49.185513 25164 consensus_queue.cc:1048] T 981d85084e6f4a4db386d45b6f98d2c1 P 3885df3ab538460fbd694913a5dc20d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:49.190529 25158 raft_consensus.cc:993] T 981d85084e6f4a4db386d45b6f98d2c1 P 3885df3ab538460fbd694913a5dc20d6: : Instructing follower cff10651e3524faf94f1582dd2d01079 to start an election
I20260709 12:12:49.191005 25158 raft_consensus.cc:1081] T 981d85084e6f4a4db386d45b6f98d2c1 P 3885df3ab538460fbd694913a5dc20d6 [term 2 LEADER]: Signalling peer cff10651e3524faf94f1582dd2d01079 to start an election
I20260709 12:12:49.193261 25109 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "981d85084e6f4a4db386d45b6f98d2c1"
dest_uuid: "cff10651e3524faf94f1582dd2d01079"
 from {username='slave'} at 127.0.0.1:59242
I20260709 12:12:49.193810 25109 raft_consensus.cc:493] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:49.194176 25109 raft_consensus.cc:3060] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:49.197777 25035 raft_consensus.cc:1275] T 981d85084e6f4a4db386d45b6f98d2c1 P 74a79f73b55c4c13b1f668fcc23a0f0c [term 2 FOLLOWER]: Refusing update from remote peer 3885df3ab538460fbd694913a5dc20d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:49.199393 25164 consensus_queue.cc:1048] T 981d85084e6f4a4db386d45b6f98d2c1 P 3885df3ab538460fbd694913a5dc20d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:49.201526 25109 raft_consensus.cc:515] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:49.202859 25108 raft_consensus.cc:1240] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [term 3 FOLLOWER]: Rejecting Update request from peer 3885df3ab538460fbd694913a5dc20d6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:12:49.204121 25109 leader_election.cc:290] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [CANDIDATE]: Term 3 election: Requested vote from peers 3885df3ab538460fbd694913a5dc20d6 (127.16.98.193:35407), 74a79f73b55c4c13b1f668fcc23a0f0c (127.16.98.194:36119)
I20260709 12:12:49.205359 25034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981d85084e6f4a4db386d45b6f98d2c1" candidate_uuid: "cff10651e3524faf94f1582dd2d01079" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c"
I20260709 12:12:49.207736 25164 consensus_queue.cc:1059] T 981d85084e6f4a4db386d45b6f98d2c1 P 3885df3ab538460fbd694913a5dc20d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:49.208511 25185 raft_consensus.cc:3055] T 981d85084e6f4a4db386d45b6f98d2c1 P 3885df3ab538460fbd694913a5dc20d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:49.208822 25185 raft_consensus.cc:740] T 981d85084e6f4a4db386d45b6f98d2c1 P 3885df3ab538460fbd694913a5dc20d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3885df3ab538460fbd694913a5dc20d6, State: Running, Role: LEADER
I20260709 12:12:49.209581 25185 consensus_queue.cc:260] T 981d85084e6f4a4db386d45b6f98d2c1 P 3885df3ab538460fbd694913a5dc20d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:49.210470 25185 raft_consensus.cc:3060] T 981d85084e6f4a4db386d45b6f98d2c1 P 3885df3ab538460fbd694913a5dc20d6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:12:49.210800 25158 consensus_queue.cc:1175] T 981d85084e6f4a4db386d45b6f98d2c1 P 3885df3ab538460fbd694913a5dc20d6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 2 index: 2 } }
I20260709 12:12:49.213070 24959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "981d85084e6f4a4db386d45b6f98d2c1" candidate_uuid: "cff10651e3524faf94f1582dd2d01079" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3885df3ab538460fbd694913a5dc20d6"
I20260709 12:12:49.222437 24959 raft_consensus.cc:2468] T 981d85084e6f4a4db386d45b6f98d2c1 P 3885df3ab538460fbd694913a5dc20d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cff10651e3524faf94f1582dd2d01079 in term 3.
I20260709 12:12:49.224114 25072 leader_election.cc:304] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3885df3ab538460fbd694913a5dc20d6, cff10651e3524faf94f1582dd2d01079; no voters: 74a79f73b55c4c13b1f668fcc23a0f0c
I20260709 12:12:49.225008 25197 raft_consensus.cc:2804] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:49.225463 25197 raft_consensus.cc:697] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [term 3 LEADER]: Becoming Leader. State: Replica: cff10651e3524faf94f1582dd2d01079, State: Running, Role: LEADER
I20260709 12:12:49.226262 25197 consensus_queue.cc:237] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } }
I20260709 12:12:49.232769 24856 catalog_manager.cc:5697] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 reported cstate change: term changed from 2 to 3, leader changed from 3885df3ab538460fbd694913a5dc20d6 (127.16.98.193) to cff10651e3524faf94f1582dd2d01079 (127.16.98.195). New cstate: current_term: 3 leader_uuid: "cff10651e3524faf94f1582dd2d01079" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3885df3ab538460fbd694913a5dc20d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 35407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74a79f73b55c4c13b1f668fcc23a0f0c" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 36119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cff10651e3524faf94f1582dd2d01079" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 32925 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:49.247457 16779 tablet_server.cc:179] TabletServer@127.16.98.193:0 shutting down...
I20260709 12:12:49.270782 16779 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:49.271466 16779 tablet_replica.cc:333] T efbe5e399bd14aea986191f4d13b892e P 3885df3ab538460fbd694913a5dc20d6: stopping tablet replica
I20260709 12:12:49.272022 16779 raft_consensus.cc:2243] T efbe5e399bd14aea986191f4d13b892e P 3885df3ab538460fbd694913a5dc20d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:49.272794 16779 raft_consensus.cc:2272] T efbe5e399bd14aea986191f4d13b892e P 3885df3ab538460fbd694913a5dc20d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:49.274901 16779 tablet_replica.cc:333] T 981d85084e6f4a4db386d45b6f98d2c1 P 3885df3ab538460fbd694913a5dc20d6: stopping tablet replica
I20260709 12:12:49.275408 16779 raft_consensus.cc:2243] T 981d85084e6f4a4db386d45b6f98d2c1 P 3885df3ab538460fbd694913a5dc20d6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:49.275825 16779 raft_consensus.cc:2272] T 981d85084e6f4a4db386d45b6f98d2c1 P 3885df3ab538460fbd694913a5dc20d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:49.277848 16779 tablet_replica.cc:333] T 60ef56ed9f744fd6afa7b1c125ced316 P 3885df3ab538460fbd694913a5dc20d6: stopping tablet replica
I20260709 12:12:49.278367 16779 raft_consensus.cc:2243] T 60ef56ed9f744fd6afa7b1c125ced316 P 3885df3ab538460fbd694913a5dc20d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:49.279172 16779 raft_consensus.cc:2272] T 60ef56ed9f744fd6afa7b1c125ced316 P 3885df3ab538460fbd694913a5dc20d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:49.281307 16779 tablet_replica.cc:333] T e4c17dde46a140269f52af4a59729c0f P 3885df3ab538460fbd694913a5dc20d6: stopping tablet replica
W20260709 12:12:49.281698 24998 consensus_peers.cc:597] T e4c17dde46a140269f52af4a59729c0f P 74a79f73b55c4c13b1f668fcc23a0f0c -> Peer 3885df3ab538460fbd694913a5dc20d6 (127.16.98.193:35407): Couldn't send request to peer 3885df3ab538460fbd694913a5dc20d6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:12:49.281906 16779 raft_consensus.cc:2243] T e4c17dde46a140269f52af4a59729c0f P 3885df3ab538460fbd694913a5dc20d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:49.282387 16779 raft_consensus.cc:2272] T e4c17dde46a140269f52af4a59729c0f P 3885df3ab538460fbd694913a5dc20d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:49.306620 16779 tablet_server.cc:196] TabletServer@127.16.98.193:0 shutdown complete.
I20260709 12:12:49.318315 16779 tablet_server.cc:179] TabletServer@127.16.98.194:0 shutting down...
I20260709 12:12:49.336633 16779 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:49.337281 16779 tablet_replica.cc:333] T efbe5e399bd14aea986191f4d13b892e P 74a79f73b55c4c13b1f668fcc23a0f0c: stopping tablet replica
I20260709 12:12:49.337852 16779 raft_consensus.cc:2243] T efbe5e399bd14aea986191f4d13b892e P 74a79f73b55c4c13b1f668fcc23a0f0c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:49.338320 16779 raft_consensus.cc:2272] T efbe5e399bd14aea986191f4d13b892e P 74a79f73b55c4c13b1f668fcc23a0f0c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:49.340962 16779 tablet_replica.cc:333] T 981d85084e6f4a4db386d45b6f98d2c1 P 74a79f73b55c4c13b1f668fcc23a0f0c: stopping tablet replica
I20260709 12:12:49.341558 16779 raft_consensus.cc:2243] T 981d85084e6f4a4db386d45b6f98d2c1 P 74a79f73b55c4c13b1f668fcc23a0f0c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:49.341995 16779 raft_consensus.cc:2272] T 981d85084e6f4a4db386d45b6f98d2c1 P 74a79f73b55c4c13b1f668fcc23a0f0c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:49.344089 16779 tablet_replica.cc:333] T e4c17dde46a140269f52af4a59729c0f P 74a79f73b55c4c13b1f668fcc23a0f0c: stopping tablet replica
I20260709 12:12:49.344592 16779 raft_consensus.cc:2243] T e4c17dde46a140269f52af4a59729c0f P 74a79f73b55c4c13b1f668fcc23a0f0c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:12:49.345242 16779 pending_rounds.cc:70] T e4c17dde46a140269f52af4a59729c0f P 74a79f73b55c4c13b1f668fcc23a0f0c: Trying to abort 1 pending ops.
I20260709 12:12:49.345438 16779 pending_rounds.cc:77] T e4c17dde46a140269f52af4a59729c0f P 74a79f73b55c4c13b1f668fcc23a0f0c: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305622195696652288 op_type: NO_OP noop_request { }
I20260709 12:12:49.345739 16779 raft_consensus.cc:2889] T e4c17dde46a140269f52af4a59729c0f P 74a79f73b55c4c13b1f668fcc23a0f0c [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:12:49.346014 16779 raft_consensus.cc:2272] T e4c17dde46a140269f52af4a59729c0f P 74a79f73b55c4c13b1f668fcc23a0f0c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:49.348138 16779 tablet_replica.cc:333] T 60ef56ed9f744fd6afa7b1c125ced316 P 74a79f73b55c4c13b1f668fcc23a0f0c: stopping tablet replica
I20260709 12:12:49.348606 16779 raft_consensus.cc:2243] T 60ef56ed9f744fd6afa7b1c125ced316 P 74a79f73b55c4c13b1f668fcc23a0f0c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:49.348999 16779 raft_consensus.cc:2272] T 60ef56ed9f744fd6afa7b1c125ced316 P 74a79f73b55c4c13b1f668fcc23a0f0c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:49.371505 16779 tablet_server.cc:196] TabletServer@127.16.98.194:0 shutdown complete.
I20260709 12:12:49.382719 16779 tablet_server.cc:179] TabletServer@127.16.98.195:0 shutting down...
I20260709 12:12:49.399317 16779 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:12:49.400079 16779 tablet_replica.cc:333] T efbe5e399bd14aea986191f4d13b892e P cff10651e3524faf94f1582dd2d01079: stopping tablet replica
I20260709 12:12:49.400678 16779 raft_consensus.cc:2243] T efbe5e399bd14aea986191f4d13b892e P cff10651e3524faf94f1582dd2d01079 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:49.401127 16779 raft_consensus.cc:2272] T efbe5e399bd14aea986191f4d13b892e P cff10651e3524faf94f1582dd2d01079 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:49.403446 16779 tablet_replica.cc:333] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079: stopping tablet replica
I20260709 12:12:49.403995 16779 raft_consensus.cc:2243] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:12:49.404598 16779 pending_rounds.cc:70] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079: Trying to abort 2 pending ops.
I20260709 12:12:49.404804 16779 pending_rounds.cc:77] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305622197158887424 op_type: NO_OP noop_request { }
I20260709 12:12:49.405071 16779 raft_consensus.cc:2889] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:12:49.405300 16779 pending_rounds.cc:77] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305622194651344896 op_type: NO_OP noop_request { }
I20260709 12:12:49.405529 16779 raft_consensus.cc:2889] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:12:49.405815 16779 raft_consensus.cc:2272] T 981d85084e6f4a4db386d45b6f98d2c1 P cff10651e3524faf94f1582dd2d01079 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:49.408131 16779 tablet_replica.cc:333] T 60ef56ed9f744fd6afa7b1c125ced316 P cff10651e3524faf94f1582dd2d01079: stopping tablet replica
I20260709 12:12:49.408627 16779 raft_consensus.cc:2243] T 60ef56ed9f744fd6afa7b1c125ced316 P cff10651e3524faf94f1582dd2d01079 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:49.409044 16779 raft_consensus.cc:2272] T 60ef56ed9f744fd6afa7b1c125ced316 P cff10651e3524faf94f1582dd2d01079 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:49.410725 16779 tablet_replica.cc:333] T e4c17dde46a140269f52af4a59729c0f P cff10651e3524faf94f1582dd2d01079: stopping tablet replica
I20260709 12:12:49.411154 16779 raft_consensus.cc:2243] T e4c17dde46a140269f52af4a59729c0f P cff10651e3524faf94f1582dd2d01079 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:12:49.411513 16779 raft_consensus.cc:2272] T e4c17dde46a140269f52af4a59729c0f P cff10651e3524faf94f1582dd2d01079 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:49.432493 16779 tablet_server.cc:196] TabletServer@127.16.98.195:0 shutdown complete.
I20260709 12:12:49.444413 16779 master.cc:562] Master@127.16.98.254:35757 shutting down...
I20260709 12:12:49.459452 16779 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6d453e7c90e142d388ba5e572b459414 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:12:49.459944 16779 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6d453e7c90e142d388ba5e572b459414 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:12:49.460201 16779 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6d453e7c90e142d388ba5e572b459414: stopping tablet replica
I20260709 12:12:49.478060 16779 master.cc:584] Master@127.16.98.254:35757 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2594 ms)
[----------] 6 tests from LeaderRebalancerTest (273771 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:12:49.506917 16779 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.98.254:45429
I20260709 12:12:49.507969 16779 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:49.512971 25205 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:49.513471 25206 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:49.514060 25208 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:49.514978 16779 server_base.cc:1061] running on GCE node
I20260709 12:12:49.515746 16779 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:49.515983 16779 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:49.516165 16779 hybrid_clock.cc:648] HybridClock initialized: now 1783599169516134 us; error 0 us; skew 500 ppm
I20260709 12:12:49.516717 16779 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:49.519049 16779 webserver.cc:533] Webserver started at http://127.16.98.254:40949/ using document root <none> and password file <none>
I20260709 12:12:49.519553 16779 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:49.519737 16779 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:49.520033 16779 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:49.521091 16779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895573690-16779-0/minicluster-data/master-0-root/instance:
uuid: "1459b8d652e04ed19af139d20b3c68e9"
format_stamp: "Formatted at 2026-07-09 12:12:49 on dist-test-slave-9bv4"
I20260709 12:12:49.525583 16779 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 12:12:49.529040 25213 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:49.529784 16779 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:12:49.530076 16779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895573690-16779-0/minicluster-data/master-0-root
uuid: "1459b8d652e04ed19af139d20b3c68e9"
format_stamp: "Formatted at 2026-07-09 12:12:49 on dist-test-slave-9bv4"
I20260709 12:12:49.530341 16779 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895573690-16779-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895573690-16779-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895573690-16779-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:49.548502 16779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:49.549510 16779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:49.583441 16779 rpc_server.cc:307] RPC server started. Bound to: 127.16.98.254:45429
I20260709 12:12:49.583536 25264 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.98.254:45429 every 8 connection(s)
I20260709 12:12:49.587112 25265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:49.597165 25265 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1459b8d652e04ed19af139d20b3c68e9: Bootstrap starting.
I20260709 12:12:49.601357 25265 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1459b8d652e04ed19af139d20b3c68e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:49.605049 25265 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1459b8d652e04ed19af139d20b3c68e9: No bootstrap required, opened a new log
I20260709 12:12:49.606938 25265 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1459b8d652e04ed19af139d20b3c68e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1459b8d652e04ed19af139d20b3c68e9" member_type: VOTER }
I20260709 12:12:49.607314 25265 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1459b8d652e04ed19af139d20b3c68e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:49.607489 25265 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1459b8d652e04ed19af139d20b3c68e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1459b8d652e04ed19af139d20b3c68e9, State: Initialized, Role: FOLLOWER
I20260709 12:12:49.607950 25265 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1459b8d652e04ed19af139d20b3c68e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1459b8d652e04ed19af139d20b3c68e9" member_type: VOTER }
I20260709 12:12:49.608346 25265 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1459b8d652e04ed19af139d20b3c68e9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:12:49.608541 25265 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1459b8d652e04ed19af139d20b3c68e9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:12:49.608733 25265 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1459b8d652e04ed19af139d20b3c68e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:49.613665 25265 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1459b8d652e04ed19af139d20b3c68e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1459b8d652e04ed19af139d20b3c68e9" member_type: VOTER }
I20260709 12:12:49.614120 25265 leader_election.cc:304] T 00000000000000000000000000000000 P 1459b8d652e04ed19af139d20b3c68e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1459b8d652e04ed19af139d20b3c68e9; no voters: 
I20260709 12:12:49.615222 25265 leader_election.cc:290] T 00000000000000000000000000000000 P 1459b8d652e04ed19af139d20b3c68e9 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:12:49.615554 25268 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1459b8d652e04ed19af139d20b3c68e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:49.616997 25268 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1459b8d652e04ed19af139d20b3c68e9 [term 1 LEADER]: Becoming Leader. State: Replica: 1459b8d652e04ed19af139d20b3c68e9, State: Running, Role: LEADER
I20260709 12:12:49.617753 25268 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1459b8d652e04ed19af139d20b3c68e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1459b8d652e04ed19af139d20b3c68e9" member_type: VOTER }
I20260709 12:12:49.618067 25265 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1459b8d652e04ed19af139d20b3c68e9 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:12:49.622417 25269 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1459b8d652e04ed19af139d20b3c68e9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1459b8d652e04ed19af139d20b3c68e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1459b8d652e04ed19af139d20b3c68e9" member_type: VOTER } }
I20260709 12:12:49.623261 25269 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1459b8d652e04ed19af139d20b3c68e9 [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:49.623135 25270 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1459b8d652e04ed19af139d20b3c68e9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1459b8d652e04ed19af139d20b3c68e9. Latest consensus state: current_term: 1 leader_uuid: "1459b8d652e04ed19af139d20b3c68e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1459b8d652e04ed19af139d20b3c68e9" member_type: VOTER } }
I20260709 12:12:49.623972 25270 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1459b8d652e04ed19af139d20b3c68e9 [sys.catalog]: This master's current role is: LEADER
I20260709 12:12:49.626204 25276 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:12:49.630839 25276 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:12:49.635599 16779 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:12:49.639994 25276 catalog_manager.cc:1383] Generated new cluster ID: 02b3b1d99ecb45b4986fdd648d966e3b
I20260709 12:12:49.640347 25276 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:12:49.654805 25276 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:12:49.656076 25276 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:12:49.674772 25276 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 1459b8d652e04ed19af139d20b3c68e9: Generated new TSK 0
I20260709 12:12:49.675365 25276 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:12:49.706503 16779 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:49.712190 25286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:49.713394 25287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:49.714774 25289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:49.715487 16779 server_base.cc:1061] running on GCE node
I20260709 12:12:49.716290 16779 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:49.716495 16779 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:49.716666 16779 hybrid_clock.cc:648] HybridClock initialized: now 1783599169716648 us; error 0 us; skew 500 ppm
I20260709 12:12:49.717213 16779 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:49.719537 16779 webserver.cc:533] Webserver started at http://127.16.98.193:43887/ using document root <none> and password file <none>
I20260709 12:12:49.720016 16779 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:49.720175 16779 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:49.720392 16779 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:49.721390 16779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895573690-16779-0/minicluster-data/ts-0-root/instance:
uuid: "52e12d0cb9004693ba368ceb7fac2259"
format_stamp: "Formatted at 2026-07-09 12:12:49 on dist-test-slave-9bv4"
I20260709 12:12:49.725638 16779 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:12:49.728899 25294 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:49.729857 16779 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:12:49.730206 16779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895573690-16779-0/minicluster-data/ts-0-root
uuid: "52e12d0cb9004693ba368ceb7fac2259"
format_stamp: "Formatted at 2026-07-09 12:12:49 on dist-test-slave-9bv4"
I20260709 12:12:49.730510 16779 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895573690-16779-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895573690-16779-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895573690-16779-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:49.751744 16779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:49.752843 16779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:49.754248 16779 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:49.756457 16779 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:49.756626 16779 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:49.756896 16779 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:49.757055 16779 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:49.795476 16779 rpc_server.cc:307] RPC server started. Bound to: 127.16.98.193:40391
I20260709 12:12:49.795639 25356 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.98.193:40391 every 8 connection(s)
I20260709 12:12:49.800360 16779 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:49.807163 25361 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:49.808905 25362 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:49.813449 25357 heartbeater.cc:344] Connected to a master server at 127.16.98.254:45429
I20260709 12:12:49.813930 25357 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:49.814152 16779 server_base.cc:1061] running on GCE node
W20260709 12:12:49.814762 25365 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:49.814922 25357 heartbeater.cc:507] Master 127.16.98.254:45429 requested a full tablet report, sending...
I20260709 12:12:49.815774 16779 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:49.816044 16779 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:49.816279 16779 hybrid_clock.cc:648] HybridClock initialized: now 1783599169816258 us; error 0 us; skew 500 ppm
I20260709 12:12:49.816890 16779 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:49.817127 25230 ts_manager.cc:194] Registered new tserver with Master: 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391)
I20260709 12:12:49.819062 25230 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58780
I20260709 12:12:49.819624 16779 webserver.cc:533] Webserver started at http://127.16.98.194:39415/ using document root <none> and password file <none>
I20260709 12:12:49.820277 16779 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:49.820538 16779 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:49.820812 16779 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:49.821872 16779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895573690-16779-0/minicluster-data/ts-1-root/instance:
uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
format_stamp: "Formatted at 2026-07-09 12:12:49 on dist-test-slave-9bv4"
I20260709 12:12:49.826104 16779 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:12:49.829511 25369 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:49.830283 16779 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:12:49.830610 16779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895573690-16779-0/minicluster-data/ts-1-root
uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
format_stamp: "Formatted at 2026-07-09 12:12:49 on dist-test-slave-9bv4"
I20260709 12:12:49.830958 16779 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895573690-16779-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895573690-16779-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895573690-16779-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:49.843052 16779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:49.844056 16779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:49.845366 16779 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:49.847635 16779 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:49.847851 16779 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:49.848083 16779 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:49.848250 16779 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:49.885126 16779 rpc_server.cc:307] RPC server started. Bound to: 127.16.98.194:42825
I20260709 12:12:49.885237 25431 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.98.194:42825 every 8 connection(s)
I20260709 12:12:49.889839 16779 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:12:49.895740 25435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:49.896678 25436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:12:49.898325 25438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:12:49.899183 16779 server_base.cc:1061] running on GCE node
I20260709 12:12:49.900336 16779 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:12:49.900600 16779 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:12:49.900802 16779 hybrid_clock.cc:648] HybridClock initialized: now 1783599169900783 us; error 0 us; skew 500 ppm
I20260709 12:12:49.901039 25432 heartbeater.cc:344] Connected to a master server at 127.16.98.254:45429
I20260709 12:12:49.901372 16779 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:12:49.901376 25432 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:49.902549 25432 heartbeater.cc:507] Master 127.16.98.254:45429 requested a full tablet report, sending...
I20260709 12:12:49.904131 16779 webserver.cc:533] Webserver started at http://127.16.98.195:35755/ using document root <none> and password file <none>
I20260709 12:12:49.904678 16779 fs_manager.cc:362] Metadata directory not provided
I20260709 12:12:49.904698 25230 ts_manager.cc:194] Registered new tserver with Master: f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825)
I20260709 12:12:49.904937 16779 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:12:49.905323 16779 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:12:49.906229 25230 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58782
I20260709 12:12:49.906352 16779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895573690-16779-0/minicluster-data/ts-2-root/instance:
uuid: "02a30f2f37194042b6ad292011c47d0d"
format_stamp: "Formatted at 2026-07-09 12:12:49 on dist-test-slave-9bv4"
I20260709 12:12:49.910781 16779 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:12:49.913793 25443 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:49.914475 16779 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:12:49.914808 16779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895573690-16779-0/minicluster-data/ts-2-root
uuid: "02a30f2f37194042b6ad292011c47d0d"
format_stamp: "Formatted at 2026-07-09 12:12:49 on dist-test-slave-9bv4"
I20260709 12:12:49.915088 16779 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895573690-16779-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895573690-16779-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783598895573690-16779-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:12:49.956825 16779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:12:49.957885 16779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:12:49.959317 16779 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:12:49.961486 16779 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:12:49.961720 16779 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:49.961958 16779 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:12:49.962138 16779 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:12:49.998757 16779 rpc_server.cc:307] RPC server started. Bound to: 127.16.98.195:41011
I20260709 12:12:49.998816 25505 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.98.195:41011 every 8 connection(s)
I20260709 12:12:50.012580 25506 heartbeater.cc:344] Connected to a master server at 127.16.98.254:45429
I20260709 12:12:50.012979 25506 heartbeater.cc:461] Registering TS with master...
I20260709 12:12:50.013801 25506 heartbeater.cc:507] Master 127.16.98.254:45429 requested a full tablet report, sending...
I20260709 12:12:50.016016 25230 ts_manager.cc:194] Registered new tserver with Master: 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:50.016860 16779 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014964386s
I20260709 12:12:50.017830 25230 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58786
I20260709 12:12:50.042840 25230 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58802:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:12:50.045200 25230 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:12:50.110939 25471 tablet_service.cc:1511] Processing CreateTablet for tablet 3e0f3f615e7f41179a2f6577f271163c (DEFAULT_TABLE table=test-workload [id=bf2546ace6f74152a5b7bda1c5025aaa]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:12:50.112347 25471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e0f3f615e7f41179a2f6577f271163c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:50.115715 25470 tablet_service.cc:1511] Processing CreateTablet for tablet 9445bca58d1d420eb940aed38f953894 (DEFAULT_TABLE table=test-workload [id=bf2546ace6f74152a5b7bda1c5025aaa]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:12:50.117241 25470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9445bca58d1d420eb940aed38f953894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:50.125465 25469 tablet_service.cc:1511] Processing CreateTablet for tablet 3ca26bcb25244e1fb8ad01b0e0de68b7 (DEFAULT_TABLE table=test-workload [id=bf2546ace6f74152a5b7bda1c5025aaa]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:12:50.126385 25467 tablet_service.cc:1511] Processing CreateTablet for tablet 9c77d7b34aa9485aaffe3e77370a6ed6 (DEFAULT_TABLE table=test-workload [id=bf2546ace6f74152a5b7bda1c5025aaa]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:12:50.128494 25467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c77d7b34aa9485aaffe3e77370a6ed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:50.128933 25468 tablet_service.cc:1511] Processing CreateTablet for tablet 1afdcff9cddc469981a2e16a4626e663 (DEFAULT_TABLE table=test-workload [id=bf2546ace6f74152a5b7bda1c5025aaa]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:12:50.130347 25469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ca26bcb25244e1fb8ad01b0e0de68b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:50.131191 25468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1afdcff9cddc469981a2e16a4626e663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:50.135715 25466 tablet_service.cc:1511] Processing CreateTablet for tablet cd519c6f9fbb43639d5d8ff2f4b209ae (DEFAULT_TABLE table=test-workload [id=bf2546ace6f74152a5b7bda1c5025aaa]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:12:50.138023 25466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd519c6f9fbb43639d5d8ff2f4b209ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:50.143043 25465 tablet_service.cc:1511] Processing CreateTablet for tablet d41ae1092f594947838fb70e9d29df68 (DEFAULT_TABLE table=test-workload [id=bf2546ace6f74152a5b7bda1c5025aaa]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:12:50.144454 25465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d41ae1092f594947838fb70e9d29df68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:50.147478 25315 tablet_service.cc:1511] Processing CreateTablet for tablet 68e0c0233618497787f44d50e1ebb6f1 (DEFAULT_TABLE table=test-workload [id=bf2546ace6f74152a5b7bda1c5025aaa]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:12:50.148533 25321 tablet_service.cc:1511] Processing CreateTablet for tablet 9445bca58d1d420eb940aed38f953894 (DEFAULT_TABLE table=test-workload [id=bf2546ace6f74152a5b7bda1c5025aaa]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:12:50.148918 25315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68e0c0233618497787f44d50e1ebb6f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:50.147493 25322 tablet_service.cc:1511] Processing CreateTablet for tablet 3e0f3f615e7f41179a2f6577f271163c (DEFAULT_TABLE table=test-workload [id=bf2546ace6f74152a5b7bda1c5025aaa]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:12:50.152005 25322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e0f3f615e7f41179a2f6577f271163c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:50.151755 25319 tablet_service.cc:1511] Processing CreateTablet for tablet 1afdcff9cddc469981a2e16a4626e663 (DEFAULT_TABLE table=test-workload [id=bf2546ace6f74152a5b7bda1c5025aaa]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:12:50.153072 25319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1afdcff9cddc469981a2e16a4626e663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:50.153725 25464 tablet_service.cc:1511] Processing CreateTablet for tablet 68e0c0233618497787f44d50e1ebb6f1 (DEFAULT_TABLE table=test-workload [id=bf2546ace6f74152a5b7bda1c5025aaa]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:12:50.155705 25463 tablet_service.cc:1511] Processing CreateTablet for tablet 87740656475e4780a6fd2c222a2e2dce (DEFAULT_TABLE table=test-workload [id=bf2546ace6f74152a5b7bda1c5025aaa]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:12:50.156057 25318 tablet_service.cc:1511] Processing CreateTablet for tablet 9c77d7b34aa9485aaffe3e77370a6ed6 (DEFAULT_TABLE table=test-workload [id=bf2546ace6f74152a5b7bda1c5025aaa]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:12:50.150686 25320 tablet_service.cc:1511] Processing CreateTablet for tablet 3ca26bcb25244e1fb8ad01b0e0de68b7 (DEFAULT_TABLE table=test-workload [id=bf2546ace6f74152a5b7bda1c5025aaa]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:12:50.157771 25318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c77d7b34aa9485aaffe3e77370a6ed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:50.158579 25320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ca26bcb25244e1fb8ad01b0e0de68b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:50.150174 25316 tablet_service.cc:1511] Processing CreateTablet for tablet d41ae1092f594947838fb70e9d29df68 (DEFAULT_TABLE table=test-workload [id=bf2546ace6f74152a5b7bda1c5025aaa]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:12:50.162983 25321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9445bca58d1d420eb940aed38f953894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:50.163865 25316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d41ae1092f594947838fb70e9d29df68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:50.167308 25463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87740656475e4780a6fd2c222a2e2dce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:50.160038 25317 tablet_service.cc:1511] Processing CreateTablet for tablet cd519c6f9fbb43639d5d8ff2f4b209ae (DEFAULT_TABLE table=test-workload [id=bf2546ace6f74152a5b7bda1c5025aaa]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:12:50.180231 25464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68e0c0233618497787f44d50e1ebb6f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:50.181375 25317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd519c6f9fbb43639d5d8ff2f4b209ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:50.184842 25314 tablet_service.cc:1511] Processing CreateTablet for tablet 87740656475e4780a6fd2c222a2e2dce (DEFAULT_TABLE table=test-workload [id=bf2546ace6f74152a5b7bda1c5025aaa]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:12:50.186244 25314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87740656475e4780a6fd2c222a2e2dce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:50.218233 25520 tablet_bootstrap.cc:492] T 1afdcff9cddc469981a2e16a4626e663 P 02a30f2f37194042b6ad292011c47d0d: Bootstrap starting.
I20260709 12:12:50.225304 25521 tablet_bootstrap.cc:492] T 87740656475e4780a6fd2c222a2e2dce P 52e12d0cb9004693ba368ceb7fac2259: Bootstrap starting.
I20260709 12:12:50.251159 25520 tablet_bootstrap.cc:654] T 1afdcff9cddc469981a2e16a4626e663 P 02a30f2f37194042b6ad292011c47d0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.251776 25397 tablet_service.cc:1511] Processing CreateTablet for tablet 3e0f3f615e7f41179a2f6577f271163c (DEFAULT_TABLE table=test-workload [id=bf2546ace6f74152a5b7bda1c5025aaa]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:12:50.253173 25397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e0f3f615e7f41179a2f6577f271163c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:50.255719 25396 tablet_service.cc:1511] Processing CreateTablet for tablet 9445bca58d1d420eb940aed38f953894 (DEFAULT_TABLE table=test-workload [id=bf2546ace6f74152a5b7bda1c5025aaa]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:12:50.257125 25396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9445bca58d1d420eb940aed38f953894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:50.257218 25521 tablet_bootstrap.cc:654] T 87740656475e4780a6fd2c222a2e2dce P 52e12d0cb9004693ba368ceb7fac2259: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.259701 25395 tablet_service.cc:1511] Processing CreateTablet for tablet 3ca26bcb25244e1fb8ad01b0e0de68b7 (DEFAULT_TABLE table=test-workload [id=bf2546ace6f74152a5b7bda1c5025aaa]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:12:50.261019 25395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ca26bcb25244e1fb8ad01b0e0de68b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:50.262228 25520 tablet_bootstrap.cc:492] T 1afdcff9cddc469981a2e16a4626e663 P 02a30f2f37194042b6ad292011c47d0d: No bootstrap required, opened a new log
I20260709 12:12:50.262753 25520 ts_tablet_manager.cc:1403] T 1afdcff9cddc469981a2e16a4626e663 P 02a30f2f37194042b6ad292011c47d0d: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.000s
I20260709 12:12:50.262550 25392 tablet_service.cc:1511] Processing CreateTablet for tablet cd519c6f9fbb43639d5d8ff2f4b209ae (DEFAULT_TABLE table=test-workload [id=bf2546ace6f74152a5b7bda1c5025aaa]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:12:50.264719 25391 tablet_service.cc:1511] Processing CreateTablet for tablet d41ae1092f594947838fb70e9d29df68 (DEFAULT_TABLE table=test-workload [id=bf2546ace6f74152a5b7bda1c5025aaa]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:12:50.265646 25520 raft_consensus.cc:359] T 1afdcff9cddc469981a2e16a4626e663 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.266395 25520 raft_consensus.cc:385] T 1afdcff9cddc469981a2e16a4626e663 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.266726 25520 raft_consensus.cc:740] T 1afdcff9cddc469981a2e16a4626e663 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02a30f2f37194042b6ad292011c47d0d, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.266825 25394 tablet_service.cc:1511] Processing CreateTablet for tablet 1afdcff9cddc469981a2e16a4626e663 (DEFAULT_TABLE table=test-workload [id=bf2546ace6f74152a5b7bda1c5025aaa]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:12:50.267516 25520 consensus_queue.cc:260] T 1afdcff9cddc469981a2e16a4626e663 P 02a30f2f37194042b6ad292011c47d0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.268935 25393 tablet_service.cc:1511] Processing CreateTablet for tablet 9c77d7b34aa9485aaffe3e77370a6ed6 (DEFAULT_TABLE table=test-workload [id=bf2546ace6f74152a5b7bda1c5025aaa]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:12:50.272040 25393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c77d7b34aa9485aaffe3e77370a6ed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:50.278700 25394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1afdcff9cddc469981a2e16a4626e663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:50.279961 25390 tablet_service.cc:1511] Processing CreateTablet for tablet 68e0c0233618497787f44d50e1ebb6f1 (DEFAULT_TABLE table=test-workload [id=bf2546ace6f74152a5b7bda1c5025aaa]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:12:50.281280 25390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68e0c0233618497787f44d50e1ebb6f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:50.284168 25389 tablet_service.cc:1511] Processing CreateTablet for tablet 87740656475e4780a6fd2c222a2e2dce (DEFAULT_TABLE table=test-workload [id=bf2546ace6f74152a5b7bda1c5025aaa]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:12:50.285463 25389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87740656475e4780a6fd2c222a2e2dce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:50.287504 25392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd519c6f9fbb43639d5d8ff2f4b209ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:50.291109 25391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d41ae1092f594947838fb70e9d29df68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:50.334072 25525 tablet_bootstrap.cc:492] T 1afdcff9cddc469981a2e16a4626e663 P f7d44497c5c04c55a6b9dae701b63b2b: Bootstrap starting.
I20260709 12:12:50.347767 25525 tablet_bootstrap.cc:654] T 1afdcff9cddc469981a2e16a4626e663 P f7d44497c5c04c55a6b9dae701b63b2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.412027 25506 heartbeater.cc:499] Master 127.16.98.254:45429 was elected leader, sending a full tablet report...
I20260709 12:12:50.412784 25520 ts_tablet_manager.cc:1434] T 1afdcff9cddc469981a2e16a4626e663 P 02a30f2f37194042b6ad292011c47d0d: Time spent starting tablet: real 0.150s	user 0.047s	sys 0.101s
I20260709 12:12:50.414799 25520 tablet_bootstrap.cc:492] T d41ae1092f594947838fb70e9d29df68 P 02a30f2f37194042b6ad292011c47d0d: Bootstrap starting.
I20260709 12:12:50.423228 25520 tablet_bootstrap.cc:654] T d41ae1092f594947838fb70e9d29df68 P 02a30f2f37194042b6ad292011c47d0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.434931 25521 tablet_bootstrap.cc:492] T 87740656475e4780a6fd2c222a2e2dce P 52e12d0cb9004693ba368ceb7fac2259: No bootstrap required, opened a new log
I20260709 12:12:50.435459 25521 ts_tablet_manager.cc:1403] T 87740656475e4780a6fd2c222a2e2dce P 52e12d0cb9004693ba368ceb7fac2259: Time spent bootstrapping tablet: real 0.210s	user 0.079s	sys 0.074s
I20260709 12:12:50.435763 25520 tablet_bootstrap.cc:492] T d41ae1092f594947838fb70e9d29df68 P 02a30f2f37194042b6ad292011c47d0d: No bootstrap required, opened a new log
I20260709 12:12:50.436374 25520 ts_tablet_manager.cc:1403] T d41ae1092f594947838fb70e9d29df68 P 02a30f2f37194042b6ad292011c47d0d: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.007s
I20260709 12:12:50.438480 25521 raft_consensus.cc:359] T 87740656475e4780a6fd2c222a2e2dce P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.439374 25521 raft_consensus.cc:385] T 87740656475e4780a6fd2c222a2e2dce P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.439260 25520 raft_consensus.cc:359] T d41ae1092f594947838fb70e9d29df68 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.439903 25521 raft_consensus.cc:740] T 87740656475e4780a6fd2c222a2e2dce P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.440315 25520 raft_consensus.cc:385] T d41ae1092f594947838fb70e9d29df68 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.440706 25520 raft_consensus.cc:740] T d41ae1092f594947838fb70e9d29df68 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02a30f2f37194042b6ad292011c47d0d, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.440891 25521 consensus_queue.cc:260] T 87740656475e4780a6fd2c222a2e2dce P 52e12d0cb9004693ba368ceb7fac2259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.441701 25520 consensus_queue.cc:260] T d41ae1092f594947838fb70e9d29df68 P 02a30f2f37194042b6ad292011c47d0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.445771 25525 tablet_bootstrap.cc:492] T 1afdcff9cddc469981a2e16a4626e663 P f7d44497c5c04c55a6b9dae701b63b2b: No bootstrap required, opened a new log
I20260709 12:12:50.446293 25525 ts_tablet_manager.cc:1403] T 1afdcff9cddc469981a2e16a4626e663 P f7d44497c5c04c55a6b9dae701b63b2b: Time spent bootstrapping tablet: real 0.113s	user 0.024s	sys 0.066s
I20260709 12:12:50.448129 25520 ts_tablet_manager.cc:1434] T d41ae1092f594947838fb70e9d29df68 P 02a30f2f37194042b6ad292011c47d0d: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:12:50.449143 25520 tablet_bootstrap.cc:492] T 68e0c0233618497787f44d50e1ebb6f1 P 02a30f2f37194042b6ad292011c47d0d: Bootstrap starting.
I20260709 12:12:50.449120 25525 raft_consensus.cc:359] T 1afdcff9cddc469981a2e16a4626e663 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.450017 25525 raft_consensus.cc:385] T 1afdcff9cddc469981a2e16a4626e663 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.450328 25525 raft_consensus.cc:740] T 1afdcff9cddc469981a2e16a4626e663 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d44497c5c04c55a6b9dae701b63b2b, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.455411 25520 tablet_bootstrap.cc:654] T 68e0c0233618497787f44d50e1ebb6f1 P 02a30f2f37194042b6ad292011c47d0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.456372 25525 consensus_queue.cc:260] T 1afdcff9cddc469981a2e16a4626e663 P f7d44497c5c04c55a6b9dae701b63b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.472496 25357 heartbeater.cc:499] Master 127.16.98.254:45429 was elected leader, sending a full tablet report...
I20260709 12:12:50.474478 25432 heartbeater.cc:499] Master 127.16.98.254:45429 was elected leader, sending a full tablet report...
I20260709 12:12:50.475096 25525 ts_tablet_manager.cc:1434] T 1afdcff9cddc469981a2e16a4626e663 P f7d44497c5c04c55a6b9dae701b63b2b: Time spent starting tablet: real 0.028s	user 0.017s	sys 0.008s
I20260709 12:12:50.475258 25521 ts_tablet_manager.cc:1434] T 87740656475e4780a6fd2c222a2e2dce P 52e12d0cb9004693ba368ceb7fac2259: Time spent starting tablet: real 0.039s	user 0.015s	sys 0.012s
I20260709 12:12:50.476205 25525 tablet_bootstrap.cc:492] T 9c77d7b34aa9485aaffe3e77370a6ed6 P f7d44497c5c04c55a6b9dae701b63b2b: Bootstrap starting.
I20260709 12:12:50.476328 25521 tablet_bootstrap.cc:492] T 68e0c0233618497787f44d50e1ebb6f1 P 52e12d0cb9004693ba368ceb7fac2259: Bootstrap starting.
I20260709 12:12:50.479158 25520 tablet_bootstrap.cc:492] T 68e0c0233618497787f44d50e1ebb6f1 P 02a30f2f37194042b6ad292011c47d0d: No bootstrap required, opened a new log
I20260709 12:12:50.479758 25520 ts_tablet_manager.cc:1403] T 68e0c0233618497787f44d50e1ebb6f1 P 02a30f2f37194042b6ad292011c47d0d: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.016s
I20260709 12:12:50.482288 25525 tablet_bootstrap.cc:654] T 9c77d7b34aa9485aaffe3e77370a6ed6 P f7d44497c5c04c55a6b9dae701b63b2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.482698 25520 raft_consensus.cc:359] T 68e0c0233618497787f44d50e1ebb6f1 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.483762 25520 raft_consensus.cc:385] T 68e0c0233618497787f44d50e1ebb6f1 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.484061 25520 raft_consensus.cc:740] T 68e0c0233618497787f44d50e1ebb6f1 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02a30f2f37194042b6ad292011c47d0d, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.482744 25521 tablet_bootstrap.cc:654] T 68e0c0233618497787f44d50e1ebb6f1 P 52e12d0cb9004693ba368ceb7fac2259: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.486943 25520 consensus_queue.cc:260] T 68e0c0233618497787f44d50e1ebb6f1 P 02a30f2f37194042b6ad292011c47d0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.489953 25520 ts_tablet_manager.cc:1434] T 68e0c0233618497787f44d50e1ebb6f1 P 02a30f2f37194042b6ad292011c47d0d: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:12:50.491372 25520 tablet_bootstrap.cc:492] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d: Bootstrap starting.
I20260709 12:12:50.499490 25520 tablet_bootstrap.cc:654] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.529592 25525 tablet_bootstrap.cc:492] T 9c77d7b34aa9485aaffe3e77370a6ed6 P f7d44497c5c04c55a6b9dae701b63b2b: No bootstrap required, opened a new log
I20260709 12:12:50.530165 25525 ts_tablet_manager.cc:1403] T 9c77d7b34aa9485aaffe3e77370a6ed6 P f7d44497c5c04c55a6b9dae701b63b2b: Time spent bootstrapping tablet: real 0.054s	user 0.025s	sys 0.026s
I20260709 12:12:50.530530 25523 raft_consensus.cc:493] T 1afdcff9cddc469981a2e16a4626e663 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.531261 25523 raft_consensus.cc:515] T 1afdcff9cddc469981a2e16a4626e663 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.533212 25525 raft_consensus.cc:359] T 9c77d7b34aa9485aaffe3e77370a6ed6 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.533977 25525 raft_consensus.cc:385] T 9c77d7b34aa9485aaffe3e77370a6ed6 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.534276 25525 raft_consensus.cc:740] T 9c77d7b34aa9485aaffe3e77370a6ed6 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d44497c5c04c55a6b9dae701b63b2b, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.534498 25523 leader_election.cc:290] T 1afdcff9cddc469981a2e16a4626e663 P 02a30f2f37194042b6ad292011c47d0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391), f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825)
I20260709 12:12:50.535229 25525 consensus_queue.cc:260] T 9c77d7b34aa9485aaffe3e77370a6ed6 P f7d44497c5c04c55a6b9dae701b63b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.538282 25525 ts_tablet_manager.cc:1434] T 9c77d7b34aa9485aaffe3e77370a6ed6 P f7d44497c5c04c55a6b9dae701b63b2b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:12:50.539332 25525 tablet_bootstrap.cc:492] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P f7d44497c5c04c55a6b9dae701b63b2b: Bootstrap starting.
I20260709 12:12:50.545204 25525 tablet_bootstrap.cc:654] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P f7d44497c5c04c55a6b9dae701b63b2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.557608 25525 tablet_bootstrap.cc:492] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P f7d44497c5c04c55a6b9dae701b63b2b: No bootstrap required, opened a new log
I20260709 12:12:50.558101 25525 ts_tablet_manager.cc:1403] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P f7d44497c5c04c55a6b9dae701b63b2b: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.004s
I20260709 12:12:50.561007 25525 raft_consensus.cc:359] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.561775 25525 raft_consensus.cc:385] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.561960 25521 tablet_bootstrap.cc:492] T 68e0c0233618497787f44d50e1ebb6f1 P 52e12d0cb9004693ba368ceb7fac2259: No bootstrap required, opened a new log
I20260709 12:12:50.562711 25521 ts_tablet_manager.cc:1403] T 68e0c0233618497787f44d50e1ebb6f1 P 52e12d0cb9004693ba368ceb7fac2259: Time spent bootstrapping tablet: real 0.087s	user 0.021s	sys 0.041s
I20260709 12:12:50.563269 25520 tablet_bootstrap.cc:492] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d: No bootstrap required, opened a new log
I20260709 12:12:50.563836 25520 ts_tablet_manager.cc:1403] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d: Time spent bootstrapping tablet: real 0.073s	user 0.031s	sys 0.039s
I20260709 12:12:50.562080 25525 raft_consensus.cc:740] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d44497c5c04c55a6b9dae701b63b2b, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.564978 25525 consensus_queue.cc:260] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P f7d44497c5c04c55a6b9dae701b63b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.565590 25521 raft_consensus.cc:359] T 68e0c0233618497787f44d50e1ebb6f1 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.568140 25521 raft_consensus.cc:385] T 68e0c0233618497787f44d50e1ebb6f1 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.568449 25521 raft_consensus.cc:740] T 68e0c0233618497787f44d50e1ebb6f1 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.568897 25332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1afdcff9cddc469981a2e16a4626e663" candidate_uuid: "02a30f2f37194042b6ad292011c47d0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52e12d0cb9004693ba368ceb7fac2259" is_pre_election: true
I20260709 12:12:50.569226 25521 consensus_queue.cc:260] T 68e0c0233618497787f44d50e1ebb6f1 P 52e12d0cb9004693ba368ceb7fac2259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.569677 25525 ts_tablet_manager.cc:1434] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P f7d44497c5c04c55a6b9dae701b63b2b: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 12:12:50.570777 25525 tablet_bootstrap.cc:492] T 68e0c0233618497787f44d50e1ebb6f1 P f7d44497c5c04c55a6b9dae701b63b2b: Bootstrap starting.
I20260709 12:12:50.571439 25521 ts_tablet_manager.cc:1434] T 68e0c0233618497787f44d50e1ebb6f1 P 52e12d0cb9004693ba368ceb7fac2259: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:12:50.572389 25521 tablet_bootstrap.cc:492] T 9445bca58d1d420eb940aed38f953894 P 52e12d0cb9004693ba368ceb7fac2259: Bootstrap starting.
I20260709 12:12:50.567042 25520 raft_consensus.cc:359] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.574800 25520 raft_consensus.cc:385] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.575139 25520 raft_consensus.cc:740] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02a30f2f37194042b6ad292011c47d0d, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.575984 25520 consensus_queue.cc:260] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.576598 25525 tablet_bootstrap.cc:654] T 68e0c0233618497787f44d50e1ebb6f1 P f7d44497c5c04c55a6b9dae701b63b2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.578502 25520 ts_tablet_manager.cc:1434] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:12:50.579459 25520 tablet_bootstrap.cc:492] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 02a30f2f37194042b6ad292011c47d0d: Bootstrap starting.
I20260709 12:12:50.583500 25528 raft_consensus.cc:493] T 68e0c0233618497787f44d50e1ebb6f1 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.584024 25528 raft_consensus.cc:515] T 68e0c0233618497787f44d50e1ebb6f1 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.585258 25520 tablet_bootstrap.cc:654] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 02a30f2f37194042b6ad292011c47d0d: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:50.588476 25444 leader_election.cc:343] T 1afdcff9cddc469981a2e16a4626e663 P 02a30f2f37194042b6ad292011c47d0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.596385 25407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1afdcff9cddc469981a2e16a4626e663" candidate_uuid: "02a30f2f37194042b6ad292011c47d0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" is_pre_election: true
I20260709 12:12:50.597340 25407 raft_consensus.cc:2468] T 1afdcff9cddc469981a2e16a4626e663 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02a30f2f37194042b6ad292011c47d0d in term 0.
I20260709 12:12:50.600730 25444 leader_election.cc:304] T 1afdcff9cddc469981a2e16a4626e663 P 02a30f2f37194042b6ad292011c47d0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02a30f2f37194042b6ad292011c47d0d, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 52e12d0cb9004693ba368ceb7fac2259
I20260709 12:12:50.601814 25523 raft_consensus.cc:2804] T 1afdcff9cddc469981a2e16a4626e663 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:50.602264 25523 raft_consensus.cc:493] T 1afdcff9cddc469981a2e16a4626e663 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.602687 25523 raft_consensus.cc:3060] T 1afdcff9cddc469981a2e16a4626e663 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.590404 25528 leader_election.cc:290] T 68e0c0233618497787f44d50e1ebb6f1 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:50.609146 25521 tablet_bootstrap.cc:654] T 9445bca58d1d420eb940aed38f953894 P 52e12d0cb9004693ba368ceb7fac2259: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.596372 25525 tablet_bootstrap.cc:492] T 68e0c0233618497787f44d50e1ebb6f1 P f7d44497c5c04c55a6b9dae701b63b2b: No bootstrap required, opened a new log
I20260709 12:12:50.618692 25525 ts_tablet_manager.cc:1403] T 68e0c0233618497787f44d50e1ebb6f1 P f7d44497c5c04c55a6b9dae701b63b2b: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.013s
I20260709 12:12:50.621085 25521 tablet_bootstrap.cc:492] T 9445bca58d1d420eb940aed38f953894 P 52e12d0cb9004693ba368ceb7fac2259: No bootstrap required, opened a new log
I20260709 12:12:50.621119 25520 tablet_bootstrap.cc:492] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 02a30f2f37194042b6ad292011c47d0d: No bootstrap required, opened a new log
I20260709 12:12:50.621867 25521 ts_tablet_manager.cc:1403] T 9445bca58d1d420eb940aed38f953894 P 52e12d0cb9004693ba368ceb7fac2259: Time spent bootstrapping tablet: real 0.050s	user 0.014s	sys 0.000s
I20260709 12:12:50.622089 25520 ts_tablet_manager.cc:1403] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 02a30f2f37194042b6ad292011c47d0d: Time spent bootstrapping tablet: real 0.043s	user 0.028s	sys 0.009s
I20260709 12:12:50.621923 25525 raft_consensus.cc:359] T 68e0c0233618497787f44d50e1ebb6f1 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.622927 25525 raft_consensus.cc:385] T 68e0c0233618497787f44d50e1ebb6f1 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.623301 25525 raft_consensus.cc:740] T 68e0c0233618497787f44d50e1ebb6f1 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d44497c5c04c55a6b9dae701b63b2b, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.624207 25525 consensus_queue.cc:260] T 68e0c0233618497787f44d50e1ebb6f1 P f7d44497c5c04c55a6b9dae701b63b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.625054 25521 raft_consensus.cc:359] T 9445bca58d1d420eb940aed38f953894 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.625860 25521 raft_consensus.cc:385] T 9445bca58d1d420eb940aed38f953894 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.626225 25521 raft_consensus.cc:740] T 9445bca58d1d420eb940aed38f953894 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.625998 25520 raft_consensus.cc:359] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.626667 25525 ts_tablet_manager.cc:1434] T 68e0c0233618497787f44d50e1ebb6f1 P f7d44497c5c04c55a6b9dae701b63b2b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:12:50.626933 25520 raft_consensus.cc:385] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.627384 25520 raft_consensus.cc:740] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02a30f2f37194042b6ad292011c47d0d, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.627101 25521 consensus_queue.cc:260] T 9445bca58d1d420eb940aed38f953894 P 52e12d0cb9004693ba368ceb7fac2259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.627815 25525 tablet_bootstrap.cc:492] T 9445bca58d1d420eb940aed38f953894 P f7d44497c5c04c55a6b9dae701b63b2b: Bootstrap starting.
I20260709 12:12:50.628302 25520 consensus_queue.cc:260] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 02a30f2f37194042b6ad292011c47d0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.632409 25521 ts_tablet_manager.cc:1434] T 9445bca58d1d420eb940aed38f953894 P 52e12d0cb9004693ba368ceb7fac2259: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:12:50.633505 25521 tablet_bootstrap.cc:492] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 52e12d0cb9004693ba368ceb7fac2259: Bootstrap starting.
I20260709 12:12:50.634859 25525 tablet_bootstrap.cc:654] T 9445bca58d1d420eb940aed38f953894 P f7d44497c5c04c55a6b9dae701b63b2b: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:50.637243 25278 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:50.641722 25520 ts_tablet_manager.cc:1434] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 02a30f2f37194042b6ad292011c47d0d: Time spent starting tablet: real 0.019s	user 0.012s	sys 0.002s
I20260709 12:12:50.642881 25520 tablet_bootstrap.cc:492] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 02a30f2f37194042b6ad292011c47d0d: Bootstrap starting.
I20260709 12:12:50.646628 25525 tablet_bootstrap.cc:492] T 9445bca58d1d420eb940aed38f953894 P f7d44497c5c04c55a6b9dae701b63b2b: No bootstrap required, opened a new log
I20260709 12:12:50.647621 25521 tablet_bootstrap.cc:654] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 52e12d0cb9004693ba368ceb7fac2259: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.649492 25520 tablet_bootstrap.cc:654] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 02a30f2f37194042b6ad292011c47d0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.613703 25523 raft_consensus.cc:515] T 1afdcff9cddc469981a2e16a4626e663 P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.655296 25525 ts_tablet_manager.cc:1403] T 9445bca58d1d420eb940aed38f953894 P f7d44497c5c04c55a6b9dae701b63b2b: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.007s
I20260709 12:12:50.663254 25332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1afdcff9cddc469981a2e16a4626e663" candidate_uuid: "02a30f2f37194042b6ad292011c47d0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52e12d0cb9004693ba368ceb7fac2259"
I20260709 12:12:50.659287 25542 raft_consensus.cc:493] T d41ae1092f594947838fb70e9d29df68 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.664208 25542 raft_consensus.cc:515] T d41ae1092f594947838fb70e9d29df68 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
W20260709 12:12:50.665072 25444 leader_election.cc:343] T 1afdcff9cddc469981a2e16a4626e663 P 02a30f2f37194042b6ad292011c47d0d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.667009 25523 leader_election.cc:290] T 1afdcff9cddc469981a2e16a4626e663 P 02a30f2f37194042b6ad292011c47d0d [CANDIDATE]: Term 1 election: Requested vote from peers 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391), f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825)
I20260709 12:12:50.667804 25407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1afdcff9cddc469981a2e16a4626e663" candidate_uuid: "02a30f2f37194042b6ad292011c47d0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
I20260709 12:12:50.668614 25407 raft_consensus.cc:3060] T 1afdcff9cddc469981a2e16a4626e663 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.676501 25481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e0c0233618497787f44d50e1ebb6f1" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02a30f2f37194042b6ad292011c47d0d" is_pre_election: true
I20260709 12:12:50.677279 25481 raft_consensus.cc:2468] T 68e0c0233618497787f44d50e1ebb6f1 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 0.
I20260709 12:12:50.678063 25332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d41ae1092f594947838fb70e9d29df68" candidate_uuid: "02a30f2f37194042b6ad292011c47d0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52e12d0cb9004693ba368ceb7fac2259" is_pre_election: true
I20260709 12:12:50.678778 25297 leader_election.cc:304] T 68e0c0233618497787f44d50e1ebb6f1 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02a30f2f37194042b6ad292011c47d0d, 52e12d0cb9004693ba368ceb7fac2259; no voters: 
I20260709 12:12:50.679742 25528 raft_consensus.cc:2804] T 68e0c0233618497787f44d50e1ebb6f1 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:50.680099 25528 raft_consensus.cc:493] T 68e0c0233618497787f44d50e1ebb6f1 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.680444 25528 raft_consensus.cc:3060] T 68e0c0233618497787f44d50e1ebb6f1 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.680953 25406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e0c0233618497787f44d50e1ebb6f1" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" is_pre_election: true
I20260709 12:12:50.681658 25406 raft_consensus.cc:2468] T 68e0c0233618497787f44d50e1ebb6f1 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 0.
I20260709 12:12:50.682148 25542 leader_election.cc:290] T d41ae1092f594947838fb70e9d29df68 P 02a30f2f37194042b6ad292011c47d0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391), f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825)
W20260709 12:12:50.683929 25444 leader_election.cc:343] T d41ae1092f594947838fb70e9d29df68 P 02a30f2f37194042b6ad292011c47d0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.684662 25407 raft_consensus.cc:2468] T 1afdcff9cddc469981a2e16a4626e663 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02a30f2f37194042b6ad292011c47d0d in term 1.
I20260709 12:12:50.685705 25406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d41ae1092f594947838fb70e9d29df68" candidate_uuid: "02a30f2f37194042b6ad292011c47d0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" is_pre_election: true
I20260709 12:12:50.686322 25444 leader_election.cc:304] T 1afdcff9cddc469981a2e16a4626e663 P 02a30f2f37194042b6ad292011c47d0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02a30f2f37194042b6ad292011c47d0d, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 52e12d0cb9004693ba368ceb7fac2259
I20260709 12:12:50.688963 25528 raft_consensus.cc:515] T 68e0c0233618497787f44d50e1ebb6f1 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
W20260709 12:12:50.689157 25444 leader_election.cc:343] T d41ae1092f594947838fb70e9d29df68 P 02a30f2f37194042b6ad292011c47d0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.689684 25444 leader_election.cc:304] T d41ae1092f594947838fb70e9d29df68 P 02a30f2f37194042b6ad292011c47d0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02a30f2f37194042b6ad292011c47d0d; no voters: 52e12d0cb9004693ba368ceb7fac2259, f7d44497c5c04c55a6b9dae701b63b2b
I20260709 12:12:50.690168 25521 tablet_bootstrap.cc:492] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 52e12d0cb9004693ba368ceb7fac2259: No bootstrap required, opened a new log
I20260709 12:12:50.690435 25523 raft_consensus.cc:2804] T 1afdcff9cddc469981a2e16a4626e663 P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:50.690830 25521 ts_tablet_manager.cc:1403] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 52e12d0cb9004693ba368ceb7fac2259: Time spent bootstrapping tablet: real 0.058s	user 0.016s	sys 0.033s
I20260709 12:12:50.691399 25406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e0c0233618497787f44d50e1ebb6f1" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
I20260709 12:12:50.691718 25481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e0c0233618497787f44d50e1ebb6f1" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02a30f2f37194042b6ad292011c47d0d"
I20260709 12:12:50.691977 25406 raft_consensus.cc:3060] T 68e0c0233618497787f44d50e1ebb6f1 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.692276 25481 raft_consensus.cc:3060] T 68e0c0233618497787f44d50e1ebb6f1 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.693734 25542 raft_consensus.cc:2749] T d41ae1092f594947838fb70e9d29df68 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:50.694360 25521 raft_consensus.cc:359] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.695277 25521 raft_consensus.cc:385] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.695552 25521 raft_consensus.cc:740] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.695797 25525 raft_consensus.cc:359] T 9445bca58d1d420eb940aed38f953894 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.696519 25525 raft_consensus.cc:385] T 9445bca58d1d420eb940aed38f953894 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.696832 25525 raft_consensus.cc:740] T 9445bca58d1d420eb940aed38f953894 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d44497c5c04c55a6b9dae701b63b2b, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.697031 25521 consensus_queue.cc:260] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 52e12d0cb9004693ba368ceb7fac2259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.697504 25523 raft_consensus.cc:697] T 1afdcff9cddc469981a2e16a4626e663 P 02a30f2f37194042b6ad292011c47d0d [term 1 LEADER]: Becoming Leader. State: Replica: 02a30f2f37194042b6ad292011c47d0d, State: Running, Role: LEADER
I20260709 12:12:50.698450 25523 consensus_queue.cc:237] T 1afdcff9cddc469981a2e16a4626e663 P 02a30f2f37194042b6ad292011c47d0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.699476 25406 raft_consensus.cc:2468] T 68e0c0233618497787f44d50e1ebb6f1 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 1.
I20260709 12:12:50.700067 25528 leader_election.cc:290] T 68e0c0233618497787f44d50e1ebb6f1 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 election: Requested vote from peers f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:50.701086 25295 leader_election.cc:304] T 68e0c0233618497787f44d50e1ebb6f1 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52e12d0cb9004693ba368ceb7fac2259, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 
I20260709 12:12:50.701838 25528 raft_consensus.cc:2804] T 68e0c0233618497787f44d50e1ebb6f1 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:50.699476 25481 raft_consensus.cc:2468] T 68e0c0233618497787f44d50e1ebb6f1 P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 1.
I20260709 12:12:50.704005 25520 tablet_bootstrap.cc:492] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 02a30f2f37194042b6ad292011c47d0d: No bootstrap required, opened a new log
I20260709 12:12:50.704483 25520 ts_tablet_manager.cc:1403] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 02a30f2f37194042b6ad292011c47d0d: Time spent bootstrapping tablet: real 0.062s	user 0.016s	sys 0.017s
I20260709 12:12:50.706838 25528 raft_consensus.cc:697] T 68e0c0233618497787f44d50e1ebb6f1 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 LEADER]: Becoming Leader. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Running, Role: LEADER
I20260709 12:12:50.706776 25520 raft_consensus.cc:359] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.707595 25520 raft_consensus.cc:385] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.707973 25520 raft_consensus.cc:740] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02a30f2f37194042b6ad292011c47d0d, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.707880 25528 consensus_queue.cc:237] T 68e0c0233618497787f44d50e1ebb6f1 P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.708384 25525 consensus_queue.cc:260] T 9445bca58d1d420eb940aed38f953894 P f7d44497c5c04c55a6b9dae701b63b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.709291 25521 ts_tablet_manager.cc:1434] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 52e12d0cb9004693ba368ceb7fac2259: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.005s
I20260709 12:12:50.711050 25525 ts_tablet_manager.cc:1434] T 9445bca58d1d420eb940aed38f953894 P f7d44497c5c04c55a6b9dae701b63b2b: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
I20260709 12:12:50.713258 25525 tablet_bootstrap.cc:492] T cd519c6f9fbb43639d5d8ff2f4b209ae P f7d44497c5c04c55a6b9dae701b63b2b: Bootstrap starting.
I20260709 12:12:50.708997 25520 consensus_queue.cc:260] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 02a30f2f37194042b6ad292011c47d0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.716629 25521 tablet_bootstrap.cc:492] T d41ae1092f594947838fb70e9d29df68 P 52e12d0cb9004693ba368ceb7fac2259: Bootstrap starting.
I20260709 12:12:50.717799 25520 ts_tablet_manager.cc:1434] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 02a30f2f37194042b6ad292011c47d0d: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:12:50.720530 25520 tablet_bootstrap.cc:492] T cd519c6f9fbb43639d5d8ff2f4b209ae P 02a30f2f37194042b6ad292011c47d0d: Bootstrap starting.
I20260709 12:12:50.727125 25520 tablet_bootstrap.cc:654] T cd519c6f9fbb43639d5d8ff2f4b209ae P 02a30f2f37194042b6ad292011c47d0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.726469 25228 catalog_manager.cc:5697] T 68e0c0233618497787f44d50e1ebb6f1 P 52e12d0cb9004693ba368ceb7fac2259 reported cstate change: term changed from 0 to 1, leader changed from <none> to 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193). New cstate: current_term: 1 leader_uuid: "52e12d0cb9004693ba368ceb7fac2259" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:50.727238 25525 tablet_bootstrap.cc:654] T cd519c6f9fbb43639d5d8ff2f4b209ae P f7d44497c5c04c55a6b9dae701b63b2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.728219 25521 tablet_bootstrap.cc:654] T d41ae1092f594947838fb70e9d29df68 P 52e12d0cb9004693ba368ceb7fac2259: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.733114 25528 raft_consensus.cc:493] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.733615 25528 raft_consensus.cc:515] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.735795 25528 leader_election.cc:290] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:50.736720 25230 catalog_manager.cc:5697] T 1afdcff9cddc469981a2e16a4626e663 P 02a30f2f37194042b6ad292011c47d0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 02a30f2f37194042b6ad292011c47d0d (127.16.98.195). New cstate: current_term: 1 leader_uuid: "02a30f2f37194042b6ad292011c47d0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:50.737468 25481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c77d7b34aa9485aaffe3e77370a6ed6" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02a30f2f37194042b6ad292011c47d0d" is_pre_election: true
I20260709 12:12:50.739277 25481 raft_consensus.cc:2468] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 0.
I20260709 12:12:50.740891 25297 leader_election.cc:304] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02a30f2f37194042b6ad292011c47d0d, 52e12d0cb9004693ba368ceb7fac2259; no voters: 
I20260709 12:12:50.741878 25528 raft_consensus.cc:2804] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:50.742268 25528 raft_consensus.cc:493] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.742573 25528 raft_consensus.cc:3060] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.744078 25407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c77d7b34aa9485aaffe3e77370a6ed6" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" is_pre_election: true
I20260709 12:12:50.744784 25407 raft_consensus.cc:2468] T 9c77d7b34aa9485aaffe3e77370a6ed6 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 0.
I20260709 12:12:50.753202 25525 tablet_bootstrap.cc:492] T cd519c6f9fbb43639d5d8ff2f4b209ae P f7d44497c5c04c55a6b9dae701b63b2b: No bootstrap required, opened a new log
I20260709 12:12:50.753759 25525 ts_tablet_manager.cc:1403] T cd519c6f9fbb43639d5d8ff2f4b209ae P f7d44497c5c04c55a6b9dae701b63b2b: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.007s
I20260709 12:12:50.749583 25528 raft_consensus.cc:515] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.756609 25407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c77d7b34aa9485aaffe3e77370a6ed6" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
I20260709 12:12:50.756781 25528 leader_election.cc:290] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 election: Requested vote from peers f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:50.757215 25407 raft_consensus.cc:3060] T 9c77d7b34aa9485aaffe3e77370a6ed6 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.756655 25525 raft_consensus.cc:359] T cd519c6f9fbb43639d5d8ff2f4b209ae P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.757647 25520 tablet_bootstrap.cc:492] T cd519c6f9fbb43639d5d8ff2f4b209ae P 02a30f2f37194042b6ad292011c47d0d: No bootstrap required, opened a new log
I20260709 12:12:50.757683 25525 raft_consensus.cc:385] T cd519c6f9fbb43639d5d8ff2f4b209ae P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.758189 25525 raft_consensus.cc:740] T cd519c6f9fbb43639d5d8ff2f4b209ae P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d44497c5c04c55a6b9dae701b63b2b, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.758323 25520 ts_tablet_manager.cc:1403] T cd519c6f9fbb43639d5d8ff2f4b209ae P 02a30f2f37194042b6ad292011c47d0d: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.009s
I20260709 12:12:50.759490 25521 tablet_bootstrap.cc:492] T d41ae1092f594947838fb70e9d29df68 P 52e12d0cb9004693ba368ceb7fac2259: No bootstrap required, opened a new log
I20260709 12:12:50.759081 25525 consensus_queue.cc:260] T cd519c6f9fbb43639d5d8ff2f4b209ae P f7d44497c5c04c55a6b9dae701b63b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.759991 25521 ts_tablet_manager.cc:1403] T d41ae1092f594947838fb70e9d29df68 P 52e12d0cb9004693ba368ceb7fac2259: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.002s
I20260709 12:12:50.761435 25520 raft_consensus.cc:359] T cd519c6f9fbb43639d5d8ff2f4b209ae P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.762233 25481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c77d7b34aa9485aaffe3e77370a6ed6" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02a30f2f37194042b6ad292011c47d0d"
I20260709 12:12:50.762933 25481 raft_consensus.cc:3060] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.763460 25521 raft_consensus.cc:359] T d41ae1092f594947838fb70e9d29df68 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.764173 25521 raft_consensus.cc:385] T d41ae1092f594947838fb70e9d29df68 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.764441 25521 raft_consensus.cc:740] T d41ae1092f594947838fb70e9d29df68 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.765416 25407 raft_consensus.cc:2468] T 9c77d7b34aa9485aaffe3e77370a6ed6 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 1.
I20260709 12:12:50.765142 25521 consensus_queue.cc:260] T d41ae1092f594947838fb70e9d29df68 P 52e12d0cb9004693ba368ceb7fac2259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.766489 25295 leader_election.cc:304] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52e12d0cb9004693ba368ceb7fac2259, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 
I20260709 12:12:50.767241 25525 ts_tablet_manager.cc:1434] T cd519c6f9fbb43639d5d8ff2f4b209ae P f7d44497c5c04c55a6b9dae701b63b2b: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.004s
I20260709 12:12:50.767398 25528 raft_consensus.cc:2804] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:50.767789 25521 ts_tablet_manager.cc:1434] T d41ae1092f594947838fb70e9d29df68 P 52e12d0cb9004693ba368ceb7fac2259: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:12:50.768107 25528 raft_consensus.cc:697] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 LEADER]: Becoming Leader. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Running, Role: LEADER
I20260709 12:12:50.768999 25521 tablet_bootstrap.cc:492] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 52e12d0cb9004693ba368ceb7fac2259: Bootstrap starting.
I20260709 12:12:50.769435 25528 consensus_queue.cc:237] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.770659 25481 raft_consensus.cc:2468] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 1.
I20260709 12:12:50.768464 25525 tablet_bootstrap.cc:492] T 3e0f3f615e7f41179a2f6577f271163c P f7d44497c5c04c55a6b9dae701b63b2b: Bootstrap starting.
I20260709 12:12:50.762240 25520 raft_consensus.cc:385] T cd519c6f9fbb43639d5d8ff2f4b209ae P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.775986 25521 tablet_bootstrap.cc:654] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 52e12d0cb9004693ba368ceb7fac2259: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.775976 25520 raft_consensus.cc:740] T cd519c6f9fbb43639d5d8ff2f4b209ae P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02a30f2f37194042b6ad292011c47d0d, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.777004 25520 consensus_queue.cc:260] T cd519c6f9fbb43639d5d8ff2f4b209ae P 02a30f2f37194042b6ad292011c47d0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.780516 25525 tablet_bootstrap.cc:654] T 3e0f3f615e7f41179a2f6577f271163c P f7d44497c5c04c55a6b9dae701b63b2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.782814 25520 ts_tablet_manager.cc:1434] T cd519c6f9fbb43639d5d8ff2f4b209ae P 02a30f2f37194042b6ad292011c47d0d: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260709 12:12:50.785842 25520 tablet_bootstrap.cc:492] T 3e0f3f615e7f41179a2f6577f271163c P 02a30f2f37194042b6ad292011c47d0d: Bootstrap starting.
I20260709 12:12:50.787777 25521 tablet_bootstrap.cc:492] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 52e12d0cb9004693ba368ceb7fac2259: No bootstrap required, opened a new log
I20260709 12:12:50.788393 25521 ts_tablet_manager.cc:1403] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 52e12d0cb9004693ba368ceb7fac2259: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.003s
I20260709 12:12:50.791055 25521 raft_consensus.cc:359] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.791893 25521 raft_consensus.cc:385] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.792256 25521 raft_consensus.cc:740] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.793116 25521 consensus_queue.cc:260] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 52e12d0cb9004693ba368ceb7fac2259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.791529 25520 tablet_bootstrap.cc:654] T 3e0f3f615e7f41179a2f6577f271163c P 02a30f2f37194042b6ad292011c47d0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.798063 25521 ts_tablet_manager.cc:1434] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 52e12d0cb9004693ba368ceb7fac2259: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:12:50.799064 25521 tablet_bootstrap.cc:492] T 1afdcff9cddc469981a2e16a4626e663 P 52e12d0cb9004693ba368ceb7fac2259: Bootstrap starting.
I20260709 12:12:50.807396 25521 tablet_bootstrap.cc:654] T 1afdcff9cddc469981a2e16a4626e663 P 52e12d0cb9004693ba368ceb7fac2259: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.810761 25525 tablet_bootstrap.cc:492] T 3e0f3f615e7f41179a2f6577f271163c P f7d44497c5c04c55a6b9dae701b63b2b: No bootstrap required, opened a new log
I20260709 12:12:50.811465 25525 ts_tablet_manager.cc:1403] T 3e0f3f615e7f41179a2f6577f271163c P f7d44497c5c04c55a6b9dae701b63b2b: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.006s
I20260709 12:12:50.814239 25530 raft_consensus.cc:493] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.814888 25530 raft_consensus.cc:515] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.821444 25520 tablet_bootstrap.cc:492] T 3e0f3f615e7f41179a2f6577f271163c P 02a30f2f37194042b6ad292011c47d0d: No bootstrap required, opened a new log
I20260709 12:12:50.822057 25520 ts_tablet_manager.cc:1403] T 3e0f3f615e7f41179a2f6577f271163c P 02a30f2f37194042b6ad292011c47d0d: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.012s
I20260709 12:12:50.820426 25525 raft_consensus.cc:359] T 3e0f3f615e7f41179a2f6577f271163c P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } } peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } }
I20260709 12:12:50.822701 25530 leader_election.cc:290] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P f7d44497c5c04c55a6b9dae701b63b2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:50.822085 25521 tablet_bootstrap.cc:492] T 1afdcff9cddc469981a2e16a4626e663 P 52e12d0cb9004693ba368ceb7fac2259: No bootstrap required, opened a new log
I20260709 12:12:50.822865 25525 raft_consensus.cc:385] T 3e0f3f615e7f41179a2f6577f271163c P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.826335 25525 raft_consensus.cc:740] T 3e0f3f615e7f41179a2f6577f271163c P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d44497c5c04c55a6b9dae701b63b2b, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.826423 25521 ts_tablet_manager.cc:1403] T 1afdcff9cddc469981a2e16a4626e663 P 52e12d0cb9004693ba368ceb7fac2259: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.011s
I20260709 12:12:50.827363 25525 consensus_queue.cc:260] T 3e0f3f615e7f41179a2f6577f271163c P f7d44497c5c04c55a6b9dae701b63b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } } peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } }
I20260709 12:12:50.829777 25230 catalog_manager.cc:5697] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 52e12d0cb9004693ba368ceb7fac2259 reported cstate change: term changed from 0 to 1, leader changed from <none> to 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193). New cstate: current_term: 1 leader_uuid: "52e12d0cb9004693ba368ceb7fac2259" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:50.829771 25525 ts_tablet_manager.cc:1434] T 3e0f3f615e7f41179a2f6577f271163c P f7d44497c5c04c55a6b9dae701b63b2b: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 12:12:50.832173 25525 tablet_bootstrap.cc:492] T d41ae1092f594947838fb70e9d29df68 P f7d44497c5c04c55a6b9dae701b63b2b: Bootstrap starting.
I20260709 12:12:50.835919 25521 raft_consensus.cc:359] T 1afdcff9cddc469981a2e16a4626e663 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.836798 25521 raft_consensus.cc:385] T 1afdcff9cddc469981a2e16a4626e663 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.837162 25528 raft_consensus.cc:493] T 87740656475e4780a6fd2c222a2e2dce P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.839222 25521 raft_consensus.cc:740] T 1afdcff9cddc469981a2e16a4626e663 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.839686 25525 tablet_bootstrap.cc:654] T d41ae1092f594947838fb70e9d29df68 P f7d44497c5c04c55a6b9dae701b63b2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.839368 25528 raft_consensus.cc:515] T 87740656475e4780a6fd2c222a2e2dce P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.841607 25528 leader_election.cc:290] T 87740656475e4780a6fd2c222a2e2dce P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:50.841639 25521 consensus_queue.cc:260] T 1afdcff9cddc469981a2e16a4626e663 P 52e12d0cb9004693ba368ceb7fac2259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.825500 25520 raft_consensus.cc:359] T 3e0f3f615e7f41179a2f6577f271163c P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } } peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } }
I20260709 12:12:50.842895 25520 raft_consensus.cc:385] T 3e0f3f615e7f41179a2f6577f271163c P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.843300 25520 raft_consensus.cc:740] T 3e0f3f615e7f41179a2f6577f271163c P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02a30f2f37194042b6ad292011c47d0d, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.844383 25521 ts_tablet_manager.cc:1434] T 1afdcff9cddc469981a2e16a4626e663 P 52e12d0cb9004693ba368ceb7fac2259: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:12:50.844424 25520 consensus_queue.cc:260] T 3e0f3f615e7f41179a2f6577f271163c P 02a30f2f37194042b6ad292011c47d0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } } peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } }
I20260709 12:12:50.845481 25521 tablet_bootstrap.cc:492] T 3e0f3f615e7f41179a2f6577f271163c P 52e12d0cb9004693ba368ceb7fac2259: Bootstrap starting.
I20260709 12:12:50.847886 25407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87740656475e4780a6fd2c222a2e2dce" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" is_pre_election: true
W20260709 12:12:50.849815 25295 leader_election.cc:343] T 87740656475e4780a6fd2c222a2e2dce P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.851888 25521 tablet_bootstrap.cc:654] T 3e0f3f615e7f41179a2f6577f271163c P 52e12d0cb9004693ba368ceb7fac2259: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.853431 25332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca26bcb25244e1fb8ad01b0e0de68b7" candidate_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52e12d0cb9004693ba368ceb7fac2259" is_pre_election: true
I20260709 12:12:50.854106 25332 raft_consensus.cc:2468] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7d44497c5c04c55a6b9dae701b63b2b in term 0.
I20260709 12:12:50.856495 25520 ts_tablet_manager.cc:1434] T 3e0f3f615e7f41179a2f6577f271163c P 02a30f2f37194042b6ad292011c47d0d: Time spent starting tablet: real 0.034s	user 0.003s	sys 0.003s
I20260709 12:12:50.859264 25370 leader_election.cc:304] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P f7d44497c5c04c55a6b9dae701b63b2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52e12d0cb9004693ba368ceb7fac2259, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 
I20260709 12:12:50.860601 25530 raft_consensus.cc:2804] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:50.861074 25530 raft_consensus.cc:493] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.861251 25523 raft_consensus.cc:493] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.861552 25530 raft_consensus.cc:3060] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.862001 25523 raft_consensus.cc:515] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.864784 25523 leader_election.cc:290] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391), f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825)
I20260709 12:12:50.866573 25332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9445bca58d1d420eb940aed38f953894" candidate_uuid: "02a30f2f37194042b6ad292011c47d0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52e12d0cb9004693ba368ceb7fac2259" is_pre_election: true
I20260709 12:12:50.867472 25332 raft_consensus.cc:2468] T 9445bca58d1d420eb940aed38f953894 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02a30f2f37194042b6ad292011c47d0d in term 0.
I20260709 12:12:50.868804 25407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9445bca58d1d420eb940aed38f953894" candidate_uuid: "02a30f2f37194042b6ad292011c47d0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" is_pre_election: true
I20260709 12:12:50.869652 25407 raft_consensus.cc:2468] T 9445bca58d1d420eb940aed38f953894 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02a30f2f37194042b6ad292011c47d0d in term 0.
I20260709 12:12:50.870010 25520 tablet_bootstrap.cc:492] T 87740656475e4780a6fd2c222a2e2dce P 02a30f2f37194042b6ad292011c47d0d: Bootstrap starting.
I20260709 12:12:50.871344 25444 leader_election.cc:304] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02a30f2f37194042b6ad292011c47d0d, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 
I20260709 12:12:50.872699 25528 raft_consensus.cc:493] T 1afdcff9cddc469981a2e16a4626e663 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.873189 25528 raft_consensus.cc:515] T 1afdcff9cddc469981a2e16a4626e663 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.873688 25523 raft_consensus.cc:2804] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:50.874084 25523 raft_consensus.cc:493] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.874401 25523 raft_consensus.cc:3060] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.875278 25528 leader_election.cc:290] T 1afdcff9cddc469981a2e16a4626e663 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:50.843349 25481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87740656475e4780a6fd2c222a2e2dce" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02a30f2f37194042b6ad292011c47d0d" is_pre_election: true
I20260709 12:12:50.877400 25481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1afdcff9cddc469981a2e16a4626e663" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02a30f2f37194042b6ad292011c47d0d" is_pre_election: true
I20260709 12:12:50.878363 25520 tablet_bootstrap.cc:654] T 87740656475e4780a6fd2c222a2e2dce P 02a30f2f37194042b6ad292011c47d0d: Neither blocks nor log segments found. Creating new log.
W20260709 12:12:50.882840 25297 leader_election.cc:343] T 87740656475e4780a6fd2c222a2e2dce P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:50.883489 25297 leader_election.cc:304] T 87740656475e4780a6fd2c222a2e2dce P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 52e12d0cb9004693ba368ceb7fac2259; no voters: 02a30f2f37194042b6ad292011c47d0d, f7d44497c5c04c55a6b9dae701b63b2b
I20260709 12:12:50.884701 25528 raft_consensus.cc:2749] T 87740656475e4780a6fd2c222a2e2dce P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:50.886911 25407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1afdcff9cddc469981a2e16a4626e663" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" is_pre_election: true
I20260709 12:12:50.888058 25407 raft_consensus.cc:2393] T 1afdcff9cddc469981a2e16a4626e663 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 52e12d0cb9004693ba368ceb7fac2259 in current term 1: Already voted for candidate 02a30f2f37194042b6ad292011c47d0d in this term.
I20260709 12:12:50.889442 25295 leader_election.cc:304] T 1afdcff9cddc469981a2e16a4626e663 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 52e12d0cb9004693ba368ceb7fac2259; no voters: 02a30f2f37194042b6ad292011c47d0d, f7d44497c5c04c55a6b9dae701b63b2b
I20260709 12:12:50.890547 25528 raft_consensus.cc:3060] T 1afdcff9cddc469981a2e16a4626e663 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.897636 25528 raft_consensus.cc:2749] T 1afdcff9cddc469981a2e16a4626e663 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:50.911151 25523 raft_consensus.cc:515] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.913951 25523 leader_election.cc:290] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d [CANDIDATE]: Term 1 election: Requested vote from peers 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391), f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825)
I20260709 12:12:50.906458 25530 raft_consensus.cc:515] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.915097 25525 tablet_bootstrap.cc:492] T d41ae1092f594947838fb70e9d29df68 P f7d44497c5c04c55a6b9dae701b63b2b: No bootstrap required, opened a new log
I20260709 12:12:50.915467 25332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9445bca58d1d420eb940aed38f953894" candidate_uuid: "02a30f2f37194042b6ad292011c47d0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52e12d0cb9004693ba368ceb7fac2259"
I20260709 12:12:50.916079 25332 raft_consensus.cc:3060] T 9445bca58d1d420eb940aed38f953894 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.916420 25525 ts_tablet_manager.cc:1403] T d41ae1092f594947838fb70e9d29df68 P f7d44497c5c04c55a6b9dae701b63b2b: Time spent bootstrapping tablet: real 0.084s	user 0.022s	sys 0.056s
I20260709 12:12:50.917245 25331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca26bcb25244e1fb8ad01b0e0de68b7" candidate_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52e12d0cb9004693ba368ceb7fac2259"
I20260709 12:12:50.917959 25331 raft_consensus.cc:3060] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.921322 25525 raft_consensus.cc:359] T d41ae1092f594947838fb70e9d29df68 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.923636 25407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9445bca58d1d420eb940aed38f953894" candidate_uuid: "02a30f2f37194042b6ad292011c47d0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
I20260709 12:12:50.927368 25525 raft_consensus.cc:385] T d41ae1092f594947838fb70e9d29df68 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.927990 25481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca26bcb25244e1fb8ad01b0e0de68b7" candidate_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02a30f2f37194042b6ad292011c47d0d" is_pre_election: true
I20260709 12:12:50.928689 25481 raft_consensus.cc:2468] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7d44497c5c04c55a6b9dae701b63b2b in term 0.
I20260709 12:12:50.924244 25332 raft_consensus.cc:2468] T 9445bca58d1d420eb940aed38f953894 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02a30f2f37194042b6ad292011c47d0d in term 1.
I20260709 12:12:50.925383 25567 raft_consensus.cc:493] T 3e0f3f615e7f41179a2f6577f271163c P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.929567 25480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca26bcb25244e1fb8ad01b0e0de68b7" candidate_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02a30f2f37194042b6ad292011c47d0d"
I20260709 12:12:50.930294 25480 raft_consensus.cc:3060] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.930198 25444 leader_election.cc:304] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02a30f2f37194042b6ad292011c47d0d, 52e12d0cb9004693ba368ceb7fac2259; no voters: 
I20260709 12:12:50.929926 25567 raft_consensus.cc:515] T 3e0f3f615e7f41179a2f6577f271163c P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } } peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } }
I20260709 12:12:50.931527 25521 tablet_bootstrap.cc:492] T 3e0f3f615e7f41179a2f6577f271163c P 52e12d0cb9004693ba368ceb7fac2259: No bootstrap required, opened a new log
I20260709 12:12:50.932188 25521 ts_tablet_manager.cc:1403] T 3e0f3f615e7f41179a2f6577f271163c P 52e12d0cb9004693ba368ceb7fac2259: Time spent bootstrapping tablet: real 0.087s	user 0.025s	sys 0.047s
I20260709 12:12:50.933353 25567 leader_election.cc:290] T 3e0f3f615e7f41179a2f6577f271163c P f7d44497c5c04c55a6b9dae701b63b2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011), 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391)
I20260709 12:12:50.927984 25525 raft_consensus.cc:740] T d41ae1092f594947838fb70e9d29df68 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d44497c5c04c55a6b9dae701b63b2b, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.934706 25525 consensus_queue.cc:260] T d41ae1092f594947838fb70e9d29df68 P f7d44497c5c04c55a6b9dae701b63b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.935417 25521 raft_consensus.cc:359] T 3e0f3f615e7f41179a2f6577f271163c P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } } peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } }
I20260709 12:12:50.936120 25521 raft_consensus.cc:385] T 3e0f3f615e7f41179a2f6577f271163c P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.936414 25521 raft_consensus.cc:740] T 3e0f3f615e7f41179a2f6577f271163c P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.936764 25525 ts_tablet_manager.cc:1434] T d41ae1092f594947838fb70e9d29df68 P f7d44497c5c04c55a6b9dae701b63b2b: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:12:50.937103 25530 leader_election.cc:290] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P f7d44497c5c04c55a6b9dae701b63b2b [CANDIDATE]: Term 1 election: Requested vote from peers 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:50.937882 25520 tablet_bootstrap.cc:492] T 87740656475e4780a6fd2c222a2e2dce P 02a30f2f37194042b6ad292011c47d0d: No bootstrap required, opened a new log
I20260709 12:12:50.937979 25480 raft_consensus.cc:2468] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d44497c5c04c55a6b9dae701b63b2b in term 1.
I20260709 12:12:50.937659 25525 tablet_bootstrap.cc:492] T 87740656475e4780a6fd2c222a2e2dce P f7d44497c5c04c55a6b9dae701b63b2b: Bootstrap starting.
I20260709 12:12:50.938442 25520 ts_tablet_manager.cc:1403] T 87740656475e4780a6fd2c222a2e2dce P 02a30f2f37194042b6ad292011c47d0d: Time spent bootstrapping tablet: real 0.069s	user 0.029s	sys 0.008s
I20260709 12:12:50.937170 25521 consensus_queue.cc:260] T 3e0f3f615e7f41179a2f6577f271163c P 52e12d0cb9004693ba368ceb7fac2259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } } peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } }
I20260709 12:12:50.940354 25372 leader_election.cc:304] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P f7d44497c5c04c55a6b9dae701b63b2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02a30f2f37194042b6ad292011c47d0d, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 
I20260709 12:12:50.941409 25481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e0f3f615e7f41179a2f6577f271163c" candidate_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02a30f2f37194042b6ad292011c47d0d" is_pre_election: true
I20260709 12:12:50.942131 25481 raft_consensus.cc:2468] T 3e0f3f615e7f41179a2f6577f271163c P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7d44497c5c04c55a6b9dae701b63b2b in term 0.
I20260709 12:12:50.942709 25528 raft_consensus.cc:493] T 3e0f3f615e7f41179a2f6577f271163c P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.943195 25528 raft_consensus.cc:515] T 3e0f3f615e7f41179a2f6577f271163c P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } } peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } }
I20260709 12:12:50.944101 25332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e0f3f615e7f41179a2f6577f271163c" candidate_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52e12d0cb9004693ba368ceb7fac2259" is_pre_election: true
I20260709 12:12:50.944748 25332 raft_consensus.cc:2468] T 3e0f3f615e7f41179a2f6577f271163c P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7d44497c5c04c55a6b9dae701b63b2b in term 0.
I20260709 12:12:50.945189 25525 tablet_bootstrap.cc:654] T 87740656475e4780a6fd2c222a2e2dce P f7d44497c5c04c55a6b9dae701b63b2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.945292 25528 leader_election.cc:290] T 3e0f3f615e7f41179a2f6577f271163c P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011), f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825)
I20260709 12:12:50.946175 25372 leader_election.cc:304] T 3e0f3f615e7f41179a2f6577f271163c P f7d44497c5c04c55a6b9dae701b63b2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02a30f2f37194042b6ad292011c47d0d, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 
I20260709 12:12:50.946741 25481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e0f3f615e7f41179a2f6577f271163c" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02a30f2f37194042b6ad292011c47d0d" is_pre_election: true
I20260709 12:12:50.946884 25406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e0f3f615e7f41179a2f6577f271163c" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" is_pre_election: true
I20260709 12:12:50.946990 25567 raft_consensus.cc:2804] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:50.947597 25406 raft_consensus.cc:2468] T 3e0f3f615e7f41179a2f6577f271163c P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 0.
I20260709 12:12:50.947064 25528 raft_consensus.cc:493] T d41ae1092f594947838fb70e9d29df68 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:50.941439 25520 raft_consensus.cc:359] T 87740656475e4780a6fd2c222a2e2dce P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.948366 25481 raft_consensus.cc:2468] T 3e0f3f615e7f41179a2f6577f271163c P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 0.
I20260709 12:12:50.948577 25520 raft_consensus.cc:385] T 87740656475e4780a6fd2c222a2e2dce P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:50.948271 25528 raft_consensus.cc:515] T d41ae1092f594947838fb70e9d29df68 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.948948 25520 raft_consensus.cc:740] T 87740656475e4780a6fd2c222a2e2dce P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02a30f2f37194042b6ad292011c47d0d, State: Initialized, Role: FOLLOWER
I20260709 12:12:50.949231 25295 leader_election.cc:304] T 3e0f3f615e7f41179a2f6577f271163c P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52e12d0cb9004693ba368ceb7fac2259, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 
I20260709 12:12:50.927456 25407 raft_consensus.cc:3060] T 9445bca58d1d420eb940aed38f953894 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.949761 25520 consensus_queue.cc:260] T 87740656475e4780a6fd2c222a2e2dce P 02a30f2f37194042b6ad292011c47d0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.950492 25547 raft_consensus.cc:2804] T 3e0f3f615e7f41179a2f6577f271163c P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:50.950838 25542 raft_consensus.cc:2804] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:50.951788 25542 raft_consensus.cc:697] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d [term 1 LEADER]: Becoming Leader. State: Replica: 02a30f2f37194042b6ad292011c47d0d, State: Running, Role: LEADER
I20260709 12:12:50.952041 25520 ts_tablet_manager.cc:1434] T 87740656475e4780a6fd2c222a2e2dce P 02a30f2f37194042b6ad292011c47d0d: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:12:50.951896 25528 leader_election.cc:290] T d41ae1092f594947838fb70e9d29df68 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:50.942726 25521 ts_tablet_manager.cc:1434] T 3e0f3f615e7f41179a2f6577f271163c P 52e12d0cb9004693ba368ceb7fac2259: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:12:50.952800 25542 consensus_queue.cc:237] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.953866 25521 tablet_bootstrap.cc:492] T cd519c6f9fbb43639d5d8ff2f4b209ae P 52e12d0cb9004693ba368ceb7fac2259: Bootstrap starting.
I20260709 12:12:50.950906 25547 raft_consensus.cc:493] T 3e0f3f615e7f41179a2f6577f271163c P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.954841 25547 raft_consensus.cc:3060] T 3e0f3f615e7f41179a2f6577f271163c P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.957501 25406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d41ae1092f594947838fb70e9d29df68" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" is_pre_election: true
I20260709 12:12:50.958802 25406 raft_consensus.cc:2468] T d41ae1092f594947838fb70e9d29df68 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 0.
I20260709 12:12:50.960227 25295 leader_election.cc:304] T d41ae1092f594947838fb70e9d29df68 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52e12d0cb9004693ba368ceb7fac2259, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 
I20260709 12:12:50.961555 25521 tablet_bootstrap.cc:654] T cd519c6f9fbb43639d5d8ff2f4b209ae P 52e12d0cb9004693ba368ceb7fac2259: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:50.963866 25568 raft_consensus.cc:2804] T 3e0f3f615e7f41179a2f6577f271163c P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:50.964329 25567 raft_consensus.cc:697] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 LEADER]: Becoming Leader. State: Replica: f7d44497c5c04c55a6b9dae701b63b2b, State: Running, Role: LEADER
I20260709 12:12:50.965540 25567 consensus_queue.cc:237] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P f7d44497c5c04c55a6b9dae701b63b2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:50.964301 25481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d41ae1092f594947838fb70e9d29df68" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02a30f2f37194042b6ad292011c47d0d" is_pre_election: true
I20260709 12:12:50.966842 25481 raft_consensus.cc:2468] T d41ae1092f594947838fb70e9d29df68 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 0.
I20260709 12:12:50.926559 25331 raft_consensus.cc:2468] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d44497c5c04c55a6b9dae701b63b2b in term 1.
I20260709 12:12:50.970753 25568 raft_consensus.cc:493] T 3e0f3f615e7f41179a2f6577f271163c P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.971262 25568 raft_consensus.cc:3060] T 3e0f3f615e7f41179a2f6577f271163c P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.966437 25547 raft_consensus.cc:515] T 3e0f3f615e7f41179a2f6577f271163c P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } } peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } }
I20260709 12:12:50.975714 25480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e0f3f615e7f41179a2f6577f271163c" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02a30f2f37194042b6ad292011c47d0d"
I20260709 12:12:50.976337 25480 raft_consensus.cc:3060] T 3e0f3f615e7f41179a2f6577f271163c P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.981772 25407 raft_consensus.cc:2468] T 9445bca58d1d420eb940aed38f953894 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02a30f2f37194042b6ad292011c47d0d in term 1.
I20260709 12:12:50.987001 25547 leader_election.cc:290] T 3e0f3f615e7f41179a2f6577f271163c P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 election: Requested vote from peers 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011), f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825)
I20260709 12:12:50.987792 25547 raft_consensus.cc:2804] T d41ae1092f594947838fb70e9d29df68 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:50.988180 25547 raft_consensus.cc:493] T d41ae1092f594947838fb70e9d29df68 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:50.988600 25547 raft_consensus.cc:3060] T d41ae1092f594947838fb70e9d29df68 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:50.991343 25568 raft_consensus.cc:515] T 3e0f3f615e7f41179a2f6577f271163c P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } } peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } }
I20260709 12:12:50.995240 25230 catalog_manager.cc:5697] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 02a30f2f37194042b6ad292011c47d0d (127.16.98.195). New cstate: current_term: 1 leader_uuid: "02a30f2f37194042b6ad292011c47d0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:51.001798 25481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e0f3f615e7f41179a2f6577f271163c" candidate_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02a30f2f37194042b6ad292011c47d0d"
I20260709 12:12:51.002053 25568 leader_election.cc:290] T 3e0f3f615e7f41179a2f6577f271163c P f7d44497c5c04c55a6b9dae701b63b2b [CANDIDATE]: Term 1 election: Requested vote from peers 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011), 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391)
I20260709 12:12:51.002907 25407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e0f3f615e7f41179a2f6577f271163c" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
I20260709 12:12:51.003077 25480 raft_consensus.cc:2468] T 3e0f3f615e7f41179a2f6577f271163c P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 1.
I20260709 12:12:51.003700 25407 raft_consensus.cc:2393] T 3e0f3f615e7f41179a2f6577f271163c P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 52e12d0cb9004693ba368ceb7fac2259 in current term 1: Already voted for candidate f7d44497c5c04c55a6b9dae701b63b2b in this term.
I20260709 12:12:51.004504 25297 leader_election.cc:304] T 3e0f3f615e7f41179a2f6577f271163c P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02a30f2f37194042b6ad292011c47d0d, 52e12d0cb9004693ba368ceb7fac2259; no voters: 
I20260709 12:12:51.004561 25547 raft_consensus.cc:515] T d41ae1092f594947838fb70e9d29df68 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:51.005162 25528 raft_consensus.cc:2804] T 3e0f3f615e7f41179a2f6577f271163c P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:51.005784 25331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e0f3f615e7f41179a2f6577f271163c" candidate_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52e12d0cb9004693ba368ceb7fac2259"
I20260709 12:12:51.006809 25547 leader_election.cc:290] T d41ae1092f594947838fb70e9d29df68 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 election: Requested vote from peers f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:51.008190 25407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d41ae1092f594947838fb70e9d29df68" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
I20260709 12:12:51.008762 25407 raft_consensus.cc:3060] T d41ae1092f594947838fb70e9d29df68 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.009168 25229 catalog_manager.cc:5697] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P f7d44497c5c04c55a6b9dae701b63b2b reported cstate change: term changed from 0 to 1, leader changed from <none> to f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194). New cstate: current_term: 1 leader_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:51.012916 25480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d41ae1092f594947838fb70e9d29df68" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02a30f2f37194042b6ad292011c47d0d"
I20260709 12:12:51.015892 25407 raft_consensus.cc:2468] T d41ae1092f594947838fb70e9d29df68 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 1.
I20260709 12:12:51.016855 25480 raft_consensus.cc:3060] T d41ae1092f594947838fb70e9d29df68 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.019151 25521 tablet_bootstrap.cc:492] T cd519c6f9fbb43639d5d8ff2f4b209ae P 52e12d0cb9004693ba368ceb7fac2259: No bootstrap required, opened a new log
I20260709 12:12:51.019800 25521 ts_tablet_manager.cc:1403] T cd519c6f9fbb43639d5d8ff2f4b209ae P 52e12d0cb9004693ba368ceb7fac2259: Time spent bootstrapping tablet: real 0.066s	user 0.028s	sys 0.015s
I20260709 12:12:51.017445 25295 leader_election.cc:304] T d41ae1092f594947838fb70e9d29df68 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52e12d0cb9004693ba368ceb7fac2259, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 
I20260709 12:12:51.023140 25547 raft_consensus.cc:2804] T d41ae1092f594947838fb70e9d29df68 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:51.023598 25547 raft_consensus.cc:697] T d41ae1092f594947838fb70e9d29df68 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 LEADER]: Becoming Leader. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Running, Role: LEADER
I20260709 12:12:51.024412 25547 consensus_queue.cc:237] T d41ae1092f594947838fb70e9d29df68 P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:51.026095 25521 raft_consensus.cc:359] T cd519c6f9fbb43639d5d8ff2f4b209ae P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:51.027302 25521 raft_consensus.cc:385] T cd519c6f9fbb43639d5d8ff2f4b209ae P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.016064 25525 tablet_bootstrap.cc:492] T 87740656475e4780a6fd2c222a2e2dce P f7d44497c5c04c55a6b9dae701b63b2b: No bootstrap required, opened a new log
I20260709 12:12:51.027943 25521 raft_consensus.cc:740] T cd519c6f9fbb43639d5d8ff2f4b209ae P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.028251 25525 ts_tablet_manager.cc:1403] T 87740656475e4780a6fd2c222a2e2dce P f7d44497c5c04c55a6b9dae701b63b2b: Time spent bootstrapping tablet: real 0.091s	user 0.009s	sys 0.015s
I20260709 12:12:51.030683 25521 consensus_queue.cc:260] T cd519c6f9fbb43639d5d8ff2f4b209ae P 52e12d0cb9004693ba368ceb7fac2259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:51.031679 25480 raft_consensus.cc:2468] T d41ae1092f594947838fb70e9d29df68 P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 1.
I20260709 12:12:51.034971 25528 raft_consensus.cc:697] T 3e0f3f615e7f41179a2f6577f271163c P 52e12d0cb9004693ba368ceb7fac2259 [term 1 LEADER]: Becoming Leader. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Running, Role: LEADER
I20260709 12:12:51.036664 25528 consensus_queue.cc:237] T 3e0f3f615e7f41179a2f6577f271163c P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } } peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } }
I20260709 12:12:51.037379 25521 ts_tablet_manager.cc:1434] T cd519c6f9fbb43639d5d8ff2f4b209ae P 52e12d0cb9004693ba368ceb7fac2259: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:12:51.038523 25568 raft_consensus.cc:493] T cd519c6f9fbb43639d5d8ff2f4b209ae P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.035203 25525 raft_consensus.cc:359] T 87740656475e4780a6fd2c222a2e2dce P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:51.039734 25525 raft_consensus.cc:385] T 87740656475e4780a6fd2c222a2e2dce P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:51.039222 25568 raft_consensus.cc:515] T cd519c6f9fbb43639d5d8ff2f4b209ae P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:51.040053 25525 raft_consensus.cc:740] T 87740656475e4780a6fd2c222a2e2dce P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d44497c5c04c55a6b9dae701b63b2b, State: Initialized, Role: FOLLOWER
I20260709 12:12:51.040904 25525 consensus_queue.cc:260] T 87740656475e4780a6fd2c222a2e2dce P f7d44497c5c04c55a6b9dae701b63b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:51.043192 25525 ts_tablet_manager.cc:1434] T 87740656475e4780a6fd2c222a2e2dce P f7d44497c5c04c55a6b9dae701b63b2b: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:12:51.043660 25568 leader_election.cc:290] T cd519c6f9fbb43639d5d8ff2f4b209ae P f7d44497c5c04c55a6b9dae701b63b2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:51.044253 25332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd519c6f9fbb43639d5d8ff2f4b209ae" candidate_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52e12d0cb9004693ba368ceb7fac2259" is_pre_election: true
I20260709 12:12:51.044485 25480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd519c6f9fbb43639d5d8ff2f4b209ae" candidate_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02a30f2f37194042b6ad292011c47d0d" is_pre_election: true
I20260709 12:12:51.044934 25332 raft_consensus.cc:2468] T cd519c6f9fbb43639d5d8ff2f4b209ae P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7d44497c5c04c55a6b9dae701b63b2b in term 0.
I20260709 12:12:51.045120 25480 raft_consensus.cc:2468] T cd519c6f9fbb43639d5d8ff2f4b209ae P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7d44497c5c04c55a6b9dae701b63b2b in term 0.
I20260709 12:12:51.045918 25370 leader_election.cc:304] T cd519c6f9fbb43639d5d8ff2f4b209ae P f7d44497c5c04c55a6b9dae701b63b2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52e12d0cb9004693ba368ceb7fac2259, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 
I20260709 12:12:51.046613 25568 raft_consensus.cc:2804] T cd519c6f9fbb43639d5d8ff2f4b209ae P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:51.046995 25568 raft_consensus.cc:493] T cd519c6f9fbb43639d5d8ff2f4b209ae P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.047353 25568 raft_consensus.cc:3060] T cd519c6f9fbb43639d5d8ff2f4b209ae P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.050734 25370 leader_election.cc:304] T 3e0f3f615e7f41179a2f6577f271163c P f7d44497c5c04c55a6b9dae701b63b2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f7d44497c5c04c55a6b9dae701b63b2b; no voters: 02a30f2f37194042b6ad292011c47d0d, 52e12d0cb9004693ba368ceb7fac2259
I20260709 12:12:51.051600 25567 raft_consensus.cc:2749] T 3e0f3f615e7f41179a2f6577f271163c P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:12:51.053434 25229 catalog_manager.cc:5697] T 3e0f3f615e7f41179a2f6577f271163c P 52e12d0cb9004693ba368ceb7fac2259 reported cstate change: term changed from 0 to 1, leader changed from <none> to 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193). New cstate: current_term: 1 leader_uuid: "52e12d0cb9004693ba368ceb7fac2259" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:51.059108 25568 raft_consensus.cc:515] T cd519c6f9fbb43639d5d8ff2f4b209ae P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:51.061842 25331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd519c6f9fbb43639d5d8ff2f4b209ae" candidate_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52e12d0cb9004693ba368ceb7fac2259"
I20260709 12:12:51.062321 25331 raft_consensus.cc:3060] T cd519c6f9fbb43639d5d8ff2f4b209ae P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.062881 25568 leader_election.cc:290] T cd519c6f9fbb43639d5d8ff2f4b209ae P f7d44497c5c04c55a6b9dae701b63b2b [CANDIDATE]: Term 1 election: Requested vote from peers 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:51.063441 25480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd519c6f9fbb43639d5d8ff2f4b209ae" candidate_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02a30f2f37194042b6ad292011c47d0d"
I20260709 12:12:51.063989 25480 raft_consensus.cc:3060] T cd519c6f9fbb43639d5d8ff2f4b209ae P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.068854 25331 raft_consensus.cc:2468] T cd519c6f9fbb43639d5d8ff2f4b209ae P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d44497c5c04c55a6b9dae701b63b2b in term 1.
I20260709 12:12:51.069931 25370 leader_election.cc:304] T cd519c6f9fbb43639d5d8ff2f4b209ae P f7d44497c5c04c55a6b9dae701b63b2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52e12d0cb9004693ba368ceb7fac2259, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 
I20260709 12:12:51.070716 25568 raft_consensus.cc:2804] T cd519c6f9fbb43639d5d8ff2f4b209ae P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:51.071069 25480 raft_consensus.cc:2468] T cd519c6f9fbb43639d5d8ff2f4b209ae P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d44497c5c04c55a6b9dae701b63b2b in term 1.
I20260709 12:12:51.071193 25568 raft_consensus.cc:697] T cd519c6f9fbb43639d5d8ff2f4b209ae P f7d44497c5c04c55a6b9dae701b63b2b [term 1 LEADER]: Becoming Leader. State: Replica: f7d44497c5c04c55a6b9dae701b63b2b, State: Running, Role: LEADER
I20260709 12:12:51.072736 25568 consensus_queue.cc:237] T cd519c6f9fbb43639d5d8ff2f4b209ae P f7d44497c5c04c55a6b9dae701b63b2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:51.074390 25229 catalog_manager.cc:5697] T d41ae1092f594947838fb70e9d29df68 P 52e12d0cb9004693ba368ceb7fac2259 reported cstate change: term changed from 0 to 1, leader changed from <none> to 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193). New cstate: current_term: 1 leader_uuid: "52e12d0cb9004693ba368ceb7fac2259" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:51.083141 25230 catalog_manager.cc:5697] T cd519c6f9fbb43639d5d8ff2f4b209ae P f7d44497c5c04c55a6b9dae701b63b2b reported cstate change: term changed from 0 to 1, leader changed from <none> to f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194). New cstate: current_term: 1 leader_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:51.102135 25547 consensus_queue.cc:1048] T 68e0c0233618497787f44d50e1ebb6f1 P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:51.113516 25547 consensus_queue.cc:1048] T 68e0c0233618497787f44d50e1ebb6f1 P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:51.227270 25523 consensus_queue.cc:1048] T 1afdcff9cddc469981a2e16a4626e663 P 02a30f2f37194042b6ad292011c47d0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:51.237506 25523 consensus_queue.cc:1048] T 1afdcff9cddc469981a2e16a4626e663 P 02a30f2f37194042b6ad292011c47d0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:51.266475 25547 consensus_queue.cc:1048] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:51.276998 25528 consensus_queue.cc:1048] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:51.279930 25567 raft_consensus.cc:493] T 87740656475e4780a6fd2c222a2e2dce P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:51.280411 25567 raft_consensus.cc:515] T 87740656475e4780a6fd2c222a2e2dce P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:51.282545 25567 leader_election.cc:290] T 87740656475e4780a6fd2c222a2e2dce P f7d44497c5c04c55a6b9dae701b63b2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:51.284081 25480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87740656475e4780a6fd2c222a2e2dce" candidate_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02a30f2f37194042b6ad292011c47d0d" is_pre_election: true
I20260709 12:12:51.284781 25480 raft_consensus.cc:2468] T 87740656475e4780a6fd2c222a2e2dce P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7d44497c5c04c55a6b9dae701b63b2b in term 0.
I20260709 12:12:51.284906 25331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87740656475e4780a6fd2c222a2e2dce" candidate_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52e12d0cb9004693ba368ceb7fac2259" is_pre_election: true
I20260709 12:12:51.285917 25331 raft_consensus.cc:2468] T 87740656475e4780a6fd2c222a2e2dce P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7d44497c5c04c55a6b9dae701b63b2b in term 0.
I20260709 12:12:51.285851 25372 leader_election.cc:304] T 87740656475e4780a6fd2c222a2e2dce P f7d44497c5c04c55a6b9dae701b63b2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02a30f2f37194042b6ad292011c47d0d, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 
I20260709 12:12:51.286794 25567 raft_consensus.cc:2804] T 87740656475e4780a6fd2c222a2e2dce P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:51.287173 25567 raft_consensus.cc:493] T 87740656475e4780a6fd2c222a2e2dce P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:51.287510 25567 raft_consensus.cc:3060] T 87740656475e4780a6fd2c222a2e2dce P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.293659 25567 raft_consensus.cc:515] T 87740656475e4780a6fd2c222a2e2dce P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:51.295778 25567 leader_election.cc:290] T 87740656475e4780a6fd2c222a2e2dce P f7d44497c5c04c55a6b9dae701b63b2b [CANDIDATE]: Term 1 election: Requested vote from peers 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:51.296419 25331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87740656475e4780a6fd2c222a2e2dce" candidate_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52e12d0cb9004693ba368ceb7fac2259"
I20260709 12:12:51.296953 25331 raft_consensus.cc:3060] T 87740656475e4780a6fd2c222a2e2dce P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.301807 25331 raft_consensus.cc:2468] T 87740656475e4780a6fd2c222a2e2dce P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d44497c5c04c55a6b9dae701b63b2b in term 1.
I20260709 12:12:51.301714 25480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87740656475e4780a6fd2c222a2e2dce" candidate_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02a30f2f37194042b6ad292011c47d0d"
I20260709 12:12:51.302696 25480 raft_consensus.cc:3060] T 87740656475e4780a6fd2c222a2e2dce P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:51.303145 25370 leader_election.cc:304] T 87740656475e4780a6fd2c222a2e2dce P f7d44497c5c04c55a6b9dae701b63b2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52e12d0cb9004693ba368ceb7fac2259, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 
I20260709 12:12:51.303968 25567 raft_consensus.cc:2804] T 87740656475e4780a6fd2c222a2e2dce P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:51.304391 25567 raft_consensus.cc:697] T 87740656475e4780a6fd2c222a2e2dce P f7d44497c5c04c55a6b9dae701b63b2b [term 1 LEADER]: Becoming Leader. State: Replica: f7d44497c5c04c55a6b9dae701b63b2b, State: Running, Role: LEADER
I20260709 12:12:51.305119 25567 consensus_queue.cc:237] T 87740656475e4780a6fd2c222a2e2dce P f7d44497c5c04c55a6b9dae701b63b2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:51.311363 25480 raft_consensus.cc:2468] T 87740656475e4780a6fd2c222a2e2dce P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d44497c5c04c55a6b9dae701b63b2b in term 1.
I20260709 12:12:51.312052 25229 catalog_manager.cc:5697] T 87740656475e4780a6fd2c222a2e2dce P f7d44497c5c04c55a6b9dae701b63b2b reported cstate change: term changed from 0 to 1, leader changed from <none> to f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194). New cstate: current_term: 1 leader_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:51.359422 25583 consensus_queue.cc:1048] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:51.370798 25583 consensus_queue.cc:1048] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:51.406049 25567 consensus_queue.cc:1048] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P f7d44497c5c04c55a6b9dae701b63b2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:51.416530 25530 consensus_queue.cc:1048] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P f7d44497c5c04c55a6b9dae701b63b2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:51.433063 25547 consensus_queue.cc:1048] T d41ae1092f594947838fb70e9d29df68 P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:51.443120 25528 consensus_queue.cc:1048] T d41ae1092f594947838fb70e9d29df68 P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:51.499727 25528 consensus_queue.cc:1048] T 3e0f3f615e7f41179a2f6577f271163c P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:51.511020 25547 consensus_queue.cc:1048] T 3e0f3f615e7f41179a2f6577f271163c P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:51.570922 25480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9445bca58d1d420eb940aed38f953894"
dest_uuid: "02a30f2f37194042b6ad292011c47d0d"
mode: GRACEFUL
new_leader_uuid: "52e12d0cb9004693ba368ceb7fac2259"
 from {username='slave'} at 127.0.0.1:46434
I20260709 12:12:51.571578 25480 raft_consensus.cc:606] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d [term 1 LEADER]: Received request to transfer leadership to TS 52e12d0cb9004693ba368ceb7fac2259
I20260709 12:12:51.584056 25407 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ca26bcb25244e1fb8ad01b0e0de68b7"
dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
mode: GRACEFUL
new_leader_uuid: "52e12d0cb9004693ba368ceb7fac2259"
 from {username='slave'} at 127.0.0.1:45256
I20260709 12:12:51.584578 25407 raft_consensus.cc:606] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 LEADER]: Received request to transfer leadership to TS 52e12d0cb9004693ba368ceb7fac2259
I20260709 12:12:51.589536 25480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1afdcff9cddc469981a2e16a4626e663"
dest_uuid: "02a30f2f37194042b6ad292011c47d0d"
mode: GRACEFUL
new_leader_uuid: "52e12d0cb9004693ba368ceb7fac2259"
 from {username='slave'} at 127.0.0.1:46434
I20260709 12:12:51.590118 25480 raft_consensus.cc:606] T 1afdcff9cddc469981a2e16a4626e663 P 02a30f2f37194042b6ad292011c47d0d [term 1 LEADER]: Received request to transfer leadership to TS 52e12d0cb9004693ba368ceb7fac2259
I20260709 12:12:51.591723 25530 consensus_queue.cc:1048] T cd519c6f9fbb43639d5d8ff2f4b209ae P f7d44497c5c04c55a6b9dae701b63b2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:51.606127 25568 consensus_queue.cc:1048] T cd519c6f9fbb43639d5d8ff2f4b209ae P f7d44497c5c04c55a6b9dae701b63b2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:51.607512 25331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c77d7b34aa9485aaffe3e77370a6ed6"
dest_uuid: "52e12d0cb9004693ba368ceb7fac2259"
mode: GRACEFUL
new_leader_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
 from {username='slave'} at 127.0.0.1:52542
I20260709 12:12:51.608095 25331 raft_consensus.cc:606] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 LEADER]: Received request to transfer leadership to TS f7d44497c5c04c55a6b9dae701b63b2b
I20260709 12:12:51.617172 25332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d41ae1092f594947838fb70e9d29df68"
dest_uuid: "52e12d0cb9004693ba368ceb7fac2259"
mode: GRACEFUL
new_leader_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
 from {username='slave'} at 127.0.0.1:52542
I20260709 12:12:51.617798 25332 raft_consensus.cc:606] T d41ae1092f594947838fb70e9d29df68 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 LEADER]: Received request to transfer leadership to TS f7d44497c5c04c55a6b9dae701b63b2b
I20260709 12:12:51.623040 25332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68e0c0233618497787f44d50e1ebb6f1"
dest_uuid: "52e12d0cb9004693ba368ceb7fac2259"
mode: GRACEFUL
new_leader_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
 from {username='slave'} at 127.0.0.1:52542
I20260709 12:12:51.623677 25332 raft_consensus.cc:606] T 68e0c0233618497787f44d50e1ebb6f1 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 LEADER]: Received request to transfer leadership to TS f7d44497c5c04c55a6b9dae701b63b2b
I20260709 12:12:51.628461 25407 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87740656475e4780a6fd2c222a2e2dce"
dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
mode: GRACEFUL
new_leader_uuid: "02a30f2f37194042b6ad292011c47d0d"
 from {username='slave'} at 127.0.0.1:45256
I20260709 12:12:51.628983 25407 raft_consensus.cc:606] T 87740656475e4780a6fd2c222a2e2dce P f7d44497c5c04c55a6b9dae701b63b2b [term 1 LEADER]: Received request to transfer leadership to TS 02a30f2f37194042b6ad292011c47d0d
I20260709 12:12:51.677758 25523 raft_consensus.cc:993] T 1afdcff9cddc469981a2e16a4626e663 P 02a30f2f37194042b6ad292011c47d0d: : Instructing follower 52e12d0cb9004693ba368ceb7fac2259 to start an election
I20260709 12:12:51.678200 25583 raft_consensus.cc:1081] T 1afdcff9cddc469981a2e16a4626e663 P 02a30f2f37194042b6ad292011c47d0d [term 1 LEADER]: Signalling peer 52e12d0cb9004693ba368ceb7fac2259 to start an election
I20260709 12:12:51.679556 25332 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1afdcff9cddc469981a2e16a4626e663"
dest_uuid: "52e12d0cb9004693ba368ceb7fac2259"
 from {username='slave'} at 127.0.0.1:52518
I20260709 12:12:51.680048 25332 raft_consensus.cc:493] T 1afdcff9cddc469981a2e16a4626e663 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:51.680347 25332 raft_consensus.cc:3060] T 1afdcff9cddc469981a2e16a4626e663 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:51.684424 25528 raft_consensus.cc:993] T 68e0c0233618497787f44d50e1ebb6f1 P 52e12d0cb9004693ba368ceb7fac2259: : Instructing follower f7d44497c5c04c55a6b9dae701b63b2b to start an election
I20260709 12:12:51.684957 25573 raft_consensus.cc:1081] T 68e0c0233618497787f44d50e1ebb6f1 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 LEADER]: Signalling peer f7d44497c5c04c55a6b9dae701b63b2b to start an election
I20260709 12:12:51.686547 25407 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "68e0c0233618497787f44d50e1ebb6f1"
dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
 from {username='slave'} at 127.0.0.1:45250
I20260709 12:12:51.687124 25407 raft_consensus.cc:493] T 68e0c0233618497787f44d50e1ebb6f1 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:51.686913 25332 raft_consensus.cc:515] T 1afdcff9cddc469981a2e16a4626e663 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:51.687615 25407 raft_consensus.cc:3060] T 68e0c0233618497787f44d50e1ebb6f1 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:51.688907 25332 leader_election.cc:290] T 1afdcff9cddc469981a2e16a4626e663 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 2 election: Requested vote from peers f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:51.689621 25406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1afdcff9cddc469981a2e16a4626e663" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
I20260709 12:12:51.689934 25481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1afdcff9cddc469981a2e16a4626e663" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02a30f2f37194042b6ad292011c47d0d"
I20260709 12:12:51.690246 25406 raft_consensus.cc:3060] T 1afdcff9cddc469981a2e16a4626e663 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:51.690629 25481 raft_consensus.cc:3055] T 1afdcff9cddc469981a2e16a4626e663 P 02a30f2f37194042b6ad292011c47d0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:51.690990 25481 raft_consensus.cc:740] T 1afdcff9cddc469981a2e16a4626e663 P 02a30f2f37194042b6ad292011c47d0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 02a30f2f37194042b6ad292011c47d0d, State: Running, Role: LEADER
I20260709 12:12:51.691718 25481 consensus_queue.cc:260] T 1afdcff9cddc469981a2e16a4626e663 P 02a30f2f37194042b6ad292011c47d0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:51.692654 25481 raft_consensus.cc:3060] T 1afdcff9cddc469981a2e16a4626e663 P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:51.694314 25407 raft_consensus.cc:515] T 68e0c0233618497787f44d50e1ebb6f1 P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:51.697395 25406 raft_consensus.cc:2468] T 1afdcff9cddc469981a2e16a4626e663 P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 2.
I20260709 12:12:51.698451 25481 raft_consensus.cc:2468] T 1afdcff9cddc469981a2e16a4626e663 P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 2.
I20260709 12:12:51.698462 25568 consensus_queue.cc:1048] T 87740656475e4780a6fd2c222a2e2dce P f7d44497c5c04c55a6b9dae701b63b2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:51.699170 25295 leader_election.cc:304] T 1afdcff9cddc469981a2e16a4626e663 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52e12d0cb9004693ba368ceb7fac2259, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 
I20260709 12:12:51.700022 25528 raft_consensus.cc:2804] T 1afdcff9cddc469981a2e16a4626e663 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:51.700469 25528 raft_consensus.cc:697] T 1afdcff9cddc469981a2e16a4626e663 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 LEADER]: Becoming Leader. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Running, Role: LEADER
I20260709 12:12:51.700601 25407 leader_election.cc:290] T 68e0c0233618497787f44d50e1ebb6f1 P f7d44497c5c04c55a6b9dae701b63b2b [CANDIDATE]: Term 2 election: Requested vote from peers 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:51.701341 25528 consensus_queue.cc:237] T 1afdcff9cddc469981a2e16a4626e663 P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:51.701670 25332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e0c0233618497787f44d50e1ebb6f1" candidate_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "52e12d0cb9004693ba368ceb7fac2259"
I20260709 12:12:51.701732 25480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e0c0233618497787f44d50e1ebb6f1" candidate_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02a30f2f37194042b6ad292011c47d0d"
I20260709 12:12:51.702309 25332 raft_consensus.cc:3055] T 68e0c0233618497787f44d50e1ebb6f1 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:51.702473 25480 raft_consensus.cc:3060] T 68e0c0233618497787f44d50e1ebb6f1 P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:51.702700 25332 raft_consensus.cc:740] T 68e0c0233618497787f44d50e1ebb6f1 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Running, Role: LEADER
I20260709 12:12:51.703091 25573 raft_consensus.cc:993] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 52e12d0cb9004693ba368ceb7fac2259: : Instructing follower f7d44497c5c04c55a6b9dae701b63b2b to start an election
I20260709 12:12:51.703534 25573 raft_consensus.cc:1081] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 LEADER]: Signalling peer f7d44497c5c04c55a6b9dae701b63b2b to start an election
I20260709 12:12:51.703699 25332 consensus_queue.cc:260] T 68e0c0233618497787f44d50e1ebb6f1 P 52e12d0cb9004693ba368ceb7fac2259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:51.704834 25332 raft_consensus.cc:3060] T 68e0c0233618497787f44d50e1ebb6f1 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:51.709829 25332 raft_consensus.cc:2468] T 68e0c0233618497787f44d50e1ebb6f1 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d44497c5c04c55a6b9dae701b63b2b in term 2.
I20260709 12:12:51.710934 25480 raft_consensus.cc:2468] T 68e0c0233618497787f44d50e1ebb6f1 P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d44497c5c04c55a6b9dae701b63b2b in term 2.
I20260709 12:12:51.711078 25370 leader_election.cc:304] T 68e0c0233618497787f44d50e1ebb6f1 P f7d44497c5c04c55a6b9dae701b63b2b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52e12d0cb9004693ba368ceb7fac2259, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 
I20260709 12:12:51.711790 25407 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c77d7b34aa9485aaffe3e77370a6ed6"
dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
 from {username='slave'} at 127.0.0.1:45250
I20260709 12:12:51.712139 25568 raft_consensus.cc:2804] T 68e0c0233618497787f44d50e1ebb6f1 P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:51.712373 25407 raft_consensus.cc:493] T 9c77d7b34aa9485aaffe3e77370a6ed6 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:51.712877 25407 raft_consensus.cc:3060] T 9c77d7b34aa9485aaffe3e77370a6ed6 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:51.713009 25568 raft_consensus.cc:697] T 68e0c0233618497787f44d50e1ebb6f1 P f7d44497c5c04c55a6b9dae701b63b2b [term 2 LEADER]: Becoming Leader. State: Replica: f7d44497c5c04c55a6b9dae701b63b2b, State: Running, Role: LEADER
I20260709 12:12:51.713927 25568 consensus_queue.cc:237] T 68e0c0233618497787f44d50e1ebb6f1 P f7d44497c5c04c55a6b9dae701b63b2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:51.720919 25407 raft_consensus.cc:515] T 9c77d7b34aa9485aaffe3e77370a6ed6 P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:51.723896 25407 leader_election.cc:290] T 9c77d7b34aa9485aaffe3e77370a6ed6 P f7d44497c5c04c55a6b9dae701b63b2b [CANDIDATE]: Term 2 election: Requested vote from peers 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:51.724273 25230 catalog_manager.cc:5697] T 1afdcff9cddc469981a2e16a4626e663 P 52e12d0cb9004693ba368ceb7fac2259 reported cstate change: term changed from 1 to 2, leader changed from 02a30f2f37194042b6ad292011c47d0d (127.16.98.195) to 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "52e12d0cb9004693ba368ceb7fac2259" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:51.726913 25481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c77d7b34aa9485aaffe3e77370a6ed6" candidate_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02a30f2f37194042b6ad292011c47d0d"
I20260709 12:12:51.727496 25481 raft_consensus.cc:3060] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:51.727340 25229 catalog_manager.cc:5697] T 68e0c0233618497787f44d50e1ebb6f1 P f7d44497c5c04c55a6b9dae701b63b2b reported cstate change: term changed from 1 to 2, leader changed from 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193) to f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194). New cstate: current_term: 2 leader_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:51.729379 25331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c77d7b34aa9485aaffe3e77370a6ed6" candidate_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "52e12d0cb9004693ba368ceb7fac2259"
I20260709 12:12:51.730031 25331 raft_consensus.cc:3055] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:51.730334 25331 raft_consensus.cc:740] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Running, Role: LEADER
I20260709 12:12:51.730743 25568 consensus_queue.cc:1048] T 87740656475e4780a6fd2c222a2e2dce P f7d44497c5c04c55a6b9dae701b63b2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:51.731299 25331 consensus_queue.cc:260] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 52e12d0cb9004693ba368ceb7fac2259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:51.732959 25331 raft_consensus.cc:3060] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:51.735930 25481 raft_consensus.cc:2468] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d44497c5c04c55a6b9dae701b63b2b in term 2.
I20260709 12:12:51.737243 25372 leader_election.cc:304] T 9c77d7b34aa9485aaffe3e77370a6ed6 P f7d44497c5c04c55a6b9dae701b63b2b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02a30f2f37194042b6ad292011c47d0d, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 
I20260709 12:12:51.738324 25568 raft_consensus.cc:2804] T 9c77d7b34aa9485aaffe3e77370a6ed6 P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:51.739033 25568 raft_consensus.cc:697] T 9c77d7b34aa9485aaffe3e77370a6ed6 P f7d44497c5c04c55a6b9dae701b63b2b [term 2 LEADER]: Becoming Leader. State: Replica: f7d44497c5c04c55a6b9dae701b63b2b, State: Running, Role: LEADER
I20260709 12:12:51.740038 25331 raft_consensus.cc:2468] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d44497c5c04c55a6b9dae701b63b2b in term 2.
I20260709 12:12:51.741716 25604 raft_consensus.cc:993] T 87740656475e4780a6fd2c222a2e2dce P f7d44497c5c04c55a6b9dae701b63b2b: : Instructing follower 02a30f2f37194042b6ad292011c47d0d to start an election
I20260709 12:12:51.742197 25604 raft_consensus.cc:1081] T 87740656475e4780a6fd2c222a2e2dce P f7d44497c5c04c55a6b9dae701b63b2b [term 1 LEADER]: Signalling peer 02a30f2f37194042b6ad292011c47d0d to start an election
I20260709 12:12:51.742635 25568 consensus_queue.cc:237] T 9c77d7b34aa9485aaffe3e77370a6ed6 P f7d44497c5c04c55a6b9dae701b63b2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:51.744902 25480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "87740656475e4780a6fd2c222a2e2dce"
dest_uuid: "02a30f2f37194042b6ad292011c47d0d"
 from {username='slave'} at 127.0.0.1:46422
I20260709 12:12:51.745507 25480 raft_consensus.cc:493] T 87740656475e4780a6fd2c222a2e2dce P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:51.745910 25480 raft_consensus.cc:3060] T 87740656475e4780a6fd2c222a2e2dce P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:51.751965 25229 catalog_manager.cc:5697] T 9c77d7b34aa9485aaffe3e77370a6ed6 P f7d44497c5c04c55a6b9dae701b63b2b reported cstate change: term changed from 1 to 2, leader changed from 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193) to f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194). New cstate: current_term: 2 leader_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:51.752507 25480 raft_consensus.cc:515] T 87740656475e4780a6fd2c222a2e2dce P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:51.754619 25480 leader_election.cc:290] T 87740656475e4780a6fd2c222a2e2dce P 02a30f2f37194042b6ad292011c47d0d [CANDIDATE]: Term 2 election: Requested vote from peers 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391), f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825)
I20260709 12:12:51.755283 25331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87740656475e4780a6fd2c222a2e2dce" candidate_uuid: "02a30f2f37194042b6ad292011c47d0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "52e12d0cb9004693ba368ceb7fac2259"
I20260709 12:12:51.755884 25331 raft_consensus.cc:3060] T 87740656475e4780a6fd2c222a2e2dce P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:51.756397 25407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87740656475e4780a6fd2c222a2e2dce" candidate_uuid: "02a30f2f37194042b6ad292011c47d0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
I20260709 12:12:51.757004 25407 raft_consensus.cc:3055] T 87740656475e4780a6fd2c222a2e2dce P f7d44497c5c04c55a6b9dae701b63b2b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:51.757318 25407 raft_consensus.cc:740] T 87740656475e4780a6fd2c222a2e2dce P f7d44497c5c04c55a6b9dae701b63b2b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7d44497c5c04c55a6b9dae701b63b2b, State: Running, Role: LEADER
I20260709 12:12:51.758095 25407 consensus_queue.cc:260] T 87740656475e4780a6fd2c222a2e2dce P f7d44497c5c04c55a6b9dae701b63b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:51.759272 25407 raft_consensus.cc:3060] T 87740656475e4780a6fd2c222a2e2dce P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:51.762053 25331 raft_consensus.cc:2468] T 87740656475e4780a6fd2c222a2e2dce P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02a30f2f37194042b6ad292011c47d0d in term 2.
I20260709 12:12:51.763298 25444 leader_election.cc:304] T 87740656475e4780a6fd2c222a2e2dce P 02a30f2f37194042b6ad292011c47d0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02a30f2f37194042b6ad292011c47d0d, 52e12d0cb9004693ba368ceb7fac2259; no voters: 
I20260709 12:12:51.764062 25583 raft_consensus.cc:2804] T 87740656475e4780a6fd2c222a2e2dce P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:51.764534 25583 raft_consensus.cc:697] T 87740656475e4780a6fd2c222a2e2dce P 02a30f2f37194042b6ad292011c47d0d [term 2 LEADER]: Becoming Leader. State: Replica: 02a30f2f37194042b6ad292011c47d0d, State: Running, Role: LEADER
I20260709 12:12:51.765322 25583 consensus_queue.cc:237] T 87740656475e4780a6fd2c222a2e2dce P 02a30f2f37194042b6ad292011c47d0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:51.766145 25407 raft_consensus.cc:2468] T 87740656475e4780a6fd2c222a2e2dce P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02a30f2f37194042b6ad292011c47d0d in term 2.
I20260709 12:12:51.771963 25230 catalog_manager.cc:5697] T 87740656475e4780a6fd2c222a2e2dce P 02a30f2f37194042b6ad292011c47d0d reported cstate change: term changed from 1 to 2, leader changed from f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194) to 02a30f2f37194042b6ad292011c47d0d (127.16.98.195). New cstate: current_term: 2 leader_uuid: "02a30f2f37194042b6ad292011c47d0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:51.939638 25523 raft_consensus.cc:993] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d: : Instructing follower 52e12d0cb9004693ba368ceb7fac2259 to start an election
I20260709 12:12:51.940045 25606 raft_consensus.cc:1081] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d [term 1 LEADER]: Signalling peer 52e12d0cb9004693ba368ceb7fac2259 to start an election
I20260709 12:12:51.941426 25331 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9445bca58d1d420eb940aed38f953894"
dest_uuid: "52e12d0cb9004693ba368ceb7fac2259"
 from {username='slave'} at 127.0.0.1:52518
I20260709 12:12:51.941898 25331 raft_consensus.cc:493] T 9445bca58d1d420eb940aed38f953894 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:51.942201 25331 raft_consensus.cc:3060] T 9445bca58d1d420eb940aed38f953894 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:51.947085 25331 raft_consensus.cc:515] T 9445bca58d1d420eb940aed38f953894 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:51.948725 25331 leader_election.cc:290] T 9445bca58d1d420eb940aed38f953894 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 2 election: Requested vote from peers f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:51.949424 25407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9445bca58d1d420eb940aed38f953894" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
I20260709 12:12:51.949776 25480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9445bca58d1d420eb940aed38f953894" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02a30f2f37194042b6ad292011c47d0d"
I20260709 12:12:51.950034 25407 raft_consensus.cc:3060] T 9445bca58d1d420eb940aed38f953894 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:51.950373 25480 raft_consensus.cc:3055] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:51.950697 25480 raft_consensus.cc:740] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 02a30f2f37194042b6ad292011c47d0d, State: Running, Role: LEADER
I20260709 12:12:51.951411 25480 consensus_queue.cc:260] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:51.952310 25480 raft_consensus.cc:3060] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:51.954939 25407 raft_consensus.cc:2468] T 9445bca58d1d420eb940aed38f953894 P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 2.
I20260709 12:12:51.955932 25295 leader_election.cc:304] T 9445bca58d1d420eb940aed38f953894 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52e12d0cb9004693ba368ceb7fac2259, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 
I20260709 12:12:51.956686 25602 raft_consensus.cc:2804] T 9445bca58d1d420eb940aed38f953894 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:51.957084 25602 raft_consensus.cc:697] T 9445bca58d1d420eb940aed38f953894 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 LEADER]: Becoming Leader. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Running, Role: LEADER
I20260709 12:12:51.957366 25480 raft_consensus.cc:2468] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 2.
I20260709 12:12:51.957893 25602 consensus_queue.cc:237] T 9445bca58d1d420eb940aed38f953894 P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:51.964128 25230 catalog_manager.cc:5697] T 9445bca58d1d420eb940aed38f953894 P 52e12d0cb9004693ba368ceb7fac2259 reported cstate change: term changed from 1 to 2, leader changed from 02a30f2f37194042b6ad292011c47d0d (127.16.98.195) to 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "52e12d0cb9004693ba368ceb7fac2259" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:51.989387 25528 raft_consensus.cc:993] T d41ae1092f594947838fb70e9d29df68 P 52e12d0cb9004693ba368ceb7fac2259: : Instructing follower f7d44497c5c04c55a6b9dae701b63b2b to start an election
I20260709 12:12:51.989877 25602 raft_consensus.cc:1081] T d41ae1092f594947838fb70e9d29df68 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 LEADER]: Signalling peer f7d44497c5c04c55a6b9dae701b63b2b to start an election
I20260709 12:12:51.991390 25407 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d41ae1092f594947838fb70e9d29df68"
dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
 from {username='slave'} at 127.0.0.1:45250
I20260709 12:12:51.991808 25407 raft_consensus.cc:493] T d41ae1092f594947838fb70e9d29df68 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:51.992056 25407 raft_consensus.cc:3060] T d41ae1092f594947838fb70e9d29df68 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:51.996667 25407 raft_consensus.cc:515] T d41ae1092f594947838fb70e9d29df68 P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:51.998179 25407 leader_election.cc:290] T d41ae1092f594947838fb70e9d29df68 P f7d44497c5c04c55a6b9dae701b63b2b [CANDIDATE]: Term 2 election: Requested vote from peers 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:51.999145 25480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d41ae1092f594947838fb70e9d29df68" candidate_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02a30f2f37194042b6ad292011c47d0d"
I20260709 12:12:51.999285 25331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d41ae1092f594947838fb70e9d29df68" candidate_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "52e12d0cb9004693ba368ceb7fac2259"
I20260709 12:12:51.999706 25480 raft_consensus.cc:3060] T d41ae1092f594947838fb70e9d29df68 P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:51.999907 25331 raft_consensus.cc:3055] T d41ae1092f594947838fb70e9d29df68 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:52.000283 25331 raft_consensus.cc:740] T d41ae1092f594947838fb70e9d29df68 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Running, Role: LEADER
I20260709 12:12:52.000983 25331 consensus_queue.cc:260] T d41ae1092f594947838fb70e9d29df68 P 52e12d0cb9004693ba368ceb7fac2259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:52.002068 25331 raft_consensus.cc:3060] T d41ae1092f594947838fb70e9d29df68 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:52.004657 25480 raft_consensus.cc:2468] T d41ae1092f594947838fb70e9d29df68 P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d44497c5c04c55a6b9dae701b63b2b in term 2.
I20260709 12:12:52.005667 25372 leader_election.cc:304] T d41ae1092f594947838fb70e9d29df68 P f7d44497c5c04c55a6b9dae701b63b2b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02a30f2f37194042b6ad292011c47d0d, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 
I20260709 12:12:52.006332 25568 raft_consensus.cc:2804] T d41ae1092f594947838fb70e9d29df68 P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:52.006853 25568 raft_consensus.cc:697] T d41ae1092f594947838fb70e9d29df68 P f7d44497c5c04c55a6b9dae701b63b2b [term 2 LEADER]: Becoming Leader. State: Replica: f7d44497c5c04c55a6b9dae701b63b2b, State: Running, Role: LEADER
I20260709 12:12:52.006953 25331 raft_consensus.cc:2468] T d41ae1092f594947838fb70e9d29df68 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d44497c5c04c55a6b9dae701b63b2b in term 2.
I20260709 12:12:52.007748 25568 consensus_queue.cc:237] T d41ae1092f594947838fb70e9d29df68 P f7d44497c5c04c55a6b9dae701b63b2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:52.013800 25230 catalog_manager.cc:5697] T d41ae1092f594947838fb70e9d29df68 P f7d44497c5c04c55a6b9dae701b63b2b reported cstate change: term changed from 1 to 2, leader changed from 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193) to f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194). New cstate: current_term: 2 leader_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:52.024312 25604 raft_consensus.cc:993] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P f7d44497c5c04c55a6b9dae701b63b2b: : Instructing follower 52e12d0cb9004693ba368ceb7fac2259 to start an election
I20260709 12:12:52.024781 25568 raft_consensus.cc:1081] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 LEADER]: Signalling peer 52e12d0cb9004693ba368ceb7fac2259 to start an election
I20260709 12:12:52.026207 25331 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ca26bcb25244e1fb8ad01b0e0de68b7"
dest_uuid: "52e12d0cb9004693ba368ceb7fac2259"
 from {username='slave'} at 127.0.0.1:52532
I20260709 12:12:52.026726 25331 raft_consensus.cc:493] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:52.027093 25331 raft_consensus.cc:3060] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:52.031925 25331 raft_consensus.cc:515] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:52.033591 25331 leader_election.cc:290] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 2 election: Requested vote from peers f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:52.034375 25407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca26bcb25244e1fb8ad01b0e0de68b7" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
I20260709 12:12:52.034580 25480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ca26bcb25244e1fb8ad01b0e0de68b7" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02a30f2f37194042b6ad292011c47d0d"
I20260709 12:12:52.035035 25407 raft_consensus.cc:3055] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:52.035115 25480 raft_consensus.cc:3060] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:52.035456 25407 raft_consensus.cc:740] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7d44497c5c04c55a6b9dae701b63b2b, State: Running, Role: LEADER
I20260709 12:12:52.036329 25407 consensus_queue.cc:260] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P f7d44497c5c04c55a6b9dae701b63b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:52.037531 25407 raft_consensus.cc:3060] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:52.042173 25480 raft_consensus.cc:2468] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 2.
I20260709 12:12:52.043354 25297 leader_election.cc:304] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02a30f2f37194042b6ad292011c47d0d, 52e12d0cb9004693ba368ceb7fac2259; no voters: 
I20260709 12:12:52.044044 25407 raft_consensus.cc:2468] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 2.
I20260709 12:12:52.044050 25602 raft_consensus.cc:2804] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:52.044732 25602 raft_consensus.cc:697] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 LEADER]: Becoming Leader. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Running, Role: LEADER
I20260709 12:12:52.045555 25602 consensus_queue.cc:237] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:52.051293 25230 catalog_manager.cc:5697] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 52e12d0cb9004693ba368ceb7fac2259 reported cstate change: term changed from 1 to 2, leader changed from f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194) to 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "52e12d0cb9004693ba368ceb7fac2259" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:52.130439 25480 raft_consensus.cc:1275] T 68e0c0233618497787f44d50e1ebb6f1 P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Refusing update from remote peer f7d44497c5c04c55a6b9dae701b63b2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:52.131758 25568 consensus_queue.cc:1048] T 68e0c0233618497787f44d50e1ebb6f1 P f7d44497c5c04c55a6b9dae701b63b2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:52.140281 25331 raft_consensus.cc:1275] T 68e0c0233618497787f44d50e1ebb6f1 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Refusing update from remote peer f7d44497c5c04c55a6b9dae701b63b2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:52.142804 25568 consensus_queue.cc:1048] T 68e0c0233618497787f44d50e1ebb6f1 P f7d44497c5c04c55a6b9dae701b63b2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:52.179035 25331 raft_consensus.cc:1275] T 87740656475e4780a6fd2c222a2e2dce P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Refusing update from remote peer 02a30f2f37194042b6ad292011c47d0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:52.180279 25606 consensus_queue.cc:1048] T 87740656475e4780a6fd2c222a2e2dce P 02a30f2f37194042b6ad292011c47d0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:52.187590 25407 raft_consensus.cc:1275] T 87740656475e4780a6fd2c222a2e2dce P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Refusing update from remote peer 02a30f2f37194042b6ad292011c47d0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:52.189391 25583 consensus_queue.cc:1048] T 87740656475e4780a6fd2c222a2e2dce P 02a30f2f37194042b6ad292011c47d0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:52.282294 25480 raft_consensus.cc:1275] T 1afdcff9cddc469981a2e16a4626e663 P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Refusing update from remote peer 52e12d0cb9004693ba368ceb7fac2259: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:52.283591 25528 consensus_queue.cc:1048] T 1afdcff9cddc469981a2e16a4626e663 P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:52.292238 25407 raft_consensus.cc:1275] T 1afdcff9cddc469981a2e16a4626e663 P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Refusing update from remote peer 52e12d0cb9004693ba368ceb7fac2259: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:52.293663 25602 consensus_queue.cc:1048] T 1afdcff9cddc469981a2e16a4626e663 P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:52.338483 25331 raft_consensus.cc:1275] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Refusing update from remote peer f7d44497c5c04c55a6b9dae701b63b2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:52.339812 25568 consensus_queue.cc:1048] T 9c77d7b34aa9485aaffe3e77370a6ed6 P f7d44497c5c04c55a6b9dae701b63b2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:52.347986 25480 raft_consensus.cc:1275] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Refusing update from remote peer f7d44497c5c04c55a6b9dae701b63b2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:52.349741 25530 consensus_queue.cc:1048] T 9c77d7b34aa9485aaffe3e77370a6ed6 P f7d44497c5c04c55a6b9dae701b63b2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:52.365737 25407 raft_consensus.cc:1275] T 9445bca58d1d420eb940aed38f953894 P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Refusing update from remote peer 52e12d0cb9004693ba368ceb7fac2259: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:52.366859 25602 consensus_queue.cc:1048] T 9445bca58d1d420eb940aed38f953894 P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:52.375721 25480 raft_consensus.cc:1275] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Refusing update from remote peer 52e12d0cb9004693ba368ceb7fac2259: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:52.379264 25602 consensus_queue.cc:1048] T 9445bca58d1d420eb940aed38f953894 P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:52.515245 25480 raft_consensus.cc:1275] T d41ae1092f594947838fb70e9d29df68 P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Refusing update from remote peer f7d44497c5c04c55a6b9dae701b63b2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:52.516544 25530 consensus_queue.cc:1048] T d41ae1092f594947838fb70e9d29df68 P f7d44497c5c04c55a6b9dae701b63b2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:52.527036 25331 raft_consensus.cc:1275] T d41ae1092f594947838fb70e9d29df68 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Refusing update from remote peer f7d44497c5c04c55a6b9dae701b63b2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:52.528801 25568 consensus_queue.cc:1048] T d41ae1092f594947838fb70e9d29df68 P f7d44497c5c04c55a6b9dae701b63b2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:52.587749 25480 raft_consensus.cc:1275] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Refusing update from remote peer 52e12d0cb9004693ba368ceb7fac2259: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:52.589157 25602 consensus_queue.cc:1048] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:52.598161 25407 raft_consensus.cc:1275] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Refusing update from remote peer 52e12d0cb9004693ba368ceb7fac2259: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:52.599925 25528 consensus_queue.cc:1048] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:54.659348 25230 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58814:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:12:54.662057 25230 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:12:54.712518 25318 tablet_service.cc:1511] Processing CreateTablet for tablet e3c5edae27a14c028d7e6dcac6ae2fa4 (DEFAULT_TABLE table=soft_deleted_table [id=8dbef7a07a084ac090f08a83c6127846]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:12:54.713598 25389 tablet_service.cc:1511] Processing CreateTablet for tablet e3c5edae27a14c028d7e6dcac6ae2fa4 (DEFAULT_TABLE table=soft_deleted_table [id=8dbef7a07a084ac090f08a83c6127846]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:12:54.714381 25318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3c5edae27a14c028d7e6dcac6ae2fa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:54.715229 25389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3c5edae27a14c028d7e6dcac6ae2fa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:54.716401 25317 tablet_service.cc:1511] Processing CreateTablet for tablet a4f91317044d4d75b44b0e091132d402 (DEFAULT_TABLE table=soft_deleted_table [id=8dbef7a07a084ac090f08a83c6127846]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:12:54.717463 25392 tablet_service.cc:1511] Processing CreateTablet for tablet a4f91317044d4d75b44b0e091132d402 (DEFAULT_TABLE table=soft_deleted_table [id=8dbef7a07a084ac090f08a83c6127846]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:12:54.717970 25317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4f91317044d4d75b44b0e091132d402. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:54.718879 25392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4f91317044d4d75b44b0e091132d402. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:54.722144 25322 tablet_service.cc:1511] Processing CreateTablet for tablet 7beeddfc1c114d3398d73e600e3b3d13 (DEFAULT_TABLE table=soft_deleted_table [id=8dbef7a07a084ac090f08a83c6127846]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:12:54.723493 25322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7beeddfc1c114d3398d73e600e3b3d13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:54.726321 25463 tablet_service.cc:1511] Processing CreateTablet for tablet e3c5edae27a14c028d7e6dcac6ae2fa4 (DEFAULT_TABLE table=soft_deleted_table [id=8dbef7a07a084ac090f08a83c6127846]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:12:54.726501 25319 tablet_service.cc:1511] Processing CreateTablet for tablet b7cd615c09bb4d13882f85a6aa6ba3e7 (DEFAULT_TABLE table=soft_deleted_table [id=8dbef7a07a084ac090f08a83c6127846]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:12:54.727792 25319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7cd615c09bb4d13882f85a6aa6ba3e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:54.727910 25463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3c5edae27a14c028d7e6dcac6ae2fa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:54.732019 25471 tablet_service.cc:1511] Processing CreateTablet for tablet a4f91317044d4d75b44b0e091132d402 (DEFAULT_TABLE table=soft_deleted_table [id=8dbef7a07a084ac090f08a83c6127846]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:12:54.733609 25471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4f91317044d4d75b44b0e091132d402. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:54.735407 25391 tablet_service.cc:1511] Processing CreateTablet for tablet 7beeddfc1c114d3398d73e600e3b3d13 (DEFAULT_TABLE table=soft_deleted_table [id=8dbef7a07a084ac090f08a83c6127846]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:12:54.736912 25391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7beeddfc1c114d3398d73e600e3b3d13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:54.744151 25466 tablet_service.cc:1511] Processing CreateTablet for tablet 7beeddfc1c114d3398d73e600e3b3d13 (DEFAULT_TABLE table=soft_deleted_table [id=8dbef7a07a084ac090f08a83c6127846]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:12:54.745558 25466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7beeddfc1c114d3398d73e600e3b3d13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:54.747323 25632 tablet_bootstrap.cc:492] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259: Bootstrap starting.
I20260709 12:12:54.758496 25397 tablet_service.cc:1511] Processing CreateTablet for tablet 0b9559a209da4bd299515a2b7cd47629 (DEFAULT_TABLE table=soft_deleted_table [id=8dbef7a07a084ac090f08a83c6127846]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:12:54.762158 25390 tablet_service.cc:1511] Processing CreateTablet for tablet f2a320cecc214596975900050a34388c (DEFAULT_TABLE table=soft_deleted_table [id=8dbef7a07a084ac090f08a83c6127846]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:12:54.762720 25397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b9559a209da4bd299515a2b7cd47629. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:54.763532 25390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2a320cecc214596975900050a34388c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:54.757879 25396 tablet_service.cc:1511] Processing CreateTablet for tablet b7cd615c09bb4d13882f85a6aa6ba3e7 (DEFAULT_TABLE table=soft_deleted_table [id=8dbef7a07a084ac090f08a83c6127846]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:12:54.764547 25396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7cd615c09bb4d13882f85a6aa6ba3e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:54.765986 25318 tablet_service.cc:1511] Processing CreateTablet for tablet f2a320cecc214596975900050a34388c (DEFAULT_TABLE table=soft_deleted_table [id=8dbef7a07a084ac090f08a83c6127846]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:12:54.760881 25469 tablet_service.cc:1511] Processing CreateTablet for tablet b7cd615c09bb4d13882f85a6aa6ba3e7 (DEFAULT_TABLE table=soft_deleted_table [id=8dbef7a07a084ac090f08a83c6127846]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:12:54.767328 25318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2a320cecc214596975900050a34388c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:54.767684 25469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7cd615c09bb4d13882f85a6aa6ba3e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:54.769089 25395 tablet_service.cc:1511] Processing CreateTablet for tablet f747ad579e1e40b18a8efbd9fa0c9d5c (DEFAULT_TABLE table=soft_deleted_table [id=8dbef7a07a084ac090f08a83c6127846]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:12:54.769493 25320 tablet_service.cc:1511] Processing CreateTablet for tablet f747ad579e1e40b18a8efbd9fa0c9d5c (DEFAULT_TABLE table=soft_deleted_table [id=8dbef7a07a084ac090f08a83c6127846]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:12:54.770437 25395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f747ad579e1e40b18a8efbd9fa0c9d5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:54.780761 25467 tablet_service.cc:1511] Processing CreateTablet for tablet 0b9559a209da4bd299515a2b7cd47629 (DEFAULT_TABLE table=soft_deleted_table [id=8dbef7a07a084ac090f08a83c6127846]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:12:54.781597 25632 tablet_bootstrap.cc:654] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.782230 25467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b9559a209da4bd299515a2b7cd47629. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:54.782606 25319 tablet_service.cc:1511] Processing CreateTablet for tablet 0b9559a209da4bd299515a2b7cd47629 (DEFAULT_TABLE table=soft_deleted_table [id=8dbef7a07a084ac090f08a83c6127846]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:12:54.783876 25470 tablet_service.cc:1511] Processing CreateTablet for tablet f2a320cecc214596975900050a34388c (DEFAULT_TABLE table=soft_deleted_table [id=8dbef7a07a084ac090f08a83c6127846]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:12:54.785173 25470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2a320cecc214596975900050a34388c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:54.787835 25468 tablet_service.cc:1511] Processing CreateTablet for tablet f747ad579e1e40b18a8efbd9fa0c9d5c (DEFAULT_TABLE table=soft_deleted_table [id=8dbef7a07a084ac090f08a83c6127846]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:12:54.788658 25318 tablet_service.cc:1511] Processing CreateTablet for tablet d7e8f5c4110f428e8c8c29e99ef734fe (DEFAULT_TABLE table=soft_deleted_table [id=8dbef7a07a084ac090f08a83c6127846]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:12:54.789170 25468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f747ad579e1e40b18a8efbd9fa0c9d5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:54.802728 25320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f747ad579e1e40b18a8efbd9fa0c9d5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:54.803508 25319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b9559a209da4bd299515a2b7cd47629. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:54.819110 25318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7e8f5c4110f428e8c8c29e99ef734fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:54.824060 25464 tablet_service.cc:1511] Processing CreateTablet for tablet d7e8f5c4110f428e8c8c29e99ef734fe (DEFAULT_TABLE table=soft_deleted_table [id=8dbef7a07a084ac090f08a83c6127846]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:12:54.824958 25317 tablet_service.cc:1511] Processing CreateTablet for tablet 1d69a320a510449598156730aee599db (DEFAULT_TABLE table=soft_deleted_table [id=8dbef7a07a084ac090f08a83c6127846]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:12:54.825470 25464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7e8f5c4110f428e8c8c29e99ef734fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:54.826244 25317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d69a320a510449598156730aee599db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:54.835660 25390 tablet_service.cc:1511] Processing CreateTablet for tablet d7e8f5c4110f428e8c8c29e99ef734fe (DEFAULT_TABLE table=soft_deleted_table [id=8dbef7a07a084ac090f08a83c6127846]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:12:54.837124 25390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7e8f5c4110f428e8c8c29e99ef734fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:54.845777 25395 tablet_service.cc:1511] Processing CreateTablet for tablet 1d69a320a510449598156730aee599db (DEFAULT_TABLE table=soft_deleted_table [id=8dbef7a07a084ac090f08a83c6127846]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:12:54.847218 25395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d69a320a510449598156730aee599db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:54.852746 25465 tablet_service.cc:1511] Processing CreateTablet for tablet 1d69a320a510449598156730aee599db (DEFAULT_TABLE table=soft_deleted_table [id=8dbef7a07a084ac090f08a83c6127846]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:12:54.861689 25465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d69a320a510449598156730aee599db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:12:54.871243 25632 tablet_bootstrap.cc:492] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259: No bootstrap required, opened a new log
I20260709 12:12:54.871882 25632 ts_tablet_manager.cc:1403] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259: Time spent bootstrapping tablet: real 0.125s	user 0.009s	sys 0.007s
I20260709 12:12:54.887061 25632 raft_consensus.cc:359] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:54.888052 25632 raft_consensus.cc:385] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.888413 25632 raft_consensus.cc:740] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.890671 25633 tablet_bootstrap.cc:492] T b7cd615c09bb4d13882f85a6aa6ba3e7 P f7d44497c5c04c55a6b9dae701b63b2b: Bootstrap starting.
I20260709 12:12:54.907124 25633 tablet_bootstrap.cc:654] T b7cd615c09bb4d13882f85a6aa6ba3e7 P f7d44497c5c04c55a6b9dae701b63b2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.911963 25632 consensus_queue.cc:260] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:54.915889 25632 ts_tablet_manager.cc:1434] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
I20260709 12:12:54.919900 25635 tablet_bootstrap.cc:492] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 02a30f2f37194042b6ad292011c47d0d: Bootstrap starting.
I20260709 12:12:54.924255 25632 tablet_bootstrap.cc:492] T a4f91317044d4d75b44b0e091132d402 P 52e12d0cb9004693ba368ceb7fac2259: Bootstrap starting.
I20260709 12:12:54.926069 25633 tablet_bootstrap.cc:492] T b7cd615c09bb4d13882f85a6aa6ba3e7 P f7d44497c5c04c55a6b9dae701b63b2b: No bootstrap required, opened a new log
I20260709 12:12:54.926689 25633 ts_tablet_manager.cc:1403] T b7cd615c09bb4d13882f85a6aa6ba3e7 P f7d44497c5c04c55a6b9dae701b63b2b: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.013s
I20260709 12:12:54.929597 25633 raft_consensus.cc:359] T b7cd615c09bb4d13882f85a6aa6ba3e7 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:54.930334 25633 raft_consensus.cc:385] T b7cd615c09bb4d13882f85a6aa6ba3e7 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.930683 25633 raft_consensus.cc:740] T b7cd615c09bb4d13882f85a6aa6ba3e7 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d44497c5c04c55a6b9dae701b63b2b, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.931531 25633 consensus_queue.cc:260] T b7cd615c09bb4d13882f85a6aa6ba3e7 P f7d44497c5c04c55a6b9dae701b63b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:54.934114 25633 ts_tablet_manager.cc:1434] T b7cd615c09bb4d13882f85a6aa6ba3e7 P f7d44497c5c04c55a6b9dae701b63b2b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:12:54.935209 25633 tablet_bootstrap.cc:492] T f2a320cecc214596975900050a34388c P f7d44497c5c04c55a6b9dae701b63b2b: Bootstrap starting.
I20260709 12:12:54.935897 25635 tablet_bootstrap.cc:654] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 02a30f2f37194042b6ad292011c47d0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.938354 25632 tablet_bootstrap.cc:654] T a4f91317044d4d75b44b0e091132d402 P 52e12d0cb9004693ba368ceb7fac2259: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.941816 25633 tablet_bootstrap.cc:654] T f2a320cecc214596975900050a34388c P f7d44497c5c04c55a6b9dae701b63b2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.945062 25635 tablet_bootstrap.cc:492] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 02a30f2f37194042b6ad292011c47d0d: No bootstrap required, opened a new log
I20260709 12:12:54.945603 25635 ts_tablet_manager.cc:1403] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 02a30f2f37194042b6ad292011c47d0d: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.004s
I20260709 12:12:54.949543 25635 raft_consensus.cc:359] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:54.950575 25635 raft_consensus.cc:385] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.951047 25635 raft_consensus.cc:740] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02a30f2f37194042b6ad292011c47d0d, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.952111 25635 consensus_queue.cc:260] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 02a30f2f37194042b6ad292011c47d0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:54.955915 25632 tablet_bootstrap.cc:492] T a4f91317044d4d75b44b0e091132d402 P 52e12d0cb9004693ba368ceb7fac2259: No bootstrap required, opened a new log
I20260709 12:12:54.956490 25632 ts_tablet_manager.cc:1403] T a4f91317044d4d75b44b0e091132d402 P 52e12d0cb9004693ba368ceb7fac2259: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.013s
I20260709 12:12:54.959334 25635 ts_tablet_manager.cc:1434] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 02a30f2f37194042b6ad292011c47d0d: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:12:54.959476 25632 raft_consensus.cc:359] T a4f91317044d4d75b44b0e091132d402 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:54.960546 25632 raft_consensus.cc:385] T a4f91317044d4d75b44b0e091132d402 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.960894 25632 raft_consensus.cc:740] T a4f91317044d4d75b44b0e091132d402 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.961066 25635 tablet_bootstrap.cc:492] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 02a30f2f37194042b6ad292011c47d0d: Bootstrap starting.
I20260709 12:12:54.961778 25632 consensus_queue.cc:260] T a4f91317044d4d75b44b0e091132d402 P 52e12d0cb9004693ba368ceb7fac2259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:54.969935 25635 tablet_bootstrap.cc:654] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 02a30f2f37194042b6ad292011c47d0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.970360 25632 ts_tablet_manager.cc:1434] T a4f91317044d4d75b44b0e091132d402 P 52e12d0cb9004693ba368ceb7fac2259: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:12:54.971503 25632 tablet_bootstrap.cc:492] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 52e12d0cb9004693ba368ceb7fac2259: Bootstrap starting.
I20260709 12:12:54.977056 25620 raft_consensus.cc:493] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:54.977604 25620 raft_consensus.cc:515] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:54.978116 25632 tablet_bootstrap.cc:654] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 52e12d0cb9004693ba368ceb7fac2259: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:54.980077 25620 leader_election.cc:290] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:54.981844 25407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c5edae27a14c028d7e6dcac6ae2fa4" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" is_pre_election: true
I20260709 12:12:54.982777 25480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c5edae27a14c028d7e6dcac6ae2fa4" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02a30f2f37194042b6ad292011c47d0d" is_pre_election: true
W20260709 12:12:54.983789 25295 leader_election.cc:343] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.984299 25635 tablet_bootstrap.cc:492] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 02a30f2f37194042b6ad292011c47d0d: No bootstrap required, opened a new log
I20260709 12:12:54.985111 25635 ts_tablet_manager.cc:1403] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 02a30f2f37194042b6ad292011c47d0d: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.008s
W20260709 12:12:54.984407 25297 leader_election.cc:343] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:54.988406 25297 leader_election.cc:304] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 52e12d0cb9004693ba368ceb7fac2259; no voters: 02a30f2f37194042b6ad292011c47d0d, f7d44497c5c04c55a6b9dae701b63b2b
I20260709 12:12:54.989480 25620 raft_consensus.cc:2749] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:54.989166 25635 raft_consensus.cc:359] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:54.990021 25635 raft_consensus.cc:385] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:54.990384 25635 raft_consensus.cc:740] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02a30f2f37194042b6ad292011c47d0d, State: Initialized, Role: FOLLOWER
I20260709 12:12:54.991192 25635 consensus_queue.cc:260] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 02a30f2f37194042b6ad292011c47d0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:54.993695 25635 ts_tablet_manager.cc:1434] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 02a30f2f37194042b6ad292011c47d0d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:12:54.995065 25635 tablet_bootstrap.cc:492] T 7beeddfc1c114d3398d73e600e3b3d13 P 02a30f2f37194042b6ad292011c47d0d: Bootstrap starting.
I20260709 12:12:55.004108 25635 tablet_bootstrap.cc:654] T 7beeddfc1c114d3398d73e600e3b3d13 P 02a30f2f37194042b6ad292011c47d0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.022249 25632 tablet_bootstrap.cc:492] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 52e12d0cb9004693ba368ceb7fac2259: No bootstrap required, opened a new log
I20260709 12:12:55.022363 25633 tablet_bootstrap.cc:492] T f2a320cecc214596975900050a34388c P f7d44497c5c04c55a6b9dae701b63b2b: No bootstrap required, opened a new log
I20260709 12:12:55.022421 25635 tablet_bootstrap.cc:492] T 7beeddfc1c114d3398d73e600e3b3d13 P 02a30f2f37194042b6ad292011c47d0d: No bootstrap required, opened a new log
I20260709 12:12:55.022990 25632 ts_tablet_manager.cc:1403] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 52e12d0cb9004693ba368ceb7fac2259: Time spent bootstrapping tablet: real 0.052s	user 0.028s	sys 0.016s
I20260709 12:12:55.023170 25633 ts_tablet_manager.cc:1403] T f2a320cecc214596975900050a34388c P f7d44497c5c04c55a6b9dae701b63b2b: Time spent bootstrapping tablet: real 0.088s	user 0.039s	sys 0.042s
I20260709 12:12:55.023176 25635 ts_tablet_manager.cc:1403] T 7beeddfc1c114d3398d73e600e3b3d13 P 02a30f2f37194042b6ad292011c47d0d: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.007s
I20260709 12:12:55.026504 25633 raft_consensus.cc:359] T f2a320cecc214596975900050a34388c P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.026811 25635 raft_consensus.cc:359] T 7beeddfc1c114d3398d73e600e3b3d13 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.027297 25633 raft_consensus.cc:385] T f2a320cecc214596975900050a34388c P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.027673 25635 raft_consensus.cc:385] T 7beeddfc1c114d3398d73e600e3b3d13 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.027689 25633 raft_consensus.cc:740] T f2a320cecc214596975900050a34388c P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d44497c5c04c55a6b9dae701b63b2b, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.027108 25632 raft_consensus.cc:359] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.028195 25635 raft_consensus.cc:740] T 7beeddfc1c114d3398d73e600e3b3d13 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02a30f2f37194042b6ad292011c47d0d, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.028388 25632 raft_consensus.cc:385] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.028726 25632 raft_consensus.cc:740] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.029031 25635 consensus_queue.cc:260] T 7beeddfc1c114d3398d73e600e3b3d13 P 02a30f2f37194042b6ad292011c47d0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.028796 25633 consensus_queue.cc:260] T f2a320cecc214596975900050a34388c P f7d44497c5c04c55a6b9dae701b63b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.029429 25632 consensus_queue.cc:260] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 52e12d0cb9004693ba368ceb7fac2259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.031641 25635 ts_tablet_manager.cc:1434] T 7beeddfc1c114d3398d73e600e3b3d13 P 02a30f2f37194042b6ad292011c47d0d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:12:55.032124 25633 ts_tablet_manager.cc:1434] T f2a320cecc214596975900050a34388c P f7d44497c5c04c55a6b9dae701b63b2b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:12:55.033718 25633 tablet_bootstrap.cc:492] T f747ad579e1e40b18a8efbd9fa0c9d5c P f7d44497c5c04c55a6b9dae701b63b2b: Bootstrap starting.
I20260709 12:12:55.033959 25632 ts_tablet_manager.cc:1434] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 52e12d0cb9004693ba368ceb7fac2259: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.004s
I20260709 12:12:55.035172 25632 tablet_bootstrap.cc:492] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259: Bootstrap starting.
I20260709 12:12:55.043216 25633 tablet_bootstrap.cc:654] T f747ad579e1e40b18a8efbd9fa0c9d5c P f7d44497c5c04c55a6b9dae701b63b2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.043638 25635 tablet_bootstrap.cc:492] T a4f91317044d4d75b44b0e091132d402 P 02a30f2f37194042b6ad292011c47d0d: Bootstrap starting.
I20260709 12:12:55.045236 25632 tablet_bootstrap.cc:654] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.049907 25620 raft_consensus.cc:493] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.050484 25620 raft_consensus.cc:515] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.052821 25620 leader_election.cc:290] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:55.055426 25635 tablet_bootstrap.cc:654] T a4f91317044d4d75b44b0e091132d402 P 02a30f2f37194042b6ad292011c47d0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.055013 25480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7cd615c09bb4d13882f85a6aa6ba3e7" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02a30f2f37194042b6ad292011c47d0d" is_pre_election: true
I20260709 12:12:55.056206 25480 raft_consensus.cc:2468] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 0.
I20260709 12:12:55.055013 25407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7cd615c09bb4d13882f85a6aa6ba3e7" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" is_pre_election: true
I20260709 12:12:55.058514 25407 raft_consensus.cc:2468] T b7cd615c09bb4d13882f85a6aa6ba3e7 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 0.
I20260709 12:12:55.060211 25295 leader_election.cc:304] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52e12d0cb9004693ba368ceb7fac2259, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 
I20260709 12:12:55.065594 25620 raft_consensus.cc:2804] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:55.065965 25620 raft_consensus.cc:493] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.066287 25620 raft_consensus.cc:3060] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.095530 25583 raft_consensus.cc:493] T 7beeddfc1c114d3398d73e600e3b3d13 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.096321 25583 raft_consensus.cc:515] T 7beeddfc1c114d3398d73e600e3b3d13 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.108024 25583 leader_election.cc:290] T 7beeddfc1c114d3398d73e600e3b3d13 P 02a30f2f37194042b6ad292011c47d0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391), f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825)
I20260709 12:12:55.115005 25407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beeddfc1c114d3398d73e600e3b3d13" candidate_uuid: "02a30f2f37194042b6ad292011c47d0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" is_pre_election: true
W20260709 12:12:55.119001 25444 leader_election.cc:343] T 7beeddfc1c114d3398d73e600e3b3d13 P 02a30f2f37194042b6ad292011c47d0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.147092 25331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beeddfc1c114d3398d73e600e3b3d13" candidate_uuid: "02a30f2f37194042b6ad292011c47d0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52e12d0cb9004693ba368ceb7fac2259" is_pre_election: true
W20260709 12:12:55.149274 25444 leader_election.cc:343] T 7beeddfc1c114d3398d73e600e3b3d13 P 02a30f2f37194042b6ad292011c47d0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.149962 25444 leader_election.cc:304] T 7beeddfc1c114d3398d73e600e3b3d13 P 02a30f2f37194042b6ad292011c47d0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02a30f2f37194042b6ad292011c47d0d; no voters: 52e12d0cb9004693ba368ceb7fac2259, f7d44497c5c04c55a6b9dae701b63b2b
I20260709 12:12:55.152951 25583 raft_consensus.cc:2749] T 7beeddfc1c114d3398d73e600e3b3d13 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:55.155783 25620 raft_consensus.cc:515] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.159500 25407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7cd615c09bb4d13882f85a6aa6ba3e7" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
I20260709 12:12:55.160322 25407 raft_consensus.cc:3060] T b7cd615c09bb4d13882f85a6aa6ba3e7 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.176916 25407 raft_consensus.cc:2468] T b7cd615c09bb4d13882f85a6aa6ba3e7 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 1.
I20260709 12:12:55.178768 25295 leader_election.cc:304] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52e12d0cb9004693ba368ceb7fac2259, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 
I20260709 12:12:55.180354 25620 leader_election.cc:290] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 election: Requested vote from peers f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:55.181080 25620 raft_consensus.cc:2804] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:55.182286 25480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7cd615c09bb4d13882f85a6aa6ba3e7" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02a30f2f37194042b6ad292011c47d0d"
I20260709 12:12:55.183121 25480 raft_consensus.cc:3060] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.187017 25635 tablet_bootstrap.cc:492] T a4f91317044d4d75b44b0e091132d402 P 02a30f2f37194042b6ad292011c47d0d: No bootstrap required, opened a new log
I20260709 12:12:55.187762 25635 ts_tablet_manager.cc:1403] T a4f91317044d4d75b44b0e091132d402 P 02a30f2f37194042b6ad292011c47d0d: Time spent bootstrapping tablet: real 0.144s	user 0.024s	sys 0.046s
I20260709 12:12:55.191852 25635 raft_consensus.cc:359] T a4f91317044d4d75b44b0e091132d402 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.192546 25635 raft_consensus.cc:385] T a4f91317044d4d75b44b0e091132d402 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.192853 25635 raft_consensus.cc:740] T a4f91317044d4d75b44b0e091132d402 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02a30f2f37194042b6ad292011c47d0d, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.181648 25620 raft_consensus.cc:697] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 LEADER]: Becoming Leader. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Running, Role: LEADER
I20260709 12:12:55.195092 25480 raft_consensus.cc:2468] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 1.
I20260709 12:12:55.195866 25620 consensus_queue.cc:237] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.197621 25633 tablet_bootstrap.cc:492] T f747ad579e1e40b18a8efbd9fa0c9d5c P f7d44497c5c04c55a6b9dae701b63b2b: No bootstrap required, opened a new log
I20260709 12:12:55.198159 25633 ts_tablet_manager.cc:1403] T f747ad579e1e40b18a8efbd9fa0c9d5c P f7d44497c5c04c55a6b9dae701b63b2b: Time spent bootstrapping tablet: real 0.165s	user 0.039s	sys 0.065s
I20260709 12:12:55.200769 25633 raft_consensus.cc:359] T f747ad579e1e40b18a8efbd9fa0c9d5c P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.201323 25633 raft_consensus.cc:385] T f747ad579e1e40b18a8efbd9fa0c9d5c P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.201587 25633 raft_consensus.cc:740] T f747ad579e1e40b18a8efbd9fa0c9d5c P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d44497c5c04c55a6b9dae701b63b2b, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.202219 25633 consensus_queue.cc:260] T f747ad579e1e40b18a8efbd9fa0c9d5c P f7d44497c5c04c55a6b9dae701b63b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.203871 25633 ts_tablet_manager.cc:1434] T f747ad579e1e40b18a8efbd9fa0c9d5c P f7d44497c5c04c55a6b9dae701b63b2b: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.004s
I20260709 12:12:55.204169 25635 consensus_queue.cc:260] T a4f91317044d4d75b44b0e091132d402 P 02a30f2f37194042b6ad292011c47d0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.204885 25633 tablet_bootstrap.cc:492] T a4f91317044d4d75b44b0e091132d402 P f7d44497c5c04c55a6b9dae701b63b2b: Bootstrap starting.
I20260709 12:12:55.208237 25635 ts_tablet_manager.cc:1434] T a4f91317044d4d75b44b0e091132d402 P 02a30f2f37194042b6ad292011c47d0d: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 12:12:55.209388 25635 tablet_bootstrap.cc:492] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d: Bootstrap starting.
I20260709 12:12:55.212586 25633 tablet_bootstrap.cc:654] T a4f91317044d4d75b44b0e091132d402 P f7d44497c5c04c55a6b9dae701b63b2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.216463 25635 tablet_bootstrap.cc:654] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.222803 25229 catalog_manager.cc:5697] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 52e12d0cb9004693ba368ceb7fac2259 reported cstate change: term changed from 0 to 1, leader changed from <none> to 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193). New cstate: current_term: 1 leader_uuid: "52e12d0cb9004693ba368ceb7fac2259" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:55.223970 25633 tablet_bootstrap.cc:492] T a4f91317044d4d75b44b0e091132d402 P f7d44497c5c04c55a6b9dae701b63b2b: No bootstrap required, opened a new log
I20260709 12:12:55.224689 25633 ts_tablet_manager.cc:1403] T a4f91317044d4d75b44b0e091132d402 P f7d44497c5c04c55a6b9dae701b63b2b: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 12:12:55.225986 25632 tablet_bootstrap.cc:492] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259: No bootstrap required, opened a new log
I20260709 12:12:55.226581 25632 ts_tablet_manager.cc:1403] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259: Time spent bootstrapping tablet: real 0.192s	user 0.067s	sys 0.081s
I20260709 12:12:55.228910 25633 raft_consensus.cc:359] T a4f91317044d4d75b44b0e091132d402 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.229993 25633 raft_consensus.cc:385] T a4f91317044d4d75b44b0e091132d402 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.230376 25633 raft_consensus.cc:740] T a4f91317044d4d75b44b0e091132d402 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d44497c5c04c55a6b9dae701b63b2b, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.231151 25632 raft_consensus.cc:359] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.231415 25633 consensus_queue.cc:260] T a4f91317044d4d75b44b0e091132d402 P f7d44497c5c04c55a6b9dae701b63b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.232322 25632 raft_consensus.cc:385] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.233280 25632 raft_consensus.cc:740] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.234112 25632 consensus_queue.cc:260] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.235883 25633 ts_tablet_manager.cc:1434] T a4f91317044d4d75b44b0e091132d402 P f7d44497c5c04c55a6b9dae701b63b2b: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.002s
I20260709 12:12:55.236720 25632 ts_tablet_manager.cc:1434] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:12:55.236992 25633 tablet_bootstrap.cc:492] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b: Bootstrap starting.
I20260709 12:12:55.237608 25635 tablet_bootstrap.cc:492] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d: No bootstrap required, opened a new log
I20260709 12:12:55.237923 25632 tablet_bootstrap.cc:492] T 0b9559a209da4bd299515a2b7cd47629 P 52e12d0cb9004693ba368ceb7fac2259: Bootstrap starting.
I20260709 12:12:55.238117 25635 ts_tablet_manager.cc:1403] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d: Time spent bootstrapping tablet: real 0.029s	user 0.023s	sys 0.000s
I20260709 12:12:55.241405 25635 raft_consensus.cc:359] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.242141 25635 raft_consensus.cc:385] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.242430 25635 raft_consensus.cc:740] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02a30f2f37194042b6ad292011c47d0d, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.243404 25620 raft_consensus.cc:493] T a4f91317044d4d75b44b0e091132d402 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.244088 25620 raft_consensus.cc:515] T a4f91317044d4d75b44b0e091132d402 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.245405 25632 tablet_bootstrap.cc:654] T 0b9559a209da4bd299515a2b7cd47629 P 52e12d0cb9004693ba368ceb7fac2259: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.248054 25480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f91317044d4d75b44b0e091132d402" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02a30f2f37194042b6ad292011c47d0d" is_pre_election: true
I20260709 12:12:55.248672 25480 raft_consensus.cc:2468] T a4f91317044d4d75b44b0e091132d402 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 0.
I20260709 12:12:55.248968 25407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f91317044d4d75b44b0e091132d402" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" is_pre_election: true
I20260709 12:12:55.249845 25407 raft_consensus.cc:2468] T a4f91317044d4d75b44b0e091132d402 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 0.
I20260709 12:12:55.249917 25297 leader_election.cc:304] T a4f91317044d4d75b44b0e091132d402 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02a30f2f37194042b6ad292011c47d0d, 52e12d0cb9004693ba368ceb7fac2259; no voters: 
I20260709 12:12:55.251121 25648 raft_consensus.cc:2804] T a4f91317044d4d75b44b0e091132d402 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:55.251590 25648 raft_consensus.cc:493] T a4f91317044d4d75b44b0e091132d402 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.252022 25648 raft_consensus.cc:3060] T a4f91317044d4d75b44b0e091132d402 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.257352 25633 tablet_bootstrap.cc:654] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.258785 25620 leader_election.cc:290] T a4f91317044d4d75b44b0e091132d402 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:55.261319 25635 consensus_queue.cc:260] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.265731 25635 ts_tablet_manager.cc:1434] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 12:12:55.266933 25635 tablet_bootstrap.cc:492] T d7e8f5c4110f428e8c8c29e99ef734fe P 02a30f2f37194042b6ad292011c47d0d: Bootstrap starting.
I20260709 12:12:55.267906 25632 tablet_bootstrap.cc:492] T 0b9559a209da4bd299515a2b7cd47629 P 52e12d0cb9004693ba368ceb7fac2259: No bootstrap required, opened a new log
I20260709 12:12:55.268461 25632 ts_tablet_manager.cc:1403] T 0b9559a209da4bd299515a2b7cd47629 P 52e12d0cb9004693ba368ceb7fac2259: Time spent bootstrapping tablet: real 0.031s	user 0.020s	sys 0.006s
I20260709 12:12:55.270198 25633 tablet_bootstrap.cc:492] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b: No bootstrap required, opened a new log
I20260709 12:12:55.262872 25648 raft_consensus.cc:515] T a4f91317044d4d75b44b0e091132d402 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.270713 25633 ts_tablet_manager.cc:1403] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.000s
I20260709 12:12:55.271495 25632 raft_consensus.cc:359] T 0b9559a209da4bd299515a2b7cd47629 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.272167 25620 raft_consensus.cc:493] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.272277 25632 raft_consensus.cc:385] T 0b9559a209da4bd299515a2b7cd47629 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.273187 25620 raft_consensus.cc:515] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.274580 25633 raft_consensus.cc:359] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.275573 25633 raft_consensus.cc:385] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.273346 25632 raft_consensus.cc:740] T 0b9559a209da4bd299515a2b7cd47629 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.276916 25632 consensus_queue.cc:260] T 0b9559a209da4bd299515a2b7cd47629 P 52e12d0cb9004693ba368ceb7fac2259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.277783 25480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a320cecc214596975900050a34388c" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02a30f2f37194042b6ad292011c47d0d" is_pre_election: true
W20260709 12:12:55.279170 25297 leader_election.cc:343] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.276038 25633 raft_consensus.cc:740] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d44497c5c04c55a6b9dae701b63b2b, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.279754 25620 leader_election.cc:290] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:55.280321 25633 consensus_queue.cc:260] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.281790 25480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f91317044d4d75b44b0e091132d402" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02a30f2f37194042b6ad292011c47d0d"
I20260709 12:12:55.282320 25480 raft_consensus.cc:3060] T a4f91317044d4d75b44b0e091132d402 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.282467 25635 tablet_bootstrap.cc:654] T d7e8f5c4110f428e8c8c29e99ef734fe P 02a30f2f37194042b6ad292011c47d0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.282771 25633 ts_tablet_manager.cc:1434] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:12:55.283774 25633 tablet_bootstrap.cc:492] T 7beeddfc1c114d3398d73e600e3b3d13 P f7d44497c5c04c55a6b9dae701b63b2b: Bootstrap starting.
I20260709 12:12:55.289235 25480 raft_consensus.cc:2468] T a4f91317044d4d75b44b0e091132d402 P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 1.
I20260709 12:12:55.290088 25633 tablet_bootstrap.cc:654] T 7beeddfc1c114d3398d73e600e3b3d13 P f7d44497c5c04c55a6b9dae701b63b2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.290222 25407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f91317044d4d75b44b0e091132d402" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
I20260709 12:12:55.290436 25297 leader_election.cc:304] T a4f91317044d4d75b44b0e091132d402 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02a30f2f37194042b6ad292011c47d0d, 52e12d0cb9004693ba368ceb7fac2259; no voters: 
I20260709 12:12:55.291064 25407 raft_consensus.cc:3060] T a4f91317044d4d75b44b0e091132d402 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.291448 25620 raft_consensus.cc:2804] T a4f91317044d4d75b44b0e091132d402 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:55.292021 25620 raft_consensus.cc:697] T a4f91317044d4d75b44b0e091132d402 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 LEADER]: Becoming Leader. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Running, Role: LEADER
I20260709 12:12:55.292876 25620 consensus_queue.cc:237] T a4f91317044d4d75b44b0e091132d402 P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.293637 25406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a320cecc214596975900050a34388c" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" is_pre_election: true
I20260709 12:12:55.294310 25406 raft_consensus.cc:2468] T f2a320cecc214596975900050a34388c P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 0.
I20260709 12:12:55.294436 25635 tablet_bootstrap.cc:492] T d7e8f5c4110f428e8c8c29e99ef734fe P 02a30f2f37194042b6ad292011c47d0d: No bootstrap required, opened a new log
I20260709 12:12:55.295001 25635 ts_tablet_manager.cc:1403] T d7e8f5c4110f428e8c8c29e99ef734fe P 02a30f2f37194042b6ad292011c47d0d: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.008s
I20260709 12:12:55.296598 25648 leader_election.cc:290] T a4f91317044d4d75b44b0e091132d402 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 election: Requested vote from peers f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:55.279270 25632 ts_tablet_manager.cc:1434] T 0b9559a209da4bd299515a2b7cd47629 P 52e12d0cb9004693ba368ceb7fac2259: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 12:12:55.298156 25635 raft_consensus.cc:359] T d7e8f5c4110f428e8c8c29e99ef734fe P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.298933 25635 raft_consensus.cc:385] T d7e8f5c4110f428e8c8c29e99ef734fe P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.299211 25635 raft_consensus.cc:740] T d7e8f5c4110f428e8c8c29e99ef734fe P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02a30f2f37194042b6ad292011c47d0d, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.299633 25632 tablet_bootstrap.cc:492] T 1d69a320a510449598156730aee599db P 52e12d0cb9004693ba368ceb7fac2259: Bootstrap starting.
I20260709 12:12:55.299938 25635 consensus_queue.cc:260] T d7e8f5c4110f428e8c8c29e99ef734fe P 02a30f2f37194042b6ad292011c47d0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.304293 25635 ts_tablet_manager.cc:1434] T d7e8f5c4110f428e8c8c29e99ef734fe P 02a30f2f37194042b6ad292011c47d0d: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 12:12:55.305188 25635 tablet_bootstrap.cc:492] T 0b9559a209da4bd299515a2b7cd47629 P 02a30f2f37194042b6ad292011c47d0d: Bootstrap starting.
I20260709 12:12:55.311411 25632 tablet_bootstrap.cc:654] T 1d69a320a510449598156730aee599db P 52e12d0cb9004693ba368ceb7fac2259: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.312871 25295 leader_election.cc:304] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 52e12d0cb9004693ba368ceb7fac2259, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 02a30f2f37194042b6ad292011c47d0d
I20260709 12:12:55.313498 25633 tablet_bootstrap.cc:492] T 7beeddfc1c114d3398d73e600e3b3d13 P f7d44497c5c04c55a6b9dae701b63b2b: No bootstrap required, opened a new log
I20260709 12:12:55.313612 25635 tablet_bootstrap.cc:654] T 0b9559a209da4bd299515a2b7cd47629 P 02a30f2f37194042b6ad292011c47d0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.314073 25620 raft_consensus.cc:2804] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:55.314154 25633 ts_tablet_manager.cc:1403] T 7beeddfc1c114d3398d73e600e3b3d13 P f7d44497c5c04c55a6b9dae701b63b2b: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.017s
I20260709 12:12:55.314575 25620 raft_consensus.cc:493] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.315050 25620 raft_consensus.cc:3060] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.318787 25633 raft_consensus.cc:359] T 7beeddfc1c114d3398d73e600e3b3d13 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.320030 25633 raft_consensus.cc:385] T 7beeddfc1c114d3398d73e600e3b3d13 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.320508 25633 raft_consensus.cc:740] T 7beeddfc1c114d3398d73e600e3b3d13 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d44497c5c04c55a6b9dae701b63b2b, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.321645 25633 consensus_queue.cc:260] T 7beeddfc1c114d3398d73e600e3b3d13 P f7d44497c5c04c55a6b9dae701b63b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.325196 25633 ts_tablet_manager.cc:1434] T 7beeddfc1c114d3398d73e600e3b3d13 P f7d44497c5c04c55a6b9dae701b63b2b: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:12:55.327438 25633 tablet_bootstrap.cc:492] T 0b9559a209da4bd299515a2b7cd47629 P f7d44497c5c04c55a6b9dae701b63b2b: Bootstrap starting.
I20260709 12:12:55.325479 25635 tablet_bootstrap.cc:492] T 0b9559a209da4bd299515a2b7cd47629 P 02a30f2f37194042b6ad292011c47d0d: No bootstrap required, opened a new log
I20260709 12:12:55.328056 25635 ts_tablet_manager.cc:1403] T 0b9559a209da4bd299515a2b7cd47629 P 02a30f2f37194042b6ad292011c47d0d: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.011s
I20260709 12:12:55.328174 25632 tablet_bootstrap.cc:492] T 1d69a320a510449598156730aee599db P 52e12d0cb9004693ba368ceb7fac2259: No bootstrap required, opened a new log
I20260709 12:12:55.328727 25632 ts_tablet_manager.cc:1403] T 1d69a320a510449598156730aee599db P 52e12d0cb9004693ba368ceb7fac2259: Time spent bootstrapping tablet: real 0.029s	user 0.022s	sys 0.004s
I20260709 12:12:55.331390 25635 raft_consensus.cc:359] T 0b9559a209da4bd299515a2b7cd47629 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.332265 25635 raft_consensus.cc:385] T 0b9559a209da4bd299515a2b7cd47629 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.332690 25635 raft_consensus.cc:740] T 0b9559a209da4bd299515a2b7cd47629 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02a30f2f37194042b6ad292011c47d0d, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.333501 25635 consensus_queue.cc:260] T 0b9559a209da4bd299515a2b7cd47629 P 02a30f2f37194042b6ad292011c47d0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.331658 25632 raft_consensus.cc:359] T 1d69a320a510449598156730aee599db P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.335070 25632 raft_consensus.cc:385] T 1d69a320a510449598156730aee599db P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.335383 25632 raft_consensus.cc:740] T 1d69a320a510449598156730aee599db P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.336169 25635 ts_tablet_manager.cc:1434] T 0b9559a209da4bd299515a2b7cd47629 P 02a30f2f37194042b6ad292011c47d0d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:12:55.336118 25632 consensus_queue.cc:260] T 1d69a320a510449598156730aee599db P 52e12d0cb9004693ba368ceb7fac2259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.337339 25635 tablet_bootstrap.cc:492] T 1d69a320a510449598156730aee599db P 02a30f2f37194042b6ad292011c47d0d: Bootstrap starting.
I20260709 12:12:55.340322 25407 raft_consensus.cc:2468] T a4f91317044d4d75b44b0e091132d402 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 1.
I20260709 12:12:55.336807 25228 catalog_manager.cc:5697] T a4f91317044d4d75b44b0e091132d402 P 52e12d0cb9004693ba368ceb7fac2259 reported cstate change: term changed from 0 to 1, leader changed from <none> to 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193). New cstate: current_term: 1 leader_uuid: "52e12d0cb9004693ba368ceb7fac2259" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:55.343304 25632 ts_tablet_manager.cc:1434] T 1d69a320a510449598156730aee599db P 52e12d0cb9004693ba368ceb7fac2259: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.003s
I20260709 12:12:55.344344 25632 tablet_bootstrap.cc:492] T f747ad579e1e40b18a8efbd9fa0c9d5c P 52e12d0cb9004693ba368ceb7fac2259: Bootstrap starting.
I20260709 12:12:55.344681 25635 tablet_bootstrap.cc:654] T 1d69a320a510449598156730aee599db P 02a30f2f37194042b6ad292011c47d0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.342077 25633 tablet_bootstrap.cc:654] T 0b9559a209da4bd299515a2b7cd47629 P f7d44497c5c04c55a6b9dae701b63b2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.347339 25648 raft_consensus.cc:493] T 1d69a320a510449598156730aee599db P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.347947 25530 raft_consensus.cc:493] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.347828 25648 raft_consensus.cc:515] T 1d69a320a510449598156730aee599db P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.348446 25530 raft_consensus.cc:515] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.350498 25648 leader_election.cc:290] T 1d69a320a510449598156730aee599db P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:55.339916 25620 raft_consensus.cc:515] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.351387 25480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d69a320a510449598156730aee599db" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02a30f2f37194042b6ad292011c47d0d" is_pre_election: true
I20260709 12:12:55.352247 25530 leader_election.cc:290] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:55.353157 25620 leader_election.cc:290] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 election: Requested vote from peers f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
W20260709 12:12:55.354631 25297 leader_election.cc:343] T 1d69a320a510449598156730aee599db P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.355796 25481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a320cecc214596975900050a34388c" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02a30f2f37194042b6ad292011c47d0d"
I20260709 12:12:55.356568 25480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c5edae27a14c028d7e6dcac6ae2fa4" candidate_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02a30f2f37194042b6ad292011c47d0d" is_pre_election: true
I20260709 12:12:55.357173 25480 raft_consensus.cc:2468] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7d44497c5c04c55a6b9dae701b63b2b in term 0.
W20260709 12:12:55.357285 25297 leader_election.cc:343] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.358441 25372 leader_election.cc:304] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02a30f2f37194042b6ad292011c47d0d, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 
I20260709 12:12:55.360126 25405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a320cecc214596975900050a34388c" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
I20260709 12:12:55.360775 25405 raft_consensus.cc:3060] T f2a320cecc214596975900050a34388c P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.360770 25331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c5edae27a14c028d7e6dcac6ae2fa4" candidate_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52e12d0cb9004693ba368ceb7fac2259" is_pre_election: true
I20260709 12:12:55.361560 25331 raft_consensus.cc:2468] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7d44497c5c04c55a6b9dae701b63b2b in term 0.
I20260709 12:12:55.365242 25406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d69a320a510449598156730aee599db" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" is_pre_election: true
I20260709 12:12:55.365638 25665 raft_consensus.cc:2804] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:55.366106 25665 raft_consensus.cc:493] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:12:55.367097 25295 leader_election.cc:343] T 1d69a320a510449598156730aee599db P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:12:55.367726 25295 leader_election.cc:304] T 1d69a320a510449598156730aee599db P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 52e12d0cb9004693ba368ceb7fac2259; no voters: 02a30f2f37194042b6ad292011c47d0d, f7d44497c5c04c55a6b9dae701b63b2b
I20260709 12:12:55.369140 25620 raft_consensus.cc:2749] T 1d69a320a510449598156730aee599db P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:55.366449 25665 raft_consensus.cc:3060] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.374884 25405 raft_consensus.cc:2468] T f2a320cecc214596975900050a34388c P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 1.
I20260709 12:12:55.354708 25632 tablet_bootstrap.cc:654] T f747ad579e1e40b18a8efbd9fa0c9d5c P 52e12d0cb9004693ba368ceb7fac2259: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.376176 25295 leader_election.cc:304] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 52e12d0cb9004693ba368ceb7fac2259, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 02a30f2f37194042b6ad292011c47d0d
I20260709 12:12:55.377799 25620 raft_consensus.cc:2804] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:55.378252 25620 raft_consensus.cc:697] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259 [term 1 LEADER]: Becoming Leader. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Running, Role: LEADER
I20260709 12:12:55.379079 25620 consensus_queue.cc:237] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.386075 25635 tablet_bootstrap.cc:492] T 1d69a320a510449598156730aee599db P 02a30f2f37194042b6ad292011c47d0d: No bootstrap required, opened a new log
I20260709 12:12:55.386808 25635 ts_tablet_manager.cc:1403] T 1d69a320a510449598156730aee599db P 02a30f2f37194042b6ad292011c47d0d: Time spent bootstrapping tablet: real 0.050s	user 0.008s	sys 0.016s
I20260709 12:12:55.389364 25635 raft_consensus.cc:359] T 1d69a320a510449598156730aee599db P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.389967 25635 raft_consensus.cc:385] T 1d69a320a510449598156730aee599db P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.390110 25633 tablet_bootstrap.cc:492] T 0b9559a209da4bd299515a2b7cd47629 P f7d44497c5c04c55a6b9dae701b63b2b: No bootstrap required, opened a new log
I20260709 12:12:55.395996 25633 ts_tablet_manager.cc:1403] T 0b9559a209da4bd299515a2b7cd47629 P f7d44497c5c04c55a6b9dae701b63b2b: Time spent bootstrapping tablet: real 0.069s	user 0.021s	sys 0.013s
I20260709 12:12:55.397725 25665 raft_consensus.cc:515] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.399786 25633 raft_consensus.cc:359] T 0b9559a209da4bd299515a2b7cd47629 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.400627 25633 raft_consensus.cc:385] T 0b9559a209da4bd299515a2b7cd47629 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.400789 25332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c5edae27a14c028d7e6dcac6ae2fa4" candidate_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52e12d0cb9004693ba368ceb7fac2259"
I20260709 12:12:55.400985 25633 raft_consensus.cc:740] T 0b9559a209da4bd299515a2b7cd47629 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d44497c5c04c55a6b9dae701b63b2b, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.401023 25632 tablet_bootstrap.cc:492] T f747ad579e1e40b18a8efbd9fa0c9d5c P 52e12d0cb9004693ba368ceb7fac2259: No bootstrap required, opened a new log
I20260709 12:12:55.390190 25635 raft_consensus.cc:740] T 1d69a320a510449598156730aee599db P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02a30f2f37194042b6ad292011c47d0d, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.401866 25632 ts_tablet_manager.cc:1403] T f747ad579e1e40b18a8efbd9fa0c9d5c P 52e12d0cb9004693ba368ceb7fac2259: Time spent bootstrapping tablet: real 0.058s	user 0.006s	sys 0.025s
I20260709 12:12:55.398211 25230 catalog_manager.cc:5697] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259 reported cstate change: term changed from 0 to 1, leader changed from <none> to 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193). New cstate: current_term: 1 leader_uuid: "52e12d0cb9004693ba368ceb7fac2259" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:55.402370 25635 consensus_queue.cc:260] T 1d69a320a510449598156730aee599db P 02a30f2f37194042b6ad292011c47d0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.402957 25332 raft_consensus.cc:3060] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.405378 25632 raft_consensus.cc:359] T f747ad579e1e40b18a8efbd9fa0c9d5c P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.406173 25632 raft_consensus.cc:385] T f747ad579e1e40b18a8efbd9fa0c9d5c P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.406457 25632 raft_consensus.cc:740] T f747ad579e1e40b18a8efbd9fa0c9d5c P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.407616 25632 consensus_queue.cc:260] T f747ad579e1e40b18a8efbd9fa0c9d5c P 52e12d0cb9004693ba368ceb7fac2259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.409219 25635 ts_tablet_manager.cc:1434] T 1d69a320a510449598156730aee599db P 02a30f2f37194042b6ad292011c47d0d: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.001s
I20260709 12:12:55.410132 25632 ts_tablet_manager.cc:1434] T f747ad579e1e40b18a8efbd9fa0c9d5c P 52e12d0cb9004693ba368ceb7fac2259: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 12:12:55.410178 25635 tablet_bootstrap.cc:492] T f2a320cecc214596975900050a34388c P 02a30f2f37194042b6ad292011c47d0d: Bootstrap starting.
I20260709 12:12:55.411408 25632 tablet_bootstrap.cc:492] T 7beeddfc1c114d3398d73e600e3b3d13 P 52e12d0cb9004693ba368ceb7fac2259: Bootstrap starting.
I20260709 12:12:55.412271 25332 raft_consensus.cc:2468] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d44497c5c04c55a6b9dae701b63b2b in term 1.
I20260709 12:12:55.413790 25665 leader_election.cc:290] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b [CANDIDATE]: Term 1 election: Requested vote from peers 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:55.401923 25633 consensus_queue.cc:260] T 0b9559a209da4bd299515a2b7cd47629 P f7d44497c5c04c55a6b9dae701b63b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.415302 25370 leader_election.cc:304] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52e12d0cb9004693ba368ceb7fac2259, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 
I20260709 12:12:55.416158 25633 ts_tablet_manager.cc:1434] T 0b9559a209da4bd299515a2b7cd47629 P f7d44497c5c04c55a6b9dae701b63b2b: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.003s
I20260709 12:12:55.416467 25530 raft_consensus.cc:2804] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:55.416972 25530 raft_consensus.cc:697] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 LEADER]: Becoming Leader. State: Replica: f7d44497c5c04c55a6b9dae701b63b2b, State: Running, Role: LEADER
I20260709 12:12:55.417505 25633 tablet_bootstrap.cc:492] T d7e8f5c4110f428e8c8c29e99ef734fe P f7d44497c5c04c55a6b9dae701b63b2b: Bootstrap starting.
I20260709 12:12:55.417572 25480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c5edae27a14c028d7e6dcac6ae2fa4" candidate_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02a30f2f37194042b6ad292011c47d0d"
I20260709 12:12:55.418279 25480 raft_consensus.cc:3060] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.418864 25632 tablet_bootstrap.cc:654] T 7beeddfc1c114d3398d73e600e3b3d13 P 52e12d0cb9004693ba368ceb7fac2259: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.425638 25480 raft_consensus.cc:2468] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d44497c5c04c55a6b9dae701b63b2b in term 1.
I20260709 12:12:55.426954 25633 tablet_bootstrap.cc:654] T d7e8f5c4110f428e8c8c29e99ef734fe P f7d44497c5c04c55a6b9dae701b63b2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.417778 25530 consensus_queue.cc:237] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.431180 25635 tablet_bootstrap.cc:654] T f2a320cecc214596975900050a34388c P 02a30f2f37194042b6ad292011c47d0d: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.438452 25620 raft_consensus.cc:493] T 0b9559a209da4bd299515a2b7cd47629 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.439285 25620 raft_consensus.cc:515] T 0b9559a209da4bd299515a2b7cd47629 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.440483 25632 tablet_bootstrap.cc:492] T 7beeddfc1c114d3398d73e600e3b3d13 P 52e12d0cb9004693ba368ceb7fac2259: No bootstrap required, opened a new log
I20260709 12:12:55.441009 25632 ts_tablet_manager.cc:1403] T 7beeddfc1c114d3398d73e600e3b3d13 P 52e12d0cb9004693ba368ceb7fac2259: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.016s
I20260709 12:12:55.443022 25407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9559a209da4bd299515a2b7cd47629" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" is_pre_election: true
I20260709 12:12:55.442565 25228 catalog_manager.cc:5697] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b reported cstate change: term changed from 0 to 1, leader changed from <none> to f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194). New cstate: current_term: 1 leader_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:55.443897 25407 raft_consensus.cc:2468] T 0b9559a209da4bd299515a2b7cd47629 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 0.
I20260709 12:12:55.444097 25632 raft_consensus.cc:359] T 7beeddfc1c114d3398d73e600e3b3d13 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.444854 25632 raft_consensus.cc:385] T 7beeddfc1c114d3398d73e600e3b3d13 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.445120 25632 raft_consensus.cc:740] T 7beeddfc1c114d3398d73e600e3b3d13 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.445501 25295 leader_election.cc:304] T 0b9559a209da4bd299515a2b7cd47629 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52e12d0cb9004693ba368ceb7fac2259, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 
I20260709 12:12:55.446622 25648 raft_consensus.cc:2804] T 0b9559a209da4bd299515a2b7cd47629 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:55.447147 25648 raft_consensus.cc:493] T 0b9559a209da4bd299515a2b7cd47629 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.447578 25648 raft_consensus.cc:3060] T 0b9559a209da4bd299515a2b7cd47629 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.445782 25632 consensus_queue.cc:260] T 7beeddfc1c114d3398d73e600e3b3d13 P 52e12d0cb9004693ba368ceb7fac2259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.449901 25632 ts_tablet_manager.cc:1434] T 7beeddfc1c114d3398d73e600e3b3d13 P 52e12d0cb9004693ba368ceb7fac2259: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:12:55.452126 25635 tablet_bootstrap.cc:492] T f2a320cecc214596975900050a34388c P 02a30f2f37194042b6ad292011c47d0d: No bootstrap required, opened a new log
I20260709 12:12:55.452641 25635 ts_tablet_manager.cc:1403] T f2a320cecc214596975900050a34388c P 02a30f2f37194042b6ad292011c47d0d: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.000s
I20260709 12:12:55.455413 25635 raft_consensus.cc:359] T f2a320cecc214596975900050a34388c P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.456045 25635 raft_consensus.cc:385] T f2a320cecc214596975900050a34388c P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.456326 25635 raft_consensus.cc:740] T f2a320cecc214596975900050a34388c P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02a30f2f37194042b6ad292011c47d0d, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.456933 25635 consensus_queue.cc:260] T f2a320cecc214596975900050a34388c P 02a30f2f37194042b6ad292011c47d0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.457654 25666 raft_consensus.cc:493] T 7beeddfc1c114d3398d73e600e3b3d13 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.458159 25666 raft_consensus.cc:515] T 7beeddfc1c114d3398d73e600e3b3d13 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.459246 25632 tablet_bootstrap.cc:492] T d7e8f5c4110f428e8c8c29e99ef734fe P 52e12d0cb9004693ba368ceb7fac2259: Bootstrap starting.
I20260709 12:12:55.458487 25648 raft_consensus.cc:515] T 0b9559a209da4bd299515a2b7cd47629 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.462337 25635 ts_tablet_manager.cc:1434] T f2a320cecc214596975900050a34388c P 02a30f2f37194042b6ad292011c47d0d: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:12:55.460582 25666 leader_election.cc:290] T 7beeddfc1c114d3398d73e600e3b3d13 P f7d44497c5c04c55a6b9dae701b63b2b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:55.464221 25648 leader_election.cc:290] T 0b9559a209da4bd299515a2b7cd47629 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 election: Requested vote from peers f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:55.464332 25407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9559a209da4bd299515a2b7cd47629" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
I20260709 12:12:55.464933 25407 raft_consensus.cc:3060] T 0b9559a209da4bd299515a2b7cd47629 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.465294 25480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beeddfc1c114d3398d73e600e3b3d13" candidate_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02a30f2f37194042b6ad292011c47d0d" is_pre_election: true
I20260709 12:12:55.465878 25480 raft_consensus.cc:2468] T 7beeddfc1c114d3398d73e600e3b3d13 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7d44497c5c04c55a6b9dae701b63b2b in term 0.
I20260709 12:12:55.465929 25620 leader_election.cc:290] T 0b9559a209da4bd299515a2b7cd47629 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:55.467049 25372 leader_election.cc:304] T 7beeddfc1c114d3398d73e600e3b3d13 P f7d44497c5c04c55a6b9dae701b63b2b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02a30f2f37194042b6ad292011c47d0d, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 
I20260709 12:12:55.468266 25649 raft_consensus.cc:493] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.468207 25332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beeddfc1c114d3398d73e600e3b3d13" candidate_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52e12d0cb9004693ba368ceb7fac2259" is_pre_election: true
I20260709 12:12:55.469002 25332 raft_consensus.cc:2468] T 7beeddfc1c114d3398d73e600e3b3d13 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7d44497c5c04c55a6b9dae701b63b2b in term 0.
I20260709 12:12:55.468875 25649 raft_consensus.cc:515] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.470846 25481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9559a209da4bd299515a2b7cd47629" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02a30f2f37194042b6ad292011c47d0d" is_pre_election: true
I20260709 12:12:55.471050 25649 leader_election.cc:290] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391), f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825)
I20260709 12:12:55.471478 25481 raft_consensus.cc:2468] T 0b9559a209da4bd299515a2b7cd47629 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 0.
I20260709 12:12:55.472958 25480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9559a209da4bd299515a2b7cd47629" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02a30f2f37194042b6ad292011c47d0d"
I20260709 12:12:55.473489 25480 raft_consensus.cc:3060] T 0b9559a209da4bd299515a2b7cd47629 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.477859 25633 tablet_bootstrap.cc:492] T d7e8f5c4110f428e8c8c29e99ef734fe P f7d44497c5c04c55a6b9dae701b63b2b: No bootstrap required, opened a new log
I20260709 12:12:55.478360 25633 ts_tablet_manager.cc:1403] T d7e8f5c4110f428e8c8c29e99ef734fe P f7d44497c5c04c55a6b9dae701b63b2b: Time spent bootstrapping tablet: real 0.061s	user 0.026s	sys 0.017s
I20260709 12:12:55.479230 25405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f747ad579e1e40b18a8efbd9fa0c9d5c" candidate_uuid: "02a30f2f37194042b6ad292011c47d0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" is_pre_election: true
I20260709 12:12:55.479490 25407 raft_consensus.cc:2468] T 0b9559a209da4bd299515a2b7cd47629 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 1.
I20260709 12:12:55.479899 25405 raft_consensus.cc:2468] T f747ad579e1e40b18a8efbd9fa0c9d5c P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02a30f2f37194042b6ad292011c47d0d in term 0.
I20260709 12:12:55.480773 25295 leader_election.cc:304] T 0b9559a209da4bd299515a2b7cd47629 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52e12d0cb9004693ba368ceb7fac2259, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 
I20260709 12:12:55.481119 25480 raft_consensus.cc:2468] T 0b9559a209da4bd299515a2b7cd47629 P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 1.
I20260709 12:12:55.481180 25444 leader_election.cc:304] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02a30f2f37194042b6ad292011c47d0d, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 
I20260709 12:12:55.481912 25332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f747ad579e1e40b18a8efbd9fa0c9d5c" candidate_uuid: "02a30f2f37194042b6ad292011c47d0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52e12d0cb9004693ba368ceb7fac2259" is_pre_election: true
I20260709 12:12:55.482323 25632 tablet_bootstrap.cc:654] T d7e8f5c4110f428e8c8c29e99ef734fe P 52e12d0cb9004693ba368ceb7fac2259: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.482532 25332 raft_consensus.cc:2468] T f747ad579e1e40b18a8efbd9fa0c9d5c P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02a30f2f37194042b6ad292011c47d0d in term 0.
I20260709 12:12:55.483752 25648 raft_consensus.cc:2804] T 0b9559a209da4bd299515a2b7cd47629 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:55.483872 25666 raft_consensus.cc:2804] T 7beeddfc1c114d3398d73e600e3b3d13 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:55.484391 25666 raft_consensus.cc:493] T 7beeddfc1c114d3398d73e600e3b3d13 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.484812 25666 raft_consensus.cc:3060] T 7beeddfc1c114d3398d73e600e3b3d13 P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.485009 25648 raft_consensus.cc:697] T 0b9559a209da4bd299515a2b7cd47629 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 LEADER]: Becoming Leader. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Running, Role: LEADER
I20260709 12:12:55.485958 25648 consensus_queue.cc:237] T 0b9559a209da4bd299515a2b7cd47629 P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.482242 25649 raft_consensus.cc:2804] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:55.486104 25633 raft_consensus.cc:359] T d7e8f5c4110f428e8c8c29e99ef734fe P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.486866 25649 raft_consensus.cc:493] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.486933 25633 raft_consensus.cc:385] T d7e8f5c4110f428e8c8c29e99ef734fe P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.487370 25649 raft_consensus.cc:3060] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.487413 25633 raft_consensus.cc:740] T d7e8f5c4110f428e8c8c29e99ef734fe P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d44497c5c04c55a6b9dae701b63b2b, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.488291 25633 consensus_queue.cc:260] T d7e8f5c4110f428e8c8c29e99ef734fe P f7d44497c5c04c55a6b9dae701b63b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.490351 25633 ts_tablet_manager.cc:1434] T d7e8f5c4110f428e8c8c29e99ef734fe P f7d44497c5c04c55a6b9dae701b63b2b: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:12:55.491636 25633 tablet_bootstrap.cc:492] T 1d69a320a510449598156730aee599db P f7d44497c5c04c55a6b9dae701b63b2b: Bootstrap starting.
I20260709 12:12:55.496678 25666 raft_consensus.cc:515] T 7beeddfc1c114d3398d73e600e3b3d13 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.497563 25633 tablet_bootstrap.cc:654] T 1d69a320a510449598156730aee599db P f7d44497c5c04c55a6b9dae701b63b2b: Neither blocks nor log segments found. Creating new log.
I20260709 12:12:55.505363 25481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beeddfc1c114d3398d73e600e3b3d13" candidate_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02a30f2f37194042b6ad292011c47d0d"
I20260709 12:12:55.505787 25332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beeddfc1c114d3398d73e600e3b3d13" candidate_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52e12d0cb9004693ba368ceb7fac2259"
I20260709 12:12:55.506022 25481 raft_consensus.cc:3060] T 7beeddfc1c114d3398d73e600e3b3d13 P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.505913 25649 raft_consensus.cc:515] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.506412 25332 raft_consensus.cc:3060] T 7beeddfc1c114d3398d73e600e3b3d13 P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.513048 25633 tablet_bootstrap.cc:492] T 1d69a320a510449598156730aee599db P f7d44497c5c04c55a6b9dae701b63b2b: No bootstrap required, opened a new log
I20260709 12:12:55.513592 25633 ts_tablet_manager.cc:1403] T 1d69a320a510449598156730aee599db P f7d44497c5c04c55a6b9dae701b63b2b: Time spent bootstrapping tablet: real 0.022s	user 0.005s	sys 0.005s
I20260709 12:12:55.514048 25632 tablet_bootstrap.cc:492] T d7e8f5c4110f428e8c8c29e99ef734fe P 52e12d0cb9004693ba368ceb7fac2259: No bootstrap required, opened a new log
I20260709 12:12:55.514564 25632 ts_tablet_manager.cc:1403] T d7e8f5c4110f428e8c8c29e99ef734fe P 52e12d0cb9004693ba368ceb7fac2259: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.008s
I20260709 12:12:55.516360 25633 raft_consensus.cc:359] T 1d69a320a510449598156730aee599db P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.517067 25633 raft_consensus.cc:385] T 1d69a320a510449598156730aee599db P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.517351 25633 raft_consensus.cc:740] T 1d69a320a510449598156730aee599db P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d44497c5c04c55a6b9dae701b63b2b, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.513602 25666 leader_election.cc:290] T 7beeddfc1c114d3398d73e600e3b3d13 P f7d44497c5c04c55a6b9dae701b63b2b [CANDIDATE]: Term 1 election: Requested vote from peers 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:55.517428 25632 raft_consensus.cc:359] T d7e8f5c4110f428e8c8c29e99ef734fe P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.518625 25632 raft_consensus.cc:385] T d7e8f5c4110f428e8c8c29e99ef734fe P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:12:55.518954 25632 raft_consensus.cc:740] T d7e8f5c4110f428e8c8c29e99ef734fe P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Initialized, Role: FOLLOWER
I20260709 12:12:55.518919 25331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f747ad579e1e40b18a8efbd9fa0c9d5c" candidate_uuid: "02a30f2f37194042b6ad292011c47d0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52e12d0cb9004693ba368ceb7fac2259"
I20260709 12:12:55.519654 25331 raft_consensus.cc:3060] T f747ad579e1e40b18a8efbd9fa0c9d5c P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.519951 25632 consensus_queue.cc:260] T d7e8f5c4110f428e8c8c29e99ef734fe P 52e12d0cb9004693ba368ceb7fac2259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.521884 25481 raft_consensus.cc:2468] T 7beeddfc1c114d3398d73e600e3b3d13 P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d44497c5c04c55a6b9dae701b63b2b in term 1.
I20260709 12:12:55.523664 25372 leader_election.cc:304] T 7beeddfc1c114d3398d73e600e3b3d13 P f7d44497c5c04c55a6b9dae701b63b2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02a30f2f37194042b6ad292011c47d0d, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 
I20260709 12:12:55.522504 25632 ts_tablet_manager.cc:1434] T d7e8f5c4110f428e8c8c29e99ef734fe P 52e12d0cb9004693ba368ceb7fac2259: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:12:55.525899 25666 raft_consensus.cc:2804] T 7beeddfc1c114d3398d73e600e3b3d13 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:55.527012 25331 raft_consensus.cc:2468] T f747ad579e1e40b18a8efbd9fa0c9d5c P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02a30f2f37194042b6ad292011c47d0d in term 1.
I20260709 12:12:55.523718 25405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f747ad579e1e40b18a8efbd9fa0c9d5c" candidate_uuid: "02a30f2f37194042b6ad292011c47d0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
I20260709 12:12:55.527997 25405 raft_consensus.cc:3060] T f747ad579e1e40b18a8efbd9fa0c9d5c P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.527740 25633 consensus_queue.cc:260] T 1d69a320a510449598156730aee599db P f7d44497c5c04c55a6b9dae701b63b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.527215 25666 raft_consensus.cc:697] T 7beeddfc1c114d3398d73e600e3b3d13 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 LEADER]: Becoming Leader. State: Replica: f7d44497c5c04c55a6b9dae701b63b2b, State: Running, Role: LEADER
I20260709 12:12:55.529940 25633 ts_tablet_manager.cc:1434] T 1d69a320a510449598156730aee599db P f7d44497c5c04c55a6b9dae701b63b2b: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.006s
I20260709 12:12:55.529621 25666 consensus_queue.cc:237] T 7beeddfc1c114d3398d73e600e3b3d13 P f7d44497c5c04c55a6b9dae701b63b2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.524001 25332 raft_consensus.cc:2468] T 7beeddfc1c114d3398d73e600e3b3d13 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d44497c5c04c55a6b9dae701b63b2b in term 1.
I20260709 12:12:55.531792 25444 leader_election.cc:304] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02a30f2f37194042b6ad292011c47d0d, 52e12d0cb9004693ba368ceb7fac2259; no voters: 
I20260709 12:12:55.532562 25583 raft_consensus.cc:2804] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:55.532606 25620 raft_consensus.cc:493] T d7e8f5c4110f428e8c8c29e99ef734fe P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.533289 25620 raft_consensus.cc:515] T d7e8f5c4110f428e8c8c29e99ef734fe P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.533895 25583 raft_consensus.cc:697] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d [term 1 LEADER]: Becoming Leader. State: Replica: 02a30f2f37194042b6ad292011c47d0d, State: Running, Role: LEADER
I20260709 12:12:55.534830 25583 consensus_queue.cc:237] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.534706 25228 catalog_manager.cc:5697] T 0b9559a209da4bd299515a2b7cd47629 P 52e12d0cb9004693ba368ceb7fac2259 reported cstate change: term changed from 0 to 1, leader changed from <none> to 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193). New cstate: current_term: 1 leader_uuid: "52e12d0cb9004693ba368ceb7fac2259" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:55.536211 25407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7e8f5c4110f428e8c8c29e99ef734fe" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" is_pre_election: true
I20260709 12:12:55.536484 25620 leader_election.cc:290] T d7e8f5c4110f428e8c8c29e99ef734fe P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:55.536628 25481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7e8f5c4110f428e8c8c29e99ef734fe" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02a30f2f37194042b6ad292011c47d0d" is_pre_election: true
I20260709 12:12:55.536803 25407 raft_consensus.cc:2468] T d7e8f5c4110f428e8c8c29e99ef734fe P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 0.
I20260709 12:12:55.537343 25481 raft_consensus.cc:2468] T d7e8f5c4110f428e8c8c29e99ef734fe P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 0.
I20260709 12:12:55.538056 25295 leader_election.cc:304] T d7e8f5c4110f428e8c8c29e99ef734fe P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52e12d0cb9004693ba368ceb7fac2259, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 
I20260709 12:12:55.542137 25405 raft_consensus.cc:2468] T f747ad579e1e40b18a8efbd9fa0c9d5c P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02a30f2f37194042b6ad292011c47d0d in term 1.
I20260709 12:12:55.542842 25620 raft_consensus.cc:2804] T d7e8f5c4110f428e8c8c29e99ef734fe P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:55.543236 25620 raft_consensus.cc:493] T d7e8f5c4110f428e8c8c29e99ef734fe P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.543583 25620 raft_consensus.cc:3060] T d7e8f5c4110f428e8c8c29e99ef734fe P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.524142 25649 leader_election.cc:290] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d [CANDIDATE]: Term 1 election: Requested vote from peers 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391), f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825)
I20260709 12:12:55.551901 25229 catalog_manager.cc:5697] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 02a30f2f37194042b6ad292011c47d0d (127.16.98.195). New cstate: current_term: 1 leader_uuid: "02a30f2f37194042b6ad292011c47d0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:55.552700 25583 raft_consensus.cc:493] T f2a320cecc214596975900050a34388c P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.552433 25620 raft_consensus.cc:515] T d7e8f5c4110f428e8c8c29e99ef734fe P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.553351 25583 raft_consensus.cc:515] T f2a320cecc214596975900050a34388c P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.556385 25583 leader_election.cc:290] T f2a320cecc214596975900050a34388c P 02a30f2f37194042b6ad292011c47d0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391), f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825)
I20260709 12:12:55.556077 25228 catalog_manager.cc:5697] T 7beeddfc1c114d3398d73e600e3b3d13 P f7d44497c5c04c55a6b9dae701b63b2b reported cstate change: term changed from 0 to 1, leader changed from <none> to f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194). New cstate: current_term: 1 leader_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:55.558130 25405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a320cecc214596975900050a34388c" candidate_uuid: "02a30f2f37194042b6ad292011c47d0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" is_pre_election: true
I20260709 12:12:55.558706 25332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a320cecc214596975900050a34388c" candidate_uuid: "02a30f2f37194042b6ad292011c47d0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52e12d0cb9004693ba368ceb7fac2259" is_pre_election: true
I20260709 12:12:55.558971 25405 raft_consensus.cc:2393] T f2a320cecc214596975900050a34388c P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 02a30f2f37194042b6ad292011c47d0d in current term 1: Already voted for candidate 52e12d0cb9004693ba368ceb7fac2259 in this term.
I20260709 12:12:55.561939 25405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7e8f5c4110f428e8c8c29e99ef734fe" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
I20260709 12:12:55.562490 25405 raft_consensus.cc:3060] T d7e8f5c4110f428e8c8c29e99ef734fe P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.563577 25444 leader_election.cc:304] T f2a320cecc214596975900050a34388c P 02a30f2f37194042b6ad292011c47d0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 02a30f2f37194042b6ad292011c47d0d; no voters: 52e12d0cb9004693ba368ceb7fac2259, f7d44497c5c04c55a6b9dae701b63b2b
I20260709 12:12:55.568135 25620 leader_election.cc:290] T d7e8f5c4110f428e8c8c29e99ef734fe P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 election: Requested vote from peers f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:55.568919 25481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7e8f5c4110f428e8c8c29e99ef734fe" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02a30f2f37194042b6ad292011c47d0d"
I20260709 12:12:55.569764 25481 raft_consensus.cc:3060] T d7e8f5c4110f428e8c8c29e99ef734fe P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.570442 25405 raft_consensus.cc:2468] T d7e8f5c4110f428e8c8c29e99ef734fe P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 1.
I20260709 12:12:55.571879 25295 leader_election.cc:304] T d7e8f5c4110f428e8c8c29e99ef734fe P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52e12d0cb9004693ba368ceb7fac2259, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 
I20260709 12:12:55.572480 25583 raft_consensus.cc:3060] T f2a320cecc214596975900050a34388c P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.575400 25620 raft_consensus.cc:2804] T d7e8f5c4110f428e8c8c29e99ef734fe P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:55.576586 25620 raft_consensus.cc:697] T d7e8f5c4110f428e8c8c29e99ef734fe P 52e12d0cb9004693ba368ceb7fac2259 [term 1 LEADER]: Becoming Leader. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Running, Role: LEADER
I20260709 12:12:55.577410 25620 consensus_queue.cc:237] T d7e8f5c4110f428e8c8c29e99ef734fe P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.578318 25481 raft_consensus.cc:2468] T d7e8f5c4110f428e8c8c29e99ef734fe P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 1.
I20260709 12:12:55.581898 25583 raft_consensus.cc:2749] T f2a320cecc214596975900050a34388c P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:12:55.586997 25229 catalog_manager.cc:5697] T d7e8f5c4110f428e8c8c29e99ef734fe P 52e12d0cb9004693ba368ceb7fac2259 reported cstate change: term changed from 0 to 1, leader changed from <none> to 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193). New cstate: current_term: 1 leader_uuid: "52e12d0cb9004693ba368ceb7fac2259" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:55.587738 25620 consensus_queue.cc:1048] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.607299 25648 consensus_queue.cc:1048] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:12:55.697989 25278 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:12:55.737740 25583 raft_consensus.cc:493] T 1d69a320a510449598156730aee599db P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:12:55.738292 25648 consensus_queue.cc:1048] T a4f91317044d4d75b44b0e091132d402 P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.738353 25583 raft_consensus.cc:515] T 1d69a320a510449598156730aee599db P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.740460 25583 leader_election.cc:290] T 1d69a320a510449598156730aee599db P 02a30f2f37194042b6ad292011c47d0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391), f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825)
I20260709 12:12:55.741128 25332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d69a320a510449598156730aee599db" candidate_uuid: "02a30f2f37194042b6ad292011c47d0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52e12d0cb9004693ba368ceb7fac2259" is_pre_election: true
I20260709 12:12:55.741609 25405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d69a320a510449598156730aee599db" candidate_uuid: "02a30f2f37194042b6ad292011c47d0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" is_pre_election: true
I20260709 12:12:55.741840 25332 raft_consensus.cc:2468] T 1d69a320a510449598156730aee599db P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02a30f2f37194042b6ad292011c47d0d in term 0.
I20260709 12:12:55.742300 25405 raft_consensus.cc:2468] T 1d69a320a510449598156730aee599db P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 02a30f2f37194042b6ad292011c47d0d in term 0.
I20260709 12:12:55.743325 25444 leader_election.cc:304] T 1d69a320a510449598156730aee599db P 02a30f2f37194042b6ad292011c47d0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02a30f2f37194042b6ad292011c47d0d, 52e12d0cb9004693ba368ceb7fac2259; no voters: 
I20260709 12:12:55.744100 25649 raft_consensus.cc:2804] T 1d69a320a510449598156730aee599db P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:12:55.744475 25649 raft_consensus.cc:493] T 1d69a320a510449598156730aee599db P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:12:55.744763 25649 raft_consensus.cc:3060] T 1d69a320a510449598156730aee599db P 02a30f2f37194042b6ad292011c47d0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.751587 25649 raft_consensus.cc:515] T 1d69a320a510449598156730aee599db P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.753499 25649 leader_election.cc:290] T 1d69a320a510449598156730aee599db P 02a30f2f37194042b6ad292011c47d0d [CANDIDATE]: Term 1 election: Requested vote from peers 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391), f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825)
I20260709 12:12:55.754623 25407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d69a320a510449598156730aee599db" candidate_uuid: "02a30f2f37194042b6ad292011c47d0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
I20260709 12:12:55.755246 25407 raft_consensus.cc:3060] T 1d69a320a510449598156730aee599db P f7d44497c5c04c55a6b9dae701b63b2b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.759040 25646 consensus_queue.cc:1048] T a4f91317044d4d75b44b0e091132d402 P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:55.754998 25332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d69a320a510449598156730aee599db" candidate_uuid: "02a30f2f37194042b6ad292011c47d0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52e12d0cb9004693ba368ceb7fac2259"
I20260709 12:12:55.760531 25332 raft_consensus.cc:3060] T 1d69a320a510449598156730aee599db P 52e12d0cb9004693ba368ceb7fac2259 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:12:55.761310 25407 raft_consensus.cc:2468] T 1d69a320a510449598156730aee599db P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02a30f2f37194042b6ad292011c47d0d in term 1.
I20260709 12:12:55.762348 25444 leader_election.cc:304] T 1d69a320a510449598156730aee599db P 02a30f2f37194042b6ad292011c47d0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02a30f2f37194042b6ad292011c47d0d, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 
I20260709 12:12:55.763041 25649 raft_consensus.cc:2804] T 1d69a320a510449598156730aee599db P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:12:55.763574 25649 raft_consensus.cc:697] T 1d69a320a510449598156730aee599db P 02a30f2f37194042b6ad292011c47d0d [term 1 LEADER]: Becoming Leader. State: Replica: 02a30f2f37194042b6ad292011c47d0d, State: Running, Role: LEADER
I20260709 12:12:55.764557 25649 consensus_queue.cc:237] T 1d69a320a510449598156730aee599db P 02a30f2f37194042b6ad292011c47d0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.767987 25332 raft_consensus.cc:2468] T 1d69a320a510449598156730aee599db P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02a30f2f37194042b6ad292011c47d0d in term 1.
I20260709 12:12:55.774051 25228 catalog_manager.cc:5697] T 1d69a320a510449598156730aee599db P 02a30f2f37194042b6ad292011c47d0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 02a30f2f37194042b6ad292011c47d0d (127.16.98.195). New cstate: current_term: 1 leader_uuid: "02a30f2f37194042b6ad292011c47d0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:55.865950 25405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3c5edae27a14c028d7e6dcac6ae2fa4"
dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
mode: GRACEFUL
new_leader_uuid: "52e12d0cb9004693ba368ceb7fac2259"
 from {username='slave'} at 127.0.0.1:45256
I20260709 12:12:55.866559 25405 raft_consensus.cc:606] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 LEADER]: Received request to transfer leadership to TS 52e12d0cb9004693ba368ceb7fac2259
I20260709 12:12:55.874545 25405 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7beeddfc1c114d3398d73e600e3b3d13"
dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
mode: GRACEFUL
new_leader_uuid: "52e12d0cb9004693ba368ceb7fac2259"
 from {username='slave'} at 127.0.0.1:45256
I20260709 12:12:55.875115 25405 raft_consensus.cc:606] T 7beeddfc1c114d3398d73e600e3b3d13 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 LEADER]: Received request to transfer leadership to TS 52e12d0cb9004693ba368ceb7fac2259
I20260709 12:12:55.883278 25332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b9559a209da4bd299515a2b7cd47629"
dest_uuid: "52e12d0cb9004693ba368ceb7fac2259"
mode: GRACEFUL
new_leader_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
 from {username='slave'} at 127.0.0.1:52542
I20260709 12:12:55.883888 25332 raft_consensus.cc:606] T 0b9559a209da4bd299515a2b7cd47629 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 LEADER]: Received request to transfer leadership to TS f7d44497c5c04c55a6b9dae701b63b2b
I20260709 12:12:55.888798 25332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2a320cecc214596975900050a34388c"
dest_uuid: "52e12d0cb9004693ba368ceb7fac2259"
mode: GRACEFUL
new_leader_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
 from {username='slave'} at 127.0.0.1:52542
I20260709 12:12:55.889282 25332 raft_consensus.cc:606] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259 [term 1 LEADER]: Received request to transfer leadership to TS f7d44497c5c04c55a6b9dae701b63b2b
I20260709 12:12:55.894047 25481 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f747ad579e1e40b18a8efbd9fa0c9d5c"
dest_uuid: "02a30f2f37194042b6ad292011c47d0d"
mode: GRACEFUL
new_leader_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
 from {username='slave'} at 127.0.0.1:46434
I20260709 12:12:55.894521 25481 raft_consensus.cc:606] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d [term 1 LEADER]: Received request to transfer leadership to TS f7d44497c5c04c55a6b9dae701b63b2b
I20260709 12:12:55.899333 25332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7e8f5c4110f428e8c8c29e99ef734fe"
dest_uuid: "52e12d0cb9004693ba368ceb7fac2259"
mode: GRACEFUL
new_leader_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
 from {username='slave'} at 127.0.0.1:52542
I20260709 12:12:55.899834 25332 raft_consensus.cc:606] T d7e8f5c4110f428e8c8c29e99ef734fe P 52e12d0cb9004693ba368ceb7fac2259 [term 1 LEADER]: Received request to transfer leadership to TS f7d44497c5c04c55a6b9dae701b63b2b
I20260709 12:12:55.956072 25646 consensus_queue.cc:1048] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.962347 25620 raft_consensus.cc:993] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259: : Instructing follower f7d44497c5c04c55a6b9dae701b63b2b to start an election
I20260709 12:12:55.962862 25648 raft_consensus.cc:1081] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259 [term 1 LEADER]: Signalling peer f7d44497c5c04c55a6b9dae701b63b2b to start an election
I20260709 12:12:55.964879 25407 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2a320cecc214596975900050a34388c"
dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
 from {username='slave'} at 127.0.0.1:45250
I20260709 12:12:55.966516 25407 raft_consensus.cc:493] T f2a320cecc214596975900050a34388c P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:55.966928 25407 raft_consensus.cc:3060] T f2a320cecc214596975900050a34388c P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:55.969493 25648 consensus_queue.cc:1048] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:55.973645 25407 raft_consensus.cc:515] T f2a320cecc214596975900050a34388c P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.976197 25407 leader_election.cc:290] T f2a320cecc214596975900050a34388c P f7d44497c5c04c55a6b9dae701b63b2b [CANDIDATE]: Term 2 election: Requested vote from peers 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:55.978017 25480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a320cecc214596975900050a34388c" candidate_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02a30f2f37194042b6ad292011c47d0d"
I20260709 12:12:55.979274 25332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a320cecc214596975900050a34388c" candidate_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "52e12d0cb9004693ba368ceb7fac2259"
I20260709 12:12:55.979893 25332 raft_consensus.cc:3055] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:55.980202 25332 raft_consensus.cc:740] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Running, Role: LEADER
I20260709 12:12:55.980970 25332 consensus_queue.cc:260] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.982172 25332 raft_consensus.cc:3060] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:55.989598 25332 raft_consensus.cc:2468] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d44497c5c04c55a6b9dae701b63b2b in term 2.
I20260709 12:12:55.990870 25370 leader_election.cc:304] T f2a320cecc214596975900050a34388c P f7d44497c5c04c55a6b9dae701b63b2b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 52e12d0cb9004693ba368ceb7fac2259, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 02a30f2f37194042b6ad292011c47d0d
I20260709 12:12:55.991542 25530 raft_consensus.cc:2804] T f2a320cecc214596975900050a34388c P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:55.992007 25530 raft_consensus.cc:697] T f2a320cecc214596975900050a34388c P f7d44497c5c04c55a6b9dae701b63b2b [term 2 LEADER]: Becoming Leader. State: Replica: f7d44497c5c04c55a6b9dae701b63b2b, State: Running, Role: LEADER
I20260709 12:12:55.992765 25530 consensus_queue.cc:237] T f2a320cecc214596975900050a34388c P f7d44497c5c04c55a6b9dae701b63b2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:55.996302 25530 consensus_queue.cc:1048] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:56.000211 25228 catalog_manager.cc:5697] T f2a320cecc214596975900050a34388c P f7d44497c5c04c55a6b9dae701b63b2b reported cstate change: term changed from 1 to 2, leader changed from 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193) to f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194). New cstate: current_term: 2 leader_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:56.004153 25666 raft_consensus.cc:993] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b: : Instructing follower 52e12d0cb9004693ba368ceb7fac2259 to start an election
I20260709 12:12:56.004873 25530 raft_consensus.cc:1081] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 LEADER]: Signalling peer 52e12d0cb9004693ba368ceb7fac2259 to start an election
I20260709 12:12:56.007277 25331 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3c5edae27a14c028d7e6dcac6ae2fa4"
dest_uuid: "52e12d0cb9004693ba368ceb7fac2259"
 from {username='slave'} at 127.0.0.1:52532
I20260709 12:12:56.008102 25331 raft_consensus.cc:493] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:56.008461 25331 raft_consensus.cc:3060] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:56.013764 25331 raft_consensus.cc:515] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:56.017213 25649 consensus_queue.cc:1048] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:56.021407 25405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c5edae27a14c028d7e6dcac6ae2fa4" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
I20260709 12:12:56.022300 25405 raft_consensus.cc:3055] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:56.022835 25405 raft_consensus.cc:740] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7d44497c5c04c55a6b9dae701b63b2b, State: Running, Role: LEADER
I20260709 12:12:56.023422 25331 leader_election.cc:290] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 2 election: Requested vote from peers f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:56.023885 25405 consensus_queue.cc:260] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:56.024456 25666 consensus_queue.cc:1048] T 7beeddfc1c114d3398d73e600e3b3d13 P f7d44497c5c04c55a6b9dae701b63b2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:12:56.023967 25480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c5edae27a14c028d7e6dcac6ae2fa4" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02a30f2f37194042b6ad292011c47d0d"
I20260709 12:12:56.027712 25530 consensus_queue.cc:1048] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:56.027735 25480 raft_consensus.cc:3060] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:56.033473 25649 raft_consensus.cc:993] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d: : Instructing follower f7d44497c5c04c55a6b9dae701b63b2b to start an election
I20260709 12:12:56.033928 25649 raft_consensus.cc:1081] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d [term 1 LEADER]: Signalling peer f7d44497c5c04c55a6b9dae701b63b2b to start an election
I20260709 12:12:56.036368 25406 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f747ad579e1e40b18a8efbd9fa0c9d5c"
dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
 from {username='slave'} at 127.0.0.1:45234
I20260709 12:12:56.037385 25480 raft_consensus.cc:2468] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 2.
I20260709 12:12:56.037592 25406 raft_consensus.cc:493] T f747ad579e1e40b18a8efbd9fa0c9d5c P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:56.038373 25406 raft_consensus.cc:3060] T f747ad579e1e40b18a8efbd9fa0c9d5c P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:56.038754 25297 leader_election.cc:304] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02a30f2f37194042b6ad292011c47d0d, 52e12d0cb9004693ba368ceb7fac2259; no voters: 
I20260709 12:12:56.039672 25648 raft_consensus.cc:2804] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:56.040119 25648 raft_consensus.cc:697] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 LEADER]: Becoming Leader. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Running, Role: LEADER
I20260709 12:12:56.040946 25648 consensus_queue.cc:237] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:56.045866 25405 raft_consensus.cc:3060] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:56.052418 25676 consensus_queue.cc:1048] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:12:56.052316 25406 raft_consensus.cc:515] T f747ad579e1e40b18a8efbd9fa0c9d5c P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:56.054162 25405 raft_consensus.cc:2468] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 2.
I20260709 12:12:56.056035 25330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f747ad579e1e40b18a8efbd9fa0c9d5c" candidate_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "52e12d0cb9004693ba368ceb7fac2259"
I20260709 12:12:56.060024 25406 leader_election.cc:290] T f747ad579e1e40b18a8efbd9fa0c9d5c P f7d44497c5c04c55a6b9dae701b63b2b [CANDIDATE]: Term 2 election: Requested vote from peers 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:56.060335 25620 consensus_queue.cc:1048] T 0b9559a209da4bd299515a2b7cd47629 P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:56.060817 25666 raft_consensus.cc:993] T 7beeddfc1c114d3398d73e600e3b3d13 P f7d44497c5c04c55a6b9dae701b63b2b: : Instructing follower 52e12d0cb9004693ba368ceb7fac2259 to start an election
I20260709 12:12:56.061254 25666 raft_consensus.cc:1081] T 7beeddfc1c114d3398d73e600e3b3d13 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 LEADER]: Signalling peer 52e12d0cb9004693ba368ceb7fac2259 to start an election
I20260709 12:12:56.064373 25330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7beeddfc1c114d3398d73e600e3b3d13"
dest_uuid: "52e12d0cb9004693ba368ceb7fac2259"
 from {username='slave'} at 127.0.0.1:52532
I20260709 12:12:56.065351 25330 raft_consensus.cc:493] T 7beeddfc1c114d3398d73e600e3b3d13 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:56.065723 25330 raft_consensus.cc:3060] T 7beeddfc1c114d3398d73e600e3b3d13 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:56.068524 25530 consensus_queue.cc:1048] T 7beeddfc1c114d3398d73e600e3b3d13 P f7d44497c5c04c55a6b9dae701b63b2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:56.072438 25481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f747ad579e1e40b18a8efbd9fa0c9d5c" candidate_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02a30f2f37194042b6ad292011c47d0d"
I20260709 12:12:56.073279 25481 raft_consensus.cc:3055] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:56.078881 25481 raft_consensus.cc:740] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 02a30f2f37194042b6ad292011c47d0d, State: Running, Role: LEADER
I20260709 12:12:56.079723 25481 consensus_queue.cc:260] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:56.080868 25481 raft_consensus.cc:3060] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:56.085307 25330 raft_consensus.cc:515] T 7beeddfc1c114d3398d73e600e3b3d13 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:56.088445 25330 leader_election.cc:290] T 7beeddfc1c114d3398d73e600e3b3d13 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 2 election: Requested vote from peers f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:56.089890 25481 raft_consensus.cc:2468] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d44497c5c04c55a6b9dae701b63b2b in term 2.
I20260709 12:12:56.091265 25648 consensus_queue.cc:1048] T 0b9559a209da4bd299515a2b7cd47629 P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:56.093240 25406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beeddfc1c114d3398d73e600e3b3d13" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
I20260709 12:12:56.094636 25478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beeddfc1c114d3398d73e600e3b3d13" candidate_uuid: "52e12d0cb9004693ba368ceb7fac2259" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02a30f2f37194042b6ad292011c47d0d"
I20260709 12:12:56.096172 25406 raft_consensus.cc:3055] T 7beeddfc1c114d3398d73e600e3b3d13 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:56.096683 25406 raft_consensus.cc:740] T 7beeddfc1c114d3398d73e600e3b3d13 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7d44497c5c04c55a6b9dae701b63b2b, State: Running, Role: LEADER
I20260709 12:12:56.097160 25229 catalog_manager.cc:5697] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259 reported cstate change: term changed from 1 to 2, leader changed from f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194) to 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "52e12d0cb9004693ba368ceb7fac2259" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:56.097797 25406 consensus_queue.cc:260] T 7beeddfc1c114d3398d73e600e3b3d13 P f7d44497c5c04c55a6b9dae701b63b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:56.099256 25406 raft_consensus.cc:3060] T 7beeddfc1c114d3398d73e600e3b3d13 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:56.102946 25372 leader_election.cc:304] T f747ad579e1e40b18a8efbd9fa0c9d5c P f7d44497c5c04c55a6b9dae701b63b2b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 02a30f2f37194042b6ad292011c47d0d, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 52e12d0cb9004693ba368ceb7fac2259
I20260709 12:12:56.106477 25666 raft_consensus.cc:2804] T f747ad579e1e40b18a8efbd9fa0c9d5c P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:56.107102 25666 raft_consensus.cc:697] T f747ad579e1e40b18a8efbd9fa0c9d5c P f7d44497c5c04c55a6b9dae701b63b2b [term 2 LEADER]: Becoming Leader. State: Replica: f7d44497c5c04c55a6b9dae701b63b2b, State: Running, Role: LEADER
I20260709 12:12:56.107987 25666 consensus_queue.cc:237] T f747ad579e1e40b18a8efbd9fa0c9d5c P f7d44497c5c04c55a6b9dae701b63b2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:56.112115 25406 raft_consensus.cc:2468] T 7beeddfc1c114d3398d73e600e3b3d13 P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52e12d0cb9004693ba368ceb7fac2259 in term 2.
I20260709 12:12:56.113365 25295 leader_election.cc:304] T 7beeddfc1c114d3398d73e600e3b3d13 P 52e12d0cb9004693ba368ceb7fac2259 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 52e12d0cb9004693ba368ceb7fac2259, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 02a30f2f37194042b6ad292011c47d0d
I20260709 12:12:56.114437 25620 raft_consensus.cc:2804] T 7beeddfc1c114d3398d73e600e3b3d13 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:56.114950 25620 raft_consensus.cc:697] T 7beeddfc1c114d3398d73e600e3b3d13 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 LEADER]: Becoming Leader. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Running, Role: LEADER
I20260709 12:12:56.115818 25620 consensus_queue.cc:237] T 7beeddfc1c114d3398d73e600e3b3d13 P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:56.119251 25648 raft_consensus.cc:993] T 0b9559a209da4bd299515a2b7cd47629 P 52e12d0cb9004693ba368ceb7fac2259: : Instructing follower f7d44497c5c04c55a6b9dae701b63b2b to start an election
I20260709 12:12:56.119726 25620 raft_consensus.cc:1081] T 0b9559a209da4bd299515a2b7cd47629 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 LEADER]: Signalling peer f7d44497c5c04c55a6b9dae701b63b2b to start an election
I20260709 12:12:56.121347 25405 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0b9559a209da4bd299515a2b7cd47629"
dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
 from {username='slave'} at 127.0.0.1:45250
I20260709 12:12:56.121935 25405 raft_consensus.cc:493] T 0b9559a209da4bd299515a2b7cd47629 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:56.122288 25405 raft_consensus.cc:3060] T 0b9559a209da4bd299515a2b7cd47629 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:56.122539 25230 catalog_manager.cc:5697] T f747ad579e1e40b18a8efbd9fa0c9d5c P f7d44497c5c04c55a6b9dae701b63b2b reported cstate change: term changed from 1 to 2, leader changed from 02a30f2f37194042b6ad292011c47d0d (127.16.98.195) to f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194). New cstate: current_term: 2 leader_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:56.129786 25405 raft_consensus.cc:515] T 0b9559a209da4bd299515a2b7cd47629 P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:56.130860 25406 raft_consensus.cc:1240] T 0b9559a209da4bd299515a2b7cd47629 P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Rejecting Update request from peer 52e12d0cb9004693ba368ceb7fac2259 for earlier term 1. Current term is 2. Ops: []
I20260709 12:12:56.132834 25330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9559a209da4bd299515a2b7cd47629" candidate_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "52e12d0cb9004693ba368ceb7fac2259"
I20260709 12:12:56.133481 25330 raft_consensus.cc:3055] T 0b9559a209da4bd299515a2b7cd47629 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:56.133811 25330 raft_consensus.cc:740] T 0b9559a209da4bd299515a2b7cd47629 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Running, Role: LEADER
I20260709 12:12:56.134605 25330 consensus_queue.cc:260] T 0b9559a209da4bd299515a2b7cd47629 P 52e12d0cb9004693ba368ceb7fac2259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:56.135743 25330 raft_consensus.cc:3060] T 0b9559a209da4bd299515a2b7cd47629 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:56.137475 25228 catalog_manager.cc:5697] T 7beeddfc1c114d3398d73e600e3b3d13 P 52e12d0cb9004693ba368ceb7fac2259 reported cstate change: term changed from 1 to 2, leader changed from f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194) to 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "52e12d0cb9004693ba368ceb7fac2259" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:56.141327 25699 consensus_queue.cc:1048] T d7e8f5c4110f428e8c8c29e99ef734fe P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:56.143249 25405 leader_election.cc:290] T 0b9559a209da4bd299515a2b7cd47629 P f7d44497c5c04c55a6b9dae701b63b2b [CANDIDATE]: Term 2 election: Requested vote from peers 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:56.143841 25330 raft_consensus.cc:2468] T 0b9559a209da4bd299515a2b7cd47629 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d44497c5c04c55a6b9dae701b63b2b in term 2.
I20260709 12:12:56.144737 25479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b9559a209da4bd299515a2b7cd47629" candidate_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02a30f2f37194042b6ad292011c47d0d"
I20260709 12:12:56.145357 25479 raft_consensus.cc:3060] T 0b9559a209da4bd299515a2b7cd47629 P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:56.145985 25370 leader_election.cc:304] T 0b9559a209da4bd299515a2b7cd47629 P f7d44497c5c04c55a6b9dae701b63b2b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52e12d0cb9004693ba368ceb7fac2259, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 
I20260709 12:12:56.146868 25530 raft_consensus.cc:2804] T 0b9559a209da4bd299515a2b7cd47629 P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:56.147312 25530 raft_consensus.cc:697] T 0b9559a209da4bd299515a2b7cd47629 P f7d44497c5c04c55a6b9dae701b63b2b [term 2 LEADER]: Becoming Leader. State: Replica: f7d44497c5c04c55a6b9dae701b63b2b, State: Running, Role: LEADER
I20260709 12:12:56.148123 25530 consensus_queue.cc:237] T 0b9559a209da4bd299515a2b7cd47629 P f7d44497c5c04c55a6b9dae701b63b2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:56.155696 25479 raft_consensus.cc:2468] T 0b9559a209da4bd299515a2b7cd47629 P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d44497c5c04c55a6b9dae701b63b2b in term 2.
I20260709 12:12:56.156662 25230 catalog_manager.cc:5697] T 0b9559a209da4bd299515a2b7cd47629 P f7d44497c5c04c55a6b9dae701b63b2b reported cstate change: term changed from 1 to 2, leader changed from 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193) to f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194). New cstate: current_term: 2 leader_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:56.159535 25699 consensus_queue.cc:1048] T d7e8f5c4110f428e8c8c29e99ef734fe P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:56.169566 25648 raft_consensus.cc:993] T d7e8f5c4110f428e8c8c29e99ef734fe P 52e12d0cb9004693ba368ceb7fac2259: : Instructing follower f7d44497c5c04c55a6b9dae701b63b2b to start an election
I20260709 12:12:56.170029 25648 raft_consensus.cc:1081] T d7e8f5c4110f428e8c8c29e99ef734fe P 52e12d0cb9004693ba368ceb7fac2259 [term 1 LEADER]: Signalling peer f7d44497c5c04c55a6b9dae701b63b2b to start an election
I20260709 12:12:56.171602 25405 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d7e8f5c4110f428e8c8c29e99ef734fe"
dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
 from {username='slave'} at 127.0.0.1:45250
I20260709 12:12:56.172209 25405 raft_consensus.cc:493] T d7e8f5c4110f428e8c8c29e99ef734fe P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:56.172549 25405 raft_consensus.cc:3060] T d7e8f5c4110f428e8c8c29e99ef734fe P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:56.178253 25405 raft_consensus.cc:515] T d7e8f5c4110f428e8c8c29e99ef734fe P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:56.179791 25405 leader_election.cc:290] T d7e8f5c4110f428e8c8c29e99ef734fe P f7d44497c5c04c55a6b9dae701b63b2b [CANDIDATE]: Term 2 election: Requested vote from peers 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391), 02a30f2f37194042b6ad292011c47d0d (127.16.98.195:41011)
I20260709 12:12:56.180433 25330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7e8f5c4110f428e8c8c29e99ef734fe" candidate_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "52e12d0cb9004693ba368ceb7fac2259"
I20260709 12:12:56.180845 25479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7e8f5c4110f428e8c8c29e99ef734fe" candidate_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "02a30f2f37194042b6ad292011c47d0d"
I20260709 12:12:56.181082 25330 raft_consensus.cc:3055] T d7e8f5c4110f428e8c8c29e99ef734fe P 52e12d0cb9004693ba368ceb7fac2259 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:56.181412 25479 raft_consensus.cc:3060] T d7e8f5c4110f428e8c8c29e99ef734fe P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:56.181432 25330 raft_consensus.cc:740] T d7e8f5c4110f428e8c8c29e99ef734fe P 52e12d0cb9004693ba368ceb7fac2259 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Running, Role: LEADER
I20260709 12:12:56.182309 25330 consensus_queue.cc:260] T d7e8f5c4110f428e8c8c29e99ef734fe P 52e12d0cb9004693ba368ceb7fac2259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:56.183305 25330 raft_consensus.cc:3060] T d7e8f5c4110f428e8c8c29e99ef734fe P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:56.186394 25479 raft_consensus.cc:2468] T d7e8f5c4110f428e8c8c29e99ef734fe P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d44497c5c04c55a6b9dae701b63b2b in term 2.
I20260709 12:12:56.187451 25372 leader_election.cc:304] T d7e8f5c4110f428e8c8c29e99ef734fe P f7d44497c5c04c55a6b9dae701b63b2b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02a30f2f37194042b6ad292011c47d0d, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 
I20260709 12:12:56.188134 25530 raft_consensus.cc:2804] T d7e8f5c4110f428e8c8c29e99ef734fe P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:56.188202 25330 raft_consensus.cc:2468] T d7e8f5c4110f428e8c8c29e99ef734fe P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d44497c5c04c55a6b9dae701b63b2b in term 2.
I20260709 12:12:56.188585 25530 raft_consensus.cc:697] T d7e8f5c4110f428e8c8c29e99ef734fe P f7d44497c5c04c55a6b9dae701b63b2b [term 2 LEADER]: Becoming Leader. State: Replica: f7d44497c5c04c55a6b9dae701b63b2b, State: Running, Role: LEADER
I20260709 12:12:56.189468 25530 consensus_queue.cc:237] T d7e8f5c4110f428e8c8c29e99ef734fe P f7d44497c5c04c55a6b9dae701b63b2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:56.195811 25228 catalog_manager.cc:5697] T d7e8f5c4110f428e8c8c29e99ef734fe P f7d44497c5c04c55a6b9dae701b63b2b reported cstate change: term changed from 1 to 2, leader changed from 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193) to f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194). New cstate: current_term: 2 leader_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } health_report { overall_health: UNKNOWN } } }
I20260709 12:12:56.256408 25676 consensus_queue.cc:1048] T 1d69a320a510449598156730aee599db P 02a30f2f37194042b6ad292011c47d0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:56.270730 25583 consensus_queue.cc:1048] T 1d69a320a510449598156730aee599db P 02a30f2f37194042b6ad292011c47d0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:56.449086 25330 raft_consensus.cc:1275] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Refusing update from remote peer f7d44497c5c04c55a6b9dae701b63b2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:56.450330 25530 consensus_queue.cc:1048] T f2a320cecc214596975900050a34388c P f7d44497c5c04c55a6b9dae701b63b2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:56.457338 25479 raft_consensus.cc:3060] T f2a320cecc214596975900050a34388c P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:56.464650 25479 raft_consensus.cc:1275] T f2a320cecc214596975900050a34388c P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Refusing update from remote peer f7d44497c5c04c55a6b9dae701b63b2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:56.465950 25692 consensus_queue.cc:1048] T f2a320cecc214596975900050a34388c P f7d44497c5c04c55a6b9dae701b63b2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:12:56.528205 25479 raft_consensus.cc:1275] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Refusing update from remote peer 52e12d0cb9004693ba368ceb7fac2259: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:56.529634 25699 consensus_queue.cc:1048] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:12:56.539090 25406 raft_consensus.cc:1275] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Refusing update from remote peer 52e12d0cb9004693ba368ceb7fac2259: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:56.540876 25648 consensus_queue.cc:1048] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:56.555727 25406 raft_consensus.cc:1275] T 7beeddfc1c114d3398d73e600e3b3d13 P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Refusing update from remote peer 52e12d0cb9004693ba368ceb7fac2259: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:56.556841 25648 consensus_queue.cc:1048] T 7beeddfc1c114d3398d73e600e3b3d13 P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:56.564317 25481 raft_consensus.cc:3060] T 7beeddfc1c114d3398d73e600e3b3d13 P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:56.572206 25481 raft_consensus.cc:1275] T 7beeddfc1c114d3398d73e600e3b3d13 P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Refusing update from remote peer 52e12d0cb9004693ba368ceb7fac2259: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:56.573427 25699 consensus_queue.cc:1048] T 7beeddfc1c114d3398d73e600e3b3d13 P 52e12d0cb9004693ba368ceb7fac2259 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:56.595376 25481 raft_consensus.cc:1275] T 0b9559a209da4bd299515a2b7cd47629 P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Refusing update from remote peer f7d44497c5c04c55a6b9dae701b63b2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:56.596562 25692 consensus_queue.cc:1048] T 0b9559a209da4bd299515a2b7cd47629 P f7d44497c5c04c55a6b9dae701b63b2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:56.604559 25330 raft_consensus.cc:1275] T 0b9559a209da4bd299515a2b7cd47629 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Refusing update from remote peer f7d44497c5c04c55a6b9dae701b63b2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:56.606976 25666 consensus_queue.cc:1048] T 0b9559a209da4bd299515a2b7cd47629 P f7d44497c5c04c55a6b9dae701b63b2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:56.697503 25330 raft_consensus.cc:3060] T f747ad579e1e40b18a8efbd9fa0c9d5c P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:56.703543 25330 raft_consensus.cc:1275] T f747ad579e1e40b18a8efbd9fa0c9d5c P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Refusing update from remote peer f7d44497c5c04c55a6b9dae701b63b2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:56.704753 25666 consensus_queue.cc:1048] T f747ad579e1e40b18a8efbd9fa0c9d5c P f7d44497c5c04c55a6b9dae701b63b2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:56.710927 25481 raft_consensus.cc:1275] T d7e8f5c4110f428e8c8c29e99ef734fe P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Refusing update from remote peer f7d44497c5c04c55a6b9dae701b63b2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:56.712853 25479 raft_consensus.cc:1275] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Refusing update from remote peer f7d44497c5c04c55a6b9dae701b63b2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:56.713167 25666 consensus_queue.cc:1048] T d7e8f5c4110f428e8c8c29e99ef734fe P f7d44497c5c04c55a6b9dae701b63b2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:56.714438 25692 consensus_queue.cc:1048] T f747ad579e1e40b18a8efbd9fa0c9d5c P f7d44497c5c04c55a6b9dae701b63b2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:56.723758 25332 raft_consensus.cc:1275] T d7e8f5c4110f428e8c8c29e99ef734fe P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Refusing update from remote peer f7d44497c5c04c55a6b9dae701b63b2b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:12:56.729545 25666 consensus_queue.cc:1048] T d7e8f5c4110f428e8c8c29e99ef734fe P f7d44497c5c04c55a6b9dae701b63b2b [LEADER]: Connected to new peer: Peer: permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:12:58.905481 25227 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58814:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:12:58.927652 25227 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58814:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:12:58.955317 16779 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:12:59.168732 25745 tablet.cc:1724] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:12:59.224606 25358 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:e3c5edae27a14c028d7e6dcac6ae2fa4)
W20260709 12:12:59.229272 25358 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:e3c5edae27a14c028d7e6dcac6ae2fa4)
W20260709 12:12:59.231928 25358 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:e3c5edae27a14c028d7e6dcac6ae2fa4)
W20260709 12:12:59.273311 25372 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.195:41011, user_credentials={real_user=slave}} blocked reactor thread for 46933.4us
I20260709 12:12:59.226063 25746 tablet.cc:1724] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:12:59.290824 25760 tablet.cc:1724] T a4f91317044d4d75b44b0e091132d402 P f7d44497c5c04c55a6b9dae701b63b2b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:12:59.276027 25761 tablet.cc:1724] T a4f91317044d4d75b44b0e091132d402 P 52e12d0cb9004693ba368ceb7fac2259: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:12:59.288210 25758 tablet.cc:1724] T 0b9559a209da4bd299515a2b7cd47629 P f7d44497c5c04c55a6b9dae701b63b2b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:12:59.317250 25331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3c5edae27a14c028d7e6dcac6ae2fa4"
dest_uuid: "52e12d0cb9004693ba368ceb7fac2259"
mode: GRACEFUL
new_leader_uuid: "02a30f2f37194042b6ad292011c47d0d"
 from {username='slave'} at 127.0.0.1:44054
I20260709 12:12:59.318239 25331 raft_consensus.cc:606] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 LEADER]: Received request to transfer leadership to TS 02a30f2f37194042b6ad292011c47d0d
W20260709 12:12:59.325978 25370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:40391, user_credentials={real_user=slave}} blocked reactor thread for 60204.3us
W20260709 12:12:59.330689 25748 log.cc:927] Time spent T d7e8f5c4110f428e8c8c29e99ef734fe P 02a30f2f37194042b6ad292011c47d0d: Append to log took a long time: real 0.139s	user 0.007s	sys 0.000s
I20260709 12:12:59.330710 25769 tablet.cc:1724] T 1d69a320a510449598156730aee599db P 52e12d0cb9004693ba368ceb7fac2259: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:12:59.337625 25767 tablet.cc:1724] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 02a30f2f37194042b6ad292011c47d0d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:12:59.340921 25765 tablet.cc:1724] T 0b9559a209da4bd299515a2b7cd47629 P 52e12d0cb9004693ba368ceb7fac2259: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:12:59.334860 25745 tablet.cc:1724] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 52e12d0cb9004693ba368ceb7fac2259: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:12:59.406184 25370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.16.98.193:40391, user_credentials={real_user=slave}} blocked reactor thread for 43697.6us
I20260709 12:12:59.345089 25771 tablet.cc:1724] T 1d69a320a510449598156730aee599db P 02a30f2f37194042b6ad292011c47d0d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:12:59.390966 25708 raft_consensus.cc:993] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259: : Instructing follower 02a30f2f37194042b6ad292011c47d0d to start an election
I20260709 12:12:59.411639 25708 raft_consensus.cc:1081] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 LEADER]: Signalling peer 02a30f2f37194042b6ad292011c47d0d to start an election
I20260709 12:12:59.342473 25774 tablet.cc:1724] T b7cd615c09bb4d13882f85a6aa6ba3e7 P f7d44497c5c04c55a6b9dae701b63b2b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:12:59.417402 25476 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3c5edae27a14c028d7e6dcac6ae2fa4"
dest_uuid: "02a30f2f37194042b6ad292011c47d0d"
 from {username='slave'} at 127.0.0.1:46416
I20260709 12:12:59.419757 25767 tablet.cc:1724] T a4f91317044d4d75b44b0e091132d402 P 02a30f2f37194042b6ad292011c47d0d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:12:59.424481 25476 raft_consensus.cc:493] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:59.424129 25746 tablet.cc:1724] T d7e8f5c4110f428e8c8c29e99ef734fe P f7d44497c5c04c55a6b9dae701b63b2b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:12:59.424942 25476 raft_consensus.cc:3060] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:59.430428 25761 tablet.cc:1724] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:12:59.432600 25403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f747ad579e1e40b18a8efbd9fa0c9d5c"
dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
mode: GRACEFUL
new_leader_uuid: "02a30f2f37194042b6ad292011c47d0d"
 from {username='slave'} at 127.0.0.1:56862
I20260709 12:12:59.433459 25403 raft_consensus.cc:606] T f747ad579e1e40b18a8efbd9fa0c9d5c P f7d44497c5c04c55a6b9dae701b63b2b [term 2 LEADER]: Received request to transfer leadership to TS 02a30f2f37194042b6ad292011c47d0d
I20260709 12:12:59.434839 25760 tablet.cc:1724] T f2a320cecc214596975900050a34388c P f7d44497c5c04c55a6b9dae701b63b2b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:12:59.437325 16779 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:12:59.438026 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:12:59.445621 25776 tablet.cc:1724] T 7beeddfc1c114d3398d73e600e3b3d13 P 02a30f2f37194042b6ad292011c47d0d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:12:59.448277 25330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9445bca58d1d420eb940aed38f953894"
dest_uuid: "52e12d0cb9004693ba368ceb7fac2259"
mode: GRACEFUL
new_leader_uuid: "02a30f2f37194042b6ad292011c47d0d"
 from {username='slave'} at 127.0.0.1:44054
I20260709 12:12:59.448897 25330 raft_consensus.cc:606] T 9445bca58d1d420eb940aed38f953894 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 LEADER]: Received request to transfer leadership to TS 02a30f2f37194042b6ad292011c47d0d
I20260709 12:12:59.451737 25403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd519c6f9fbb43639d5d8ff2f4b209ae"
dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
mode: GRACEFUL
new_leader_uuid: "02a30f2f37194042b6ad292011c47d0d"
 from {username='slave'} at 127.0.0.1:56862
I20260709 12:12:59.458806 25403 raft_consensus.cc:606] T cd519c6f9fbb43639d5d8ff2f4b209ae P f7d44497c5c04c55a6b9dae701b63b2b [term 1 LEADER]: Received request to transfer leadership to TS 02a30f2f37194042b6ad292011c47d0d
I20260709 12:12:59.470041 25769 tablet.cc:1724] T 7beeddfc1c114d3398d73e600e3b3d13 P 52e12d0cb9004693ba368ceb7fac2259: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:12:59.474395 25778 tablet.cc:1724] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 02a30f2f37194042b6ad292011c47d0d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:12:59.466398 25758 tablet.cc:1724] T 7beeddfc1c114d3398d73e600e3b3d13 P f7d44497c5c04c55a6b9dae701b63b2b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:12:59.478338 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:12:59.492038 25476 raft_consensus.cc:515] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 02a30f2f37194042b6ad292011c47d0d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:59.495282 25620 raft_consensus.cc:993] T 9445bca58d1d420eb940aed38f953894 P 52e12d0cb9004693ba368ceb7fac2259: : Instructing follower 02a30f2f37194042b6ad292011c47d0d to start an election
I20260709 12:12:59.495952 25749 raft_consensus.cc:1081] T 9445bca58d1d420eb940aed38f953894 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 LEADER]: Signalling peer 02a30f2f37194042b6ad292011c47d0d to start an election
I20260709 12:12:59.479482 25745 tablet.cc:1724] T d7e8f5c4110f428e8c8c29e99ef734fe P 52e12d0cb9004693ba368ceb7fac2259: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:12:59.497853 25478 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9445bca58d1d420eb940aed38f953894"
dest_uuid: "02a30f2f37194042b6ad292011c47d0d"
 from {username='slave'} at 127.0.0.1:46416
I20260709 12:12:59.498458 25478 raft_consensus.cc:493] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:59.498919 25478 raft_consensus.cc:3060] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:59.504334 25476 leader_election.cc:290] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 02a30f2f37194042b6ad292011c47d0d [CANDIDATE]: Term 3 election: Requested vote from peers 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391), f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825)
I20260709 12:12:59.505409 25330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c5edae27a14c028d7e6dcac6ae2fa4" candidate_uuid: "02a30f2f37194042b6ad292011c47d0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "52e12d0cb9004693ba368ceb7fac2259"
I20260709 12:12:59.506073 25330 raft_consensus.cc:3055] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:59.505956 25478 raft_consensus.cc:515] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:59.506462 25330 raft_consensus.cc:740] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Running, Role: LEADER
I20260709 12:12:59.506812 25777 raft_consensus.cc:993] T f747ad579e1e40b18a8efbd9fa0c9d5c P f7d44497c5c04c55a6b9dae701b63b2b: : Instructing follower 02a30f2f37194042b6ad292011c47d0d to start an election
I20260709 12:12:59.507285 25777 raft_consensus.cc:1081] T f747ad579e1e40b18a8efbd9fa0c9d5c P f7d44497c5c04c55a6b9dae701b63b2b [term 2 LEADER]: Signalling peer 02a30f2f37194042b6ad292011c47d0d to start an election
I20260709 12:12:59.507364 25330 consensus_queue.cc:260] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:59.474757 25765 tablet.cc:1724] T f747ad579e1e40b18a8efbd9fa0c9d5c P 52e12d0cb9004693ba368ceb7fac2259: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:12:59.508545 25776 tablet.cc:1724] T 0b9559a209da4bd299515a2b7cd47629 P 02a30f2f37194042b6ad292011c47d0d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:12:59.509377 25403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c5edae27a14c028d7e6dcac6ae2fa4" candidate_uuid: "02a30f2f37194042b6ad292011c47d0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
I20260709 12:12:59.508512 25330 raft_consensus.cc:3060] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:59.509986 25403 raft_consensus.cc:3060] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:59.514171 25746 tablet.cc:1724] T f747ad579e1e40b18a8efbd9fa0c9d5c P f7d44497c5c04c55a6b9dae701b63b2b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:12:59.509943 25476 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f747ad579e1e40b18a8efbd9fa0c9d5c"
dest_uuid: "02a30f2f37194042b6ad292011c47d0d"
 from {username='slave'} at 127.0.0.1:46422
I20260709 12:12:59.517264 25476 raft_consensus.cc:493] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:59.517647 25476 raft_consensus.cc:3060] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:59.519559 25758 tablet.cc:1724] T 1d69a320a510449598156730aee599db P f7d44497c5c04c55a6b9dae701b63b2b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:12:59.520334 25403 raft_consensus.cc:2468] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02a30f2f37194042b6ad292011c47d0d in term 3.
I20260709 12:12:59.521832 25331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9445bca58d1d420eb940aed38f953894" candidate_uuid: "02a30f2f37194042b6ad292011c47d0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "52e12d0cb9004693ba368ceb7fac2259"
I20260709 12:12:59.529536 25444 leader_election.cc:304] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 02a30f2f37194042b6ad292011c47d0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02a30f2f37194042b6ad292011c47d0d, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 
I20260709 12:12:59.522468 25330 raft_consensus.cc:2468] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02a30f2f37194042b6ad292011c47d0d in term 3.
I20260709 12:12:59.533068 25583 raft_consensus.cc:2804] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 02a30f2f37194042b6ad292011c47d0d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:59.533627 25583 raft_consensus.cc:697] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 02a30f2f37194042b6ad292011c47d0d [term 3 LEADER]: Becoming Leader. State: Replica: 02a30f2f37194042b6ad292011c47d0d, State: Running, Role: LEADER
I20260709 12:12:59.534433 25583 consensus_queue.cc:237] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 02a30f2f37194042b6ad292011c47d0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:59.524109 25478 leader_election.cc:290] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d [CANDIDATE]: Term 3 election: Requested vote from peers 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391), f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825)
I20260709 12:12:59.478958 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:12:59.530781 25331 raft_consensus.cc:3055] T 9445bca58d1d420eb940aed38f953894 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:59.541574 25331 raft_consensus.cc:740] T 9445bca58d1d420eb940aed38f953894 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 52e12d0cb9004693ba368ceb7fac2259, State: Running, Role: LEADER
I20260709 12:12:59.542519 25331 consensus_queue.cc:260] T 9445bca58d1d420eb940aed38f953894 P 52e12d0cb9004693ba368ceb7fac2259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:59.542685 25778 tablet.cc:1724] T d7e8f5c4110f428e8c8c29e99ef734fe P 02a30f2f37194042b6ad292011c47d0d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:12:59.542953 25767 tablet.cc:1724] T f2a320cecc214596975900050a34388c P 02a30f2f37194042b6ad292011c47d0d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:12:59.544111 25331 raft_consensus.cc:3060] T 9445bca58d1d420eb940aed38f953894 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:59.543660 25771 tablet.cc:1724] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:12:59.551152 25403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9445bca58d1d420eb940aed38f953894" candidate_uuid: "02a30f2f37194042b6ad292011c47d0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
I20260709 12:12:59.551810 25403 raft_consensus.cc:3060] T 9445bca58d1d420eb940aed38f953894 P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:59.551560 25230 catalog_manager.cc:5697] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 02a30f2f37194042b6ad292011c47d0d reported cstate change: term changed from 2 to 3, leader changed from 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193) to 02a30f2f37194042b6ad292011c47d0d (127.16.98.195). New cstate: current_term: 3 leader_uuid: "02a30f2f37194042b6ad292011c47d0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:59.542398 25476 raft_consensus.cc:515] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:59.569923 25331 raft_consensus.cc:2468] T 9445bca58d1d420eb940aed38f953894 P 52e12d0cb9004693ba368ceb7fac2259 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02a30f2f37194042b6ad292011c47d0d in term 3.
I20260709 12:12:59.571075 25444 leader_election.cc:304] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02a30f2f37194042b6ad292011c47d0d, 52e12d0cb9004693ba368ceb7fac2259; no voters: 
I20260709 12:12:59.571884 25583 raft_consensus.cc:2804] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:59.572379 25583 raft_consensus.cc:697] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d [term 3 LEADER]: Becoming Leader. State: Replica: 02a30f2f37194042b6ad292011c47d0d, State: Running, Role: LEADER
I20260709 12:12:59.573299 25583 consensus_queue.cc:237] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:59.576483 25331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f747ad579e1e40b18a8efbd9fa0c9d5c" candidate_uuid: "02a30f2f37194042b6ad292011c47d0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "52e12d0cb9004693ba368ceb7fac2259"
I20260709 12:12:59.577282 25331 raft_consensus.cc:3060] T f747ad579e1e40b18a8efbd9fa0c9d5c P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:59.584694 25476 leader_election.cc:290] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d [CANDIDATE]: Term 3 election: Requested vote from peers 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391), f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825)
I20260709 12:12:59.585472 25404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f747ad579e1e40b18a8efbd9fa0c9d5c" candidate_uuid: "02a30f2f37194042b6ad292011c47d0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
I20260709 12:12:59.586354 25404 raft_consensus.cc:3055] T f747ad579e1e40b18a8efbd9fa0c9d5c P f7d44497c5c04c55a6b9dae701b63b2b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:12:59.586791 25404 raft_consensus.cc:740] T f747ad579e1e40b18a8efbd9fa0c9d5c P f7d44497c5c04c55a6b9dae701b63b2b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f7d44497c5c04c55a6b9dae701b63b2b, State: Running, Role: LEADER
I20260709 12:12:59.587532 25403 raft_consensus.cc:2468] T 9445bca58d1d420eb940aed38f953894 P f7d44497c5c04c55a6b9dae701b63b2b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02a30f2f37194042b6ad292011c47d0d in term 3.
I20260709 12:12:59.587893 25404 consensus_queue.cc:260] T f747ad579e1e40b18a8efbd9fa0c9d5c P f7d44497c5c04c55a6b9dae701b63b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:59.589486 25404 raft_consensus.cc:3060] T f747ad579e1e40b18a8efbd9fa0c9d5c P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:12:59.596642 25404 raft_consensus.cc:2468] T f747ad579e1e40b18a8efbd9fa0c9d5c P f7d44497c5c04c55a6b9dae701b63b2b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02a30f2f37194042b6ad292011c47d0d in term 3.
I20260709 12:12:59.597587 25444 leader_election.cc:304] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02a30f2f37194042b6ad292011c47d0d, f7d44497c5c04c55a6b9dae701b63b2b; no voters: 
I20260709 12:12:59.598783 25583 raft_consensus.cc:2804] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:12:59.599253 25583 raft_consensus.cc:697] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d [term 3 LEADER]: Becoming Leader. State: Replica: 02a30f2f37194042b6ad292011c47d0d, State: Running, Role: LEADER
I20260709 12:12:59.600057 25583 consensus_queue.cc:237] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:59.601184 25331 raft_consensus.cc:2468] T f747ad579e1e40b18a8efbd9fa0c9d5c P 52e12d0cb9004693ba368ceb7fac2259 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02a30f2f37194042b6ad292011c47d0d in term 3.
I20260709 12:12:59.602510 25227 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 1459b8d652e04ed19af139d20b3c68e9: soft_deleted_table [id=8dbef7a07a084ac090f08a83c6127846] alter complete (version 1)
I20260709 12:12:59.613827 25228 catalog_manager.cc:5697] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d reported cstate change: term changed from 2 to 3, leader changed from 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193) to 02a30f2f37194042b6ad292011c47d0d (127.16.98.195). New cstate: current_term: 3 leader_uuid: "02a30f2f37194042b6ad292011c47d0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:59.615015 25228 catalog_manager.cc:5697] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d reported cstate change: term changed from 2 to 3, leader changed from f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194) to 02a30f2f37194042b6ad292011c47d0d (127.16.98.195). New cstate: current_term: 3 leader_uuid: "02a30f2f37194042b6ad292011c47d0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:59.670140 25777 raft_consensus.cc:993] T cd519c6f9fbb43639d5d8ff2f4b209ae P f7d44497c5c04c55a6b9dae701b63b2b: : Instructing follower 02a30f2f37194042b6ad292011c47d0d to start an election
I20260709 12:12:59.670589 25692 raft_consensus.cc:1081] T cd519c6f9fbb43639d5d8ff2f4b209ae P f7d44497c5c04c55a6b9dae701b63b2b [term 1 LEADER]: Signalling peer 02a30f2f37194042b6ad292011c47d0d to start an election
I20260709 12:12:59.672045 25476 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd519c6f9fbb43639d5d8ff2f4b209ae"
dest_uuid: "02a30f2f37194042b6ad292011c47d0d"
 from {username='slave'} at 127.0.0.1:46422
I20260709 12:12:59.672544 25476 raft_consensus.cc:493] T cd519c6f9fbb43639d5d8ff2f4b209ae P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:12:59.672861 25476 raft_consensus.cc:3060] T cd519c6f9fbb43639d5d8ff2f4b209ae P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:59.677709 25476 raft_consensus.cc:515] T cd519c6f9fbb43639d5d8ff2f4b209ae P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:59.679318 25476 leader_election.cc:290] T cd519c6f9fbb43639d5d8ff2f4b209ae P 02a30f2f37194042b6ad292011c47d0d [CANDIDATE]: Term 2 election: Requested vote from peers 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391), f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825)
I20260709 12:12:59.680114 25331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd519c6f9fbb43639d5d8ff2f4b209ae" candidate_uuid: "02a30f2f37194042b6ad292011c47d0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "52e12d0cb9004693ba368ceb7fac2259"
I20260709 12:12:59.680361 25404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd519c6f9fbb43639d5d8ff2f4b209ae" candidate_uuid: "02a30f2f37194042b6ad292011c47d0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7d44497c5c04c55a6b9dae701b63b2b"
I20260709 12:12:59.680644 25331 raft_consensus.cc:3060] T cd519c6f9fbb43639d5d8ff2f4b209ae P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:59.680991 25404 raft_consensus.cc:3055] T cd519c6f9fbb43639d5d8ff2f4b209ae P f7d44497c5c04c55a6b9dae701b63b2b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:12:59.681279 25404 raft_consensus.cc:740] T cd519c6f9fbb43639d5d8ff2f4b209ae P f7d44497c5c04c55a6b9dae701b63b2b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7d44497c5c04c55a6b9dae701b63b2b, State: Running, Role: LEADER
I20260709 12:12:59.681933 25404 consensus_queue.cc:260] T cd519c6f9fbb43639d5d8ff2f4b209ae P f7d44497c5c04c55a6b9dae701b63b2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:59.682953 25404 raft_consensus.cc:3060] T cd519c6f9fbb43639d5d8ff2f4b209ae P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:12:59.685271 25331 raft_consensus.cc:2468] T cd519c6f9fbb43639d5d8ff2f4b209ae P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02a30f2f37194042b6ad292011c47d0d in term 2.
I20260709 12:12:59.686311 25444 leader_election.cc:304] T cd519c6f9fbb43639d5d8ff2f4b209ae P 02a30f2f37194042b6ad292011c47d0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02a30f2f37194042b6ad292011c47d0d, 52e12d0cb9004693ba368ceb7fac2259; no voters: 
I20260709 12:12:59.687013 25583 raft_consensus.cc:2804] T cd519c6f9fbb43639d5d8ff2f4b209ae P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:12:59.687397 25583 raft_consensus.cc:697] T cd519c6f9fbb43639d5d8ff2f4b209ae P 02a30f2f37194042b6ad292011c47d0d [term 2 LEADER]: Becoming Leader. State: Replica: 02a30f2f37194042b6ad292011c47d0d, State: Running, Role: LEADER
I20260709 12:12:59.687769 25404 raft_consensus.cc:2468] T cd519c6f9fbb43639d5d8ff2f4b209ae P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 02a30f2f37194042b6ad292011c47d0d in term 2.
I20260709 12:12:59.688202 25583 consensus_queue.cc:237] T cd519c6f9fbb43639d5d8ff2f4b209ae P 02a30f2f37194042b6ad292011c47d0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } }
I20260709 12:12:59.696022 25228 catalog_manager.cc:5697] T cd519c6f9fbb43639d5d8ff2f4b209ae P 02a30f2f37194042b6ad292011c47d0d reported cstate change: term changed from 1 to 2, leader changed from f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194) to 02a30f2f37194042b6ad292011c47d0d (127.16.98.195). New cstate: current_term: 2 leader_uuid: "02a30f2f37194042b6ad292011c47d0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02a30f2f37194042b6ad292011c47d0d" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 41011 } health_report { overall_health: HEALTHY } } }
I20260709 12:12:59.990868 25331 raft_consensus.cc:1275] T 9445bca58d1d420eb940aed38f953894 P 52e12d0cb9004693ba368ceb7fac2259 [term 3 FOLLOWER]: Refusing update from remote peer 02a30f2f37194042b6ad292011c47d0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:12:59.991966 25583 consensus_queue.cc:1048] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:00.005868 25404 raft_consensus.cc:1275] T 9445bca58d1d420eb940aed38f953894 P f7d44497c5c04c55a6b9dae701b63b2b [term 3 FOLLOWER]: Refusing update from remote peer 02a30f2f37194042b6ad292011c47d0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:00.012285 25787 consensus_queue.cc:1048] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:00.033620 25404 raft_consensus.cc:1275] T f747ad579e1e40b18a8efbd9fa0c9d5c P f7d44497c5c04c55a6b9dae701b63b2b [term 3 FOLLOWER]: Refusing update from remote peer 02a30f2f37194042b6ad292011c47d0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:00.035292 25331 raft_consensus.cc:1275] T f747ad579e1e40b18a8efbd9fa0c9d5c P 52e12d0cb9004693ba368ceb7fac2259 [term 3 FOLLOWER]: Refusing update from remote peer 02a30f2f37194042b6ad292011c47d0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:00.035198 25787 consensus_queue.cc:1048] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:00.036679 25787 consensus_queue.cc:1048] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:00.066272 25404 raft_consensus.cc:1275] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b [term 3 FOLLOWER]: Refusing update from remote peer 02a30f2f37194042b6ad292011c47d0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:00.067502 25583 consensus_queue.cc:1048] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 02a30f2f37194042b6ad292011c47d0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:00.075668 25331 raft_consensus.cc:1275] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259 [term 3 FOLLOWER]: Refusing update from remote peer 02a30f2f37194042b6ad292011c47d0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:13:00.077155 25787 consensus_queue.cc:1048] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 02a30f2f37194042b6ad292011c47d0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:13:00.216324 25331 raft_consensus.cc:1275] T cd519c6f9fbb43639d5d8ff2f4b209ae P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Refusing update from remote peer 02a30f2f37194042b6ad292011c47d0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:00.217644 25787 consensus_queue.cc:1048] T cd519c6f9fbb43639d5d8ff2f4b209ae P 02a30f2f37194042b6ad292011c47d0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "52e12d0cb9004693ba368ceb7fac2259" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:00.225951 25404 raft_consensus.cc:1275] T cd519c6f9fbb43639d5d8ff2f4b209ae P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Refusing update from remote peer 02a30f2f37194042b6ad292011c47d0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:00.227787 25787 consensus_queue.cc:1048] T cd519c6f9fbb43639d5d8ff2f4b209ae P 02a30f2f37194042b6ad292011c47d0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d44497c5c04c55a6b9dae701b63b2b" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 42825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:00.542142 16779 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:13:00.547849 16779 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:13:00.548416 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:00.554134 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:00.554543 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:01.555629 16779 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:13:01.560708 16779 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:13:01.561161 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:01.566999 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:01.567380 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:02.568397 16779 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:13:02.573738 16779 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:13:02.574236 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:02.580927 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:02.581342 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:03.582746 16779 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:13:03.590197 16779 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:13:03.590587 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:03.595201 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:03.595520 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:04.596654 16779 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:13:04.601778 16779 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:13:04.602150 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:04.607793 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:04.608117 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:05.609014 16779 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:13:05.613771 16779 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:13:05.614148 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:05.618901 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:05.619294 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:06.620312 16779 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:13:06.625201 16779 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:13:06.625588 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:06.630257 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:06.630671 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:07.631776 16779 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:13:07.637598 16779 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:13:07.638041 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:07.643082 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:07.643452 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:08.644337 16779 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:13:08.649245 16779 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:13:08.649689 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:08.654244 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:08.654631 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:09.710144 16779 tablet_server.cc:179] TabletServer@127.16.98.193:0 shutting down...
I20260709 12:13:09.741459 16779 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:09.742424 16779 tablet_replica.cc:333] T 1d69a320a510449598156730aee599db P 52e12d0cb9004693ba368ceb7fac2259: stopping tablet replica
I20260709 12:13:09.743719 16779 raft_consensus.cc:2243] T 1d69a320a510449598156730aee599db P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:09.744663 16779 raft_consensus.cc:2272] T 1d69a320a510449598156730aee599db P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.747236 16779 tablet_replica.cc:333] T 0b9559a209da4bd299515a2b7cd47629 P 52e12d0cb9004693ba368ceb7fac2259: stopping tablet replica
I20260709 12:13:09.747844 16779 raft_consensus.cc:2243] T 0b9559a209da4bd299515a2b7cd47629 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:09.748454 16779 raft_consensus.cc:2272] T 0b9559a209da4bd299515a2b7cd47629 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.750756 16779 tablet_replica.cc:333] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259: stopping tablet replica
I20260709 12:13:09.751343 16779 raft_consensus.cc:2243] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:09.751981 16779 raft_consensus.cc:2272] T f2a320cecc214596975900050a34388c P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.754925 16779 tablet_replica.cc:333] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 52e12d0cb9004693ba368ceb7fac2259: stopping tablet replica
I20260709 12:13:09.755892 16779 raft_consensus.cc:2243] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:09.756791 16779 raft_consensus.cc:2272] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.759207 16779 tablet_replica.cc:333] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259: stopping tablet replica
I20260709 12:13:09.759775 16779 raft_consensus.cc:2243] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:09.760218 16779 raft_consensus.cc:2272] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 52e12d0cb9004693ba368ceb7fac2259 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.762913 16779 tablet_replica.cc:333] T cd519c6f9fbb43639d5d8ff2f4b209ae P 52e12d0cb9004693ba368ceb7fac2259: stopping tablet replica
I20260709 12:13:09.763473 16779 raft_consensus.cc:2243] T cd519c6f9fbb43639d5d8ff2f4b209ae P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:09.763918 16779 raft_consensus.cc:2272] T cd519c6f9fbb43639d5d8ff2f4b209ae P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.766148 16779 tablet_replica.cc:333] T 3e0f3f615e7f41179a2f6577f271163c P 52e12d0cb9004693ba368ceb7fac2259: stopping tablet replica
I20260709 12:13:09.766789 16779 raft_consensus.cc:2243] T 3e0f3f615e7f41179a2f6577f271163c P 52e12d0cb9004693ba368ceb7fac2259 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:09.767630 16779 raft_consensus.cc:2272] T 3e0f3f615e7f41179a2f6577f271163c P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.769950 16779 tablet_replica.cc:333] T a4f91317044d4d75b44b0e091132d402 P 52e12d0cb9004693ba368ceb7fac2259: stopping tablet replica
I20260709 12:13:09.770711 16779 raft_consensus.cc:2243] T a4f91317044d4d75b44b0e091132d402 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:13:09.771610 25370 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
I20260709 12:13:09.771867 16779 raft_consensus.cc:2272] T a4f91317044d4d75b44b0e091132d402 P 52e12d0cb9004693ba368ceb7fac2259 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:09.775008 25370 consensus_peers.cc:597] T 68e0c0233618497787f44d50e1ebb6f1 P f7d44497c5c04c55a6b9dae701b63b2b -> Peer 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391): Couldn't send request to peer 52e12d0cb9004693ba368ceb7fac2259. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:09.775549 16779 tablet_replica.cc:333] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 52e12d0cb9004693ba368ceb7fac2259: stopping tablet replica
I20260709 12:13:09.776392 16779 raft_consensus.cc:2243] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:09.776981 16779 raft_consensus.cc:2272] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:09.778873 25444 consensus_peers.cc:597] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 02a30f2f37194042b6ad292011c47d0d -> Peer 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391): Couldn't send request to peer 52e12d0cb9004693ba368ceb7fac2259. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:09.780225 16779 tablet_replica.cc:333] T 1afdcff9cddc469981a2e16a4626e663 P 52e12d0cb9004693ba368ceb7fac2259: stopping tablet replica
I20260709 12:13:09.780895 16779 raft_consensus.cc:2243] T 1afdcff9cddc469981a2e16a4626e663 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:09.782002 16779 raft_consensus.cc:2272] T 1afdcff9cddc469981a2e16a4626e663 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.784335 16779 tablet_replica.cc:333] T d7e8f5c4110f428e8c8c29e99ef734fe P 52e12d0cb9004693ba368ceb7fac2259: stopping tablet replica
I20260709 12:13:09.784904 16779 raft_consensus.cc:2243] T d7e8f5c4110f428e8c8c29e99ef734fe P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:09.785483 16779 raft_consensus.cc:2272] T d7e8f5c4110f428e8c8c29e99ef734fe P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.787868 16779 tablet_replica.cc:333] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 52e12d0cb9004693ba368ceb7fac2259: stopping tablet replica
I20260709 12:13:09.788410 16779 raft_consensus.cc:2243] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:09.789203 16779 raft_consensus.cc:2272] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.791414 16779 tablet_replica.cc:333] T d41ae1092f594947838fb70e9d29df68 P 52e12d0cb9004693ba368ceb7fac2259: stopping tablet replica
I20260709 12:13:09.791963 16779 raft_consensus.cc:2243] T d41ae1092f594947838fb70e9d29df68 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:09.792459 16779 raft_consensus.cc:2272] T d41ae1092f594947838fb70e9d29df68 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.794660 16779 tablet_replica.cc:333] T f747ad579e1e40b18a8efbd9fa0c9d5c P 52e12d0cb9004693ba368ceb7fac2259: stopping tablet replica
I20260709 12:13:09.795182 16779 raft_consensus.cc:2243] T f747ad579e1e40b18a8efbd9fa0c9d5c P 52e12d0cb9004693ba368ceb7fac2259 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:09.795914 16779 raft_consensus.cc:2272] T f747ad579e1e40b18a8efbd9fa0c9d5c P 52e12d0cb9004693ba368ceb7fac2259 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.798880 16779 tablet_replica.cc:333] T 68e0c0233618497787f44d50e1ebb6f1 P 52e12d0cb9004693ba368ceb7fac2259: stopping tablet replica
I20260709 12:13:09.799417 16779 raft_consensus.cc:2243] T 68e0c0233618497787f44d50e1ebb6f1 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:09.799882 16779 raft_consensus.cc:2272] T 68e0c0233618497787f44d50e1ebb6f1 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.802196 16779 tablet_replica.cc:333] T 7beeddfc1c114d3398d73e600e3b3d13 P 52e12d0cb9004693ba368ceb7fac2259: stopping tablet replica
I20260709 12:13:09.802937 16779 raft_consensus.cc:2243] T 7beeddfc1c114d3398d73e600e3b3d13 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:09.803963 16779 raft_consensus.cc:2272] T 7beeddfc1c114d3398d73e600e3b3d13 P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.807215 16779 tablet_replica.cc:333] T 9445bca58d1d420eb940aed38f953894 P 52e12d0cb9004693ba368ceb7fac2259: stopping tablet replica
I20260709 12:13:09.807972 16779 raft_consensus.cc:2243] T 9445bca58d1d420eb940aed38f953894 P 52e12d0cb9004693ba368ceb7fac2259 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 12:13:09.808276 25370 consensus_peers.cc:597] T 0b9559a209da4bd299515a2b7cd47629 P f7d44497c5c04c55a6b9dae701b63b2b -> Peer 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391): Couldn't send request to peer 52e12d0cb9004693ba368ceb7fac2259. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:09.808877 16779 raft_consensus.cc:2272] T 9445bca58d1d420eb940aed38f953894 P 52e12d0cb9004693ba368ceb7fac2259 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.811228 16779 tablet_replica.cc:333] T 87740656475e4780a6fd2c222a2e2dce P 52e12d0cb9004693ba368ceb7fac2259: stopping tablet replica
I20260709 12:13:09.811779 16779 raft_consensus.cc:2243] T 87740656475e4780a6fd2c222a2e2dce P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:09.812256 16779 raft_consensus.cc:2272] T 87740656475e4780a6fd2c222a2e2dce P 52e12d0cb9004693ba368ceb7fac2259 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:09.828698 25444 consensus_peers.cc:597] T 1d69a320a510449598156730aee599db P 02a30f2f37194042b6ad292011c47d0d -> Peer 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391): Couldn't send request to peer 52e12d0cb9004693ba368ceb7fac2259. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:09.860412 16779 tablet_server.cc:196] TabletServer@127.16.98.193:0 shutdown complete.
W20260709 12:13:09.862737 25370 consensus_peers.cc:597] T d7e8f5c4110f428e8c8c29e99ef734fe P f7d44497c5c04c55a6b9dae701b63b2b -> Peer 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391): Couldn't send request to peer 52e12d0cb9004693ba368ceb7fac2259. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:40391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:09.888610 25444 consensus_peers.cc:597] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d -> Peer 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391): Couldn't send request to peer 52e12d0cb9004693ba368ceb7fac2259. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:40391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:09.902731 16779 tablet_server.cc:179] TabletServer@127.16.98.194:0 shutting down...
I20260709 12:13:09.935469 16779 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:09.936285 16779 tablet_replica.cc:333] T 1d69a320a510449598156730aee599db P f7d44497c5c04c55a6b9dae701b63b2b: stopping tablet replica
I20260709 12:13:09.937423 16779 raft_consensus.cc:2243] T 1d69a320a510449598156730aee599db P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:09.938041 16779 raft_consensus.cc:2272] T 1d69a320a510449598156730aee599db P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.940325 16779 tablet_replica.cc:333] T 0b9559a209da4bd299515a2b7cd47629 P f7d44497c5c04c55a6b9dae701b63b2b: stopping tablet replica
I20260709 12:13:09.940948 16779 raft_consensus.cc:2243] T 0b9559a209da4bd299515a2b7cd47629 P f7d44497c5c04c55a6b9dae701b63b2b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:09.941776 16779 raft_consensus.cc:2272] T 0b9559a209da4bd299515a2b7cd47629 P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.943825 16779 tablet_replica.cc:333] T a4f91317044d4d75b44b0e091132d402 P f7d44497c5c04c55a6b9dae701b63b2b: stopping tablet replica
I20260709 12:13:09.944378 16779 raft_consensus.cc:2243] T a4f91317044d4d75b44b0e091132d402 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:09.944861 16779 raft_consensus.cc:2272] T a4f91317044d4d75b44b0e091132d402 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.946956 16779 tablet_replica.cc:333] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b: stopping tablet replica
I20260709 12:13:09.947490 16779 raft_consensus.cc:2243] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:09.948041 16779 raft_consensus.cc:2272] T e3c5edae27a14c028d7e6dcac6ae2fa4 P f7d44497c5c04c55a6b9dae701b63b2b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.950132 16779 tablet_replica.cc:333] T 87740656475e4780a6fd2c222a2e2dce P f7d44497c5c04c55a6b9dae701b63b2b: stopping tablet replica
I20260709 12:13:09.950804 16779 raft_consensus.cc:2243] T 87740656475e4780a6fd2c222a2e2dce P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:09.951296 16779 raft_consensus.cc:2272] T 87740656475e4780a6fd2c222a2e2dce P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.953416 16779 tablet_replica.cc:333] T f2a320cecc214596975900050a34388c P f7d44497c5c04c55a6b9dae701b63b2b: stopping tablet replica
I20260709 12:13:09.953951 16779 raft_consensus.cc:2243] T f2a320cecc214596975900050a34388c P f7d44497c5c04c55a6b9dae701b63b2b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:09.954780 16779 raft_consensus.cc:2272] T f2a320cecc214596975900050a34388c P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.956943 16779 tablet_replica.cc:333] T 3e0f3f615e7f41179a2f6577f271163c P f7d44497c5c04c55a6b9dae701b63b2b: stopping tablet replica
I20260709 12:13:09.957451 16779 raft_consensus.cc:2243] T 3e0f3f615e7f41179a2f6577f271163c P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:09.957882 16779 raft_consensus.cc:2272] T 3e0f3f615e7f41179a2f6577f271163c P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.960141 16779 tablet_replica.cc:333] T cd519c6f9fbb43639d5d8ff2f4b209ae P f7d44497c5c04c55a6b9dae701b63b2b: stopping tablet replica
I20260709 12:13:09.960731 16779 raft_consensus.cc:2243] T cd519c6f9fbb43639d5d8ff2f4b209ae P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:09.961159 16779 raft_consensus.cc:2272] T cd519c6f9fbb43639d5d8ff2f4b209ae P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.963492 16779 tablet_replica.cc:333] T 7beeddfc1c114d3398d73e600e3b3d13 P f7d44497c5c04c55a6b9dae701b63b2b: stopping tablet replica
I20260709 12:13:09.964035 16779 raft_consensus.cc:2243] T 7beeddfc1c114d3398d73e600e3b3d13 P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:09.964552 16779 raft_consensus.cc:2272] T 7beeddfc1c114d3398d73e600e3b3d13 P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.966742 16779 tablet_replica.cc:333] T 9445bca58d1d420eb940aed38f953894 P f7d44497c5c04c55a6b9dae701b63b2b: stopping tablet replica
I20260709 12:13:09.967325 16779 raft_consensus.cc:2243] T 9445bca58d1d420eb940aed38f953894 P f7d44497c5c04c55a6b9dae701b63b2b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:09.967820 16779 raft_consensus.cc:2272] T 9445bca58d1d420eb940aed38f953894 P f7d44497c5c04c55a6b9dae701b63b2b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.970348 16779 tablet_replica.cc:333] T f747ad579e1e40b18a8efbd9fa0c9d5c P f7d44497c5c04c55a6b9dae701b63b2b: stopping tablet replica
I20260709 12:13:09.971128 16779 raft_consensus.cc:2243] T f747ad579e1e40b18a8efbd9fa0c9d5c P f7d44497c5c04c55a6b9dae701b63b2b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:09.971747 16779 raft_consensus.cc:2272] T f747ad579e1e40b18a8efbd9fa0c9d5c P f7d44497c5c04c55a6b9dae701b63b2b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.974491 16779 tablet_replica.cc:333] T 68e0c0233618497787f44d50e1ebb6f1 P f7d44497c5c04c55a6b9dae701b63b2b: stopping tablet replica
I20260709 12:13:09.975059 16779 raft_consensus.cc:2243] T 68e0c0233618497787f44d50e1ebb6f1 P f7d44497c5c04c55a6b9dae701b63b2b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:09.975941 16779 raft_consensus.cc:2272] T 68e0c0233618497787f44d50e1ebb6f1 P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.978132 16779 tablet_replica.cc:333] T d7e8f5c4110f428e8c8c29e99ef734fe P f7d44497c5c04c55a6b9dae701b63b2b: stopping tablet replica
I20260709 12:13:09.978763 16779 raft_consensus.cc:2243] T d7e8f5c4110f428e8c8c29e99ef734fe P f7d44497c5c04c55a6b9dae701b63b2b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:09.979616 16779 raft_consensus.cc:2272] T d7e8f5c4110f428e8c8c29e99ef734fe P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.981910 16779 tablet_replica.cc:333] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P f7d44497c5c04c55a6b9dae701b63b2b: stopping tablet replica
I20260709 12:13:09.982410 16779 raft_consensus.cc:2243] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:09.982870 16779 raft_consensus.cc:2272] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.984992 16779 tablet_replica.cc:333] T b7cd615c09bb4d13882f85a6aa6ba3e7 P f7d44497c5c04c55a6b9dae701b63b2b: stopping tablet replica
I20260709 12:13:09.985472 16779 raft_consensus.cc:2243] T b7cd615c09bb4d13882f85a6aa6ba3e7 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:09.985980 16779 raft_consensus.cc:2272] T b7cd615c09bb4d13882f85a6aa6ba3e7 P f7d44497c5c04c55a6b9dae701b63b2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.988132 16779 tablet_replica.cc:333] T d41ae1092f594947838fb70e9d29df68 P f7d44497c5c04c55a6b9dae701b63b2b: stopping tablet replica
I20260709 12:13:09.988665 16779 raft_consensus.cc:2243] T d41ae1092f594947838fb70e9d29df68 P f7d44497c5c04c55a6b9dae701b63b2b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:09.989477 16779 raft_consensus.cc:2272] T d41ae1092f594947838fb70e9d29df68 P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.991485 16779 tablet_replica.cc:333] T 9c77d7b34aa9485aaffe3e77370a6ed6 P f7d44497c5c04c55a6b9dae701b63b2b: stopping tablet replica
I20260709 12:13:09.991987 16779 raft_consensus.cc:2243] T 9c77d7b34aa9485aaffe3e77370a6ed6 P f7d44497c5c04c55a6b9dae701b63b2b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:09.992789 16779 raft_consensus.cc:2272] T 9c77d7b34aa9485aaffe3e77370a6ed6 P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:09.994782 16779 tablet_replica.cc:333] T 1afdcff9cddc469981a2e16a4626e663 P f7d44497c5c04c55a6b9dae701b63b2b: stopping tablet replica
I20260709 12:13:09.995282 16779 raft_consensus.cc:2243] T 1afdcff9cddc469981a2e16a4626e663 P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:09.995734 16779 raft_consensus.cc:2272] T 1afdcff9cddc469981a2e16a4626e663 P f7d44497c5c04c55a6b9dae701b63b2b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:10.036724 16779 tablet_server.cc:196] TabletServer@127.16.98.194:0 shutdown complete.
W20260709 12:13:10.062105 25444 consensus_peers.cc:597] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d -> Peer 52e12d0cb9004693ba368ceb7fac2259 (127.16.98.193:40391): Couldn't send request to peer 52e12d0cb9004693ba368ceb7fac2259. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:40391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:10.074515 16779 tablet_server.cc:179] TabletServer@127.16.98.195:0 shutting down...
I20260709 12:13:10.103021 16779 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:10.103727 16779 tablet_replica.cc:333] T f2a320cecc214596975900050a34388c P 02a30f2f37194042b6ad292011c47d0d: stopping tablet replica
I20260709 12:13:10.104493 16779 raft_consensus.cc:2243] T f2a320cecc214596975900050a34388c P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:10.105067 16779 raft_consensus.cc:2272] T f2a320cecc214596975900050a34388c P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:10.107259 16779 tablet_replica.cc:333] T 1d69a320a510449598156730aee599db P 02a30f2f37194042b6ad292011c47d0d: stopping tablet replica
I20260709 12:13:10.107822 16779 raft_consensus.cc:2243] T 1d69a320a510449598156730aee599db P 02a30f2f37194042b6ad292011c47d0d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:10.108755 16779 raft_consensus.cc:2272] T 1d69a320a510449598156730aee599db P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:10.110780 16779 tablet_replica.cc:333] T 0b9559a209da4bd299515a2b7cd47629 P 02a30f2f37194042b6ad292011c47d0d: stopping tablet replica
I20260709 12:13:10.111308 16779 raft_consensus.cc:2243] T 0b9559a209da4bd299515a2b7cd47629 P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:10.111794 16779 raft_consensus.cc:2272] T 0b9559a209da4bd299515a2b7cd47629 P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:10.113786 16779 tablet_replica.cc:333] T a4f91317044d4d75b44b0e091132d402 P 02a30f2f37194042b6ad292011c47d0d: stopping tablet replica
I20260709 12:13:10.114344 16779 raft_consensus.cc:2243] T a4f91317044d4d75b44b0e091132d402 P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:10.114866 16779 raft_consensus.cc:2272] T a4f91317044d4d75b44b0e091132d402 P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:10.116922 16779 tablet_replica.cc:333] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 02a30f2f37194042b6ad292011c47d0d: stopping tablet replica
I20260709 12:13:10.117513 16779 raft_consensus.cc:2243] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 02a30f2f37194042b6ad292011c47d0d [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:10.118343 16779 raft_consensus.cc:2272] T e3c5edae27a14c028d7e6dcac6ae2fa4 P 02a30f2f37194042b6ad292011c47d0d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:10.120404 16779 tablet_replica.cc:333] T 87740656475e4780a6fd2c222a2e2dce P 02a30f2f37194042b6ad292011c47d0d: stopping tablet replica
I20260709 12:13:10.120922 16779 raft_consensus.cc:2243] T 87740656475e4780a6fd2c222a2e2dce P 02a30f2f37194042b6ad292011c47d0d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:10.121925 16779 raft_consensus.cc:2272] T 87740656475e4780a6fd2c222a2e2dce P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:10.124370 16779 tablet_replica.cc:333] T 3e0f3f615e7f41179a2f6577f271163c P 02a30f2f37194042b6ad292011c47d0d: stopping tablet replica
I20260709 12:13:10.124909 16779 raft_consensus.cc:2243] T 3e0f3f615e7f41179a2f6577f271163c P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:10.125355 16779 raft_consensus.cc:2272] T 3e0f3f615e7f41179a2f6577f271163c P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:10.126121 25444 consensus_peers.cc:597] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d -> Peer f7d44497c5c04c55a6b9dae701b63b2b (127.16.98.194:42825): Couldn't send request to peer f7d44497c5c04c55a6b9dae701b63b2b. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.194:42825: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:10.127575 16779 tablet_replica.cc:333] T cd519c6f9fbb43639d5d8ff2f4b209ae P 02a30f2f37194042b6ad292011c47d0d: stopping tablet replica
I20260709 12:13:10.128201 16779 raft_consensus.cc:2243] T cd519c6f9fbb43639d5d8ff2f4b209ae P 02a30f2f37194042b6ad292011c47d0d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:10.128983 16779 raft_consensus.cc:2272] T cd519c6f9fbb43639d5d8ff2f4b209ae P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:10.131357 16779 tablet_replica.cc:333] T d7e8f5c4110f428e8c8c29e99ef734fe P 02a30f2f37194042b6ad292011c47d0d: stopping tablet replica
I20260709 12:13:10.131911 16779 raft_consensus.cc:2243] T d7e8f5c4110f428e8c8c29e99ef734fe P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:10.132442 16779 raft_consensus.cc:2272] T d7e8f5c4110f428e8c8c29e99ef734fe P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:10.134529 16779 tablet_replica.cc:333] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 02a30f2f37194042b6ad292011c47d0d: stopping tablet replica
I20260709 12:13:10.135160 16779 raft_consensus.cc:2243] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:10.135629 16779 raft_consensus.cc:2272] T 3ca26bcb25244e1fb8ad01b0e0de68b7 P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:10.137687 16779 tablet_replica.cc:333] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 02a30f2f37194042b6ad292011c47d0d: stopping tablet replica
I20260709 12:13:10.138206 16779 raft_consensus.cc:2243] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:10.138738 16779 raft_consensus.cc:2272] T b7cd615c09bb4d13882f85a6aa6ba3e7 P 02a30f2f37194042b6ad292011c47d0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:10.140576 16779 tablet_replica.cc:333] T d41ae1092f594947838fb70e9d29df68 P 02a30f2f37194042b6ad292011c47d0d: stopping tablet replica
I20260709 12:13:10.141077 16779 raft_consensus.cc:2243] T d41ae1092f594947838fb70e9d29df68 P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:10.141554 16779 raft_consensus.cc:2272] T d41ae1092f594947838fb70e9d29df68 P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:10.143513 16779 tablet_replica.cc:333] T 1afdcff9cddc469981a2e16a4626e663 P 02a30f2f37194042b6ad292011c47d0d: stopping tablet replica
I20260709 12:13:10.144030 16779 raft_consensus.cc:2243] T 1afdcff9cddc469981a2e16a4626e663 P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:10.144464 16779 raft_consensus.cc:2272] T 1afdcff9cddc469981a2e16a4626e663 P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:10.146322 16779 tablet_replica.cc:333] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 02a30f2f37194042b6ad292011c47d0d: stopping tablet replica
I20260709 12:13:10.146896 16779 raft_consensus.cc:2243] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:10.147344 16779 raft_consensus.cc:2272] T 9c77d7b34aa9485aaffe3e77370a6ed6 P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:10.149261 16779 tablet_replica.cc:333] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d: stopping tablet replica
I20260709 12:13:10.149829 16779 raft_consensus.cc:2243] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:10.150619 16779 raft_consensus.cc:2272] T f747ad579e1e40b18a8efbd9fa0c9d5c P 02a30f2f37194042b6ad292011c47d0d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:10.152680 16779 tablet_replica.cc:333] T 68e0c0233618497787f44d50e1ebb6f1 P 02a30f2f37194042b6ad292011c47d0d: stopping tablet replica
I20260709 12:13:10.153187 16779 raft_consensus.cc:2243] T 68e0c0233618497787f44d50e1ebb6f1 P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:10.153623 16779 raft_consensus.cc:2272] T 68e0c0233618497787f44d50e1ebb6f1 P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:10.155666 16779 tablet_replica.cc:333] T 7beeddfc1c114d3398d73e600e3b3d13 P 02a30f2f37194042b6ad292011c47d0d: stopping tablet replica
I20260709 12:13:10.156153 16779 raft_consensus.cc:2243] T 7beeddfc1c114d3398d73e600e3b3d13 P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:10.156638 16779 raft_consensus.cc:2272] T 7beeddfc1c114d3398d73e600e3b3d13 P 02a30f2f37194042b6ad292011c47d0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:10.158562 16779 tablet_replica.cc:333] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d: stopping tablet replica
I20260709 12:13:10.159082 16779 raft_consensus.cc:2243] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:10.160116 16779 raft_consensus.cc:2272] T 9445bca58d1d420eb940aed38f953894 P 02a30f2f37194042b6ad292011c47d0d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:10.199489 16779 tablet_server.cc:196] TabletServer@127.16.98.195:0 shutdown complete.
I20260709 12:13:10.237051 16779 master.cc:562] Master@127.16.98.254:45429 shutting down...
I20260709 12:13:10.263273 16779 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1459b8d652e04ed19af139d20b3c68e9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:10.263862 16779 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1459b8d652e04ed19af139d20b3c68e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:10.264191 16779 tablet_replica.cc:333] T 00000000000000000000000000000000 P 1459b8d652e04ed19af139d20b3c68e9: stopping tablet replica
I20260709 12:13:10.284582 16779 master.cc:584] Master@127.16.98.254:45429 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (20829 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:13:10.336833 16779 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.98.254:37529
I20260709 12:13:10.338042 16779 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:10.343837 25815 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:10.343832 25816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:10.344805 25818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:10.345283 16779 server_base.cc:1061] running on GCE node
I20260709 12:13:10.346227 16779 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:10.346421 16779 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:10.346598 16779 hybrid_clock.cc:648] HybridClock initialized: now 1783599190346565 us; error 0 us; skew 500 ppm
I20260709 12:13:10.347289 16779 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:10.349525 16779 webserver.cc:533] Webserver started at http://127.16.98.254:38427/ using document root <none> and password file <none>
I20260709 12:13:10.350019 16779 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:10.350203 16779 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:10.350486 16779 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:10.351626 16779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895573690-16779-0/minicluster-data/master-0-root/instance:
uuid: "81391cf9513c4c26ba7f862909533651"
format_stamp: "Formatted at 2026-07-09 12:13:10 on dist-test-slave-9bv4"
I20260709 12:13:10.355858 16779 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:13:10.359025 25823 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:10.359668 16779 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:13:10.359936 16779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895573690-16779-0/minicluster-data/master-0-root
uuid: "81391cf9513c4c26ba7f862909533651"
format_stamp: "Formatted at 2026-07-09 12:13:10 on dist-test-slave-9bv4"
I20260709 12:13:10.360217 16779 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895573690-16779-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895573690-16779-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895573690-16779-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:10.377411 16779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:10.378580 16779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:10.414921 16779 rpc_server.cc:307] RPC server started. Bound to: 127.16.98.254:37529
I20260709 12:13:10.415027 25874 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.98.254:37529 every 8 connection(s)
I20260709 12:13:10.418859 25875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:10.430466 25875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 81391cf9513c4c26ba7f862909533651: Bootstrap starting.
I20260709 12:13:10.435253 25875 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 81391cf9513c4c26ba7f862909533651: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:10.439353 25875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 81391cf9513c4c26ba7f862909533651: No bootstrap required, opened a new log
I20260709 12:13:10.441443 25875 raft_consensus.cc:359] T 00000000000000000000000000000000 P 81391cf9513c4c26ba7f862909533651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81391cf9513c4c26ba7f862909533651" member_type: VOTER }
I20260709 12:13:10.441866 25875 raft_consensus.cc:385] T 00000000000000000000000000000000 P 81391cf9513c4c26ba7f862909533651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:10.442044 25875 raft_consensus.cc:740] T 00000000000000000000000000000000 P 81391cf9513c4c26ba7f862909533651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81391cf9513c4c26ba7f862909533651, State: Initialized, Role: FOLLOWER
I20260709 12:13:10.442735 25875 consensus_queue.cc:260] T 00000000000000000000000000000000 P 81391cf9513c4c26ba7f862909533651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81391cf9513c4c26ba7f862909533651" member_type: VOTER }
I20260709 12:13:10.443418 25875 raft_consensus.cc:399] T 00000000000000000000000000000000 P 81391cf9513c4c26ba7f862909533651 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:13:10.443677 25875 raft_consensus.cc:493] T 00000000000000000000000000000000 P 81391cf9513c4c26ba7f862909533651 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:13:10.443964 25875 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 81391cf9513c4c26ba7f862909533651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:10.448606 25875 raft_consensus.cc:515] T 00000000000000000000000000000000 P 81391cf9513c4c26ba7f862909533651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81391cf9513c4c26ba7f862909533651" member_type: VOTER }
I20260709 12:13:10.449113 25875 leader_election.cc:304] T 00000000000000000000000000000000 P 81391cf9513c4c26ba7f862909533651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 81391cf9513c4c26ba7f862909533651; no voters: 
I20260709 12:13:10.450186 25875 leader_election.cc:290] T 00000000000000000000000000000000 P 81391cf9513c4c26ba7f862909533651 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:13:10.450598 25878 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 81391cf9513c4c26ba7f862909533651 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:10.451982 25878 raft_consensus.cc:697] T 00000000000000000000000000000000 P 81391cf9513c4c26ba7f862909533651 [term 1 LEADER]: Becoming Leader. State: Replica: 81391cf9513c4c26ba7f862909533651, State: Running, Role: LEADER
I20260709 12:13:10.452674 25878 consensus_queue.cc:237] T 00000000000000000000000000000000 P 81391cf9513c4c26ba7f862909533651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81391cf9513c4c26ba7f862909533651" member_type: VOTER }
I20260709 12:13:10.453138 25875 sys_catalog.cc:565] T 00000000000000000000000000000000 P 81391cf9513c4c26ba7f862909533651 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:13:10.457625 25880 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81391cf9513c4c26ba7f862909533651 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 81391cf9513c4c26ba7f862909533651. Latest consensus state: current_term: 1 leader_uuid: "81391cf9513c4c26ba7f862909533651" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81391cf9513c4c26ba7f862909533651" member_type: VOTER } }
I20260709 12:13:10.457764 25879 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81391cf9513c4c26ba7f862909533651 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "81391cf9513c4c26ba7f862909533651" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81391cf9513c4c26ba7f862909533651" member_type: VOTER } }
I20260709 12:13:10.458571 25879 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81391cf9513c4c26ba7f862909533651 [sys.catalog]: This master's current role is: LEADER
I20260709 12:13:10.458469 25880 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81391cf9513c4c26ba7f862909533651 [sys.catalog]: This master's current role is: LEADER
I20260709 12:13:10.462304 25886 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:13:10.469946 25886 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:13:10.470959 16779 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:13:10.478871 25886 catalog_manager.cc:1383] Generated new cluster ID: 6f78884f85794e59a74521924c03be1e
I20260709 12:13:10.479208 25886 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:13:10.500218 25886 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:13:10.501662 25886 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:13:10.517462 25886 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 81391cf9513c4c26ba7f862909533651: Generated new TSK 0
I20260709 12:13:10.518118 25886 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:13:10.537367 16779 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:10.543725 25896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:10.545331 25897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:10.548684 25899 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:10.552054 16779 server_base.cc:1061] running on GCE node
I20260709 12:13:10.552923 16779 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:10.553109 16779 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:10.553236 16779 hybrid_clock.cc:648] HybridClock initialized: now 1783599190553225 us; error 0 us; skew 500 ppm
I20260709 12:13:10.553684 16779 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:10.557363 16779 webserver.cc:533] Webserver started at http://127.16.98.193:37987/ using document root <none> and password file <none>
I20260709 12:13:10.557802 16779 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:10.557955 16779 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:10.558156 16779 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:10.559423 16779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895573690-16779-0/minicluster-data/ts-0-root/instance:
uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
format_stamp: "Formatted at 2026-07-09 12:13:10 on dist-test-slave-9bv4"
I20260709 12:13:10.564225 16779 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:13:10.567878 25904 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:10.568724 16779 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:13:10.569051 16779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895573690-16779-0/minicluster-data/ts-0-root
uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
format_stamp: "Formatted at 2026-07-09 12:13:10 on dist-test-slave-9bv4"
I20260709 12:13:10.569370 16779 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895573690-16779-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895573690-16779-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895573690-16779-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:10.593984 16779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:10.595242 16779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:10.596695 16779 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:10.598970 16779 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:10.599185 16779 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:10.599426 16779 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:10.599615 16779 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:10.639765 16779 rpc_server.cc:307] RPC server started. Bound to: 127.16.98.193:44015
I20260709 12:13:10.639902 25966 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.98.193:44015 every 8 connection(s)
I20260709 12:13:10.644853 16779 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:10.651831 25971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:10.653662 25972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:10.655520 25974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:10.656625 16779 server_base.cc:1061] running on GCE node
I20260709 12:13:10.657481 16779 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:10.657691 16779 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:10.657863 16779 hybrid_clock.cc:648] HybridClock initialized: now 1783599190657845 us; error 0 us; skew 500 ppm
I20260709 12:13:10.658480 16779 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:10.661183 16779 webserver.cc:533] Webserver started at http://127.16.98.194:39805/ using document root <none> and password file <none>
I20260709 12:13:10.661491 25967 heartbeater.cc:344] Connected to a master server at 127.16.98.254:37529
I20260709 12:13:10.661785 16779 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:10.661888 25967 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:10.662074 16779 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:10.662506 16779 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:10.662904 25967 heartbeater.cc:507] Master 127.16.98.254:37529 requested a full tablet report, sending...
I20260709 12:13:10.663813 16779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895573690-16779-0/minicluster-data/ts-1-root/instance:
uuid: "6c64624965ef4562abcea530986dd3ae"
format_stamp: "Formatted at 2026-07-09 12:13:10 on dist-test-slave-9bv4"
I20260709 12:13:10.665179 25840 ts_manager.cc:194] Registered new tserver with Master: dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015)
I20260709 12:13:10.667685 25840 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57980
I20260709 12:13:10.669916 16779 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:13:10.673575 25979 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:10.674294 16779 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:13:10.674593 16779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895573690-16779-0/minicluster-data/ts-1-root
uuid: "6c64624965ef4562abcea530986dd3ae"
format_stamp: "Formatted at 2026-07-09 12:13:10 on dist-test-slave-9bv4"
I20260709 12:13:10.674919 16779 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895573690-16779-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895573690-16779-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895573690-16779-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:10.688877 16779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:10.690039 16779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:10.691480 16779 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:10.693590 16779 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:10.693819 16779 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:10.694056 16779 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:10.694227 16779 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:10.732813 16779 rpc_server.cc:307] RPC server started. Bound to: 127.16.98.194:45419
I20260709 12:13:10.732936 26041 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.98.194:45419 every 8 connection(s)
I20260709 12:13:10.737516 16779 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:13:10.744364 26045 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:13:10.746134 26046 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:10.749042 16779 server_base.cc:1061] running on GCE node
W20260709 12:13:10.749496 26048 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:13:10.750116 26042 heartbeater.cc:344] Connected to a master server at 127.16.98.254:37529
I20260709 12:13:10.750547 26042 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:10.750768 16779 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:13:10.751060 16779 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:13:10.751273 16779 hybrid_clock.cc:648] HybridClock initialized: now 1783599190751254 us; error 0 us; skew 500 ppm
I20260709 12:13:10.751495 26042 heartbeater.cc:507] Master 127.16.98.254:37529 requested a full tablet report, sending...
I20260709 12:13:10.752058 16779 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:13:10.753844 25840 ts_manager.cc:194] Registered new tserver with Master: 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
I20260709 12:13:10.755010 16779 webserver.cc:533] Webserver started at http://127.16.98.195:36285/ using document root <none> and password file <none>
I20260709 12:13:10.755676 16779 fs_manager.cc:362] Metadata directory not provided
I20260709 12:13:10.755784 25840 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57994
I20260709 12:13:10.755934 16779 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:13:10.756388 16779 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:13:10.757938 16779 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895573690-16779-0/minicluster-data/ts-2-root/instance:
uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
format_stamp: "Formatted at 2026-07-09 12:13:10 on dist-test-slave-9bv4"
I20260709 12:13:10.762446 16779 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:13:10.765735 26053 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:10.766469 16779 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:13:10.766827 16779 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895573690-16779-0/minicluster-data/ts-2-root
uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
format_stamp: "Formatted at 2026-07-09 12:13:10 on dist-test-slave-9bv4"
I20260709 12:13:10.767113 16779 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895573690-16779-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895573690-16779-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskANJqDT/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783598895573690-16779-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:13:10.776393 16779 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:13:10.777526 16779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:13:10.778937 16779 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:13:10.781045 16779 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:13:10.781279 16779 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:10.781530 16779 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:13:10.781718 16779 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:13:10.820636 16779 rpc_server.cc:307] RPC server started. Bound to: 127.16.98.195:37971
I20260709 12:13:10.820755 26115 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.98.195:37971 every 8 connection(s)
I20260709 12:13:10.834824 26116 heartbeater.cc:344] Connected to a master server at 127.16.98.254:37529
I20260709 12:13:10.835330 26116 heartbeater.cc:461] Registering TS with master...
I20260709 12:13:10.836025 26116 heartbeater.cc:507] Master 127.16.98.254:37529 requested a full tablet report, sending...
I20260709 12:13:10.837942 25840 ts_manager.cc:194] Registered new tserver with Master: 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971)
I20260709 12:13:10.838572 16779 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014741296s
I20260709 12:13:10.839304 25840 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58008
I20260709 12:13:10.863588 25840 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58020:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:13:10.866297 25840 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:13:10.948401 26080 tablet_service.cc:1511] Processing CreateTablet for tablet 8474f54272164d4f84cb19d5844442af (DEFAULT_TABLE table=test-workload [id=6d407fada547423f8820c80f791f9008]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:13:10.949205 26081 tablet_service.cc:1511] Processing CreateTablet for tablet 796c3f24ad0843f18759a0c487728078 (DEFAULT_TABLE table=test-workload [id=6d407fada547423f8820c80f791f9008]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:13:10.949920 26080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8474f54272164d4f84cb19d5844442af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:10.950590 26081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 796c3f24ad0843f18759a0c487728078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:10.951802 26079 tablet_service.cc:1511] Processing CreateTablet for tablet b5e1998d449245b483308f4b257c0452 (DEFAULT_TABLE table=test-workload [id=6d407fada547423f8820c80f791f9008]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:13:10.953120 26079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5e1998d449245b483308f4b257c0452. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:10.955282 26078 tablet_service.cc:1511] Processing CreateTablet for tablet 8a8ed0809b1d49efbe69bc68167edfba (DEFAULT_TABLE table=test-workload [id=6d407fada547423f8820c80f791f9008]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:13:10.960965 26007 tablet_service.cc:1511] Processing CreateTablet for tablet 796c3f24ad0843f18759a0c487728078 (DEFAULT_TABLE table=test-workload [id=6d407fada547423f8820c80f791f9008]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:13:10.961421 26076 tablet_service.cc:1511] Processing CreateTablet for tablet f067007d0f714d73af016a85a9da6785 (DEFAULT_TABLE table=test-workload [id=6d407fada547423f8820c80f791f9008]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:13:10.962400 26007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 796c3f24ad0843f18759a0c487728078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:10.963737 26004 tablet_service.cc:1511] Processing CreateTablet for tablet 8a8ed0809b1d49efbe69bc68167edfba (DEFAULT_TABLE table=test-workload [id=6d407fada547423f8820c80f791f9008]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:13:10.963840 26077 tablet_service.cc:1511] Processing CreateTablet for tablet ee94f3771d884f83a218d2cee1dba3d0 (DEFAULT_TABLE table=test-workload [id=6d407fada547423f8820c80f791f9008]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:13:10.966061 25925 tablet_service.cc:1511] Processing CreateTablet for tablet a43feb33ed3f4ed984eb21f31f81f88b (DEFAULT_TABLE table=test-workload [id=6d407fada547423f8820c80f791f9008]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:13:10.967551 25925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a43feb33ed3f4ed984eb21f31f81f88b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:10.967953 26005 tablet_service.cc:1511] Processing CreateTablet for tablet b5e1998d449245b483308f4b257c0452 (DEFAULT_TABLE table=test-workload [id=6d407fada547423f8820c80f791f9008]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:13:10.968918 26003 tablet_service.cc:1511] Processing CreateTablet for tablet ee94f3771d884f83a218d2cee1dba3d0 (DEFAULT_TABLE table=test-workload [id=6d407fada547423f8820c80f791f9008]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:13:10.970091 26002 tablet_service.cc:1511] Processing CreateTablet for tablet f067007d0f714d73af016a85a9da6785 (DEFAULT_TABLE table=test-workload [id=6d407fada547423f8820c80f791f9008]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:13:10.970211 26075 tablet_service.cc:1511] Processing CreateTablet for tablet 4c26d5a58e504dfa8a8c0edeadcd5976 (DEFAULT_TABLE table=test-workload [id=6d407fada547423f8820c80f791f9008]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:13:10.966193 26006 tablet_service.cc:1511] Processing CreateTablet for tablet 8474f54272164d4f84cb19d5844442af (DEFAULT_TABLE table=test-workload [id=6d407fada547423f8820c80f791f9008]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:13:10.975613 25927 tablet_service.cc:1511] Processing CreateTablet for tablet f067007d0f714d73af016a85a9da6785 (DEFAULT_TABLE table=test-workload [id=6d407fada547423f8820c80f791f9008]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:13:10.975761 25929 tablet_service.cc:1511] Processing CreateTablet for tablet 8a8ed0809b1d49efbe69bc68167edfba (DEFAULT_TABLE table=test-workload [id=6d407fada547423f8820c80f791f9008]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:13:10.977106 25927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f067007d0f714d73af016a85a9da6785. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:10.977769 25926 tablet_service.cc:1511] Processing CreateTablet for tablet 4c26d5a58e504dfa8a8c0edeadcd5976 (DEFAULT_TABLE table=test-workload [id=6d407fada547423f8820c80f791f9008]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:13:10.979799 25926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c26d5a58e504dfa8a8c0edeadcd5976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:10.979665 25930 tablet_service.cc:1511] Processing CreateTablet for tablet b5e1998d449245b483308f4b257c0452 (DEFAULT_TABLE table=test-workload [id=6d407fada547423f8820c80f791f9008]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:13:10.981791 25928 tablet_service.cc:1511] Processing CreateTablet for tablet ee94f3771d884f83a218d2cee1dba3d0 (DEFAULT_TABLE table=test-workload [id=6d407fada547423f8820c80f791f9008]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:13:10.983081 25928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee94f3771d884f83a218d2cee1dba3d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:10.983757 25929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a8ed0809b1d49efbe69bc68167edfba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:10.984992 25931 tablet_service.cc:1511] Processing CreateTablet for tablet 8474f54272164d4f84cb19d5844442af (DEFAULT_TABLE table=test-workload [id=6d407fada547423f8820c80f791f9008]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:13:10.986297 25931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8474f54272164d4f84cb19d5844442af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:10.987720 25932 tablet_service.cc:1511] Processing CreateTablet for tablet 796c3f24ad0843f18759a0c487728078 (DEFAULT_TABLE table=test-workload [id=6d407fada547423f8820c80f791f9008]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:13:10.989030 25932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 796c3f24ad0843f18759a0c487728078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:10.991240 26001 tablet_service.cc:1511] Processing CreateTablet for tablet 4c26d5a58e504dfa8a8c0edeadcd5976 (DEFAULT_TABLE table=test-workload [id=6d407fada547423f8820c80f791f9008]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:13:10.992897 26005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5e1998d449245b483308f4b257c0452. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:10.993543 26000 tablet_service.cc:1511] Processing CreateTablet for tablet a43feb33ed3f4ed984eb21f31f81f88b (DEFAULT_TABLE table=test-workload [id=6d407fada547423f8820c80f791f9008]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:13:10.994879 26000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a43feb33ed3f4ed984eb21f31f81f88b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:10.997501 26006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8474f54272164d4f84cb19d5844442af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:11.003049 25930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5e1998d449245b483308f4b257c0452. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:11.003901 26003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee94f3771d884f83a218d2cee1dba3d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:11.006985 26076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f067007d0f714d73af016a85a9da6785. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:11.007640 26077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee94f3771d884f83a218d2cee1dba3d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:11.008394 26078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a8ed0809b1d49efbe69bc68167edfba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:11.010759 26075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c26d5a58e504dfa8a8c0edeadcd5976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:11.019106 25999 tablet_service.cc:1511] Processing CreateTablet for tablet c5d45aab99914708a3d777f6468b84aa (DEFAULT_TABLE table=test-workload [id=6d407fada547423f8820c80f791f9008]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:13:11.030162 26004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a8ed0809b1d49efbe69bc68167edfba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:11.031013 26002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f067007d0f714d73af016a85a9da6785. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:11.031747 26074 tablet_service.cc:1511] Processing CreateTablet for tablet c5d45aab99914708a3d777f6468b84aa (DEFAULT_TABLE table=test-workload [id=6d407fada547423f8820c80f791f9008]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:13:11.032320 25924 tablet_service.cc:1511] Processing CreateTablet for tablet c5d45aab99914708a3d777f6468b84aa (DEFAULT_TABLE table=test-workload [id=6d407fada547423f8820c80f791f9008]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:13:11.033151 26074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5d45aab99914708a3d777f6468b84aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:11.033591 25924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5d45aab99914708a3d777f6468b84aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:11.032145 25999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5d45aab99914708a3d777f6468b84aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:11.034564 26001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c26d5a58e504dfa8a8c0edeadcd5976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:11.030514 26081 tablet_service.cc:1511] Processing CreateTablet for tablet a43feb33ed3f4ed984eb21f31f81f88b (DEFAULT_TABLE table=test-workload [id=6d407fada547423f8820c80f791f9008]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:13:11.035907 26081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a43feb33ed3f4ed984eb21f31f81f88b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:11.113560 26132 tablet_bootstrap.cc:492] T a43feb33ed3f4ed984eb21f31f81f88b P dd4a4845e5f94eec9578accbfafcb4d6: Bootstrap starting.
I20260709 12:13:11.120256 26132 tablet_bootstrap.cc:654] T a43feb33ed3f4ed984eb21f31f81f88b P dd4a4845e5f94eec9578accbfafcb4d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.126129 26133 tablet_bootstrap.cc:492] T ee94f3771d884f83a218d2cee1dba3d0 P 6c64624965ef4562abcea530986dd3ae: Bootstrap starting.
I20260709 12:13:11.137991 26133 tablet_bootstrap.cc:654] T ee94f3771d884f83a218d2cee1dba3d0 P 6c64624965ef4562abcea530986dd3ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.139094 26131 tablet_bootstrap.cc:492] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Bootstrap starting.
I20260709 12:13:11.151857 26132 tablet_bootstrap.cc:492] T a43feb33ed3f4ed984eb21f31f81f88b P dd4a4845e5f94eec9578accbfafcb4d6: No bootstrap required, opened a new log
I20260709 12:13:11.152087 26131 tablet_bootstrap.cc:654] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.152436 26132 ts_tablet_manager.cc:1403] T a43feb33ed3f4ed984eb21f31f81f88b P dd4a4845e5f94eec9578accbfafcb4d6: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.007s
I20260709 12:13:11.155786 26132 raft_consensus.cc:359] T a43feb33ed3f4ed984eb21f31f81f88b P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.156544 26132 raft_consensus.cc:385] T a43feb33ed3f4ed984eb21f31f81f88b P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.156862 26132 raft_consensus.cc:740] T a43feb33ed3f4ed984eb21f31f81f88b P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd4a4845e5f94eec9578accbfafcb4d6, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.157522 26133 tablet_bootstrap.cc:492] T ee94f3771d884f83a218d2cee1dba3d0 P 6c64624965ef4562abcea530986dd3ae: No bootstrap required, opened a new log
I20260709 12:13:11.157799 26131 tablet_bootstrap.cc:492] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59: No bootstrap required, opened a new log
I20260709 12:13:11.158185 26133 ts_tablet_manager.cc:1403] T ee94f3771d884f83a218d2cee1dba3d0 P 6c64624965ef4562abcea530986dd3ae: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.004s
I20260709 12:13:11.157593 26132 consensus_queue.cc:260] T a43feb33ed3f4ed984eb21f31f81f88b P dd4a4845e5f94eec9578accbfafcb4d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.158390 26131 ts_tablet_manager.cc:1403] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.003s
I20260709 12:13:11.160250 25967 heartbeater.cc:499] Master 127.16.98.254:37529 was elected leader, sending a full tablet report...
I20260709 12:13:11.161311 26132 ts_tablet_manager.cc:1434] T a43feb33ed3f4ed984eb21f31f81f88b P dd4a4845e5f94eec9578accbfafcb4d6: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.001s
I20260709 12:13:11.161548 26133 raft_consensus.cc:359] T ee94f3771d884f83a218d2cee1dba3d0 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.162303 26133 raft_consensus.cc:385] T ee94f3771d884f83a218d2cee1dba3d0 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.161863 26131 raft_consensus.cc:359] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.162501 26132 tablet_bootstrap.cc:492] T f067007d0f714d73af016a85a9da6785 P dd4a4845e5f94eec9578accbfafcb4d6: Bootstrap starting.
I20260709 12:13:11.162668 26133 raft_consensus.cc:740] T ee94f3771d884f83a218d2cee1dba3d0 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c64624965ef4562abcea530986dd3ae, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.162979 26131 raft_consensus.cc:385] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.163422 26131 raft_consensus.cc:740] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f81d7b411a34e1e9ff80e6fcd7caf59, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.163511 26133 consensus_queue.cc:260] T ee94f3771d884f83a218d2cee1dba3d0 P 6c64624965ef4562abcea530986dd3ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.164417 26131 consensus_queue.cc:260] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.170975 26132 tablet_bootstrap.cc:654] T f067007d0f714d73af016a85a9da6785 P dd4a4845e5f94eec9578accbfafcb4d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.174269 26131 ts_tablet_manager.cc:1434] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.007s
I20260709 12:13:11.175163 26116 heartbeater.cc:499] Master 127.16.98.254:37529 was elected leader, sending a full tablet report...
I20260709 12:13:11.183840 26131 tablet_bootstrap.cc:492] T 796c3f24ad0843f18759a0c487728078 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Bootstrap starting.
I20260709 12:13:11.192688 26131 tablet_bootstrap.cc:654] T 796c3f24ad0843f18759a0c487728078 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.204425 26131 tablet_bootstrap.cc:492] T 796c3f24ad0843f18759a0c487728078 P 5f81d7b411a34e1e9ff80e6fcd7caf59: No bootstrap required, opened a new log
I20260709 12:13:11.205051 26131 ts_tablet_manager.cc:1403] T 796c3f24ad0843f18759a0c487728078 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.002s
I20260709 12:13:11.205305 26132 tablet_bootstrap.cc:492] T f067007d0f714d73af016a85a9da6785 P dd4a4845e5f94eec9578accbfafcb4d6: No bootstrap required, opened a new log
I20260709 12:13:11.205634 26042 heartbeater.cc:499] Master 127.16.98.254:37529 was elected leader, sending a full tablet report...
I20260709 12:13:11.205305 26133 ts_tablet_manager.cc:1434] T ee94f3771d884f83a218d2cee1dba3d0 P 6c64624965ef4562abcea530986dd3ae: Time spent starting tablet: real 0.047s	user 0.017s	sys 0.030s
I20260709 12:13:11.205950 26132 ts_tablet_manager.cc:1403] T f067007d0f714d73af016a85a9da6785 P dd4a4845e5f94eec9578accbfafcb4d6: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.031s
I20260709 12:13:11.207110 26133 tablet_bootstrap.cc:492] T f067007d0f714d73af016a85a9da6785 P 6c64624965ef4562abcea530986dd3ae: Bootstrap starting.
I20260709 12:13:11.208365 26131 raft_consensus.cc:359] T 796c3f24ad0843f18759a0c487728078 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } }
I20260709 12:13:11.209223 26131 raft_consensus.cc:385] T 796c3f24ad0843f18759a0c487728078 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.209004 26132 raft_consensus.cc:359] T f067007d0f714d73af016a85a9da6785 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.209707 26131 raft_consensus.cc:740] T 796c3f24ad0843f18759a0c487728078 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f81d7b411a34e1e9ff80e6fcd7caf59, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.209859 26132 raft_consensus.cc:385] T f067007d0f714d73af016a85a9da6785 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.210371 26132 raft_consensus.cc:740] T f067007d0f714d73af016a85a9da6785 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd4a4845e5f94eec9578accbfafcb4d6, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.211285 26131 consensus_queue.cc:260] T 796c3f24ad0843f18759a0c487728078 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } }
I20260709 12:13:11.211319 26132 consensus_queue.cc:260] T f067007d0f714d73af016a85a9da6785 P dd4a4845e5f94eec9578accbfafcb4d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.213474 26133 tablet_bootstrap.cc:654] T f067007d0f714d73af016a85a9da6785 P 6c64624965ef4562abcea530986dd3ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.213873 26132 ts_tablet_manager.cc:1434] T f067007d0f714d73af016a85a9da6785 P dd4a4845e5f94eec9578accbfafcb4d6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:11.214219 26131 ts_tablet_manager.cc:1434] T 796c3f24ad0843f18759a0c487728078 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:13:11.215021 26132 tablet_bootstrap.cc:492] T 8a8ed0809b1d49efbe69bc68167edfba P dd4a4845e5f94eec9578accbfafcb4d6: Bootstrap starting.
I20260709 12:13:11.215384 26131 tablet_bootstrap.cc:492] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Bootstrap starting.
I20260709 12:13:11.224078 26131 tablet_bootstrap.cc:654] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.224610 26132 tablet_bootstrap.cc:654] T 8a8ed0809b1d49efbe69bc68167edfba P dd4a4845e5f94eec9578accbfafcb4d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.230384 26133 tablet_bootstrap.cc:492] T f067007d0f714d73af016a85a9da6785 P 6c64624965ef4562abcea530986dd3ae: No bootstrap required, opened a new log
I20260709 12:13:11.231076 26133 ts_tablet_manager.cc:1403] T f067007d0f714d73af016a85a9da6785 P 6c64624965ef4562abcea530986dd3ae: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.006s
I20260709 12:13:11.234927 26133 raft_consensus.cc:359] T f067007d0f714d73af016a85a9da6785 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.235977 26133 raft_consensus.cc:385] T f067007d0f714d73af016a85a9da6785 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.236364 26133 raft_consensus.cc:740] T f067007d0f714d73af016a85a9da6785 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c64624965ef4562abcea530986dd3ae, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.237382 26133 consensus_queue.cc:260] T f067007d0f714d73af016a85a9da6785 P 6c64624965ef4562abcea530986dd3ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.238509 26131 tablet_bootstrap.cc:492] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59: No bootstrap required, opened a new log
I20260709 12:13:11.239176 26131 ts_tablet_manager.cc:1403] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Time spent bootstrapping tablet: real 0.024s	user 0.004s	sys 0.011s
I20260709 12:13:11.240617 26133 ts_tablet_manager.cc:1434] T f067007d0f714d73af016a85a9da6785 P 6c64624965ef4562abcea530986dd3ae: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.003s
I20260709 12:13:11.241999 26133 tablet_bootstrap.cc:492] T 796c3f24ad0843f18759a0c487728078 P 6c64624965ef4562abcea530986dd3ae: Bootstrap starting.
I20260709 12:13:11.242475 26131 raft_consensus.cc:359] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.243392 26131 raft_consensus.cc:385] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.244866 26131 raft_consensus.cc:740] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f81d7b411a34e1e9ff80e6fcd7caf59, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.245826 26131 consensus_queue.cc:260] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.247071 26132 tablet_bootstrap.cc:492] T 8a8ed0809b1d49efbe69bc68167edfba P dd4a4845e5f94eec9578accbfafcb4d6: No bootstrap required, opened a new log
I20260709 12:13:11.247643 26132 ts_tablet_manager.cc:1403] T 8a8ed0809b1d49efbe69bc68167edfba P dd4a4845e5f94eec9578accbfafcb4d6: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.018s
I20260709 12:13:11.249569 26133 tablet_bootstrap.cc:654] T 796c3f24ad0843f18759a0c487728078 P 6c64624965ef4562abcea530986dd3ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.250763 26132 raft_consensus.cc:359] T 8a8ed0809b1d49efbe69bc68167edfba P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.251534 26132 raft_consensus.cc:385] T 8a8ed0809b1d49efbe69bc68167edfba P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.251818 26132 raft_consensus.cc:740] T 8a8ed0809b1d49efbe69bc68167edfba P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd4a4845e5f94eec9578accbfafcb4d6, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.252589 26132 consensus_queue.cc:260] T 8a8ed0809b1d49efbe69bc68167edfba P dd4a4845e5f94eec9578accbfafcb4d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.253600 26131 ts_tablet_manager.cc:1434] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
I20260709 12:13:11.254719 26131 tablet_bootstrap.cc:492] T ee94f3771d884f83a218d2cee1dba3d0 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Bootstrap starting.
I20260709 12:13:11.261171 26133 tablet_bootstrap.cc:492] T 796c3f24ad0843f18759a0c487728078 P 6c64624965ef4562abcea530986dd3ae: No bootstrap required, opened a new log
I20260709 12:13:11.261415 26131 tablet_bootstrap.cc:654] T ee94f3771d884f83a218d2cee1dba3d0 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.261751 26133 ts_tablet_manager.cc:1403] T 796c3f24ad0843f18759a0c487728078 P 6c64624965ef4562abcea530986dd3ae: Time spent bootstrapping tablet: real 0.020s	user 0.004s	sys 0.013s
I20260709 12:13:11.262351 26132 ts_tablet_manager.cc:1434] T 8a8ed0809b1d49efbe69bc68167edfba P dd4a4845e5f94eec9578accbfafcb4d6: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 12:13:11.264992 26133 raft_consensus.cc:359] T 796c3f24ad0843f18759a0c487728078 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } }
I20260709 12:13:11.265803 26133 raft_consensus.cc:385] T 796c3f24ad0843f18759a0c487728078 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.266096 26133 raft_consensus.cc:740] T 796c3f24ad0843f18759a0c487728078 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c64624965ef4562abcea530986dd3ae, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.267081 26132 tablet_bootstrap.cc:492] T 4c26d5a58e504dfa8a8c0edeadcd5976 P dd4a4845e5f94eec9578accbfafcb4d6: Bootstrap starting.
I20260709 12:13:11.267060 26133 consensus_queue.cc:260] T 796c3f24ad0843f18759a0c487728078 P 6c64624965ef4562abcea530986dd3ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } }
I20260709 12:13:11.272951 26133 ts_tablet_manager.cc:1434] T 796c3f24ad0843f18759a0c487728078 P 6c64624965ef4562abcea530986dd3ae: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.002s
I20260709 12:13:11.274631 26133 tablet_bootstrap.cc:492] T a43feb33ed3f4ed984eb21f31f81f88b P 6c64624965ef4562abcea530986dd3ae: Bootstrap starting.
I20260709 12:13:11.276522 26132 tablet_bootstrap.cc:654] T 4c26d5a58e504dfa8a8c0edeadcd5976 P dd4a4845e5f94eec9578accbfafcb4d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.281812 26131 tablet_bootstrap.cc:492] T ee94f3771d884f83a218d2cee1dba3d0 P 5f81d7b411a34e1e9ff80e6fcd7caf59: No bootstrap required, opened a new log
I20260709 12:13:11.282470 26131 ts_tablet_manager.cc:1403] T ee94f3771d884f83a218d2cee1dba3d0 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.008s
I20260709 12:13:11.282872 26133 tablet_bootstrap.cc:654] T a43feb33ed3f4ed984eb21f31f81f88b P 6c64624965ef4562abcea530986dd3ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.286369 26131 raft_consensus.cc:359] T ee94f3771d884f83a218d2cee1dba3d0 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.287343 26131 raft_consensus.cc:385] T ee94f3771d884f83a218d2cee1dba3d0 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.287401 26133 tablet_bootstrap.cc:492] T a43feb33ed3f4ed984eb21f31f81f88b P 6c64624965ef4562abcea530986dd3ae: No bootstrap required, opened a new log
I20260709 12:13:11.287658 26131 raft_consensus.cc:740] T ee94f3771d884f83a218d2cee1dba3d0 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f81d7b411a34e1e9ff80e6fcd7caf59, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.287966 26133 ts_tablet_manager.cc:1403] T a43feb33ed3f4ed984eb21f31f81f88b P 6c64624965ef4562abcea530986dd3ae: Time spent bootstrapping tablet: real 0.014s	user 0.000s	sys 0.010s
I20260709 12:13:11.288535 26131 consensus_queue.cc:260] T ee94f3771d884f83a218d2cee1dba3d0 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.289309 26132 tablet_bootstrap.cc:492] T 4c26d5a58e504dfa8a8c0edeadcd5976 P dd4a4845e5f94eec9578accbfafcb4d6: No bootstrap required, opened a new log
I20260709 12:13:11.290097 26132 ts_tablet_manager.cc:1403] T 4c26d5a58e504dfa8a8c0edeadcd5976 P dd4a4845e5f94eec9578accbfafcb4d6: Time spent bootstrapping tablet: real 0.023s	user 0.020s	sys 0.000s
I20260709 12:13:11.291396 26131 ts_tablet_manager.cc:1434] T ee94f3771d884f83a218d2cee1dba3d0 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:13:11.291138 26133 raft_consensus.cc:359] T a43feb33ed3f4ed984eb21f31f81f88b P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.291915 26133 raft_consensus.cc:385] T a43feb33ed3f4ed984eb21f31f81f88b P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.292213 26133 raft_consensus.cc:740] T a43feb33ed3f4ed984eb21f31f81f88b P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c64624965ef4562abcea530986dd3ae, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.292466 26131 tablet_bootstrap.cc:492] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Bootstrap starting.
I20260709 12:13:11.293078 26133 consensus_queue.cc:260] T a43feb33ed3f4ed984eb21f31f81f88b P 6c64624965ef4562abcea530986dd3ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.293299 26132 raft_consensus.cc:359] T 4c26d5a58e504dfa8a8c0edeadcd5976 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.294070 26132 raft_consensus.cc:385] T 4c26d5a58e504dfa8a8c0edeadcd5976 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.294363 26132 raft_consensus.cc:740] T 4c26d5a58e504dfa8a8c0edeadcd5976 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd4a4845e5f94eec9578accbfafcb4d6, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.295238 26132 consensus_queue.cc:260] T 4c26d5a58e504dfa8a8c0edeadcd5976 P dd4a4845e5f94eec9578accbfafcb4d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.297705 26133 ts_tablet_manager.cc:1434] T a43feb33ed3f4ed984eb21f31f81f88b P 6c64624965ef4562abcea530986dd3ae: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.006s
I20260709 12:13:11.298768 26133 tablet_bootstrap.cc:492] T 8474f54272164d4f84cb19d5844442af P 6c64624965ef4562abcea530986dd3ae: Bootstrap starting.
I20260709 12:13:11.299458 26131 tablet_bootstrap.cc:654] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.302835 26132 ts_tablet_manager.cc:1434] T 4c26d5a58e504dfa8a8c0edeadcd5976 P dd4a4845e5f94eec9578accbfafcb4d6: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.001s
I20260709 12:13:11.304785 26132 tablet_bootstrap.cc:492] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6: Bootstrap starting.
I20260709 12:13:11.306521 26133 tablet_bootstrap.cc:654] T 8474f54272164d4f84cb19d5844442af P 6c64624965ef4562abcea530986dd3ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.310379 26138 raft_consensus.cc:493] T 796c3f24ad0843f18759a0c487728078 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.310895 26138 raft_consensus.cc:515] T 796c3f24ad0843f18759a0c487728078 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } }
I20260709 12:13:11.313689 26132 tablet_bootstrap.cc:654] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.317978 26138 leader_election.cc:290] T 796c3f24ad0843f18759a0c487728078 P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971), dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015)
W20260709 12:13:11.325116 26117 tablet.cc:2406] T 796c3f24ad0843f18759a0c487728078 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:13:11.332890 26132 tablet_bootstrap.cc:492] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6: No bootstrap required, opened a new log
I20260709 12:13:11.333451 26132 ts_tablet_manager.cc:1403] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.013s
I20260709 12:13:11.335374 26131 tablet_bootstrap.cc:492] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59: No bootstrap required, opened a new log
I20260709 12:13:11.335963 26131 ts_tablet_manager.cc:1403] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Time spent bootstrapping tablet: real 0.044s	user 0.006s	sys 0.033s
I20260709 12:13:11.336438 26132 raft_consensus.cc:359] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.337219 26132 raft_consensus.cc:385] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.337522 26132 raft_consensus.cc:740] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd4a4845e5f94eec9578accbfafcb4d6, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.338013 26133 tablet_bootstrap.cc:492] T 8474f54272164d4f84cb19d5844442af P 6c64624965ef4562abcea530986dd3ae: No bootstrap required, opened a new log
I20260709 12:13:11.338557 26133 ts_tablet_manager.cc:1403] T 8474f54272164d4f84cb19d5844442af P 6c64624965ef4562abcea530986dd3ae: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.002s
I20260709 12:13:11.338403 26132 consensus_queue.cc:260] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.339484 26131 raft_consensus.cc:359] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.340281 26131 raft_consensus.cc:385] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.340622 26131 raft_consensus.cc:740] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f81d7b411a34e1e9ff80e6fcd7caf59, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.341559 26131 consensus_queue.cc:260] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.341447 26133 raft_consensus.cc:359] T 8474f54272164d4f84cb19d5844442af P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.343403 26133 raft_consensus.cc:385] T 8474f54272164d4f84cb19d5844442af P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.343709 26133 raft_consensus.cc:740] T 8474f54272164d4f84cb19d5844442af P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c64624965ef4562abcea530986dd3ae, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.344483 26133 consensus_queue.cc:260] T 8474f54272164d4f84cb19d5844442af P 6c64624965ef4562abcea530986dd3ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.346917 26131 ts_tablet_manager.cc:1434] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 12:13:11.346967 26133 ts_tablet_manager.cc:1434] T 8474f54272164d4f84cb19d5844442af P 6c64624965ef4562abcea530986dd3ae: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:11.347699 26132 ts_tablet_manager.cc:1434] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 12:13:11.349723 26132 tablet_bootstrap.cc:492] T c5d45aab99914708a3d777f6468b84aa P dd4a4845e5f94eec9578accbfafcb4d6: Bootstrap starting.
I20260709 12:13:11.351073 26133 tablet_bootstrap.cc:492] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 6c64624965ef4562abcea530986dd3ae: Bootstrap starting.
I20260709 12:13:11.351363 26131 tablet_bootstrap.cc:492] T 8a8ed0809b1d49efbe69bc68167edfba P 5f81d7b411a34e1e9ff80e6fcd7caf59: Bootstrap starting.
I20260709 12:13:11.353018 26139 raft_consensus.cc:493] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.353557 26139 raft_consensus.cc:515] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.356590 26132 tablet_bootstrap.cc:654] T c5d45aab99914708a3d777f6468b84aa P dd4a4845e5f94eec9578accbfafcb4d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.359464 26139 leader_election.cc:290] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
I20260709 12:13:11.361593 26091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796c3f24ad0843f18759a0c487728078" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" is_pre_election: true
I20260709 12:13:11.362485 26091 raft_consensus.cc:2468] T 796c3f24ad0843f18759a0c487728078 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c64624965ef4562abcea530986dd3ae in term 0.
I20260709 12:13:11.362812 26133 tablet_bootstrap.cc:654] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 6c64624965ef4562abcea530986dd3ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.364514 25981 leader_election.cc:304] T 796c3f24ad0843f18759a0c487728078 P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, 6c64624965ef4562abcea530986dd3ae; no voters: 
I20260709 12:13:11.364800 26137 raft_consensus.cc:493] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.365407 26138 raft_consensus.cc:2804] T 796c3f24ad0843f18759a0c487728078 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:11.365935 26138 raft_consensus.cc:493] T 796c3f24ad0843f18759a0c487728078 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:11.366274 26138 raft_consensus.cc:3060] T 796c3f24ad0843f18759a0c487728078 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.365434 26137 raft_consensus.cc:515] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.371799 26137 leader_election.cc:290] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419), 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971)
I20260709 12:13:11.372382 26137 raft_consensus.cc:493] T 8a8ed0809b1d49efbe69bc68167edfba P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.372910 26137 raft_consensus.cc:515] T 8a8ed0809b1d49efbe69bc68167edfba P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.373349 26138 raft_consensus.cc:515] T 796c3f24ad0843f18759a0c487728078 P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } }
I20260709 12:13:11.375285 26137 leader_election.cc:290] T 8a8ed0809b1d49efbe69bc68167edfba P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419), 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971)
I20260709 12:13:11.375898 26091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796c3f24ad0843f18759a0c487728078" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
I20260709 12:13:11.376775 26091 raft_consensus.cc:3060] T 796c3f24ad0843f18759a0c487728078 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.387827 26138 leader_election.cc:290] T 796c3f24ad0843f18759a0c487728078 P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 election: Requested vote from peers 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971), dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015)
I20260709 12:13:11.389396 26091 raft_consensus.cc:2468] T 796c3f24ad0843f18759a0c487728078 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c64624965ef4562abcea530986dd3ae in term 1.
I20260709 12:13:11.391073 25981 leader_election.cc:304] T 796c3f24ad0843f18759a0c487728078 P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, 6c64624965ef4562abcea530986dd3ae; no voters: 
I20260709 12:13:11.392204 26138 raft_consensus.cc:2804] T 796c3f24ad0843f18759a0c487728078 P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:11.400820 26138 raft_consensus.cc:697] T 796c3f24ad0843f18759a0c487728078 P 6c64624965ef4562abcea530986dd3ae [term 1 LEADER]: Becoming Leader. State: Replica: 6c64624965ef4562abcea530986dd3ae, State: Running, Role: LEADER
I20260709 12:13:11.401984 26138 consensus_queue.cc:237] T 796c3f24ad0843f18759a0c487728078 P 6c64624965ef4562abcea530986dd3ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } }
I20260709 12:13:11.424805 25840 catalog_manager.cc:5697] T 796c3f24ad0843f18759a0c487728078 P 6c64624965ef4562abcea530986dd3ae reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c64624965ef4562abcea530986dd3ae (127.16.98.194). New cstate: current_term: 1 leader_uuid: "6c64624965ef4562abcea530986dd3ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:11.445626 25942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f067007d0f714d73af016a85a9da6785" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" is_pre_election: true
I20260709 12:13:11.446517 25942 raft_consensus.cc:2468] T f067007d0f714d73af016a85a9da6785 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 0.
I20260709 12:13:11.454186 25942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796c3f24ad0843f18759a0c487728078" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" is_pre_election: true
I20260709 12:13:11.456390 25942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796c3f24ad0843f18759a0c487728078" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
W20260709 12:13:11.457876 25981 leader_election.cc:343] T 796c3f24ad0843f18759a0c487728078 P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:11.459492 25981 leader_election.cc:343] T 796c3f24ad0843f18759a0c487728078 P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:11.461557 26055 leader_election.cc:304] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, dd4a4845e5f94eec9578accbfafcb4d6; no voters: 
I20260709 12:13:11.462810 26139 raft_consensus.cc:2804] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:11.463195 26139 raft_consensus.cc:493] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:11.463549 26139 raft_consensus.cc:3060] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:11.465584 25888 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:11.466276 26131 tablet_bootstrap.cc:654] T 8a8ed0809b1d49efbe69bc68167edfba P 5f81d7b411a34e1e9ff80e6fcd7caf59: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.471143 26139 raft_consensus.cc:515] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.473489 26133 tablet_bootstrap.cc:492] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 6c64624965ef4562abcea530986dd3ae: No bootstrap required, opened a new log
I20260709 12:13:11.473850 26138 raft_consensus.cc:493] T a43feb33ed3f4ed984eb21f31f81f88b P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.474381 26133 ts_tablet_manager.cc:1403] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 6c64624965ef4562abcea530986dd3ae: Time spent bootstrapping tablet: real 0.124s	user 0.058s	sys 0.047s
I20260709 12:13:11.474426 26138 raft_consensus.cc:515] T a43feb33ed3f4ed984eb21f31f81f88b P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.475256 26132 tablet_bootstrap.cc:492] T c5d45aab99914708a3d777f6468b84aa P dd4a4845e5f94eec9578accbfafcb4d6: No bootstrap required, opened a new log
I20260709 12:13:11.475770 26132 ts_tablet_manager.cc:1403] T c5d45aab99914708a3d777f6468b84aa P dd4a4845e5f94eec9578accbfafcb4d6: Time spent bootstrapping tablet: real 0.126s	user 0.022s	sys 0.054s
I20260709 12:13:11.476626 26139 leader_election.cc:290] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 1 election: Requested vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
I20260709 12:13:11.476881 26138 leader_election.cc:290] T a43feb33ed3f4ed984eb21f31f81f88b P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971)
I20260709 12:13:11.473559 26017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f067007d0f714d73af016a85a9da6785" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c64624965ef4562abcea530986dd3ae" is_pre_election: true
I20260709 12:13:11.478040 26017 raft_consensus.cc:2468] T f067007d0f714d73af016a85a9da6785 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 0.
I20260709 12:13:11.479364 26132 raft_consensus.cc:359] T c5d45aab99914708a3d777f6468b84aa P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.479275 26133 raft_consensus.cc:359] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.480330 26132 raft_consensus.cc:385] T c5d45aab99914708a3d777f6468b84aa P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.480733 26132 raft_consensus.cc:740] T c5d45aab99914708a3d777f6468b84aa P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd4a4845e5f94eec9578accbfafcb4d6, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.480760 26133 raft_consensus.cc:385] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.481451 26133 raft_consensus.cc:740] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c64624965ef4562abcea530986dd3ae, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.481721 26132 consensus_queue.cc:260] T c5d45aab99914708a3d777f6468b84aa P dd4a4845e5f94eec9578accbfafcb4d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.482352 26017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f067007d0f714d73af016a85a9da6785" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c64624965ef4562abcea530986dd3ae"
I20260709 12:13:11.482930 26017 raft_consensus.cc:3060] T f067007d0f714d73af016a85a9da6785 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.481690 26091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43feb33ed3f4ed984eb21f31f81f88b" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" is_pre_election: true
I20260709 12:13:11.484303 26132 ts_tablet_manager.cc:1434] T c5d45aab99914708a3d777f6468b84aa P dd4a4845e5f94eec9578accbfafcb4d6: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
W20260709 12:13:11.484836 25981 leader_election.cc:343] T a43feb33ed3f4ed984eb21f31f81f88b P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:11.483057 26138 raft_consensus.cc:493] T ee94f3771d884f83a218d2cee1dba3d0 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.485658 26138 raft_consensus.cc:515] T ee94f3771d884f83a218d2cee1dba3d0 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.486800 26132 tablet_bootstrap.cc:492] T 796c3f24ad0843f18759a0c487728078 P dd4a4845e5f94eec9578accbfafcb4d6: Bootstrap starting.
I20260709 12:13:11.487916 26138 leader_election.cc:290] T ee94f3771d884f83a218d2cee1dba3d0 P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971)
I20260709 12:13:11.490935 26091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee94f3771d884f83a218d2cee1dba3d0" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" is_pre_election: true
I20260709 12:13:11.492445 26091 raft_consensus.cc:2468] T ee94f3771d884f83a218d2cee1dba3d0 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c64624965ef4562abcea530986dd3ae in term 0.
I20260709 12:13:11.493703 25942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f067007d0f714d73af016a85a9da6785" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
I20260709 12:13:11.494063 26132 tablet_bootstrap.cc:654] T 796c3f24ad0843f18759a0c487728078 P dd4a4845e5f94eec9578accbfafcb4d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.494336 25942 raft_consensus.cc:3060] T f067007d0f714d73af016a85a9da6785 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.499025 25981 leader_election.cc:304] T ee94f3771d884f83a218d2cee1dba3d0 P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, 6c64624965ef4562abcea530986dd3ae; no voters: 
I20260709 12:13:11.500270 26160 raft_consensus.cc:2804] T ee94f3771d884f83a218d2cee1dba3d0 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:11.500746 26160 raft_consensus.cc:493] T ee94f3771d884f83a218d2cee1dba3d0 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:11.501183 26160 raft_consensus.cc:3060] T ee94f3771d884f83a218d2cee1dba3d0 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.505710 26132 tablet_bootstrap.cc:492] T 796c3f24ad0843f18759a0c487728078 P dd4a4845e5f94eec9578accbfafcb4d6: No bootstrap required, opened a new log
I20260709 12:13:11.506301 26132 ts_tablet_manager.cc:1403] T 796c3f24ad0843f18759a0c487728078 P dd4a4845e5f94eec9578accbfafcb4d6: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.010s
I20260709 12:13:11.509094 26139 raft_consensus.cc:493] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.509603 26139 raft_consensus.cc:515] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.509819 26132 raft_consensus.cc:359] T 796c3f24ad0843f18759a0c487728078 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } }
I20260709 12:13:11.510515 26132 raft_consensus.cc:385] T 796c3f24ad0843f18759a0c487728078 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.510833 26132 raft_consensus.cc:740] T 796c3f24ad0843f18759a0c487728078 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd4a4845e5f94eec9578accbfafcb4d6, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.511818 26139 leader_election.cc:290] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
I20260709 12:13:11.511847 26132 consensus_queue.cc:260] T 796c3f24ad0843f18759a0c487728078 P dd4a4845e5f94eec9578accbfafcb4d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } }
I20260709 12:13:11.513904 26016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c26d5a58e504dfa8a8c0edeadcd5976" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c64624965ef4562abcea530986dd3ae" is_pre_election: true
I20260709 12:13:11.516741 26132 ts_tablet_manager.cc:1434] T 796c3f24ad0843f18759a0c487728078 P dd4a4845e5f94eec9578accbfafcb4d6: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:13:11.482896 26133 consensus_queue.cc:260] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 6c64624965ef4562abcea530986dd3ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.519235 25941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c26d5a58e504dfa8a8c0edeadcd5976" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" is_pre_election: true
I20260709 12:13:11.519908 25941 raft_consensus.cc:2468] T 4c26d5a58e504dfa8a8c0edeadcd5976 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 0.
I20260709 12:13:11.519992 26016 raft_consensus.cc:2468] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 0.
I20260709 12:13:11.521212 26055 leader_election.cc:304] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, dd4a4845e5f94eec9578accbfafcb4d6; no voters: 
I20260709 12:13:11.522105 26139 raft_consensus.cc:2804] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:11.522503 26139 raft_consensus.cc:493] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:11.522894 26139 raft_consensus.cc:3060] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.525580 26133 ts_tablet_manager.cc:1434] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 6c64624965ef4562abcea530986dd3ae: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.000s
I20260709 12:13:11.537038 25940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee94f3771d884f83a218d2cee1dba3d0" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" is_pre_election: true
I20260709 12:13:11.517596 25942 raft_consensus.cc:2468] T f067007d0f714d73af016a85a9da6785 P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 1.
I20260709 12:13:11.517784 26132 tablet_bootstrap.cc:492] T 8474f54272164d4f84cb19d5844442af P dd4a4845e5f94eec9578accbfafcb4d6: Bootstrap starting.
I20260709 12:13:11.530470 26139 raft_consensus.cc:515] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.531921 26157 raft_consensus.cc:493] T a43feb33ed3f4ed984eb21f31f81f88b P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.538993 26157 raft_consensus.cc:515] T a43feb33ed3f4ed984eb21f31f81f88b P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.535521 25941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43feb33ed3f4ed984eb21f31f81f88b" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" is_pre_election: true
I20260709 12:13:11.540445 25941 raft_consensus.cc:2468] T a43feb33ed3f4ed984eb21f31f81f88b P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c64624965ef4562abcea530986dd3ae in term 0.
I20260709 12:13:11.541256 26157 leader_election.cc:290] T a43feb33ed3f4ed984eb21f31f81f88b P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419), 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971)
I20260709 12:13:11.544209 25941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c26d5a58e504dfa8a8c0edeadcd5976" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
I20260709 12:13:11.544766 25941 raft_consensus.cc:3060] T 4c26d5a58e504dfa8a8c0edeadcd5976 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.549147 26132 tablet_bootstrap.cc:654] T 8474f54272164d4f84cb19d5844442af P dd4a4845e5f94eec9578accbfafcb4d6: Neither blocks nor log segments found. Creating new log.
W20260709 12:13:11.550575 25981 leader_election.cc:343] T ee94f3771d884f83a218d2cee1dba3d0 P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:11.521046 26160 raft_consensus.cc:515] T ee94f3771d884f83a218d2cee1dba3d0 P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.537745 26133 tablet_bootstrap.cc:492] T c5d45aab99914708a3d777f6468b84aa P 6c64624965ef4562abcea530986dd3ae: Bootstrap starting.
I20260709 12:13:11.551251 26055 leader_election.cc:304] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, dd4a4845e5f94eec9578accbfafcb4d6; no voters: 
I20260709 12:13:11.556872 26016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c26d5a58e504dfa8a8c0edeadcd5976" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c64624965ef4562abcea530986dd3ae"
I20260709 12:13:11.557507 26016 raft_consensus.cc:3060] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.558194 26133 tablet_bootstrap.cc:654] T c5d45aab99914708a3d777f6468b84aa P 6c64624965ef4562abcea530986dd3ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.561607 26132 tablet_bootstrap.cc:492] T 8474f54272164d4f84cb19d5844442af P dd4a4845e5f94eec9578accbfafcb4d6: No bootstrap required, opened a new log
I20260709 12:13:11.562168 26132 ts_tablet_manager.cc:1403] T 8474f54272164d4f84cb19d5844442af P dd4a4845e5f94eec9578accbfafcb4d6: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.011s
I20260709 12:13:11.561954 25981 leader_election.cc:304] T a43feb33ed3f4ed984eb21f31f81f88b P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c64624965ef4562abcea530986dd3ae, dd4a4845e5f94eec9578accbfafcb4d6; no voters: 5f81d7b411a34e1e9ff80e6fcd7caf59
I20260709 12:13:11.563304 26138 raft_consensus.cc:2804] T a43feb33ed3f4ed984eb21f31f81f88b P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:11.563869 26138 raft_consensus.cc:493] T a43feb33ed3f4ed984eb21f31f81f88b P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:11.564389 26138 raft_consensus.cc:3060] T a43feb33ed3f4ed984eb21f31f81f88b P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.565402 26016 raft_consensus.cc:2468] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 1.
I20260709 12:13:11.565943 25942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee94f3771d884f83a218d2cee1dba3d0" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
I20260709 12:13:11.566762 26057 leader_election.cc:304] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, 6c64624965ef4562abcea530986dd3ae; no voters: 
I20260709 12:13:11.570544 26091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee94f3771d884f83a218d2cee1dba3d0" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
I20260709 12:13:11.571302 26091 raft_consensus.cc:3060] T ee94f3771d884f83a218d2cee1dba3d0 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.574132 26132 raft_consensus.cc:359] T 8474f54272164d4f84cb19d5844442af P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.585889 26132 raft_consensus.cc:385] T 8474f54272164d4f84cb19d5844442af P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.585770 26015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8ed0809b1d49efbe69bc68167edfba" candidate_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c64624965ef4562abcea530986dd3ae" is_pre_election: true
I20260709 12:13:11.586251 26132 raft_consensus.cc:740] T 8474f54272164d4f84cb19d5844442af P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd4a4845e5f94eec9578accbfafcb4d6, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.586351 26088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43feb33ed3f4ed984eb21f31f81f88b" candidate_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" is_pre_election: true
I20260709 12:13:11.586733 26131 tablet_bootstrap.cc:492] T 8a8ed0809b1d49efbe69bc68167edfba P 5f81d7b411a34e1e9ff80e6fcd7caf59: No bootstrap required, opened a new log
I20260709 12:13:11.587149 26014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43feb33ed3f4ed984eb21f31f81f88b" candidate_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c64624965ef4562abcea530986dd3ae" is_pre_election: true
I20260709 12:13:11.587507 26131 ts_tablet_manager.cc:1403] T 8a8ed0809b1d49efbe69bc68167edfba P 5f81d7b411a34e1e9ff80e6fcd7caf59: Time spent bootstrapping tablet: real 0.238s	user 0.038s	sys 0.077s
W20260709 12:13:11.588182 25906 leader_election.cc:343] T a43feb33ed3f4ed984eb21f31f81f88b P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:11.588454 26016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e1998d449245b483308f4b257c0452" candidate_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c64624965ef4562abcea530986dd3ae" is_pre_election: true
I20260709 12:13:11.588886 26133 tablet_bootstrap.cc:492] T c5d45aab99914708a3d777f6468b84aa P 6c64624965ef4562abcea530986dd3ae: No bootstrap required, opened a new log
I20260709 12:13:11.589404 26133 ts_tablet_manager.cc:1403] T c5d45aab99914708a3d777f6468b84aa P 6c64624965ef4562abcea530986dd3ae: Time spent bootstrapping tablet: real 0.052s	user 0.009s	sys 0.002s
W20260709 12:13:11.575841 25981 leader_election.cc:343] T ee94f3771d884f83a218d2cee1dba3d0 P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:11.577811 26139 leader_election.cc:290] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 1 election: Requested vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
I20260709 12:13:11.579262 25941 raft_consensus.cc:2468] T 4c26d5a58e504dfa8a8c0edeadcd5976 P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 1.
I20260709 12:13:11.579597 26091 raft_consensus.cc:2468] T ee94f3771d884f83a218d2cee1dba3d0 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c64624965ef4562abcea530986dd3ae in term 1.
I20260709 12:13:11.580699 26171 raft_consensus.cc:2804] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:11.590567 26131 raft_consensus.cc:359] T 8a8ed0809b1d49efbe69bc68167edfba P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.591398 26131 raft_consensus.cc:385] T 8a8ed0809b1d49efbe69bc68167edfba P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.591514 26171 raft_consensus.cc:697] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 LEADER]: Becoming Leader. State: Replica: 5f81d7b411a34e1e9ff80e6fcd7caf59, State: Running, Role: LEADER
I20260709 12:13:11.591750 26131 raft_consensus.cc:740] T 8a8ed0809b1d49efbe69bc68167edfba P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f81d7b411a34e1e9ff80e6fcd7caf59, State: Initialized, Role: FOLLOWER
W20260709 12:13:11.591131 25908 leader_election.cc:343] T 8a8ed0809b1d49efbe69bc68167edfba P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:11.592343 26133 raft_consensus.cc:359] T c5d45aab99914708a3d777f6468b84aa P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
W20260709 12:13:11.592667 25908 leader_election.cc:343] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:11.593102 26133 raft_consensus.cc:385] T c5d45aab99914708a3d777f6468b84aa P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.536115 26017 raft_consensus.cc:2468] T f067007d0f714d73af016a85a9da6785 P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 1.
I20260709 12:13:11.582082 26170 raft_consensus.cc:2804] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:11.583567 26090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e1998d449245b483308f4b257c0452" candidate_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" is_pre_election: true
I20260709 12:13:11.593461 26133 raft_consensus.cc:740] T c5d45aab99914708a3d777f6468b84aa P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c64624965ef4562abcea530986dd3ae, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.585012 26089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8ed0809b1d49efbe69bc68167edfba" candidate_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" is_pre_election: true
I20260709 12:13:11.593833 26170 raft_consensus.cc:697] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 LEADER]: Becoming Leader. State: Replica: 5f81d7b411a34e1e9ff80e6fcd7caf59, State: Running, Role: LEADER
I20260709 12:13:11.592782 26171 consensus_queue.cc:237] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.594755 26170 consensus_queue.cc:237] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.577644 26173 raft_consensus.cc:493] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.595883 26173 raft_consensus.cc:515] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.596923 26090 raft_consensus.cc:2468] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd4a4845e5f94eec9578accbfafcb4d6 in term 0.
I20260709 12:13:11.597173 26138 raft_consensus.cc:515] T a43feb33ed3f4ed984eb21f31f81f88b P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.598688 26014 raft_consensus.cc:2393] T a43feb33ed3f4ed984eb21f31f81f88b P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd4a4845e5f94eec9578accbfafcb4d6 in current term 1: Already voted for candidate 6c64624965ef4562abcea530986dd3ae in this term.
I20260709 12:13:11.594283 26133 consensus_queue.cc:260] T c5d45aab99914708a3d777f6468b84aa P 6c64624965ef4562abcea530986dd3ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.600274 25942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43feb33ed3f4ed984eb21f31f81f88b" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
I20260709 12:13:11.600920 25942 raft_consensus.cc:3060] T a43feb33ed3f4ed984eb21f31f81f88b P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.580695 26160 leader_election.cc:290] T ee94f3771d884f83a218d2cee1dba3d0 P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 election: Requested vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971)
I20260709 12:13:11.601938 26138 leader_election.cc:290] T a43feb33ed3f4ed984eb21f31f81f88b P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 election: Requested vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971)
I20260709 12:13:11.601893 25981 leader_election.cc:304] T ee94f3771d884f83a218d2cee1dba3d0 P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, 6c64624965ef4562abcea530986dd3ae; no voters: dd4a4845e5f94eec9578accbfafcb4d6
I20260709 12:13:11.587080 26132 consensus_queue.cc:260] T 8474f54272164d4f84cb19d5844442af P dd4a4845e5f94eec9578accbfafcb4d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.603551 25941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e1998d449245b483308f4b257c0452" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" is_pre_election: true
I20260709 12:13:11.603852 26160 raft_consensus.cc:2804] T ee94f3771d884f83a218d2cee1dba3d0 P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:11.604085 26132 ts_tablet_manager.cc:1434] T 8474f54272164d4f84cb19d5844442af P dd4a4845e5f94eec9578accbfafcb4d6: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:13:11.604157 25941 raft_consensus.cc:2468] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 0.
I20260709 12:13:11.604378 26160 raft_consensus.cc:697] T ee94f3771d884f83a218d2cee1dba3d0 P 6c64624965ef4562abcea530986dd3ae [term 1 LEADER]: Becoming Leader. State: Replica: 6c64624965ef4562abcea530986dd3ae, State: Running, Role: LEADER
I20260709 12:13:11.605197 26132 tablet_bootstrap.cc:492] T ee94f3771d884f83a218d2cee1dba3d0 P dd4a4845e5f94eec9578accbfafcb4d6: Bootstrap starting.
I20260709 12:13:11.605304 26160 consensus_queue.cc:237] T ee94f3771d884f83a218d2cee1dba3d0 P 6c64624965ef4562abcea530986dd3ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.605685 26055 leader_election.cc:304] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, dd4a4845e5f94eec9578accbfafcb4d6; no voters: 
I20260709 12:13:11.606752 26139 raft_consensus.cc:2804] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:11.607105 26139 raft_consensus.cc:493] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:11.607420 26139 raft_consensus.cc:3060] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.609527 26173 leader_election.cc:290] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
I20260709 12:13:11.592549 26131 consensus_queue.cc:260] T 8a8ed0809b1d49efbe69bc68167edfba P 5f81d7b411a34e1e9ff80e6fcd7caf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.610316 26089 raft_consensus.cc:2468] T 8a8ed0809b1d49efbe69bc68167edfba P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd4a4845e5f94eec9578accbfafcb4d6 in term 0.
I20260709 12:13:11.611328 26132 tablet_bootstrap.cc:654] T ee94f3771d884f83a218d2cee1dba3d0 P dd4a4845e5f94eec9578accbfafcb4d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.612819 26014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e1998d449245b483308f4b257c0452" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c64624965ef4562abcea530986dd3ae" is_pre_election: true
I20260709 12:13:11.613174 26131 ts_tablet_manager.cc:1434] T 8a8ed0809b1d49efbe69bc68167edfba P 5f81d7b411a34e1e9ff80e6fcd7caf59: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.004s
I20260709 12:13:11.614233 26131 tablet_bootstrap.cc:492] T c5d45aab99914708a3d777f6468b84aa P 5f81d7b411a34e1e9ff80e6fcd7caf59: Bootstrap starting.
W20260709 12:13:11.614732 26057 leader_election.cc:343] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:11.623543 26089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43feb33ed3f4ed984eb21f31f81f88b" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
I20260709 12:13:11.625453 26157 raft_consensus.cc:493] T 796c3f24ad0843f18759a0c487728078 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.626088 26157 raft_consensus.cc:515] T 796c3f24ad0843f18759a0c487728078 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } }
I20260709 12:13:11.626389 25908 leader_election.cc:304] T a43feb33ed3f4ed984eb21f31f81f88b P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd4a4845e5f94eec9578accbfafcb4d6; no voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, 6c64624965ef4562abcea530986dd3ae
I20260709 12:13:11.628170 26132 tablet_bootstrap.cc:492] T ee94f3771d884f83a218d2cee1dba3d0 P dd4a4845e5f94eec9578accbfafcb4d6: No bootstrap required, opened a new log
I20260709 12:13:11.628552 26157 leader_election.cc:290] T 796c3f24ad0843f18759a0c487728078 P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971), 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
I20260709 12:13:11.628675 26132 ts_tablet_manager.cc:1403] T ee94f3771d884f83a218d2cee1dba3d0 P dd4a4845e5f94eec9578accbfafcb4d6: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.000s
I20260709 12:13:11.629225 26131 tablet_bootstrap.cc:654] T c5d45aab99914708a3d777f6468b84aa P 5f81d7b411a34e1e9ff80e6fcd7caf59: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.629640 25906 leader_election.cc:304] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, dd4a4845e5f94eec9578accbfafcb4d6; no voters: 6c64624965ef4562abcea530986dd3ae
I20260709 12:13:11.630470 26089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796c3f24ad0843f18759a0c487728078" candidate_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" is_pre_election: true
I20260709 12:13:11.631289 26089 raft_consensus.cc:2393] T 796c3f24ad0843f18759a0c487728078 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd4a4845e5f94eec9578accbfafcb4d6 in current term 1: Already voted for candidate 6c64624965ef4562abcea530986dd3ae in this term.
I20260709 12:13:11.631036 25906 leader_election.cc:304] T 8a8ed0809b1d49efbe69bc68167edfba P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, dd4a4845e5f94eec9578accbfafcb4d6; no voters: 6c64624965ef4562abcea530986dd3ae
I20260709 12:13:11.631444 26132 raft_consensus.cc:359] T ee94f3771d884f83a218d2cee1dba3d0 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.632670 26157 raft_consensus.cc:2804] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:11.633193 26157 raft_consensus.cc:493] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:11.633286 26180 raft_consensus.cc:2804] T 8a8ed0809b1d49efbe69bc68167edfba P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:11.633682 26157 raft_consensus.cc:3060] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.633800 26180 raft_consensus.cc:493] T 8a8ed0809b1d49efbe69bc68167edfba P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:11.634300 26180 raft_consensus.cc:3060] T 8a8ed0809b1d49efbe69bc68167edfba P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.635003 25942 raft_consensus.cc:2468] T a43feb33ed3f4ed984eb21f31f81f88b P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c64624965ef4562abcea530986dd3ae in term 1.
I20260709 12:13:11.636988 26137 raft_consensus.cc:2749] T a43feb33ed3f4ed984eb21f31f81f88b P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:11.636178 26139 raft_consensus.cc:515] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.632301 26132 raft_consensus.cc:385] T ee94f3771d884f83a218d2cee1dba3d0 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.642529 26132 raft_consensus.cc:740] T ee94f3771d884f83a218d2cee1dba3d0 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd4a4845e5f94eec9578accbfafcb4d6, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.644457 26014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796c3f24ad0843f18759a0c487728078" candidate_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c64624965ef4562abcea530986dd3ae" is_pre_election: true
I20260709 12:13:11.646927 26132 consensus_queue.cc:260] T ee94f3771d884f83a218d2cee1dba3d0 P dd4a4845e5f94eec9578accbfafcb4d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.645573 26139 leader_election.cc:290] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 1 election: Requested vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
W20260709 12:13:11.645622 25981 leader_election.cc:343] T a43feb33ed3f4ed984eb21f31f81f88b P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:11.650133 25908 leader_election.cc:304] T 796c3f24ad0843f18759a0c487728078 P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd4a4845e5f94eec9578accbfafcb4d6; no voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, 6c64624965ef4562abcea530986dd3ae
I20260709 12:13:11.652371 26132 ts_tablet_manager.cc:1434] T ee94f3771d884f83a218d2cee1dba3d0 P dd4a4845e5f94eec9578accbfafcb4d6: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 12:13:11.654335 26137 raft_consensus.cc:3060] T 796c3f24ad0843f18759a0c487728078 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.655836 26014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e1998d449245b483308f4b257c0452" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c64624965ef4562abcea530986dd3ae"
I20260709 12:13:11.656059 26180 raft_consensus.cc:515] T 8a8ed0809b1d49efbe69bc68167edfba P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.653970 25981 leader_election.cc:304] T a43feb33ed3f4ed984eb21f31f81f88b P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c64624965ef4562abcea530986dd3ae, dd4a4845e5f94eec9578accbfafcb4d6; no voters: 5f81d7b411a34e1e9ff80e6fcd7caf59
I20260709 12:13:11.662407 25942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e1998d449245b483308f4b257c0452" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
I20260709 12:13:11.654330 26138 raft_consensus.cc:493] T 8474f54272164d4f84cb19d5844442af P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.663396 26017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8ed0809b1d49efbe69bc68167edfba" candidate_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c64624965ef4562abcea530986dd3ae"
W20260709 12:13:11.664729 26057 leader_election.cc:343] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:13:11.664842 25908 leader_election.cc:343] T 8a8ed0809b1d49efbe69bc68167edfba P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:11.663378 26138 raft_consensus.cc:515] T 8474f54272164d4f84cb19d5844442af P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.666507 26089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8ed0809b1d49efbe69bc68167edfba" candidate_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
I20260709 12:13:11.667150 26089 raft_consensus.cc:3060] T 8a8ed0809b1d49efbe69bc68167edfba P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.667486 26138 leader_election.cc:290] T 8474f54272164d4f84cb19d5844442af P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971)
I20260709 12:13:11.666812 25840 catalog_manager.cc:5697] T ee94f3771d884f83a218d2cee1dba3d0 P 6c64624965ef4562abcea530986dd3ae reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c64624965ef4562abcea530986dd3ae (127.16.98.194). New cstate: current_term: 1 leader_uuid: "6c64624965ef4562abcea530986dd3ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:11.668066 26138 raft_consensus.cc:2804] T a43feb33ed3f4ed984eb21f31f81f88b P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:11.669778 26091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8474f54272164d4f84cb19d5844442af" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" is_pre_election: true
I20260709 12:13:11.670107 26137 raft_consensus.cc:2749] T 796c3f24ad0843f18759a0c487728078 P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:11.656347 26133 ts_tablet_manager.cc:1434] T c5d45aab99914708a3d777f6468b84aa P 6c64624965ef4562abcea530986dd3ae: Time spent starting tablet: real 0.067s	user 0.017s	sys 0.016s
W20260709 12:13:11.671787 25981 leader_election.cc:343] T 8474f54272164d4f84cb19d5844442af P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:11.671749 25941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8474f54272164d4f84cb19d5844442af" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" is_pre_election: true
I20260709 12:13:11.672537 25941 raft_consensus.cc:2468] T 8474f54272164d4f84cb19d5844442af P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c64624965ef4562abcea530986dd3ae in term 0.
I20260709 12:13:11.672793 26133 tablet_bootstrap.cc:492] T b5e1998d449245b483308f4b257c0452 P 6c64624965ef4562abcea530986dd3ae: Bootstrap starting.
I20260709 12:13:11.673880 25981 leader_election.cc:304] T 8474f54272164d4f84cb19d5844442af P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c64624965ef4562abcea530986dd3ae, dd4a4845e5f94eec9578accbfafcb4d6; no voters: 5f81d7b411a34e1e9ff80e6fcd7caf59
I20260709 12:13:11.673362 25839 catalog_manager.cc:5697] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:11.675685 26160 raft_consensus.cc:2804] T 8474f54272164d4f84cb19d5844442af P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:11.676070 26160 raft_consensus.cc:493] T 8474f54272164d4f84cb19d5844442af P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:11.676434 26160 raft_consensus.cc:3060] T 8474f54272164d4f84cb19d5844442af P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.677440 26089 raft_consensus.cc:2468] T 8a8ed0809b1d49efbe69bc68167edfba P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd4a4845e5f94eec9578accbfafcb4d6 in term 1.
I20260709 12:13:11.678577 25906 leader_election.cc:304] T 8a8ed0809b1d49efbe69bc68167edfba P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, dd4a4845e5f94eec9578accbfafcb4d6; no voters: 6c64624965ef4562abcea530986dd3ae
I20260709 12:13:11.679443 26137 raft_consensus.cc:2804] T 8a8ed0809b1d49efbe69bc68167edfba P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:11.680272 26133 tablet_bootstrap.cc:654] T b5e1998d449245b483308f4b257c0452 P 6c64624965ef4562abcea530986dd3ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.683161 26138 raft_consensus.cc:697] T a43feb33ed3f4ed984eb21f31f81f88b P 6c64624965ef4562abcea530986dd3ae [term 1 LEADER]: Becoming Leader. State: Replica: 6c64624965ef4562abcea530986dd3ae, State: Running, Role: LEADER
I20260709 12:13:11.684068 26180 leader_election.cc:290] T 8a8ed0809b1d49efbe69bc68167edfba P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 1 election: Requested vote from peers 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419), 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971)
I20260709 12:13:11.684376 26138 consensus_queue.cc:237] T a43feb33ed3f4ed984eb21f31f81f88b P 6c64624965ef4562abcea530986dd3ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.686738 26157 raft_consensus.cc:515] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.688313 25942 raft_consensus.cc:2393] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in current term 1: Already voted for candidate dd4a4845e5f94eec9578accbfafcb4d6 in this term.
I20260709 12:13:11.690403 26055 leader_election.cc:304] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59; no voters: 6c64624965ef4562abcea530986dd3ae, dd4a4845e5f94eec9578accbfafcb4d6
I20260709 12:13:11.691670 26133 tablet_bootstrap.cc:492] T b5e1998d449245b483308f4b257c0452 P 6c64624965ef4562abcea530986dd3ae: No bootstrap required, opened a new log
I20260709 12:13:11.692193 26133 ts_tablet_manager.cc:1403] T b5e1998d449245b483308f4b257c0452 P 6c64624965ef4562abcea530986dd3ae: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.002s
I20260709 12:13:11.693388 26017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e1998d449245b483308f4b257c0452" candidate_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c64624965ef4562abcea530986dd3ae"
W20260709 12:13:11.694777 25908 leader_election.cc:343] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:11.694927 26133 raft_consensus.cc:359] T b5e1998d449245b483308f4b257c0452 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.695815 26133 raft_consensus.cc:385] T b5e1998d449245b483308f4b257c0452 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.696209 26157 leader_election.cc:290] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 1 election: Requested vote from peers 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419), 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971)
I20260709 12:13:11.696795 26089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e1998d449245b483308f4b257c0452" candidate_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
I20260709 12:13:11.697500 26133 raft_consensus.cc:740] T b5e1998d449245b483308f4b257c0452 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c64624965ef4562abcea530986dd3ae, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.697819 26089 raft_consensus.cc:2393] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dd4a4845e5f94eec9578accbfafcb4d6 in current term 1: Already voted for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in this term.
I20260709 12:13:11.698309 26133 consensus_queue.cc:260] T b5e1998d449245b483308f4b257c0452 P 6c64624965ef4562abcea530986dd3ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.698954 25906 leader_election.cc:304] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd4a4845e5f94eec9578accbfafcb4d6; no voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, 6c64624965ef4562abcea530986dd3ae
I20260709 12:13:11.702935 26157 raft_consensus.cc:2749] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:11.701004 26170 raft_consensus.cc:2749] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:11.703570 26133 ts_tablet_manager.cc:1434] T b5e1998d449245b483308f4b257c0452 P 6c64624965ef4562abcea530986dd3ae: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:13:11.701134 26160 raft_consensus.cc:515] T 8474f54272164d4f84cb19d5844442af P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.704716 26133 tablet_bootstrap.cc:492] T 8a8ed0809b1d49efbe69bc68167edfba P 6c64624965ef4562abcea530986dd3ae: Bootstrap starting.
I20260709 12:13:11.706153 25942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8474f54272164d4f84cb19d5844442af" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
I20260709 12:13:11.708164 26089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8474f54272164d4f84cb19d5844442af" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
I20260709 12:13:11.708830 25942 raft_consensus.cc:3060] T 8474f54272164d4f84cb19d5844442af P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:13:11.709620 25981 leader_election.cc:343] T 8474f54272164d4f84cb19d5844442af P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:11.716553 26133 tablet_bootstrap.cc:654] T 8a8ed0809b1d49efbe69bc68167edfba P 6c64624965ef4562abcea530986dd3ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.714015 25838 catalog_manager.cc:5697] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:11.719820 25942 raft_consensus.cc:2468] T 8474f54272164d4f84cb19d5844442af P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c64624965ef4562abcea530986dd3ae in term 1.
I20260709 12:13:11.721037 25840 catalog_manager.cc:5697] T a43feb33ed3f4ed984eb21f31f81f88b P 6c64624965ef4562abcea530986dd3ae reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c64624965ef4562abcea530986dd3ae (127.16.98.194). New cstate: current_term: 1 leader_uuid: "6c64624965ef4562abcea530986dd3ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:11.722908 25981 leader_election.cc:304] T 8474f54272164d4f84cb19d5844442af P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c64624965ef4562abcea530986dd3ae, dd4a4845e5f94eec9578accbfafcb4d6; no voters: 5f81d7b411a34e1e9ff80e6fcd7caf59
I20260709 12:13:11.723876 26138 raft_consensus.cc:2804] T 8474f54272164d4f84cb19d5844442af P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:11.726608 26138 raft_consensus.cc:697] T 8474f54272164d4f84cb19d5844442af P 6c64624965ef4562abcea530986dd3ae [term 1 LEADER]: Becoming Leader. State: Replica: 6c64624965ef4562abcea530986dd3ae, State: Running, Role: LEADER
I20260709 12:13:11.727854 26137 raft_consensus.cc:697] T 8a8ed0809b1d49efbe69bc68167edfba P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 LEADER]: Becoming Leader. State: Replica: dd4a4845e5f94eec9578accbfafcb4d6, State: Running, Role: LEADER
I20260709 12:13:11.727609 26138 consensus_queue.cc:237] T 8474f54272164d4f84cb19d5844442af P 6c64624965ef4562abcea530986dd3ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.728804 26137 consensus_queue.cc:237] T 8a8ed0809b1d49efbe69bc68167edfba P dd4a4845e5f94eec9578accbfafcb4d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.729512 26133 tablet_bootstrap.cc:492] T 8a8ed0809b1d49efbe69bc68167edfba P 6c64624965ef4562abcea530986dd3ae: No bootstrap required, opened a new log
I20260709 12:13:11.730000 26133 ts_tablet_manager.cc:1403] T 8a8ed0809b1d49efbe69bc68167edfba P 6c64624965ef4562abcea530986dd3ae: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.003s
I20260709 12:13:11.708602 26160 leader_election.cc:290] T 8474f54272164d4f84cb19d5844442af P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 election: Requested vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971)
I20260709 12:13:11.737999 26131 tablet_bootstrap.cc:492] T c5d45aab99914708a3d777f6468b84aa P 5f81d7b411a34e1e9ff80e6fcd7caf59: No bootstrap required, opened a new log
I20260709 12:13:11.738581 26131 ts_tablet_manager.cc:1403] T c5d45aab99914708a3d777f6468b84aa P 5f81d7b411a34e1e9ff80e6fcd7caf59: Time spent bootstrapping tablet: real 0.125s	user 0.005s	sys 0.009s
I20260709 12:13:11.740574 26133 raft_consensus.cc:359] T 8a8ed0809b1d49efbe69bc68167edfba P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.741289 26133 raft_consensus.cc:385] T 8a8ed0809b1d49efbe69bc68167edfba P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.741603 26133 raft_consensus.cc:740] T 8a8ed0809b1d49efbe69bc68167edfba P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c64624965ef4562abcea530986dd3ae, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.742296 26133 consensus_queue.cc:260] T 8a8ed0809b1d49efbe69bc68167edfba P 6c64624965ef4562abcea530986dd3ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.743233 26131 raft_consensus.cc:359] T c5d45aab99914708a3d777f6468b84aa P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.743848 26133 ts_tablet_manager.cc:1434] T 8a8ed0809b1d49efbe69bc68167edfba P 6c64624965ef4562abcea530986dd3ae: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:13:11.743937 26131 raft_consensus.cc:385] T c5d45aab99914708a3d777f6468b84aa P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.744379 26131 raft_consensus.cc:740] T c5d45aab99914708a3d777f6468b84aa P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f81d7b411a34e1e9ff80e6fcd7caf59, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.745600 26131 consensus_queue.cc:260] T c5d45aab99914708a3d777f6468b84aa P 5f81d7b411a34e1e9ff80e6fcd7caf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.745676 25840 catalog_manager.cc:5697] T 8a8ed0809b1d49efbe69bc68167edfba P dd4a4845e5f94eec9578accbfafcb4d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193). New cstate: current_term: 1 leader_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:11.749647 26131 ts_tablet_manager.cc:1434] T c5d45aab99914708a3d777f6468b84aa P 5f81d7b411a34e1e9ff80e6fcd7caf59: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:13:11.750602 26131 tablet_bootstrap.cc:492] T a43feb33ed3f4ed984eb21f31f81f88b P 5f81d7b411a34e1e9ff80e6fcd7caf59: Bootstrap starting.
I20260709 12:13:11.756575 26131 tablet_bootstrap.cc:654] T a43feb33ed3f4ed984eb21f31f81f88b P 5f81d7b411a34e1e9ff80e6fcd7caf59: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.757684 25839 catalog_manager.cc:5697] T 8474f54272164d4f84cb19d5844442af P 6c64624965ef4562abcea530986dd3ae reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c64624965ef4562abcea530986dd3ae (127.16.98.194). New cstate: current_term: 1 leader_uuid: "6c64624965ef4562abcea530986dd3ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:11.760864 26131 tablet_bootstrap.cc:492] T a43feb33ed3f4ed984eb21f31f81f88b P 5f81d7b411a34e1e9ff80e6fcd7caf59: No bootstrap required, opened a new log
I20260709 12:13:11.761309 26131 ts_tablet_manager.cc:1403] T a43feb33ed3f4ed984eb21f31f81f88b P 5f81d7b411a34e1e9ff80e6fcd7caf59: Time spent bootstrapping tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 12:13:11.763641 26131 raft_consensus.cc:359] T a43feb33ed3f4ed984eb21f31f81f88b P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.764228 26131 raft_consensus.cc:385] T a43feb33ed3f4ed984eb21f31f81f88b P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.764495 26131 raft_consensus.cc:740] T a43feb33ed3f4ed984eb21f31f81f88b P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f81d7b411a34e1e9ff80e6fcd7caf59, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.765161 26131 consensus_queue.cc:260] T a43feb33ed3f4ed984eb21f31f81f88b P 5f81d7b411a34e1e9ff80e6fcd7caf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.767624 26131 ts_tablet_manager.cc:1434] T a43feb33ed3f4ed984eb21f31f81f88b P 5f81d7b411a34e1e9ff80e6fcd7caf59: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:13:11.768627 26131 tablet_bootstrap.cc:492] T 8474f54272164d4f84cb19d5844442af P 5f81d7b411a34e1e9ff80e6fcd7caf59: Bootstrap starting.
I20260709 12:13:11.773885 26131 tablet_bootstrap.cc:654] T 8474f54272164d4f84cb19d5844442af P 5f81d7b411a34e1e9ff80e6fcd7caf59: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:11.778164 26131 tablet_bootstrap.cc:492] T 8474f54272164d4f84cb19d5844442af P 5f81d7b411a34e1e9ff80e6fcd7caf59: No bootstrap required, opened a new log
I20260709 12:13:11.778488 26131 ts_tablet_manager.cc:1403] T 8474f54272164d4f84cb19d5844442af P 5f81d7b411a34e1e9ff80e6fcd7caf59: Time spent bootstrapping tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:13:11.780422 26131 raft_consensus.cc:359] T 8474f54272164d4f84cb19d5844442af P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.780853 26131 raft_consensus.cc:385] T 8474f54272164d4f84cb19d5844442af P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:11.781147 26131 raft_consensus.cc:740] T 8474f54272164d4f84cb19d5844442af P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f81d7b411a34e1e9ff80e6fcd7caf59, State: Initialized, Role: FOLLOWER
I20260709 12:13:11.781682 26131 consensus_queue.cc:260] T 8474f54272164d4f84cb19d5844442af P 5f81d7b411a34e1e9ff80e6fcd7caf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.782984 26131 ts_tablet_manager.cc:1434] T 8474f54272164d4f84cb19d5844442af P 5f81d7b411a34e1e9ff80e6fcd7caf59: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:13:11.786919 26138 raft_consensus.cc:493] T c5d45aab99914708a3d777f6468b84aa P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.787392 26138 raft_consensus.cc:515] T c5d45aab99914708a3d777f6468b84aa P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.789316 26138 leader_election.cc:290] T c5d45aab99914708a3d777f6468b84aa P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971)
I20260709 12:13:11.789882 25942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d45aab99914708a3d777f6468b84aa" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" is_pre_election: true
I20260709 12:13:11.790274 26089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d45aab99914708a3d777f6468b84aa" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" is_pre_election: true
I20260709 12:13:11.790591 25942 raft_consensus.cc:2468] T c5d45aab99914708a3d777f6468b84aa P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c64624965ef4562abcea530986dd3ae in term 0.
I20260709 12:13:11.790902 26089 raft_consensus.cc:2468] T c5d45aab99914708a3d777f6468b84aa P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c64624965ef4562abcea530986dd3ae in term 0.
I20260709 12:13:11.791736 25981 leader_election.cc:304] T c5d45aab99914708a3d777f6468b84aa P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c64624965ef4562abcea530986dd3ae, dd4a4845e5f94eec9578accbfafcb4d6; no voters: 
I20260709 12:13:11.792510 26138 raft_consensus.cc:2804] T c5d45aab99914708a3d777f6468b84aa P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:11.792869 26138 raft_consensus.cc:493] T c5d45aab99914708a3d777f6468b84aa P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:11.793170 26138 raft_consensus.cc:3060] T c5d45aab99914708a3d777f6468b84aa P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.797760 26138 raft_consensus.cc:515] T c5d45aab99914708a3d777f6468b84aa P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.799364 26138 leader_election.cc:290] T c5d45aab99914708a3d777f6468b84aa P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 election: Requested vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971)
I20260709 12:13:11.800015 25942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d45aab99914708a3d777f6468b84aa" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
I20260709 12:13:11.800273 26089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d45aab99914708a3d777f6468b84aa" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
I20260709 12:13:11.800655 25942 raft_consensus.cc:3060] T c5d45aab99914708a3d777f6468b84aa P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.800813 26089 raft_consensus.cc:3060] T c5d45aab99914708a3d777f6468b84aa P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.807416 25942 raft_consensus.cc:2468] T c5d45aab99914708a3d777f6468b84aa P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c64624965ef4562abcea530986dd3ae in term 1.
I20260709 12:13:11.807426 26089 raft_consensus.cc:2468] T c5d45aab99914708a3d777f6468b84aa P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c64624965ef4562abcea530986dd3ae in term 1.
I20260709 12:13:11.808626 25981 leader_election.cc:304] T c5d45aab99914708a3d777f6468b84aa P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c64624965ef4562abcea530986dd3ae, dd4a4845e5f94eec9578accbfafcb4d6; no voters: 
I20260709 12:13:11.809252 26138 raft_consensus.cc:2804] T c5d45aab99914708a3d777f6468b84aa P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:11.809719 26138 raft_consensus.cc:697] T c5d45aab99914708a3d777f6468b84aa P 6c64624965ef4562abcea530986dd3ae [term 1 LEADER]: Becoming Leader. State: Replica: 6c64624965ef4562abcea530986dd3ae, State: Running, Role: LEADER
I20260709 12:13:11.810511 26138 consensus_queue.cc:237] T c5d45aab99914708a3d777f6468b84aa P 6c64624965ef4562abcea530986dd3ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.813262 26160 consensus_queue.cc:1048] T 796c3f24ad0843f18759a0c487728078 P 6c64624965ef4562abcea530986dd3ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:11.818351 25840 catalog_manager.cc:5697] T c5d45aab99914708a3d777f6468b84aa P 6c64624965ef4562abcea530986dd3ae reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c64624965ef4562abcea530986dd3ae (127.16.98.194). New cstate: current_term: 1 leader_uuid: "6c64624965ef4562abcea530986dd3ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:11.828559 26176 consensus_queue.cc:1048] T 796c3f24ad0843f18759a0c487728078 P 6c64624965ef4562abcea530986dd3ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:11.867686 26137 raft_consensus.cc:493] T ee94f3771d884f83a218d2cee1dba3d0 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.868254 26137 raft_consensus.cc:515] T ee94f3771d884f83a218d2cee1dba3d0 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.870096 26137 leader_election.cc:290] T ee94f3771d884f83a218d2cee1dba3d0 P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419), 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971)
I20260709 12:13:11.870831 26017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee94f3771d884f83a218d2cee1dba3d0" candidate_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c64624965ef4562abcea530986dd3ae" is_pre_election: true
I20260709 12:13:11.871136 26089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee94f3771d884f83a218d2cee1dba3d0" candidate_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" is_pre_election: true
I20260709 12:13:11.871832 26089 raft_consensus.cc:2393] T ee94f3771d884f83a218d2cee1dba3d0 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd4a4845e5f94eec9578accbfafcb4d6 in current term 1: Already voted for candidate 6c64624965ef4562abcea530986dd3ae in this term.
I20260709 12:13:11.872677 25906 leader_election.cc:304] T ee94f3771d884f83a218d2cee1dba3d0 P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd4a4845e5f94eec9578accbfafcb4d6; no voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, 6c64624965ef4562abcea530986dd3ae
I20260709 12:13:11.873309 26137 raft_consensus.cc:3060] T ee94f3771d884f83a218d2cee1dba3d0 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.878228 26137 raft_consensus.cc:2749] T ee94f3771d884f83a218d2cee1dba3d0 P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:11.908473 26176 raft_consensus.cc:493] T 8a8ed0809b1d49efbe69bc68167edfba P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.909082 26176 raft_consensus.cc:515] T 8a8ed0809b1d49efbe69bc68167edfba P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.910732 26176 leader_election.cc:290] T 8a8ed0809b1d49efbe69bc68167edfba P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971)
I20260709 12:13:11.911620 25942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8ed0809b1d49efbe69bc68167edfba" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" is_pre_election: true
I20260709 12:13:11.911892 26089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8ed0809b1d49efbe69bc68167edfba" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" is_pre_election: true
I20260709 12:13:11.912629 26089 raft_consensus.cc:2393] T 8a8ed0809b1d49efbe69bc68167edfba P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c64624965ef4562abcea530986dd3ae in current term 1: Already voted for candidate dd4a4845e5f94eec9578accbfafcb4d6 in this term.
I20260709 12:13:11.913470 25981 leader_election.cc:304] T 8a8ed0809b1d49efbe69bc68167edfba P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c64624965ef4562abcea530986dd3ae; no voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, dd4a4845e5f94eec9578accbfafcb4d6
I20260709 12:13:11.914160 26176 raft_consensus.cc:3060] T 8a8ed0809b1d49efbe69bc68167edfba P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.919061 26176 raft_consensus.cc:2749] T 8a8ed0809b1d49efbe69bc68167edfba P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:11.958194 26170 raft_consensus.cc:493] T 8474f54272164d4f84cb19d5844442af P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.958817 26170 raft_consensus.cc:515] T 8474f54272164d4f84cb19d5844442af P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.960618 26170 leader_election.cc:290] T 8474f54272164d4f84cb19d5844442af P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
I20260709 12:13:11.961338 25942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8474f54272164d4f84cb19d5844442af" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" is_pre_election: true
I20260709 12:13:11.961705 26017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8474f54272164d4f84cb19d5844442af" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c64624965ef4562abcea530986dd3ae" is_pre_election: true
I20260709 12:13:11.962131 25942 raft_consensus.cc:2393] T 8474f54272164d4f84cb19d5844442af P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in current term 1: Already voted for candidate 6c64624965ef4562abcea530986dd3ae in this term.
I20260709 12:13:11.963115 26055 leader_election.cc:304] T 8474f54272164d4f84cb19d5844442af P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59; no voters: 6c64624965ef4562abcea530986dd3ae, dd4a4845e5f94eec9578accbfafcb4d6
I20260709 12:13:11.963790 26170 raft_consensus.cc:3060] T 8474f54272164d4f84cb19d5844442af P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.965215 26171 raft_consensus.cc:493] T a43feb33ed3f4ed984eb21f31f81f88b P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:11.965764 26171 raft_consensus.cc:515] T a43feb33ed3f4ed984eb21f31f81f88b P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:11.967868 26171 leader_election.cc:290] T a43feb33ed3f4ed984eb21f31f81f88b P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
I20260709 12:13:11.968544 25942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43feb33ed3f4ed984eb21f31f81f88b" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" is_pre_election: true
I20260709 12:13:11.969427 25942 raft_consensus.cc:2393] T a43feb33ed3f4ed984eb21f31f81f88b P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in current term 1: Already voted for candidate 6c64624965ef4562abcea530986dd3ae in this term.
I20260709 12:13:11.969347 26017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43feb33ed3f4ed984eb21f31f81f88b" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c64624965ef4562abcea530986dd3ae" is_pre_election: true
I20260709 12:13:11.971238 26170 raft_consensus.cc:2749] T 8474f54272164d4f84cb19d5844442af P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:11.971004 26057 leader_election.cc:304] T a43feb33ed3f4ed984eb21f31f81f88b P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59; no voters: 6c64624965ef4562abcea530986dd3ae, dd4a4845e5f94eec9578accbfafcb4d6
I20260709 12:13:11.971979 26170 raft_consensus.cc:3060] T a43feb33ed3f4ed984eb21f31f81f88b P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:11.978092 26170 raft_consensus.cc:2749] T a43feb33ed3f4ed984eb21f31f81f88b P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:11.995131 26170 consensus_queue.cc:1048] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:12.006119 26171 consensus_queue.cc:1048] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:12.077057 26160 consensus_queue.cc:1048] T ee94f3771d884f83a218d2cee1dba3d0 P 6c64624965ef4562abcea530986dd3ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:12.078197 26176 consensus_queue.cc:1048] T ee94f3771d884f83a218d2cee1dba3d0 P 6c64624965ef4562abcea530986dd3ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:12.088717 26138 raft_consensus.cc:493] T b5e1998d449245b483308f4b257c0452 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:12.089233 26138 raft_consensus.cc:515] T b5e1998d449245b483308f4b257c0452 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:12.091284 26138 leader_election.cc:290] T b5e1998d449245b483308f4b257c0452 P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971)
I20260709 12:13:12.094373 26091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e1998d449245b483308f4b257c0452" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" is_pre_election: true
I20260709 12:13:12.095292 26091 raft_consensus.cc:2393] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c64624965ef4562abcea530986dd3ae in current term 1: Already voted for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in this term.
I20260709 12:13:12.093309 25941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e1998d449245b483308f4b257c0452" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" is_pre_election: true
I20260709 12:13:12.096750 25941 raft_consensus.cc:2393] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c64624965ef4562abcea530986dd3ae in current term 1: Already voted for candidate dd4a4845e5f94eec9578accbfafcb4d6 in this term.
I20260709 12:13:12.099582 25981 leader_election.cc:304] T b5e1998d449245b483308f4b257c0452 P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c64624965ef4562abcea530986dd3ae; no voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, dd4a4845e5f94eec9578accbfafcb4d6
I20260709 12:13:12.100418 26138 raft_consensus.cc:3060] T b5e1998d449245b483308f4b257c0452 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:12.107156 26138 raft_consensus.cc:2749] T b5e1998d449245b483308f4b257c0452 P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:12.107321 26160 consensus_queue.cc:1048] T a43feb33ed3f4ed984eb21f31f81f88b P 6c64624965ef4562abcea530986dd3ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:12.117697 26138 consensus_queue.cc:1048] T a43feb33ed3f4ed984eb21f31f81f88b P 6c64624965ef4562abcea530986dd3ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:12.179563 26171 consensus_queue.cc:1048] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:12.189888 26171 consensus_queue.cc:1048] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:12.266554 26137 consensus_queue.cc:1048] T 8a8ed0809b1d49efbe69bc68167edfba P dd4a4845e5f94eec9578accbfafcb4d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:12.277148 26137 consensus_queue.cc:1048] T 8a8ed0809b1d49efbe69bc68167edfba P dd4a4845e5f94eec9578accbfafcb4d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:12.282836 26138 consensus_queue.cc:1048] T 8474f54272164d4f84cb19d5844442af P 6c64624965ef4562abcea530986dd3ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:12.296784 26138 consensus_queue.cc:1048] T 8474f54272164d4f84cb19d5844442af P 6c64624965ef4562abcea530986dd3ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:12.356685 26138 consensus_queue.cc:1048] T c5d45aab99914708a3d777f6468b84aa P 6c64624965ef4562abcea530986dd3ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:12.367254 26176 consensus_queue.cc:1048] T c5d45aab99914708a3d777f6468b84aa P 6c64624965ef4562abcea530986dd3ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:13:12.468557 25888 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:13.224606 26139 raft_consensus.cc:493] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:13.225364 26139 raft_consensus.cc:515] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:13.227617 26139 leader_election.cc:290] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
I20260709 12:13:13.229079 26017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e1998d449245b483308f4b257c0452" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c64624965ef4562abcea530986dd3ae" is_pre_election: true
I20260709 12:13:13.229307 25941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e1998d449245b483308f4b257c0452" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" is_pre_election: true
I20260709 12:13:13.230464 25941 raft_consensus.cc:2468] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 1.
I20260709 12:13:13.230448 26017 raft_consensus.cc:2468] T b5e1998d449245b483308f4b257c0452 P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 1.
I20260709 12:13:13.232290 26055 leader_election.cc:304] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, dd4a4845e5f94eec9578accbfafcb4d6; no voters: 
I20260709 12:13:13.233053 26139 raft_consensus.cc:2804] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:13:13.233448 26139 raft_consensus.cc:493] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:13.233866 26139 raft_consensus.cc:3060] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:13.242091 26139 raft_consensus.cc:515] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:13.243703 26139 leader_election.cc:290] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 2 election: Requested vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
I20260709 12:13:13.244419 25941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e1998d449245b483308f4b257c0452" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
I20260709 12:13:13.244802 26014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e1998d449245b483308f4b257c0452" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c64624965ef4562abcea530986dd3ae"
I20260709 12:13:13.245002 25941 raft_consensus.cc:3060] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:13.245415 26014 raft_consensus.cc:3060] T b5e1998d449245b483308f4b257c0452 P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:13.251420 25941 raft_consensus.cc:2468] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 2.
I20260709 12:13:13.252076 26014 raft_consensus.cc:2468] T b5e1998d449245b483308f4b257c0452 P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 2.
I20260709 12:13:13.252539 26055 leader_election.cc:304] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, dd4a4845e5f94eec9578accbfafcb4d6; no voters: 
I20260709 12:13:13.253353 26139 raft_consensus.cc:2804] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:13.253787 26139 raft_consensus.cc:697] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 LEADER]: Becoming Leader. State: Replica: 5f81d7b411a34e1e9ff80e6fcd7caf59, State: Running, Role: LEADER
I20260709 12:13:13.255028 26139 consensus_queue.cc:237] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:13.263437 25840 catalog_manager.cc:5697] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 reported cstate change: term changed from 0 to 2, leader changed from <none> to 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195). New cstate: current_term: 2 leader_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:13.626461 26014 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "796c3f24ad0843f18759a0c487728078"
dest_uuid: "6c64624965ef4562abcea530986dd3ae"
mode: GRACEFUL
new_leader_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
 from {username='slave'} at 127.0.0.1:39080
I20260709 12:13:13.627154 26014 raft_consensus.cc:606] T 796c3f24ad0843f18759a0c487728078 P 6c64624965ef4562abcea530986dd3ae [term 1 LEADER]: Received request to transfer leadership to TS dd4a4845e5f94eec9578accbfafcb4d6
I20260709 12:13:13.632298 26014 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8474f54272164d4f84cb19d5844442af"
dest_uuid: "6c64624965ef4562abcea530986dd3ae"
mode: GRACEFUL
new_leader_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
 from {username='slave'} at 127.0.0.1:39080
I20260709 12:13:13.632805 26014 raft_consensus.cc:606] T 8474f54272164d4f84cb19d5844442af P 6c64624965ef4562abcea530986dd3ae [term 1 LEADER]: Received request to transfer leadership to TS dd4a4845e5f94eec9578accbfafcb4d6
I20260709 12:13:13.646621 26089 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5e1998d449245b483308f4b257c0452"
dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
mode: GRACEFUL
new_leader_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
 from {username='slave'} at 127.0.0.1:34310
I20260709 12:13:13.647186 26089 raft_consensus.cc:606] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 LEADER]: Received request to transfer leadership to TS dd4a4845e5f94eec9578accbfafcb4d6
I20260709 12:13:13.656890 26089 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f067007d0f714d73af016a85a9da6785"
dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
mode: GRACEFUL
new_leader_uuid: "6c64624965ef4562abcea530986dd3ae"
 from {username='slave'} at 127.0.0.1:34310
I20260709 12:13:13.657408 26089 raft_consensus.cc:606] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 LEADER]: Received request to transfer leadership to TS 6c64624965ef4562abcea530986dd3ae
I20260709 12:13:13.661944 26089 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c26d5a58e504dfa8a8c0edeadcd5976"
dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
mode: GRACEFUL
new_leader_uuid: "6c64624965ef4562abcea530986dd3ae"
 from {username='slave'} at 127.0.0.1:34310
I20260709 12:13:13.662381 26089 raft_consensus.cc:606] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 LEADER]: Received request to transfer leadership to TS 6c64624965ef4562abcea530986dd3ae
I20260709 12:13:13.669386 26014 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5d45aab99914708a3d777f6468b84aa"
dest_uuid: "6c64624965ef4562abcea530986dd3ae"
mode: GRACEFUL
new_leader_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
 from {username='slave'} at 127.0.0.1:39080
I20260709 12:13:13.669935 26014 raft_consensus.cc:606] T c5d45aab99914708a3d777f6468b84aa P 6c64624965ef4562abcea530986dd3ae [term 1 LEADER]: Received request to transfer leadership to TS 5f81d7b411a34e1e9ff80e6fcd7caf59
I20260709 12:13:13.767560 26226 raft_consensus.cc:993] T 8474f54272164d4f84cb19d5844442af P 6c64624965ef4562abcea530986dd3ae: : Instructing follower dd4a4845e5f94eec9578accbfafcb4d6 to start an election
I20260709 12:13:13.768118 26176 raft_consensus.cc:1081] T 8474f54272164d4f84cb19d5844442af P 6c64624965ef4562abcea530986dd3ae [term 1 LEADER]: Signalling peer dd4a4845e5f94eec9578accbfafcb4d6 to start an election
I20260709 12:13:13.770051 25941 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8474f54272164d4f84cb19d5844442af"
dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
 from {username='slave'} at 127.0.0.1:49468
I20260709 12:13:13.770713 25941 raft_consensus.cc:493] T 8474f54272164d4f84cb19d5844442af P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:13.771059 25941 raft_consensus.cc:3060] T 8474f54272164d4f84cb19d5844442af P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:13.777243 25941 raft_consensus.cc:515] T 8474f54272164d4f84cb19d5844442af P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:13.778882 25941 leader_election.cc:290] T 8474f54272164d4f84cb19d5844442af P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 2 election: Requested vote from peers 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419), 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971)
I20260709 12:13:13.779551 26014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8474f54272164d4f84cb19d5844442af" candidate_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c64624965ef4562abcea530986dd3ae"
I20260709 12:13:13.779947 26089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8474f54272164d4f84cb19d5844442af" candidate_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
I20260709 12:13:13.780231 26014 raft_consensus.cc:3055] T 8474f54272164d4f84cb19d5844442af P 6c64624965ef4562abcea530986dd3ae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:13.780568 26089 raft_consensus.cc:3060] T 8474f54272164d4f84cb19d5844442af P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:13.780575 26014 raft_consensus.cc:740] T 8474f54272164d4f84cb19d5844442af P 6c64624965ef4562abcea530986dd3ae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6c64624965ef4562abcea530986dd3ae, State: Running, Role: LEADER
I20260709 12:13:13.781736 26014 consensus_queue.cc:260] T 8474f54272164d4f84cb19d5844442af P 6c64624965ef4562abcea530986dd3ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:13.783018 26014 raft_consensus.cc:3060] T 8474f54272164d4f84cb19d5844442af P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:13.787256 26089 raft_consensus.cc:2468] T 8474f54272164d4f84cb19d5844442af P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd4a4845e5f94eec9578accbfafcb4d6 in term 2.
I20260709 12:13:13.788206 26014 raft_consensus.cc:2468] T 8474f54272164d4f84cb19d5844442af P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd4a4845e5f94eec9578accbfafcb4d6 in term 2.
I20260709 12:13:13.788553 25906 leader_election.cc:304] T 8474f54272164d4f84cb19d5844442af P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, dd4a4845e5f94eec9578accbfafcb4d6; no voters: 
I20260709 12:13:13.789565 26215 raft_consensus.cc:2804] T 8474f54272164d4f84cb19d5844442af P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:13.790350 26215 raft_consensus.cc:697] T 8474f54272164d4f84cb19d5844442af P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 LEADER]: Becoming Leader. State: Replica: dd4a4845e5f94eec9578accbfafcb4d6, State: Running, Role: LEADER
I20260709 12:13:13.791232 26215 consensus_queue.cc:237] T 8474f54272164d4f84cb19d5844442af P dd4a4845e5f94eec9578accbfafcb4d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:13.797982 25840 catalog_manager.cc:5697] T 8474f54272164d4f84cb19d5844442af P dd4a4845e5f94eec9578accbfafcb4d6 reported cstate change: term changed from 1 to 2, leader changed from 6c64624965ef4562abcea530986dd3ae (127.16.98.194) to dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:13.806143 26014 raft_consensus.cc:1275] T b5e1998d449245b483308f4b257c0452 P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Refusing update from remote peer 5f81d7b411a34e1e9ff80e6fcd7caf59: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:13:13.807622 26139 consensus_queue.cc:1048] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:13.819789 25941 raft_consensus.cc:1275] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Refusing update from remote peer 5f81d7b411a34e1e9ff80e6fcd7caf59: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:13:13.821616 26235 consensus_queue.cc:1048] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:13.829991 26233 raft_consensus.cc:993] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59: : Instructing follower dd4a4845e5f94eec9578accbfafcb4d6 to start an election
I20260709 12:13:13.830466 26235 raft_consensus.cc:1081] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 LEADER]: Signalling peer dd4a4845e5f94eec9578accbfafcb4d6 to start an election
I20260709 12:13:13.832015 25941 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5e1998d449245b483308f4b257c0452"
dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
 from {username='slave'} at 127.0.0.1:49470
I20260709 12:13:13.832593 25941 raft_consensus.cc:493] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:13.832958 25941 raft_consensus.cc:3060] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:13.838733 25941 raft_consensus.cc:515] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:13.840287 25941 leader_election.cc:290] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 3 election: Requested vote from peers 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419), 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971)
I20260709 12:13:13.841216 26014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e1998d449245b483308f4b257c0452" candidate_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "6c64624965ef4562abcea530986dd3ae"
I20260709 12:13:13.841361 26089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5e1998d449245b483308f4b257c0452" candidate_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
I20260709 12:13:13.842053 26089 raft_consensus.cc:3055] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:13.842336 26014 raft_consensus.cc:3060] T b5e1998d449245b483308f4b257c0452 P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:13.842412 26089 raft_consensus.cc:740] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5f81d7b411a34e1e9ff80e6fcd7caf59, State: Running, Role: LEADER
I20260709 12:13:13.843501 26089 consensus_queue.cc:260] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:13.844879 26089 raft_consensus.cc:3060] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:13.850261 26089 raft_consensus.cc:2468] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd4a4845e5f94eec9578accbfafcb4d6 in term 3.
I20260709 12:13:13.851641 26014 raft_consensus.cc:2468] T b5e1998d449245b483308f4b257c0452 P 6c64624965ef4562abcea530986dd3ae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd4a4845e5f94eec9578accbfafcb4d6 in term 3.
I20260709 12:13:13.851719 25906 leader_election.cc:304] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, dd4a4845e5f94eec9578accbfafcb4d6; no voters: 
I20260709 12:13:13.852625 26215 raft_consensus.cc:2804] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:13.853024 26215 raft_consensus.cc:697] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6 [term 3 LEADER]: Becoming Leader. State: Replica: dd4a4845e5f94eec9578accbfafcb4d6, State: Running, Role: LEADER
I20260709 12:13:13.853927 26215 consensus_queue.cc:237] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:13.860463 25839 catalog_manager.cc:5697] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6 reported cstate change: term changed from 2 to 3, leader changed from 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195) to dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193). New cstate: current_term: 3 leader_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:14.013309 26225 raft_consensus.cc:993] T c5d45aab99914708a3d777f6468b84aa P 6c64624965ef4562abcea530986dd3ae: : Instructing follower 5f81d7b411a34e1e9ff80e6fcd7caf59 to start an election
I20260709 12:13:14.013836 26176 raft_consensus.cc:1081] T c5d45aab99914708a3d777f6468b84aa P 6c64624965ef4562abcea530986dd3ae [term 1 LEADER]: Signalling peer 5f81d7b411a34e1e9ff80e6fcd7caf59 to start an election
I20260709 12:13:14.015228 26089 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c5d45aab99914708a3d777f6468b84aa"
dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
 from {username='slave'} at 127.0.0.1:34284
I20260709 12:13:14.015725 26089 raft_consensus.cc:493] T c5d45aab99914708a3d777f6468b84aa P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:14.016006 26089 raft_consensus.cc:3060] T c5d45aab99914708a3d777f6468b84aa P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:14.020952 26089 raft_consensus.cc:515] T c5d45aab99914708a3d777f6468b84aa P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:14.022825 26089 leader_election.cc:290] T c5d45aab99914708a3d777f6468b84aa P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 2 election: Requested vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
I20260709 12:13:14.023592 25941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d45aab99914708a3d777f6468b84aa" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
I20260709 12:13:14.024008 26014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d45aab99914708a3d777f6468b84aa" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c64624965ef4562abcea530986dd3ae"
I20260709 12:13:14.024358 25941 raft_consensus.cc:3060] T c5d45aab99914708a3d777f6468b84aa P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:14.024680 26014 raft_consensus.cc:3055] T c5d45aab99914708a3d777f6468b84aa P 6c64624965ef4562abcea530986dd3ae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:14.025010 26014 raft_consensus.cc:740] T c5d45aab99914708a3d777f6468b84aa P 6c64624965ef4562abcea530986dd3ae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6c64624965ef4562abcea530986dd3ae, State: Running, Role: LEADER
I20260709 12:13:14.025946 26014 consensus_queue.cc:260] T c5d45aab99914708a3d777f6468b84aa P 6c64624965ef4562abcea530986dd3ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:14.027361 26014 raft_consensus.cc:3060] T c5d45aab99914708a3d777f6468b84aa P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:14.028582 26225 raft_consensus.cc:993] T 796c3f24ad0843f18759a0c487728078 P 6c64624965ef4562abcea530986dd3ae: : Instructing follower dd4a4845e5f94eec9578accbfafcb4d6 to start an election
I20260709 12:13:14.029078 26176 raft_consensus.cc:1081] T 796c3f24ad0843f18759a0c487728078 P 6c64624965ef4562abcea530986dd3ae [term 1 LEADER]: Signalling peer dd4a4845e5f94eec9578accbfafcb4d6 to start an election
I20260709 12:13:14.030594 25942 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "796c3f24ad0843f18759a0c487728078"
dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
 from {username='slave'} at 127.0.0.1:49468
I20260709 12:13:14.031114 25942 raft_consensus.cc:493] T 796c3f24ad0843f18759a0c487728078 P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:14.031416 25942 raft_consensus.cc:3060] T 796c3f24ad0843f18759a0c487728078 P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:14.031896 25941 raft_consensus.cc:2468] T c5d45aab99914708a3d777f6468b84aa P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 2.
I20260709 12:13:14.033124 26055 leader_election.cc:304] T c5d45aab99914708a3d777f6468b84aa P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, dd4a4845e5f94eec9578accbfafcb4d6; no voters: 
I20260709 12:13:14.033991 26235 raft_consensus.cc:2804] T c5d45aab99914708a3d777f6468b84aa P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:14.034502 26235 raft_consensus.cc:697] T c5d45aab99914708a3d777f6468b84aa P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 LEADER]: Becoming Leader. State: Replica: 5f81d7b411a34e1e9ff80e6fcd7caf59, State: Running, Role: LEADER
I20260709 12:13:14.034782 26014 raft_consensus.cc:2468] T c5d45aab99914708a3d777f6468b84aa P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 2.
I20260709 12:13:14.035621 26235 consensus_queue.cc:237] T c5d45aab99914708a3d777f6468b84aa P 5f81d7b411a34e1e9ff80e6fcd7caf59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:14.039816 25942 raft_consensus.cc:515] T 796c3f24ad0843f18759a0c487728078 P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } }
I20260709 12:13:14.041785 25942 leader_election.cc:290] T 796c3f24ad0843f18759a0c487728078 P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 2 election: Requested vote from peers 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971), 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
I20260709 12:13:14.042405 26089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796c3f24ad0843f18759a0c487728078" candidate_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
I20260709 12:13:14.043205 26089 raft_consensus.cc:3060] T 796c3f24ad0843f18759a0c487728078 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:14.045130 25839 catalog_manager.cc:5697] T c5d45aab99914708a3d777f6468b84aa P 5f81d7b411a34e1e9ff80e6fcd7caf59 reported cstate change: term changed from 1 to 2, leader changed from 6c64624965ef4562abcea530986dd3ae (127.16.98.194) to 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195). New cstate: current_term: 2 leader_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:14.046734 26014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "796c3f24ad0843f18759a0c487728078" candidate_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c64624965ef4562abcea530986dd3ae"
I20260709 12:13:14.047250 26014 raft_consensus.cc:3055] T 796c3f24ad0843f18759a0c487728078 P 6c64624965ef4562abcea530986dd3ae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:14.047523 26014 raft_consensus.cc:740] T 796c3f24ad0843f18759a0c487728078 P 6c64624965ef4562abcea530986dd3ae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6c64624965ef4562abcea530986dd3ae, State: Running, Role: LEADER
I20260709 12:13:14.048465 26014 consensus_queue.cc:260] T 796c3f24ad0843f18759a0c487728078 P 6c64624965ef4562abcea530986dd3ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } }
I20260709 12:13:14.049914 26014 raft_consensus.cc:3060] T 796c3f24ad0843f18759a0c487728078 P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:14.049943 26089 raft_consensus.cc:2468] T 796c3f24ad0843f18759a0c487728078 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd4a4845e5f94eec9578accbfafcb4d6 in term 2.
I20260709 12:13:14.051187 25906 leader_election.cc:304] T 796c3f24ad0843f18759a0c487728078 P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, dd4a4845e5f94eec9578accbfafcb4d6; no voters: 
I20260709 12:13:14.051945 26215 raft_consensus.cc:2804] T 796c3f24ad0843f18759a0c487728078 P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:14.052466 26215 raft_consensus.cc:697] T 796c3f24ad0843f18759a0c487728078 P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 LEADER]: Becoming Leader. State: Replica: dd4a4845e5f94eec9578accbfafcb4d6, State: Running, Role: LEADER
I20260709 12:13:14.053459 26215 consensus_queue.cc:237] T 796c3f24ad0843f18759a0c487728078 P dd4a4845e5f94eec9578accbfafcb4d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } }
I20260709 12:13:14.056298 26014 raft_consensus.cc:2468] T 796c3f24ad0843f18759a0c487728078 P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd4a4845e5f94eec9578accbfafcb4d6 in term 2.
I20260709 12:13:14.061592 25839 catalog_manager.cc:5697] T 796c3f24ad0843f18759a0c487728078 P dd4a4845e5f94eec9578accbfafcb4d6 reported cstate change: term changed from 1 to 2, leader changed from 6c64624965ef4562abcea530986dd3ae (127.16.98.194) to dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:14.080406 26233 raft_consensus.cc:993] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59: : Instructing follower 6c64624965ef4562abcea530986dd3ae to start an election
I20260709 12:13:14.080938 26235 raft_consensus.cc:1081] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 LEADER]: Signalling peer 6c64624965ef4562abcea530986dd3ae to start an election
I20260709 12:13:14.082459 26014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f067007d0f714d73af016a85a9da6785"
dest_uuid: "6c64624965ef4562abcea530986dd3ae"
 from {username='slave'} at 127.0.0.1:39064
I20260709 12:13:14.082984 26014 raft_consensus.cc:493] T f067007d0f714d73af016a85a9da6785 P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:14.083276 26014 raft_consensus.cc:3060] T f067007d0f714d73af016a85a9da6785 P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:14.088289 26014 raft_consensus.cc:515] T f067007d0f714d73af016a85a9da6785 P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:14.090031 26014 leader_election.cc:290] T f067007d0f714d73af016a85a9da6785 P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 2 election: Requested vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971)
I20260709 12:13:14.090812 25942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f067007d0f714d73af016a85a9da6785" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
I20260709 12:13:14.091096 26089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f067007d0f714d73af016a85a9da6785" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
I20260709 12:13:14.091562 25942 raft_consensus.cc:3060] T f067007d0f714d73af016a85a9da6785 P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:14.091693 26089 raft_consensus.cc:3055] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:14.092113 26089 raft_consensus.cc:740] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f81d7b411a34e1e9ff80e6fcd7caf59, State: Running, Role: LEADER
I20260709 12:13:14.092872 26089 consensus_queue.cc:260] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:14.093869 26089 raft_consensus.cc:3060] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:14.096735 25942 raft_consensus.cc:2468] T f067007d0f714d73af016a85a9da6785 P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c64624965ef4562abcea530986dd3ae in term 2.
I20260709 12:13:14.097818 25981 leader_election.cc:304] T f067007d0f714d73af016a85a9da6785 P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c64624965ef4562abcea530986dd3ae, dd4a4845e5f94eec9578accbfafcb4d6; no voters: 
I20260709 12:13:14.098523 26176 raft_consensus.cc:2804] T f067007d0f714d73af016a85a9da6785 P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:14.098915 26089 raft_consensus.cc:2468] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c64624965ef4562abcea530986dd3ae in term 2.
I20260709 12:13:14.098989 26176 raft_consensus.cc:697] T f067007d0f714d73af016a85a9da6785 P 6c64624965ef4562abcea530986dd3ae [term 2 LEADER]: Becoming Leader. State: Replica: 6c64624965ef4562abcea530986dd3ae, State: Running, Role: LEADER
I20260709 12:13:14.100099 26176 consensus_queue.cc:237] T f067007d0f714d73af016a85a9da6785 P 6c64624965ef4562abcea530986dd3ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:14.107465 25839 catalog_manager.cc:5697] T f067007d0f714d73af016a85a9da6785 P 6c64624965ef4562abcea530986dd3ae reported cstate change: term changed from 1 to 2, leader changed from 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195) to 6c64624965ef4562abcea530986dd3ae (127.16.98.194). New cstate: current_term: 2 leader_uuid: "6c64624965ef4562abcea530986dd3ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:14.148001 26233 raft_consensus.cc:993] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59: : Instructing follower 6c64624965ef4562abcea530986dd3ae to start an election
I20260709 12:13:14.148424 26235 raft_consensus.cc:1081] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 LEADER]: Signalling peer 6c64624965ef4562abcea530986dd3ae to start an election
I20260709 12:13:14.149775 26014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c26d5a58e504dfa8a8c0edeadcd5976"
dest_uuid: "6c64624965ef4562abcea530986dd3ae"
 from {username='slave'} at 127.0.0.1:39064
I20260709 12:13:14.150341 26014 raft_consensus.cc:493] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:14.150766 26014 raft_consensus.cc:3060] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:14.156586 26014 raft_consensus.cc:515] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:14.158201 26014 leader_election.cc:290] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 2 election: Requested vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971)
I20260709 12:13:14.158859 25942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c26d5a58e504dfa8a8c0edeadcd5976" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
I20260709 12:13:14.159227 26089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c26d5a58e504dfa8a8c0edeadcd5976" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
I20260709 12:13:14.159559 25942 raft_consensus.cc:3060] T 4c26d5a58e504dfa8a8c0edeadcd5976 P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:14.159862 26089 raft_consensus.cc:3055] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:14.160171 26089 raft_consensus.cc:740] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f81d7b411a34e1e9ff80e6fcd7caf59, State: Running, Role: LEADER
I20260709 12:13:14.160936 26089 consensus_queue.cc:260] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:14.162114 26089 raft_consensus.cc:3060] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:14.164968 25942 raft_consensus.cc:2468] T 4c26d5a58e504dfa8a8c0edeadcd5976 P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c64624965ef4562abcea530986dd3ae in term 2.
I20260709 12:13:14.166005 25981 leader_election.cc:304] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c64624965ef4562abcea530986dd3ae, dd4a4845e5f94eec9578accbfafcb4d6; no voters: 
I20260709 12:13:14.166855 26176 raft_consensus.cc:2804] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:14.167243 26176 raft_consensus.cc:697] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 6c64624965ef4562abcea530986dd3ae [term 2 LEADER]: Becoming Leader. State: Replica: 6c64624965ef4562abcea530986dd3ae, State: Running, Role: LEADER
I20260709 12:13:14.167547 26089 raft_consensus.cc:2468] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c64624965ef4562abcea530986dd3ae in term 2.
I20260709 12:13:14.168251 26176 consensus_queue.cc:237] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 6c64624965ef4562abcea530986dd3ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:14.175717 25839 catalog_manager.cc:5697] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 6c64624965ef4562abcea530986dd3ae reported cstate change: term changed from 1 to 2, leader changed from 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195) to 6c64624965ef4562abcea530986dd3ae (127.16.98.194). New cstate: current_term: 2 leader_uuid: "6c64624965ef4562abcea530986dd3ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:14.285815 26089 raft_consensus.cc:1275] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 3 FOLLOWER]: Refusing update from remote peer dd4a4845e5f94eec9578accbfafcb4d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:14.286984 26215 consensus_queue.cc:1048] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:14.294541 26014 raft_consensus.cc:1275] T b5e1998d449245b483308f4b257c0452 P 6c64624965ef4562abcea530986dd3ae [term 3 FOLLOWER]: Refusing update from remote peer dd4a4845e5f94eec9578accbfafcb4d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:13:14.296092 26215 consensus_queue.cc:1048] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:14.315562 26014 raft_consensus.cc:1275] T 8474f54272164d4f84cb19d5844442af P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Refusing update from remote peer dd4a4845e5f94eec9578accbfafcb4d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:14.316798 26215 consensus_queue.cc:1048] T 8474f54272164d4f84cb19d5844442af P dd4a4845e5f94eec9578accbfafcb4d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:14.329205 26089 raft_consensus.cc:1275] T 8474f54272164d4f84cb19d5844442af P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Refusing update from remote peer dd4a4845e5f94eec9578accbfafcb4d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:14.331136 26215 consensus_queue.cc:1048] T 8474f54272164d4f84cb19d5844442af P dd4a4845e5f94eec9578accbfafcb4d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:14.493430 26089 raft_consensus.cc:1275] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Refusing update from remote peer 6c64624965ef4562abcea530986dd3ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:14.494786 26176 consensus_queue.cc:1048] T f067007d0f714d73af016a85a9da6785 P 6c64624965ef4562abcea530986dd3ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:14.496755 26014 raft_consensus.cc:1275] T 796c3f24ad0843f18759a0c487728078 P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Refusing update from remote peer dd4a4845e5f94eec9578accbfafcb4d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:14.498322 26245 consensus_queue.cc:1048] T 796c3f24ad0843f18759a0c487728078 P dd4a4845e5f94eec9578accbfafcb4d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:14.506506 25942 raft_consensus.cc:1275] T f067007d0f714d73af016a85a9da6785 P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Refusing update from remote peer 6c64624965ef4562abcea530986dd3ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:14.506801 26091 raft_consensus.cc:1275] T 796c3f24ad0843f18759a0c487728078 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Refusing update from remote peer dd4a4845e5f94eec9578accbfafcb4d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:14.508083 26176 consensus_queue.cc:1048] T f067007d0f714d73af016a85a9da6785 P 6c64624965ef4562abcea530986dd3ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:14.508764 26245 consensus_queue.cc:1048] T 796c3f24ad0843f18759a0c487728078 P dd4a4845e5f94eec9578accbfafcb4d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:14.526729 26014 raft_consensus.cc:1275] T c5d45aab99914708a3d777f6468b84aa P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Refusing update from remote peer 5f81d7b411a34e1e9ff80e6fcd7caf59: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:14.530536 26235 consensus_queue.cc:1048] T c5d45aab99914708a3d777f6468b84aa P 5f81d7b411a34e1e9ff80e6fcd7caf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:14.541781 25942 raft_consensus.cc:1275] T c5d45aab99914708a3d777f6468b84aa P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Refusing update from remote peer 5f81d7b411a34e1e9ff80e6fcd7caf59: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:14.544186 26235 consensus_queue.cc:1048] T c5d45aab99914708a3d777f6468b84aa P 5f81d7b411a34e1e9ff80e6fcd7caf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:14.589213 25942 raft_consensus.cc:1275] T 4c26d5a58e504dfa8a8c0edeadcd5976 P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Refusing update from remote peer 6c64624965ef4562abcea530986dd3ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:14.590435 26249 consensus_queue.cc:1048] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 6c64624965ef4562abcea530986dd3ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:14.603406 26089 raft_consensus.cc:1275] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Refusing update from remote peer 6c64624965ef4562abcea530986dd3ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:14.605459 26225 consensus_queue.cc:1048] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 6c64624965ef4562abcea530986dd3ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:16.703444 25838 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58024:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:13:16.706161 25838 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:13:16.752799 25928 tablet_service.cc:1511] Processing CreateTablet for tablet 9b58bf7d2f584791ab4cd02832978173 (DEFAULT_TABLE table=soft_deleted_table [id=6e461bac081a4fe2a308b0759f9a1a1d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:13:16.753662 26004 tablet_service.cc:1511] Processing CreateTablet for tablet 9b58bf7d2f584791ab4cd02832978173 (DEFAULT_TABLE table=soft_deleted_table [id=6e461bac081a4fe2a308b0759f9a1a1d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:13:16.754473 25928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b58bf7d2f584791ab4cd02832978173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:16.755204 26004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b58bf7d2f584791ab4cd02832978173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:16.757257 25932 tablet_service.cc:1511] Processing CreateTablet for tablet e3ae8cd984b945fd9d10fc3eda704a3f (DEFAULT_TABLE table=soft_deleted_table [id=6e461bac081a4fe2a308b0759f9a1a1d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:13:16.756711 26080 tablet_service.cc:1511] Processing CreateTablet for tablet 9b58bf7d2f584791ab4cd02832978173 (DEFAULT_TABLE table=soft_deleted_table [id=6e461bac081a4fe2a308b0759f9a1a1d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:13:16.758603 25932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3ae8cd984b945fd9d10fc3eda704a3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:16.759487 26080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b58bf7d2f584791ab4cd02832978173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:16.761200 26005 tablet_service.cc:1511] Processing CreateTablet for tablet e3ae8cd984b945fd9d10fc3eda704a3f (DEFAULT_TABLE table=soft_deleted_table [id=6e461bac081a4fe2a308b0759f9a1a1d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:13:16.762559 26005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3ae8cd984b945fd9d10fc3eda704a3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:16.763980 26081 tablet_service.cc:1511] Processing CreateTablet for tablet e3ae8cd984b945fd9d10fc3eda704a3f (DEFAULT_TABLE table=soft_deleted_table [id=6e461bac081a4fe2a308b0759f9a1a1d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:13:16.765354 26081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3ae8cd984b945fd9d10fc3eda704a3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:16.775965 25924 tablet_service.cc:1511] Processing CreateTablet for tablet 02fdc5e5e4e24f67b98f13312c916596 (DEFAULT_TABLE table=soft_deleted_table [id=6e461bac081a4fe2a308b0759f9a1a1d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:13:16.777355 25924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02fdc5e5e4e24f67b98f13312c916596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:16.789094 25999 tablet_service.cc:1511] Processing CreateTablet for tablet 02fdc5e5e4e24f67b98f13312c916596 (DEFAULT_TABLE table=soft_deleted_table [id=6e461bac081a4fe2a308b0759f9a1a1d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:13:16.790520 25999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02fdc5e5e4e24f67b98f13312c916596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:16.793880 26074 tablet_service.cc:1511] Processing CreateTablet for tablet 02fdc5e5e4e24f67b98f13312c916596 (DEFAULT_TABLE table=soft_deleted_table [id=6e461bac081a4fe2a308b0759f9a1a1d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:13:16.796748 26074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02fdc5e5e4e24f67b98f13312c916596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:16.799747 26001 tablet_service.cc:1511] Processing CreateTablet for tablet d02a838011d445a593c78c10943c6038 (DEFAULT_TABLE table=soft_deleted_table [id=6e461bac081a4fe2a308b0759f9a1a1d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:13:16.801019 26001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d02a838011d445a593c78c10943c6038. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:16.804652 25928 tablet_service.cc:1511] Processing CreateTablet for tablet d02a838011d445a593c78c10943c6038 (DEFAULT_TABLE table=soft_deleted_table [id=6e461bac081a4fe2a308b0759f9a1a1d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:13:16.792631 26273 tablet_bootstrap.cc:492] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Bootstrap starting.
I20260709 12:13:16.805958 25928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d02a838011d445a593c78c10943c6038. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:16.809975 26078 tablet_service.cc:1511] Processing CreateTablet for tablet d02a838011d445a593c78c10943c6038 (DEFAULT_TABLE table=soft_deleted_table [id=6e461bac081a4fe2a308b0759f9a1a1d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:13:16.811374 26078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d02a838011d445a593c78c10943c6038. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:16.814741 26273 tablet_bootstrap.cc:654] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:16.815307 26272 tablet_bootstrap.cc:492] T 9b58bf7d2f584791ab4cd02832978173 P dd4a4845e5f94eec9578accbfafcb4d6: Bootstrap starting.
I20260709 12:13:16.820454 25931 tablet_service.cc:1511] Processing CreateTablet for tablet a5c01777e5be4afcab9c09c4b00ad324 (DEFAULT_TABLE table=soft_deleted_table [id=6e461bac081a4fe2a308b0759f9a1a1d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:13:16.821810 25931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5c01777e5be4afcab9c09c4b00ad324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:16.821702 26005 tablet_service.cc:1511] Processing CreateTablet for tablet a5c01777e5be4afcab9c09c4b00ad324 (DEFAULT_TABLE table=soft_deleted_table [id=6e461bac081a4fe2a308b0759f9a1a1d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:13:16.822999 26005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5c01777e5be4afcab9c09c4b00ad324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:16.823076 26077 tablet_service.cc:1511] Processing CreateTablet for tablet a5c01777e5be4afcab9c09c4b00ad324 (DEFAULT_TABLE table=soft_deleted_table [id=6e461bac081a4fe2a308b0759f9a1a1d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:13:16.824443 26077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5c01777e5be4afcab9c09c4b00ad324. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:16.828715 25930 tablet_service.cc:1511] Processing CreateTablet for tablet 94628c0fec194ca3a8dde23bb75433fc (DEFAULT_TABLE table=soft_deleted_table [id=6e461bac081a4fe2a308b0759f9a1a1d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:13:16.830090 25930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94628c0fec194ca3a8dde23bb75433fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:16.830361 26000 tablet_service.cc:1511] Processing CreateTablet for tablet 94628c0fec194ca3a8dde23bb75433fc (DEFAULT_TABLE table=soft_deleted_table [id=6e461bac081a4fe2a308b0759f9a1a1d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:13:16.831645 26000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94628c0fec194ca3a8dde23bb75433fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:16.833767 26080 tablet_service.cc:1511] Processing CreateTablet for tablet 94628c0fec194ca3a8dde23bb75433fc (DEFAULT_TABLE table=soft_deleted_table [id=6e461bac081a4fe2a308b0759f9a1a1d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:13:16.834352 25926 tablet_service.cc:1511] Processing CreateTablet for tablet 5c16e5dbed0b4c98988c91e5475f1946 (DEFAULT_TABLE table=soft_deleted_table [id=6e461bac081a4fe2a308b0759f9a1a1d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:13:16.835129 26080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94628c0fec194ca3a8dde23bb75433fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:16.835830 25926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c16e5dbed0b4c98988c91e5475f1946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:16.839943 26006 tablet_service.cc:1511] Processing CreateTablet for tablet 5c16e5dbed0b4c98988c91e5475f1946 (DEFAULT_TABLE table=soft_deleted_table [id=6e461bac081a4fe2a308b0759f9a1a1d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:13:16.841291 26006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c16e5dbed0b4c98988c91e5475f1946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:16.854740 25927 tablet_service.cc:1511] Processing CreateTablet for tablet 6de0ab2b47674ac2bf7bf690c4fe4b37 (DEFAULT_TABLE table=soft_deleted_table [id=6e461bac081a4fe2a308b0759f9a1a1d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:13:16.856240 25927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6de0ab2b47674ac2bf7bf690c4fe4b37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:16.856101 26081 tablet_service.cc:1511] Processing CreateTablet for tablet 5c16e5dbed0b4c98988c91e5475f1946 (DEFAULT_TABLE table=soft_deleted_table [id=6e461bac081a4fe2a308b0759f9a1a1d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:13:16.856460 26007 tablet_service.cc:1511] Processing CreateTablet for tablet 6de0ab2b47674ac2bf7bf690c4fe4b37 (DEFAULT_TABLE table=soft_deleted_table [id=6e461bac081a4fe2a308b0759f9a1a1d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:13:16.857811 26007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6de0ab2b47674ac2bf7bf690c4fe4b37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:16.872743 26075 tablet_service.cc:1511] Processing CreateTablet for tablet 6de0ab2b47674ac2bf7bf690c4fe4b37 (DEFAULT_TABLE table=soft_deleted_table [id=6e461bac081a4fe2a308b0759f9a1a1d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:13:16.874245 25929 tablet_service.cc:1511] Processing CreateTablet for tablet baab9174e4d542069954eb94db182f0c (DEFAULT_TABLE table=soft_deleted_table [id=6e461bac081a4fe2a308b0759f9a1a1d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:13:16.875641 25929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baab9174e4d542069954eb94db182f0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:16.878041 26079 tablet_service.cc:1511] Processing CreateTablet for tablet baab9174e4d542069954eb94db182f0c (DEFAULT_TABLE table=soft_deleted_table [id=6e461bac081a4fe2a308b0759f9a1a1d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:13:16.880012 26272 tablet_bootstrap.cc:654] T 9b58bf7d2f584791ab4cd02832978173 P dd4a4845e5f94eec9578accbfafcb4d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:16.883064 26003 tablet_service.cc:1511] Processing CreateTablet for tablet baab9174e4d542069954eb94db182f0c (DEFAULT_TABLE table=soft_deleted_table [id=6e461bac081a4fe2a308b0759f9a1a1d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:13:16.884855 26003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baab9174e4d542069954eb94db182f0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:16.915764 26274 tablet_bootstrap.cc:492] T 9b58bf7d2f584791ab4cd02832978173 P 6c64624965ef4562abcea530986dd3ae: Bootstrap starting.
I20260709 12:13:16.920696 26075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6de0ab2b47674ac2bf7bf690c4fe4b37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:16.924561 26079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baab9174e4d542069954eb94db182f0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:16.928336 26081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c16e5dbed0b4c98988c91e5475f1946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:13:16.936911 26272 tablet_bootstrap.cc:492] T 9b58bf7d2f584791ab4cd02832978173 P dd4a4845e5f94eec9578accbfafcb4d6: No bootstrap required, opened a new log
I20260709 12:13:16.937547 26272 ts_tablet_manager.cc:1403] T 9b58bf7d2f584791ab4cd02832978173 P dd4a4845e5f94eec9578accbfafcb4d6: Time spent bootstrapping tablet: real 0.122s	user 0.006s	sys 0.007s
I20260709 12:13:16.943894 26272 raft_consensus.cc:359] T 9b58bf7d2f584791ab4cd02832978173 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:16.944734 26272 raft_consensus.cc:385] T 9b58bf7d2f584791ab4cd02832978173 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:16.945114 26272 raft_consensus.cc:740] T 9b58bf7d2f584791ab4cd02832978173 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd4a4845e5f94eec9578accbfafcb4d6, State: Initialized, Role: FOLLOWER
I20260709 12:13:16.945904 26272 consensus_queue.cc:260] T 9b58bf7d2f584791ab4cd02832978173 P dd4a4845e5f94eec9578accbfafcb4d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:16.948549 26272 ts_tablet_manager.cc:1434] T 9b58bf7d2f584791ab4cd02832978173 P dd4a4845e5f94eec9578accbfafcb4d6: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:13:16.949563 26272 tablet_bootstrap.cc:492] T e3ae8cd984b945fd9d10fc3eda704a3f P dd4a4845e5f94eec9578accbfafcb4d6: Bootstrap starting.
I20260709 12:13:16.949927 26274 tablet_bootstrap.cc:654] T 9b58bf7d2f584791ab4cd02832978173 P 6c64624965ef4562abcea530986dd3ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:16.954682 26273 tablet_bootstrap.cc:492] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59: No bootstrap required, opened a new log
I20260709 12:13:16.955317 26273 ts_tablet_manager.cc:1403] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Time spent bootstrapping tablet: real 0.163s	user 0.015s	sys 0.007s
I20260709 12:13:16.964684 26273 raft_consensus.cc:359] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:16.966564 26273 raft_consensus.cc:385] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:16.967007 26273 raft_consensus.cc:740] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f81d7b411a34e1e9ff80e6fcd7caf59, State: Initialized, Role: FOLLOWER
I20260709 12:13:16.972410 26272 tablet_bootstrap.cc:654] T e3ae8cd984b945fd9d10fc3eda704a3f P dd4a4845e5f94eec9578accbfafcb4d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:16.967978 26273 consensus_queue.cc:260] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:16.977661 26273 ts_tablet_manager.cc:1434] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:13:16.978919 26273 tablet_bootstrap.cc:492] T e3ae8cd984b945fd9d10fc3eda704a3f P 5f81d7b411a34e1e9ff80e6fcd7caf59: Bootstrap starting.
I20260709 12:13:16.982764 26274 tablet_bootstrap.cc:492] T 9b58bf7d2f584791ab4cd02832978173 P 6c64624965ef4562abcea530986dd3ae: No bootstrap required, opened a new log
I20260709 12:13:16.983309 26274 ts_tablet_manager.cc:1403] T 9b58bf7d2f584791ab4cd02832978173 P 6c64624965ef4562abcea530986dd3ae: Time spent bootstrapping tablet: real 0.068s	user 0.012s	sys 0.019s
I20260709 12:13:16.982764 26272 tablet_bootstrap.cc:492] T e3ae8cd984b945fd9d10fc3eda704a3f P dd4a4845e5f94eec9578accbfafcb4d6: No bootstrap required, opened a new log
I20260709 12:13:16.984721 26272 ts_tablet_manager.cc:1403] T e3ae8cd984b945fd9d10fc3eda704a3f P dd4a4845e5f94eec9578accbfafcb4d6: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.000s
I20260709 12:13:16.986111 26273 tablet_bootstrap.cc:654] T e3ae8cd984b945fd9d10fc3eda704a3f P 5f81d7b411a34e1e9ff80e6fcd7caf59: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:16.986308 26274 raft_consensus.cc:359] T 9b58bf7d2f584791ab4cd02832978173 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:16.987201 26274 raft_consensus.cc:385] T 9b58bf7d2f584791ab4cd02832978173 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:16.987548 26274 raft_consensus.cc:740] T 9b58bf7d2f584791ab4cd02832978173 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c64624965ef4562abcea530986dd3ae, State: Initialized, Role: FOLLOWER
I20260709 12:13:16.987789 26272 raft_consensus.cc:359] T e3ae8cd984b945fd9d10fc3eda704a3f P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:16.988562 26272 raft_consensus.cc:385] T e3ae8cd984b945fd9d10fc3eda704a3f P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:16.988345 26274 consensus_queue.cc:260] T 9b58bf7d2f584791ab4cd02832978173 P 6c64624965ef4562abcea530986dd3ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:16.988916 26272 raft_consensus.cc:740] T e3ae8cd984b945fd9d10fc3eda704a3f P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd4a4845e5f94eec9578accbfafcb4d6, State: Initialized, Role: FOLLOWER
I20260709 12:13:16.989732 26272 consensus_queue.cc:260] T e3ae8cd984b945fd9d10fc3eda704a3f P dd4a4845e5f94eec9578accbfafcb4d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:16.991094 26274 ts_tablet_manager.cc:1434] T 9b58bf7d2f584791ab4cd02832978173 P 6c64624965ef4562abcea530986dd3ae: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:13:16.992655 26274 tablet_bootstrap.cc:492] T e3ae8cd984b945fd9d10fc3eda704a3f P 6c64624965ef4562abcea530986dd3ae: Bootstrap starting.
I20260709 12:13:17.001842 26274 tablet_bootstrap.cc:654] T e3ae8cd984b945fd9d10fc3eda704a3f P 6c64624965ef4562abcea530986dd3ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:17.004217 26272 ts_tablet_manager.cc:1434] T e3ae8cd984b945fd9d10fc3eda704a3f P dd4a4845e5f94eec9578accbfafcb4d6: Time spent starting tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 12:13:17.007941 26272 tablet_bootstrap.cc:492] T 02fdc5e5e4e24f67b98f13312c916596 P dd4a4845e5f94eec9578accbfafcb4d6: Bootstrap starting.
I20260709 12:13:17.014189 26272 tablet_bootstrap.cc:654] T 02fdc5e5e4e24f67b98f13312c916596 P dd4a4845e5f94eec9578accbfafcb4d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:17.027001 26272 tablet_bootstrap.cc:492] T 02fdc5e5e4e24f67b98f13312c916596 P dd4a4845e5f94eec9578accbfafcb4d6: No bootstrap required, opened a new log
I20260709 12:13:17.027575 26272 ts_tablet_manager.cc:1403] T 02fdc5e5e4e24f67b98f13312c916596 P dd4a4845e5f94eec9578accbfafcb4d6: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.010s
I20260709 12:13:17.028415 26274 tablet_bootstrap.cc:492] T e3ae8cd984b945fd9d10fc3eda704a3f P 6c64624965ef4562abcea530986dd3ae: No bootstrap required, opened a new log
I20260709 12:13:17.029001 26274 ts_tablet_manager.cc:1403] T e3ae8cd984b945fd9d10fc3eda704a3f P 6c64624965ef4562abcea530986dd3ae: Time spent bootstrapping tablet: real 0.037s	user 0.020s	sys 0.010s
I20260709 12:13:17.029865 26273 tablet_bootstrap.cc:492] T e3ae8cd984b945fd9d10fc3eda704a3f P 5f81d7b411a34e1e9ff80e6fcd7caf59: No bootstrap required, opened a new log
I20260709 12:13:17.030439 26273 ts_tablet_manager.cc:1403] T e3ae8cd984b945fd9d10fc3eda704a3f P 5f81d7b411a34e1e9ff80e6fcd7caf59: Time spent bootstrapping tablet: real 0.052s	user 0.019s	sys 0.014s
I20260709 12:13:17.030604 26272 raft_consensus.cc:359] T 02fdc5e5e4e24f67b98f13312c916596 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.031500 26272 raft_consensus.cc:385] T 02fdc5e5e4e24f67b98f13312c916596 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:17.031845 26272 raft_consensus.cc:740] T 02fdc5e5e4e24f67b98f13312c916596 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd4a4845e5f94eec9578accbfafcb4d6, State: Initialized, Role: FOLLOWER
I20260709 12:13:17.032121 26274 raft_consensus.cc:359] T e3ae8cd984b945fd9d10fc3eda704a3f P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.032871 26274 raft_consensus.cc:385] T e3ae8cd984b945fd9d10fc3eda704a3f P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:17.032666 26272 consensus_queue.cc:260] T 02fdc5e5e4e24f67b98f13312c916596 P dd4a4845e5f94eec9578accbfafcb4d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.033176 26274 raft_consensus.cc:740] T e3ae8cd984b945fd9d10fc3eda704a3f P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c64624965ef4562abcea530986dd3ae, State: Initialized, Role: FOLLOWER
I20260709 12:13:17.034037 26274 consensus_queue.cc:260] T e3ae8cd984b945fd9d10fc3eda704a3f P 6c64624965ef4562abcea530986dd3ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.035076 26272 ts_tablet_manager.cc:1434] T 02fdc5e5e4e24f67b98f13312c916596 P dd4a4845e5f94eec9578accbfafcb4d6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:13:17.036108 26272 tablet_bootstrap.cc:492] T baab9174e4d542069954eb94db182f0c P dd4a4845e5f94eec9578accbfafcb4d6: Bootstrap starting.
I20260709 12:13:17.036463 26274 ts_tablet_manager.cc:1434] T e3ae8cd984b945fd9d10fc3eda704a3f P 6c64624965ef4562abcea530986dd3ae: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:13:17.036250 26273 raft_consensus.cc:359] T e3ae8cd984b945fd9d10fc3eda704a3f P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.037106 26273 raft_consensus.cc:385] T e3ae8cd984b945fd9d10fc3eda704a3f P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:17.037451 26273 raft_consensus.cc:740] T e3ae8cd984b945fd9d10fc3eda704a3f P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f81d7b411a34e1e9ff80e6fcd7caf59, State: Initialized, Role: FOLLOWER
I20260709 12:13:17.037513 26274 tablet_bootstrap.cc:492] T a5c01777e5be4afcab9c09c4b00ad324 P 6c64624965ef4562abcea530986dd3ae: Bootstrap starting.
I20260709 12:13:17.038288 26273 consensus_queue.cc:260] T e3ae8cd984b945fd9d10fc3eda704a3f P 5f81d7b411a34e1e9ff80e6fcd7caf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.040707 26273 ts_tablet_manager.cc:1434] T e3ae8cd984b945fd9d10fc3eda704a3f P 5f81d7b411a34e1e9ff80e6fcd7caf59: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:13:17.041707 26273 tablet_bootstrap.cc:492] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59: Bootstrap starting.
I20260709 12:13:17.043449 26272 tablet_bootstrap.cc:654] T baab9174e4d542069954eb94db182f0c P dd4a4845e5f94eec9578accbfafcb4d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:17.044736 26274 tablet_bootstrap.cc:654] T a5c01777e5be4afcab9c09c4b00ad324 P 6c64624965ef4562abcea530986dd3ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:17.048012 26273 tablet_bootstrap.cc:654] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:17.055907 26272 tablet_bootstrap.cc:492] T baab9174e4d542069954eb94db182f0c P dd4a4845e5f94eec9578accbfafcb4d6: No bootstrap required, opened a new log
I20260709 12:13:17.062963 26272 ts_tablet_manager.cc:1403] T baab9174e4d542069954eb94db182f0c P dd4a4845e5f94eec9578accbfafcb4d6: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.006s
I20260709 12:13:17.067023 26272 raft_consensus.cc:359] T baab9174e4d542069954eb94db182f0c P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.069271 26272 raft_consensus.cc:385] T baab9174e4d542069954eb94db182f0c P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:17.069629 26272 raft_consensus.cc:740] T baab9174e4d542069954eb94db182f0c P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd4a4845e5f94eec9578accbfafcb4d6, State: Initialized, Role: FOLLOWER
I20260709 12:13:17.070781 26274 tablet_bootstrap.cc:492] T a5c01777e5be4afcab9c09c4b00ad324 P 6c64624965ef4562abcea530986dd3ae: No bootstrap required, opened a new log
I20260709 12:13:17.071533 26274 ts_tablet_manager.cc:1403] T a5c01777e5be4afcab9c09c4b00ad324 P 6c64624965ef4562abcea530986dd3ae: Time spent bootstrapping tablet: real 0.034s	user 0.021s	sys 0.012s
I20260709 12:13:17.074755 26274 raft_consensus.cc:359] T a5c01777e5be4afcab9c09c4b00ad324 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.075646 26274 raft_consensus.cc:385] T a5c01777e5be4afcab9c09c4b00ad324 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:17.076016 26274 raft_consensus.cc:740] T a5c01777e5be4afcab9c09c4b00ad324 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c64624965ef4562abcea530986dd3ae, State: Initialized, Role: FOLLOWER
I20260709 12:13:17.076920 26274 consensus_queue.cc:260] T a5c01777e5be4afcab9c09c4b00ad324 P 6c64624965ef4562abcea530986dd3ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.080160 26274 ts_tablet_manager.cc:1434] T a5c01777e5be4afcab9c09c4b00ad324 P 6c64624965ef4562abcea530986dd3ae: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:13:17.081184 26274 tablet_bootstrap.cc:492] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 6c64624965ef4562abcea530986dd3ae: Bootstrap starting.
I20260709 12:13:17.070853 26272 consensus_queue.cc:260] T baab9174e4d542069954eb94db182f0c P dd4a4845e5f94eec9578accbfafcb4d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.084266 26273 tablet_bootstrap.cc:492] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59: No bootstrap required, opened a new log
I20260709 12:13:17.085095 26273 ts_tablet_manager.cc:1403] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59: Time spent bootstrapping tablet: real 0.044s	user 0.021s	sys 0.017s
I20260709 12:13:17.087715 26274 tablet_bootstrap.cc:654] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 6c64624965ef4562abcea530986dd3ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:17.088987 26273 raft_consensus.cc:359] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.085768 26272 ts_tablet_manager.cc:1434] T baab9174e4d542069954eb94db182f0c P dd4a4845e5f94eec9578accbfafcb4d6: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:13:17.089727 26273 raft_consensus.cc:385] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:17.090111 26273 raft_consensus.cc:740] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f81d7b411a34e1e9ff80e6fcd7caf59, State: Initialized, Role: FOLLOWER
I20260709 12:13:17.090828 26272 tablet_bootstrap.cc:492] T d02a838011d445a593c78c10943c6038 P dd4a4845e5f94eec9578accbfafcb4d6: Bootstrap starting.
I20260709 12:13:17.090998 26273 consensus_queue.cc:260] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.100262 26272 tablet_bootstrap.cc:654] T d02a838011d445a593c78c10943c6038 P dd4a4845e5f94eec9578accbfafcb4d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:17.102834 26273 ts_tablet_manager.cc:1434] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:13:17.103991 26273 tablet_bootstrap.cc:492] T a5c01777e5be4afcab9c09c4b00ad324 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Bootstrap starting.
I20260709 12:13:17.104413 26274 tablet_bootstrap.cc:492] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 6c64624965ef4562abcea530986dd3ae: No bootstrap required, opened a new log
I20260709 12:13:17.105149 26274 ts_tablet_manager.cc:1403] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 6c64624965ef4562abcea530986dd3ae: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.004s
I20260709 12:13:17.109033 26274 raft_consensus.cc:359] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.109835 26274 raft_consensus.cc:385] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:17.110172 26274 raft_consensus.cc:740] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c64624965ef4562abcea530986dd3ae, State: Initialized, Role: FOLLOWER
I20260709 12:13:17.110332 26273 tablet_bootstrap.cc:654] T a5c01777e5be4afcab9c09c4b00ad324 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:17.111127 26274 consensus_queue.cc:260] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 6c64624965ef4562abcea530986dd3ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.111974 26272 tablet_bootstrap.cc:492] T d02a838011d445a593c78c10943c6038 P dd4a4845e5f94eec9578accbfafcb4d6: No bootstrap required, opened a new log
I20260709 12:13:17.112826 26272 ts_tablet_manager.cc:1403] T d02a838011d445a593c78c10943c6038 P dd4a4845e5f94eec9578accbfafcb4d6: Time spent bootstrapping tablet: real 0.022s	user 0.020s	sys 0.000s
I20260709 12:13:17.113729 26274 ts_tablet_manager.cc:1434] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 6c64624965ef4562abcea530986dd3ae: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:13:17.114761 26274 tablet_bootstrap.cc:492] T 02fdc5e5e4e24f67b98f13312c916596 P 6c64624965ef4562abcea530986dd3ae: Bootstrap starting.
I20260709 12:13:17.115867 26272 raft_consensus.cc:359] T d02a838011d445a593c78c10943c6038 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.116768 26272 raft_consensus.cc:385] T d02a838011d445a593c78c10943c6038 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:17.117117 26272 raft_consensus.cc:740] T d02a838011d445a593c78c10943c6038 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd4a4845e5f94eec9578accbfafcb4d6, State: Initialized, Role: FOLLOWER
I20260709 12:13:17.118003 26272 consensus_queue.cc:260] T d02a838011d445a593c78c10943c6038 P dd4a4845e5f94eec9578accbfafcb4d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.120554 26272 ts_tablet_manager.cc:1434] T d02a838011d445a593c78c10943c6038 P dd4a4845e5f94eec9578accbfafcb4d6: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:13:17.121991 26272 tablet_bootstrap.cc:492] T 94628c0fec194ca3a8dde23bb75433fc P dd4a4845e5f94eec9578accbfafcb4d6: Bootstrap starting.
I20260709 12:13:17.122112 26274 tablet_bootstrap.cc:654] T 02fdc5e5e4e24f67b98f13312c916596 P 6c64624965ef4562abcea530986dd3ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:17.128968 26259 raft_consensus.cc:493] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.129679 26259 raft_consensus.cc:515] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.132306 26272 tablet_bootstrap.cc:654] T 94628c0fec194ca3a8dde23bb75433fc P dd4a4845e5f94eec9578accbfafcb4d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:17.136284 25941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b58bf7d2f584791ab4cd02832978173" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" is_pre_election: true
I20260709 12:13:17.136982 25941 raft_consensus.cc:2468] T 9b58bf7d2f584791ab4cd02832978173 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 0.
I20260709 12:13:17.134873 26273 tablet_bootstrap.cc:492] T a5c01777e5be4afcab9c09c4b00ad324 P 5f81d7b411a34e1e9ff80e6fcd7caf59: No bootstrap required, opened a new log
I20260709 12:13:17.138439 26055 leader_election.cc:304] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, dd4a4845e5f94eec9578accbfafcb4d6; no voters: 
I20260709 12:13:17.139164 26273 ts_tablet_manager.cc:1403] T a5c01777e5be4afcab9c09c4b00ad324 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.017s
I20260709 12:13:17.141753 26017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b58bf7d2f584791ab4cd02832978173" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c64624965ef4562abcea530986dd3ae" is_pre_election: true
I20260709 12:13:17.142351 26017 raft_consensus.cc:2468] T 9b58bf7d2f584791ab4cd02832978173 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 0.
I20260709 12:13:17.143131 26259 leader_election.cc:290] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
I20260709 12:13:17.144038 26259 raft_consensus.cc:2804] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:17.145031 26259 raft_consensus.cc:493] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:17.145911 26259 raft_consensus.cc:3060] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:17.148149 26274 tablet_bootstrap.cc:492] T 02fdc5e5e4e24f67b98f13312c916596 P 6c64624965ef4562abcea530986dd3ae: No bootstrap required, opened a new log
I20260709 12:13:17.148763 26274 ts_tablet_manager.cc:1403] T 02fdc5e5e4e24f67b98f13312c916596 P 6c64624965ef4562abcea530986dd3ae: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.016s
I20260709 12:13:17.143494 26273 raft_consensus.cc:359] T a5c01777e5be4afcab9c09c4b00ad324 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.150558 26272 tablet_bootstrap.cc:492] T 94628c0fec194ca3a8dde23bb75433fc P dd4a4845e5f94eec9578accbfafcb4d6: No bootstrap required, opened a new log
I20260709 12:13:17.150933 26273 raft_consensus.cc:385] T a5c01777e5be4afcab9c09c4b00ad324 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:17.151161 26272 ts_tablet_manager.cc:1403] T 94628c0fec194ca3a8dde23bb75433fc P dd4a4845e5f94eec9578accbfafcb4d6: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.007s
I20260709 12:13:17.151384 26273 raft_consensus.cc:740] T a5c01777e5be4afcab9c09c4b00ad324 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f81d7b411a34e1e9ff80e6fcd7caf59, State: Initialized, Role: FOLLOWER
I20260709 12:13:17.152041 26274 raft_consensus.cc:359] T 02fdc5e5e4e24f67b98f13312c916596 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.152352 26273 consensus_queue.cc:260] T a5c01777e5be4afcab9c09c4b00ad324 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.152856 26274 raft_consensus.cc:385] T 02fdc5e5e4e24f67b98f13312c916596 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:17.153301 26274 raft_consensus.cc:740] T 02fdc5e5e4e24f67b98f13312c916596 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c64624965ef4562abcea530986dd3ae, State: Initialized, Role: FOLLOWER
I20260709 12:13:17.154083 26274 consensus_queue.cc:260] T 02fdc5e5e4e24f67b98f13312c916596 P 6c64624965ef4562abcea530986dd3ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.154218 26272 raft_consensus.cc:359] T 94628c0fec194ca3a8dde23bb75433fc P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.155138 26272 raft_consensus.cc:385] T 94628c0fec194ca3a8dde23bb75433fc P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:17.155431 26272 raft_consensus.cc:740] T 94628c0fec194ca3a8dde23bb75433fc P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd4a4845e5f94eec9578accbfafcb4d6, State: Initialized, Role: FOLLOWER
I20260709 12:13:17.156112 26272 consensus_queue.cc:260] T 94628c0fec194ca3a8dde23bb75433fc P dd4a4845e5f94eec9578accbfafcb4d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.157022 26274 ts_tablet_manager.cc:1434] T 02fdc5e5e4e24f67b98f13312c916596 P 6c64624965ef4562abcea530986dd3ae: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:13:17.154980 26259 raft_consensus.cc:515] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.158038 26274 tablet_bootstrap.cc:492] T 94628c0fec194ca3a8dde23bb75433fc P 6c64624965ef4562abcea530986dd3ae: Bootstrap starting.
I20260709 12:13:17.160055 25941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b58bf7d2f584791ab4cd02832978173" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
I20260709 12:13:17.162616 26272 ts_tablet_manager.cc:1434] T 94628c0fec194ca3a8dde23bb75433fc P dd4a4845e5f94eec9578accbfafcb4d6: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:13:17.163870 26272 tablet_bootstrap.cc:492] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P dd4a4845e5f94eec9578accbfafcb4d6: Bootstrap starting.
I20260709 12:13:17.164870 26273 ts_tablet_manager.cc:1434] T a5c01777e5be4afcab9c09c4b00ad324 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.001s
I20260709 12:13:17.165408 26274 tablet_bootstrap.cc:654] T 94628c0fec194ca3a8dde23bb75433fc P 6c64624965ef4562abcea530986dd3ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:17.170454 26272 tablet_bootstrap.cc:654] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P dd4a4845e5f94eec9578accbfafcb4d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:17.170743 25941 raft_consensus.cc:3060] T 9b58bf7d2f584791ab4cd02832978173 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:17.171805 26273 tablet_bootstrap.cc:492] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Bootstrap starting.
I20260709 12:13:17.186033 26273 tablet_bootstrap.cc:654] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:17.186913 26017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b58bf7d2f584791ab4cd02832978173" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c64624965ef4562abcea530986dd3ae"
I20260709 12:13:17.187758 26017 raft_consensus.cc:3060] T 9b58bf7d2f584791ab4cd02832978173 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:17.189168 26274 tablet_bootstrap.cc:492] T 94628c0fec194ca3a8dde23bb75433fc P 6c64624965ef4562abcea530986dd3ae: No bootstrap required, opened a new log
I20260709 12:13:17.189713 26274 ts_tablet_manager.cc:1403] T 94628c0fec194ca3a8dde23bb75433fc P 6c64624965ef4562abcea530986dd3ae: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.019s
I20260709 12:13:17.192796 26272 tablet_bootstrap.cc:492] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P dd4a4845e5f94eec9578accbfafcb4d6: No bootstrap required, opened a new log
I20260709 12:13:17.193404 26272 ts_tablet_manager.cc:1403] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P dd4a4845e5f94eec9578accbfafcb4d6: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.002s
I20260709 12:13:17.194015 26259 leader_election.cc:290] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 1 election: Requested vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
I20260709 12:13:17.193399 26274 raft_consensus.cc:359] T 94628c0fec194ca3a8dde23bb75433fc P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.195562 26274 raft_consensus.cc:385] T 94628c0fec194ca3a8dde23bb75433fc P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:17.195923 26274 raft_consensus.cc:740] T 94628c0fec194ca3a8dde23bb75433fc P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c64624965ef4562abcea530986dd3ae, State: Initialized, Role: FOLLOWER
I20260709 12:13:17.196776 26017 raft_consensus.cc:2468] T 9b58bf7d2f584791ab4cd02832978173 P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 1.
I20260709 12:13:17.196988 26272 raft_consensus.cc:359] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.197978 26272 raft_consensus.cc:385] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:17.198298 26272 raft_consensus.cc:740] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd4a4845e5f94eec9578accbfafcb4d6, State: Initialized, Role: FOLLOWER
I20260709 12:13:17.198498 26057 leader_election.cc:304] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, 6c64624965ef4562abcea530986dd3ae; no voters: 
I20260709 12:13:17.199662 26259 raft_consensus.cc:2804] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:17.199285 26272 consensus_queue.cc:260] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P dd4a4845e5f94eec9578accbfafcb4d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.196882 26274 consensus_queue.cc:260] T 94628c0fec194ca3a8dde23bb75433fc P 6c64624965ef4562abcea530986dd3ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.203063 26274 ts_tablet_manager.cc:1434] T 94628c0fec194ca3a8dde23bb75433fc P 6c64624965ef4562abcea530986dd3ae: Time spent starting tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 12:13:17.203075 26272 ts_tablet_manager.cc:1434] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P dd4a4845e5f94eec9578accbfafcb4d6: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:13:17.199349 26273 tablet_bootstrap.cc:492] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59: No bootstrap required, opened a new log
I20260709 12:13:17.204560 26274 tablet_bootstrap.cc:492] T d02a838011d445a593c78c10943c6038 P 6c64624965ef4562abcea530986dd3ae: Bootstrap starting.
I20260709 12:13:17.205183 26273 ts_tablet_manager.cc:1403] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.003s
I20260709 12:13:17.206517 25941 raft_consensus.cc:2468] T 9b58bf7d2f584791ab4cd02832978173 P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 1.
I20260709 12:13:17.204535 26272 tablet_bootstrap.cc:492] T 5c16e5dbed0b4c98988c91e5475f1946 P dd4a4845e5f94eec9578accbfafcb4d6: Bootstrap starting.
I20260709 12:13:17.208186 26273 raft_consensus.cc:359] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.209002 26273 raft_consensus.cc:385] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:17.209311 26273 raft_consensus.cc:740] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f81d7b411a34e1e9ff80e6fcd7caf59, State: Initialized, Role: FOLLOWER
I20260709 12:13:17.209781 26287 raft_consensus.cc:493] T e3ae8cd984b945fd9d10fc3eda704a3f P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.210033 26273 consensus_queue.cc:260] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.210320 26287 raft_consensus.cc:515] T e3ae8cd984b945fd9d10fc3eda704a3f P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.212438 26287 leader_election.cc:290] T e3ae8cd984b945fd9d10fc3eda704a3f P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971)
I20260709 12:13:17.212666 26273 ts_tablet_manager.cc:1434] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:17.213716 26273 tablet_bootstrap.cc:492] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Bootstrap starting.
I20260709 12:13:17.215309 26272 tablet_bootstrap.cc:654] T 5c16e5dbed0b4c98988c91e5475f1946 P dd4a4845e5f94eec9578accbfafcb4d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:17.218040 26091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ae8cd984b945fd9d10fc3eda704a3f" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" is_pre_election: true
I20260709 12:13:17.218744 26091 raft_consensus.cc:2468] T e3ae8cd984b945fd9d10fc3eda704a3f P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c64624965ef4562abcea530986dd3ae in term 0.
I20260709 12:13:17.220515 26273 tablet_bootstrap.cc:654] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:17.221884 25981 leader_election.cc:304] T e3ae8cd984b945fd9d10fc3eda704a3f P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, 6c64624965ef4562abcea530986dd3ae; no voters: 
I20260709 12:13:17.223201 26260 raft_consensus.cc:2804] T e3ae8cd984b945fd9d10fc3eda704a3f P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:17.223554 26260 raft_consensus.cc:493] T e3ae8cd984b945fd9d10fc3eda704a3f P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:17.223912 26260 raft_consensus.cc:3060] T e3ae8cd984b945fd9d10fc3eda704a3f P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:17.225908 26259 raft_consensus.cc:697] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 LEADER]: Becoming Leader. State: Replica: 5f81d7b411a34e1e9ff80e6fcd7caf59, State: Running, Role: LEADER
I20260709 12:13:17.226949 26259 consensus_queue.cc:237] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.229470 26272 tablet_bootstrap.cc:492] T 5c16e5dbed0b4c98988c91e5475f1946 P dd4a4845e5f94eec9578accbfafcb4d6: No bootstrap required, opened a new log
I20260709 12:13:17.231068 26272 ts_tablet_manager.cc:1403] T 5c16e5dbed0b4c98988c91e5475f1946 P dd4a4845e5f94eec9578accbfafcb4d6: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.004s
I20260709 12:13:17.231071 26293 raft_consensus.cc:493] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.231971 25941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ae8cd984b945fd9d10fc3eda704a3f" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" is_pre_election: true
I20260709 12:13:17.231812 26293 raft_consensus.cc:515] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.234395 26272 raft_consensus.cc:359] T 5c16e5dbed0b4c98988c91e5475f1946 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.235949 26272 raft_consensus.cc:385] T 5c16e5dbed0b4c98988c91e5475f1946 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:17.235993 25941 raft_consensus.cc:2468] T e3ae8cd984b945fd9d10fc3eda704a3f P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c64624965ef4562abcea530986dd3ae in term 0.
I20260709 12:13:17.236498 26272 raft_consensus.cc:740] T 5c16e5dbed0b4c98988c91e5475f1946 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd4a4845e5f94eec9578accbfafcb4d6, State: Initialized, Role: FOLLOWER
I20260709 12:13:17.237330 26272 consensus_queue.cc:260] T 5c16e5dbed0b4c98988c91e5475f1946 P dd4a4845e5f94eec9578accbfafcb4d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.238725 26293 leader_election.cc:290] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
I20260709 12:13:17.240037 26272 ts_tablet_manager.cc:1434] T 5c16e5dbed0b4c98988c91e5475f1946 P dd4a4845e5f94eec9578accbfafcb4d6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:13:17.243371 26260 raft_consensus.cc:515] T e3ae8cd984b945fd9d10fc3eda704a3f P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.240666 26273 tablet_bootstrap.cc:492] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 5f81d7b411a34e1e9ff80e6fcd7caf59: No bootstrap required, opened a new log
I20260709 12:13:17.246133 25942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ae8cd984b945fd9d10fc3eda704a3f" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
I20260709 12:13:17.246670 26272 tablet_bootstrap.cc:492] T a5c01777e5be4afcab9c09c4b00ad324 P dd4a4845e5f94eec9578accbfafcb4d6: Bootstrap starting.
I20260709 12:13:17.246803 25942 raft_consensus.cc:3060] T e3ae8cd984b945fd9d10fc3eda704a3f P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:17.253228 26274 tablet_bootstrap.cc:654] T d02a838011d445a593c78c10943c6038 P 6c64624965ef4562abcea530986dd3ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:17.241135 26293 raft_consensus.cc:493] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.245604 26260 leader_election.cc:290] T e3ae8cd984b945fd9d10fc3eda704a3f P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 election: Requested vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971)
I20260709 12:13:17.258343 25942 raft_consensus.cc:2468] T e3ae8cd984b945fd9d10fc3eda704a3f P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c64624965ef4562abcea530986dd3ae in term 1.
I20260709 12:13:17.259600 25981 leader_election.cc:304] T e3ae8cd984b945fd9d10fc3eda704a3f P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c64624965ef4562abcea530986dd3ae, dd4a4845e5f94eec9578accbfafcb4d6; no voters: 
I20260709 12:13:17.255744 25941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fdc5e5e4e24f67b98f13312c916596" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" is_pre_election: true
I20260709 12:13:17.256887 26091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ae8cd984b945fd9d10fc3eda704a3f" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
I20260709 12:13:17.260471 26260 raft_consensus.cc:2804] T e3ae8cd984b945fd9d10fc3eda704a3f P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:17.260636 26091 raft_consensus.cc:3060] T e3ae8cd984b945fd9d10fc3eda704a3f P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:17.260812 26272 tablet_bootstrap.cc:654] T a5c01777e5be4afcab9c09c4b00ad324 P dd4a4845e5f94eec9578accbfafcb4d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:17.261979 26260 raft_consensus.cc:697] T e3ae8cd984b945fd9d10fc3eda704a3f P 6c64624965ef4562abcea530986dd3ae [term 1 LEADER]: Becoming Leader. State: Replica: 6c64624965ef4562abcea530986dd3ae, State: Running, Role: LEADER
I20260709 12:13:17.263069 26260 consensus_queue.cc:237] T e3ae8cd984b945fd9d10fc3eda704a3f P 6c64624965ef4562abcea530986dd3ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.257433 26273 ts_tablet_manager.cc:1403] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Time spent bootstrapping tablet: real 0.044s	user 0.006s	sys 0.013s
I20260709 12:13:17.269244 25836 catalog_manager.cc:5697] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:17.273466 25941 raft_consensus.cc:2468] T 02fdc5e5e4e24f67b98f13312c916596 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 0.
I20260709 12:13:17.241341 26017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fdc5e5e4e24f67b98f13312c916596" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c64624965ef4562abcea530986dd3ae" is_pre_election: true
I20260709 12:13:17.255290 26293 raft_consensus.cc:515] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.275018 26055 leader_election.cc:304] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, dd4a4845e5f94eec9578accbfafcb4d6; no voters: 
I20260709 12:13:17.276075 26259 raft_consensus.cc:2804] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:17.276453 26259 raft_consensus.cc:493] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:17.276787 26259 raft_consensus.cc:3060] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:17.277439 26272 tablet_bootstrap.cc:492] T a5c01777e5be4afcab9c09c4b00ad324 P dd4a4845e5f94eec9578accbfafcb4d6: No bootstrap required, opened a new log
I20260709 12:13:17.278393 26272 ts_tablet_manager.cc:1403] T a5c01777e5be4afcab9c09c4b00ad324 P dd4a4845e5f94eec9578accbfafcb4d6: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.007s
I20260709 12:13:17.279956 26273 raft_consensus.cc:359] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.280736 26273 raft_consensus.cc:385] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:17.281026 26273 raft_consensus.cc:740] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f81d7b411a34e1e9ff80e6fcd7caf59, State: Initialized, Role: FOLLOWER
I20260709 12:13:17.281451 26274 tablet_bootstrap.cc:492] T d02a838011d445a593c78c10943c6038 P 6c64624965ef4562abcea530986dd3ae: No bootstrap required, opened a new log
I20260709 12:13:17.281867 26017 raft_consensus.cc:2468] T 02fdc5e5e4e24f67b98f13312c916596 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 0.
I20260709 12:13:17.282124 26274 ts_tablet_manager.cc:1403] T d02a838011d445a593c78c10943c6038 P 6c64624965ef4562abcea530986dd3ae: Time spent bootstrapping tablet: real 0.078s	user 0.016s	sys 0.000s
I20260709 12:13:17.277843 26014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94628c0fec194ca3a8dde23bb75433fc" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c64624965ef4562abcea530986dd3ae" is_pre_election: true
I20260709 12:13:17.283342 26014 raft_consensus.cc:2468] T 94628c0fec194ca3a8dde23bb75433fc P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 0.
I20260709 12:13:17.277616 26293 leader_election.cc:290] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
I20260709 12:13:17.284162 26259 raft_consensus.cc:515] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.284533 26091 raft_consensus.cc:2468] T e3ae8cd984b945fd9d10fc3eda704a3f P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c64624965ef4562abcea530986dd3ae in term 1.
I20260709 12:13:17.284626 26057 leader_election.cc:304] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, 6c64624965ef4562abcea530986dd3ae; no voters: 
I20260709 12:13:17.285569 26293 raft_consensus.cc:2804] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:17.285928 26293 raft_consensus.cc:493] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:17.281172 26272 raft_consensus.cc:359] T a5c01777e5be4afcab9c09c4b00ad324 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.286417 26293 raft_consensus.cc:3060] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:17.286602 26272 raft_consensus.cc:385] T a5c01777e5be4afcab9c09c4b00ad324 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:17.287046 26272 raft_consensus.cc:740] T a5c01777e5be4afcab9c09c4b00ad324 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd4a4845e5f94eec9578accbfafcb4d6, State: Initialized, Role: FOLLOWER
I20260709 12:13:17.287046 25942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fdc5e5e4e24f67b98f13312c916596" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
I20260709 12:13:17.288257 25942 raft_consensus.cc:3060] T 02fdc5e5e4e24f67b98f13312c916596 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:17.288684 26014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fdc5e5e4e24f67b98f13312c916596" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c64624965ef4562abcea530986dd3ae"
I20260709 12:13:17.289319 26014 raft_consensus.cc:3060] T 02fdc5e5e4e24f67b98f13312c916596 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:17.292960 26259 leader_election.cc:290] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 1 election: Requested vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
I20260709 12:13:17.293090 26281 raft_consensus.cc:493] T 5c16e5dbed0b4c98988c91e5475f1946 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.293730 26281 raft_consensus.cc:515] T 5c16e5dbed0b4c98988c91e5475f1946 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.293848 25839 catalog_manager.cc:5697] T e3ae8cd984b945fd9d10fc3eda704a3f P 6c64624965ef4562abcea530986dd3ae reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c64624965ef4562abcea530986dd3ae (127.16.98.194). New cstate: current_term: 1 leader_uuid: "6c64624965ef4562abcea530986dd3ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:17.293296 26274 raft_consensus.cc:359] T d02a838011d445a593c78c10943c6038 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.296027 26274 raft_consensus.cc:385] T d02a838011d445a593c78c10943c6038 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:17.296221 26281 leader_election.cc:290] T 5c16e5dbed0b4c98988c91e5475f1946 P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419), 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971)
I20260709 12:13:17.296429 26274 raft_consensus.cc:740] T d02a838011d445a593c78c10943c6038 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c64624965ef4562abcea530986dd3ae, State: Initialized, Role: FOLLOWER
I20260709 12:13:17.297595 25942 raft_consensus.cc:2468] T 02fdc5e5e4e24f67b98f13312c916596 P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 1.
I20260709 12:13:17.297400 26274 consensus_queue.cc:260] T d02a838011d445a593c78c10943c6038 P 6c64624965ef4562abcea530986dd3ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.297835 26089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c16e5dbed0b4c98988c91e5475f1946" candidate_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" is_pre_election: true
I20260709 12:13:17.298988 26055 leader_election.cc:304] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, dd4a4845e5f94eec9578accbfafcb4d6; no voters: 
W20260709 12:13:17.299304 25906 leader_election.cc:343] T 5c16e5dbed0b4c98988c91e5475f1946 P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:17.299984 26017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c16e5dbed0b4c98988c91e5475f1946" candidate_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c64624965ef4562abcea530986dd3ae" is_pre_election: true
W20260709 12:13:17.301380 25908 leader_election.cc:343] T 5c16e5dbed0b4c98988c91e5475f1946 P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:17.301856 25908 leader_election.cc:304] T 5c16e5dbed0b4c98988c91e5475f1946 P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd4a4845e5f94eec9578accbfafcb4d6; no voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, 6c64624965ef4562abcea530986dd3ae
I20260709 12:13:17.302554 26274 ts_tablet_manager.cc:1434] T d02a838011d445a593c78c10943c6038 P 6c64624965ef4562abcea530986dd3ae: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.003s
I20260709 12:13:17.302977 26281 raft_consensus.cc:2749] T 5c16e5dbed0b4c98988c91e5475f1946 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:13:17.285836 25941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94628c0fec194ca3a8dde23bb75433fc" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" is_pre_election: true
I20260709 12:13:17.304188 25941 raft_consensus.cc:2468] T 94628c0fec194ca3a8dde23bb75433fc P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 0.
I20260709 12:13:17.304243 26273 consensus_queue.cc:260] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.303726 26274 tablet_bootstrap.cc:492] T baab9174e4d542069954eb94db182f0c P 6c64624965ef4562abcea530986dd3ae: Bootstrap starting.
I20260709 12:13:17.308625 26293 raft_consensus.cc:515] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.310873 26293 leader_election.cc:290] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 1 election: Requested vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
I20260709 12:13:17.311439 26293 raft_consensus.cc:2804] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:17.311893 26293 raft_consensus.cc:697] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 LEADER]: Becoming Leader. State: Replica: 5f81d7b411a34e1e9ff80e6fcd7caf59, State: Running, Role: LEADER
I20260709 12:13:17.312288 26017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94628c0fec194ca3a8dde23bb75433fc" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c64624965ef4562abcea530986dd3ae"
I20260709 12:13:17.319289 26017 raft_consensus.cc:3060] T 94628c0fec194ca3a8dde23bb75433fc P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:17.319449 26274 tablet_bootstrap.cc:654] T baab9174e4d542069954eb94db182f0c P 6c64624965ef4562abcea530986dd3ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:17.320979 26273 ts_tablet_manager.cc:1434] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.009s
I20260709 12:13:17.322080 26273 tablet_bootstrap.cc:492] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Bootstrap starting.
I20260709 12:13:17.327301 26017 raft_consensus.cc:2468] T 94628c0fec194ca3a8dde23bb75433fc P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 1.
I20260709 12:13:17.328536 26057 leader_election.cc:304] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, 6c64624965ef4562abcea530986dd3ae; no voters: 
I20260709 12:13:17.329524 26272 consensus_queue.cc:260] T a5c01777e5be4afcab9c09c4b00ad324 P dd4a4845e5f94eec9578accbfafcb4d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.331226 26304 raft_consensus.cc:2804] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:17.331730 26272 ts_tablet_manager.cc:1434] T a5c01777e5be4afcab9c09c4b00ad324 P dd4a4845e5f94eec9578accbfafcb4d6: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.000s
I20260709 12:13:17.331796 26304 raft_consensus.cc:697] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 LEADER]: Becoming Leader. State: Replica: 5f81d7b411a34e1e9ff80e6fcd7caf59, State: Running, Role: LEADER
I20260709 12:13:17.313720 25942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94628c0fec194ca3a8dde23bb75433fc" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
I20260709 12:13:17.332522 26014 raft_consensus.cc:2468] T 02fdc5e5e4e24f67b98f13312c916596 P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 1.
I20260709 12:13:17.333063 25942 raft_consensus.cc:3060] T 94628c0fec194ca3a8dde23bb75433fc P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:17.330785 26273 tablet_bootstrap.cc:654] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:17.335613 26304 consensus_queue.cc:237] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.312731 26293 consensus_queue.cc:237] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.344376 26274 tablet_bootstrap.cc:492] T baab9174e4d542069954eb94db182f0c P 6c64624965ef4562abcea530986dd3ae: No bootstrap required, opened a new log
I20260709 12:13:17.345093 26274 ts_tablet_manager.cc:1403] T baab9174e4d542069954eb94db182f0c P 6c64624965ef4562abcea530986dd3ae: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.012s
I20260709 12:13:17.348755 26274 raft_consensus.cc:359] T baab9174e4d542069954eb94db182f0c P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.349486 26274 raft_consensus.cc:385] T baab9174e4d542069954eb94db182f0c P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:17.353209 26274 raft_consensus.cc:740] T baab9174e4d542069954eb94db182f0c P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c64624965ef4562abcea530986dd3ae, State: Initialized, Role: FOLLOWER
I20260709 12:13:17.352234 25942 raft_consensus.cc:2468] T 94628c0fec194ca3a8dde23bb75433fc P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 1.
I20260709 12:13:17.358952 26274 consensus_queue.cc:260] T baab9174e4d542069954eb94db182f0c P 6c64624965ef4562abcea530986dd3ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.361141 26274 ts_tablet_manager.cc:1434] T baab9174e4d542069954eb94db182f0c P 6c64624965ef4562abcea530986dd3ae: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 12:13:17.362326 26274 tablet_bootstrap.cc:492] T 5c16e5dbed0b4c98988c91e5475f1946 P 6c64624965ef4562abcea530986dd3ae: Bootstrap starting.
I20260709 12:13:17.364547 26273 tablet_bootstrap.cc:492] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59: No bootstrap required, opened a new log
I20260709 12:13:17.365119 26273 ts_tablet_manager.cc:1403] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.023s
I20260709 12:13:17.364861 25836 catalog_manager.cc:5697] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:17.368252 26274 tablet_bootstrap.cc:654] T 5c16e5dbed0b4c98988c91e5475f1946 P 6c64624965ef4562abcea530986dd3ae: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:17.371093 26273 raft_consensus.cc:359] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.371841 26273 raft_consensus.cc:385] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:17.372146 26273 raft_consensus.cc:740] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f81d7b411a34e1e9ff80e6fcd7caf59, State: Initialized, Role: FOLLOWER
I20260709 12:13:17.372885 26273 consensus_queue.cc:260] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.375255 26273 ts_tablet_manager.cc:1434] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:13:17.376247 26273 tablet_bootstrap.cc:492] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Bootstrap starting.
I20260709 12:13:17.377465 26274 tablet_bootstrap.cc:492] T 5c16e5dbed0b4c98988c91e5475f1946 P 6c64624965ef4562abcea530986dd3ae: No bootstrap required, opened a new log
I20260709 12:13:17.377821 26274 ts_tablet_manager.cc:1403] T 5c16e5dbed0b4c98988c91e5475f1946 P 6c64624965ef4562abcea530986dd3ae: Time spent bootstrapping tablet: real 0.016s	user 0.002s	sys 0.007s
I20260709 12:13:17.379884 26274 raft_consensus.cc:359] T 5c16e5dbed0b4c98988c91e5475f1946 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.380475 26274 raft_consensus.cc:385] T 5c16e5dbed0b4c98988c91e5475f1946 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:17.380738 26274 raft_consensus.cc:740] T 5c16e5dbed0b4c98988c91e5475f1946 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c64624965ef4562abcea530986dd3ae, State: Initialized, Role: FOLLOWER
I20260709 12:13:17.382103 26273 tablet_bootstrap.cc:654] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:17.383214 25836 catalog_manager.cc:5697] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:17.381382 26274 consensus_queue.cc:260] T 5c16e5dbed0b4c98988c91e5475f1946 P 6c64624965ef4562abcea530986dd3ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.386451 26274 ts_tablet_manager.cc:1434] T 5c16e5dbed0b4c98988c91e5475f1946 P 6c64624965ef4562abcea530986dd3ae: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:13:17.386777 26273 tablet_bootstrap.cc:492] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59: No bootstrap required, opened a new log
I20260709 12:13:17.387293 26273 ts_tablet_manager.cc:1403] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Time spent bootstrapping tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 12:13:17.389794 26273 raft_consensus.cc:359] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.390378 26273 raft_consensus.cc:385] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:17.390631 26273 raft_consensus.cc:740] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f81d7b411a34e1e9ff80e6fcd7caf59, State: Initialized, Role: FOLLOWER
I20260709 12:13:17.391286 26273 consensus_queue.cc:260] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.392932 26273 ts_tablet_manager.cc:1434] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:13:17.393803 26273 tablet_bootstrap.cc:492] T baab9174e4d542069954eb94db182f0c P 5f81d7b411a34e1e9ff80e6fcd7caf59: Bootstrap starting.
I20260709 12:13:17.397413 26281 raft_consensus.cc:493] T baab9174e4d542069954eb94db182f0c P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.397966 26281 raft_consensus.cc:515] T baab9174e4d542069954eb94db182f0c P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.399358 26273 tablet_bootstrap.cc:654] T baab9174e4d542069954eb94db182f0c P 5f81d7b411a34e1e9ff80e6fcd7caf59: Neither blocks nor log segments found. Creating new log.
I20260709 12:13:17.400067 26281 leader_election.cc:290] T baab9174e4d542069954eb94db182f0c P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419), 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971)
I20260709 12:13:17.401263 26091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baab9174e4d542069954eb94db182f0c" candidate_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" is_pre_election: true
W20260709 12:13:17.402449 25906 leader_election.cc:343] T baab9174e4d542069954eb94db182f0c P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:13:17.403383 26017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baab9174e4d542069954eb94db182f0c" candidate_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c64624965ef4562abcea530986dd3ae" is_pre_election: true
I20260709 12:13:17.404031 26017 raft_consensus.cc:2468] T baab9174e4d542069954eb94db182f0c P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd4a4845e5f94eec9578accbfafcb4d6 in term 0.
I20260709 12:13:17.405056 25908 leader_election.cc:304] T baab9174e4d542069954eb94db182f0c P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c64624965ef4562abcea530986dd3ae, dd4a4845e5f94eec9578accbfafcb4d6; no voters: 5f81d7b411a34e1e9ff80e6fcd7caf59
I20260709 12:13:17.405890 26281 raft_consensus.cc:2804] T baab9174e4d542069954eb94db182f0c P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:17.406230 26281 raft_consensus.cc:493] T baab9174e4d542069954eb94db182f0c P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:17.406162 26293 raft_consensus.cc:493] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.406831 26281 raft_consensus.cc:3060] T baab9174e4d542069954eb94db182f0c P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:17.406937 26293 raft_consensus.cc:515] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.409874 25942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02a838011d445a593c78c10943c6038" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" is_pre_election: true
I20260709 12:13:17.410262 26293 leader_election.cc:290] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
I20260709 12:13:17.410458 26017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02a838011d445a593c78c10943c6038" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c64624965ef4562abcea530986dd3ae" is_pre_election: true
I20260709 12:13:17.410527 25942 raft_consensus.cc:2468] T d02a838011d445a593c78c10943c6038 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 0.
I20260709 12:13:17.411116 26017 raft_consensus.cc:2468] T d02a838011d445a593c78c10943c6038 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 0.
I20260709 12:13:17.411841 26055 leader_election.cc:304] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, dd4a4845e5f94eec9578accbfafcb4d6; no voters: 
I20260709 12:13:17.412989 26273 tablet_bootstrap.cc:492] T baab9174e4d542069954eb94db182f0c P 5f81d7b411a34e1e9ff80e6fcd7caf59: No bootstrap required, opened a new log
I20260709 12:13:17.412983 26293 raft_consensus.cc:2804] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:17.413473 26293 raft_consensus.cc:493] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:17.413597 26273 ts_tablet_manager.cc:1403] T baab9174e4d542069954eb94db182f0c P 5f81d7b411a34e1e9ff80e6fcd7caf59: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.001s
I20260709 12:13:17.413851 26293 raft_consensus.cc:3060] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:17.415136 26281 raft_consensus.cc:515] T baab9174e4d542069954eb94db182f0c P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.416491 26273 raft_consensus.cc:359] T baab9174e4d542069954eb94db182f0c P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.417169 26273 raft_consensus.cc:385] T baab9174e4d542069954eb94db182f0c P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:13:17.417426 26273 raft_consensus.cc:740] T baab9174e4d542069954eb94db182f0c P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f81d7b411a34e1e9ff80e6fcd7caf59, State: Initialized, Role: FOLLOWER
I20260709 12:13:17.417486 26017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baab9174e4d542069954eb94db182f0c" candidate_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c64624965ef4562abcea530986dd3ae"
I20260709 12:13:17.417796 26091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baab9174e4d542069954eb94db182f0c" candidate_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
I20260709 12:13:17.418166 26273 consensus_queue.cc:260] T baab9174e4d542069954eb94db182f0c P 5f81d7b411a34e1e9ff80e6fcd7caf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.418525 26281 leader_election.cc:290] T baab9174e4d542069954eb94db182f0c P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 1 election: Requested vote from peers 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419), 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971)
I20260709 12:13:17.418162 26017 raft_consensus.cc:3060] T baab9174e4d542069954eb94db182f0c P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:17.419170 26091 raft_consensus.cc:3060] T baab9174e4d542069954eb94db182f0c P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:17.420553 26273 ts_tablet_manager.cc:1434] T baab9174e4d542069954eb94db182f0c P 5f81d7b411a34e1e9ff80e6fcd7caf59: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:13:17.421264 26293 raft_consensus.cc:515] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.423447 26293 leader_election.cc:290] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 1 election: Requested vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
I20260709 12:13:17.423581 25942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02a838011d445a593c78c10943c6038" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
I20260709 12:13:17.423935 26014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02a838011d445a593c78c10943c6038" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c64624965ef4562abcea530986dd3ae"
I20260709 12:13:17.424536 25942 raft_consensus.cc:3060] T d02a838011d445a593c78c10943c6038 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:17.424671 26014 raft_consensus.cc:3060] T d02a838011d445a593c78c10943c6038 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:17.426990 26091 raft_consensus.cc:2468] T baab9174e4d542069954eb94db182f0c P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd4a4845e5f94eec9578accbfafcb4d6 in term 1.
I20260709 12:13:17.427500 26260 raft_consensus.cc:493] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.428031 26260 raft_consensus.cc:515] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.429420 26017 raft_consensus.cc:2468] T baab9174e4d542069954eb94db182f0c P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd4a4845e5f94eec9578accbfafcb4d6 in term 1.
I20260709 12:13:17.429920 26260 leader_election.cc:290] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971)
I20260709 12:13:17.424135 26245 raft_consensus.cc:493] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.430543 26245 raft_consensus.cc:515] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.431010 26014 raft_consensus.cc:2468] T d02a838011d445a593c78c10943c6038 P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 1.
I20260709 12:13:17.431126 25908 leader_election.cc:304] T baab9174e4d542069954eb94db182f0c P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c64624965ef4562abcea530986dd3ae, dd4a4845e5f94eec9578accbfafcb4d6; no voters: 
I20260709 12:13:17.432147 26057 leader_election.cc:304] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, 6c64624965ef4562abcea530986dd3ae; no voters: 
I20260709 12:13:17.432736 26245 leader_election.cc:290] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419), 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971)
I20260709 12:13:17.433126 26293 raft_consensus.cc:2804] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:17.433282 26245 raft_consensus.cc:2804] T baab9174e4d542069954eb94db182f0c P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:17.433974 26245 raft_consensus.cc:697] T baab9174e4d542069954eb94db182f0c P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 LEADER]: Becoming Leader. State: Replica: dd4a4845e5f94eec9578accbfafcb4d6, State: Running, Role: LEADER
I20260709 12:13:17.433686 26293 raft_consensus.cc:697] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 LEADER]: Becoming Leader. State: Replica: 5f81d7b411a34e1e9ff80e6fcd7caf59, State: Running, Role: LEADER
I20260709 12:13:17.434827 26245 consensus_queue.cc:237] T baab9174e4d542069954eb94db182f0c P dd4a4845e5f94eec9578accbfafcb4d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.435209 26089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de0ab2b47674ac2bf7bf690c4fe4b37" candidate_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" is_pre_election: true
I20260709 12:13:17.435165 26293 consensus_queue.cc:237] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.435981 26089 raft_consensus.cc:2468] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd4a4845e5f94eec9578accbfafcb4d6 in term 0.
I20260709 12:13:17.437662 26014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de0ab2b47674ac2bf7bf690c4fe4b37" candidate_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c64624965ef4562abcea530986dd3ae" is_pre_election: true
I20260709 12:13:17.437873 25941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de0ab2b47674ac2bf7bf690c4fe4b37" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" is_pre_election: true
I20260709 12:13:17.438393 26014 raft_consensus.cc:2468] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd4a4845e5f94eec9578accbfafcb4d6 in term 0.
I20260709 12:13:17.439181 25906 leader_election.cc:304] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, dd4a4845e5f94eec9578accbfafcb4d6; no voters: 
I20260709 12:13:17.442353 25942 raft_consensus.cc:2468] T d02a838011d445a593c78c10943c6038 P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 1.
I20260709 12:13:17.443163 26091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de0ab2b47674ac2bf7bf690c4fe4b37" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" is_pre_election: true
I20260709 12:13:17.444236 26091 raft_consensus.cc:2468] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c64624965ef4562abcea530986dd3ae in term 0.
I20260709 12:13:17.438546 25941 raft_consensus.cc:2468] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c64624965ef4562abcea530986dd3ae in term 0.
I20260709 12:13:17.445443 25981 leader_election.cc:304] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, 6c64624965ef4562abcea530986dd3ae; no voters: 
I20260709 12:13:17.445709 26280 raft_consensus.cc:2804] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:17.446966 26260 raft_consensus.cc:2804] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:17.447031 26280 raft_consensus.cc:493] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:17.447399 26260 raft_consensus.cc:493] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:17.447467 26280 raft_consensus.cc:3060] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:17.447809 26260 raft_consensus.cc:3060] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:17.456017 26260 raft_consensus.cc:515] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.460132 26091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de0ab2b47674ac2bf7bf690c4fe4b37" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
I20260709 12:13:17.460968 26091 raft_consensus.cc:3060] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:17.466744 26260 leader_election.cc:290] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 election: Requested vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971)
I20260709 12:13:17.466487 26280 raft_consensus.cc:515] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.472208 26091 raft_consensus.cc:2468] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c64624965ef4562abcea530986dd3ae in term 1.
I20260709 12:13:17.472921 26089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de0ab2b47674ac2bf7bf690c4fe4b37" candidate_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
I20260709 12:13:17.473675 26089 raft_consensus.cc:2393] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dd4a4845e5f94eec9578accbfafcb4d6 in current term 1: Already voted for candidate 6c64624965ef4562abcea530986dd3ae in this term.
I20260709 12:13:17.473475 25981 leader_election.cc:304] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, 6c64624965ef4562abcea530986dd3ae; no voters: 
I20260709 12:13:17.477154 26014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de0ab2b47674ac2bf7bf690c4fe4b37" candidate_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c64624965ef4562abcea530986dd3ae"
I20260709 12:13:17.477603 25941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de0ab2b47674ac2bf7bf690c4fe4b37" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
I20260709 12:13:17.478277 26014 raft_consensus.cc:2393] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dd4a4845e5f94eec9578accbfafcb4d6 in current term 1: Already voted for candidate 6c64624965ef4562abcea530986dd3ae in this term.
I20260709 12:13:17.478456 25941 raft_consensus.cc:2393] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c64624965ef4562abcea530986dd3ae in current term 1: Already voted for candidate dd4a4845e5f94eec9578accbfafcb4d6 in this term.
I20260709 12:13:17.478195 25836 catalog_manager.cc:5697] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:17.480325 25908 leader_election.cc:304] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd4a4845e5f94eec9578accbfafcb4d6; no voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, 6c64624965ef4562abcea530986dd3ae
I20260709 12:13:17.481361 26260 raft_consensus.cc:2804] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:17.482132 26281 raft_consensus.cc:2749] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:13:17.482714 26260 raft_consensus.cc:697] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 6c64624965ef4562abcea530986dd3ae [term 1 LEADER]: Becoming Leader. State: Replica: 6c64624965ef4562abcea530986dd3ae, State: Running, Role: LEADER
I20260709 12:13:17.483671 26260 consensus_queue.cc:237] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 6c64624965ef4562abcea530986dd3ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.489244 26287 raft_consensus.cc:493] T a5c01777e5be4afcab9c09c4b00ad324 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.489784 26287 raft_consensus.cc:515] T a5c01777e5be4afcab9c09c4b00ad324 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.491807 26287 leader_election.cc:290] T a5c01777e5be4afcab9c09c4b00ad324 P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971)
I20260709 12:13:17.474982 26280 leader_election.cc:290] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 1 election: Requested vote from peers 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419), 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971)
I20260709 12:13:17.494033 26091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5c01777e5be4afcab9c09c4b00ad324" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" is_pre_election: true
I20260709 12:13:17.494802 26091 raft_consensus.cc:2468] T a5c01777e5be4afcab9c09c4b00ad324 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c64624965ef4562abcea530986dd3ae in term 0.
I20260709 12:13:17.495056 25941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5c01777e5be4afcab9c09c4b00ad324" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" is_pre_election: true
I20260709 12:13:17.495715 25941 raft_consensus.cc:2468] T a5c01777e5be4afcab9c09c4b00ad324 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c64624965ef4562abcea530986dd3ae in term 0.
I20260709 12:13:17.496101 25981 leader_election.cc:304] T a5c01777e5be4afcab9c09c4b00ad324 P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, 6c64624965ef4562abcea530986dd3ae; no voters: 
I20260709 12:13:17.497501 26287 raft_consensus.cc:2804] T a5c01777e5be4afcab9c09c4b00ad324 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:17.497912 26287 raft_consensus.cc:493] T a5c01777e5be4afcab9c09c4b00ad324 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:17.498270 26287 raft_consensus.cc:3060] T a5c01777e5be4afcab9c09c4b00ad324 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:17.502811 25836 catalog_manager.cc:5697] T baab9174e4d542069954eb94db182f0c P dd4a4845e5f94eec9578accbfafcb4d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193). New cstate: current_term: 1 leader_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:17.505193 25839 catalog_manager.cc:5697] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 6c64624965ef4562abcea530986dd3ae reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c64624965ef4562abcea530986dd3ae (127.16.98.194). New cstate: current_term: 1 leader_uuid: "6c64624965ef4562abcea530986dd3ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:17.506438 26287 raft_consensus.cc:515] T a5c01777e5be4afcab9c09c4b00ad324 P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.508463 26287 leader_election.cc:290] T a5c01777e5be4afcab9c09c4b00ad324 P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 election: Requested vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971)
I20260709 12:13:17.509917 25941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5c01777e5be4afcab9c09c4b00ad324" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
I20260709 12:13:17.510546 25941 raft_consensus.cc:3060] T a5c01777e5be4afcab9c09c4b00ad324 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:17.510455 26091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5c01777e5be4afcab9c09c4b00ad324" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
I20260709 12:13:17.511266 26091 raft_consensus.cc:3060] T a5c01777e5be4afcab9c09c4b00ad324 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:17.518254 26091 raft_consensus.cc:2468] T a5c01777e5be4afcab9c09c4b00ad324 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c64624965ef4562abcea530986dd3ae in term 1.
I20260709 12:13:17.519374 25981 leader_election.cc:304] T a5c01777e5be4afcab9c09c4b00ad324 P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, 6c64624965ef4562abcea530986dd3ae; no voters: 
I20260709 12:13:17.519937 25941 raft_consensus.cc:2468] T a5c01777e5be4afcab9c09c4b00ad324 P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c64624965ef4562abcea530986dd3ae in term 1.
I20260709 12:13:17.520222 26287 raft_consensus.cc:2804] T a5c01777e5be4afcab9c09c4b00ad324 P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:13:17.521096 25888 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:13:17.521601 26287 raft_consensus.cc:697] T a5c01777e5be4afcab9c09c4b00ad324 P 6c64624965ef4562abcea530986dd3ae [term 1 LEADER]: Becoming Leader. State: Replica: 6c64624965ef4562abcea530986dd3ae, State: Running, Role: LEADER
I20260709 12:13:17.522414 26287 consensus_queue.cc:237] T a5c01777e5be4afcab9c09c4b00ad324 P 6c64624965ef4562abcea530986dd3ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.529404 25839 catalog_manager.cc:5697] T a5c01777e5be4afcab9c09c4b00ad324 P 6c64624965ef4562abcea530986dd3ae reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c64624965ef4562abcea530986dd3ae (127.16.98.194). New cstate: current_term: 1 leader_uuid: "6c64624965ef4562abcea530986dd3ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:17.644825 26287 consensus_queue.cc:1048] T e3ae8cd984b945fd9d10fc3eda704a3f P 6c64624965ef4562abcea530986dd3ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:17.657542 26287 consensus_queue.cc:1048] T e3ae8cd984b945fd9d10fc3eda704a3f P 6c64624965ef4562abcea530986dd3ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:17.772553 26293 raft_consensus.cc:493] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:13:17.773015 26293 raft_consensus.cc:515] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.774773 26293 leader_election.cc:290] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
I20260709 12:13:17.775581 25941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c16e5dbed0b4c98988c91e5475f1946" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" is_pre_election: true
I20260709 12:13:17.775923 26014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c16e5dbed0b4c98988c91e5475f1946" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c64624965ef4562abcea530986dd3ae" is_pre_election: true
I20260709 12:13:17.776271 25941 raft_consensus.cc:2468] T 5c16e5dbed0b4c98988c91e5475f1946 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 0.
I20260709 12:13:17.776630 26014 raft_consensus.cc:2468] T 5c16e5dbed0b4c98988c91e5475f1946 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 0.
I20260709 12:13:17.777458 26055 leader_election.cc:304] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, dd4a4845e5f94eec9578accbfafcb4d6; no voters: 
I20260709 12:13:17.778326 26293 raft_consensus.cc:2804] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:13:17.778721 26293 raft_consensus.cc:493] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:13:17.779004 26293 raft_consensus.cc:3060] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:17.783696 26293 raft_consensus.cc:515] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.785195 26293 leader_election.cc:290] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 1 election: Requested vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
I20260709 12:13:17.785912 25941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c16e5dbed0b4c98988c91e5475f1946" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
I20260709 12:13:17.786183 26014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c16e5dbed0b4c98988c91e5475f1946" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c64624965ef4562abcea530986dd3ae"
I20260709 12:13:17.786470 25941 raft_consensus.cc:3060] T 5c16e5dbed0b4c98988c91e5475f1946 P dd4a4845e5f94eec9578accbfafcb4d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:17.786885 26014 raft_consensus.cc:3060] T 5c16e5dbed0b4c98988c91e5475f1946 P 6c64624965ef4562abcea530986dd3ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:13:17.791265 25941 raft_consensus.cc:2468] T 5c16e5dbed0b4c98988c91e5475f1946 P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 1.
I20260709 12:13:17.791455 26014 raft_consensus.cc:2468] T 5c16e5dbed0b4c98988c91e5475f1946 P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 1.
I20260709 12:13:17.792392 26055 leader_election.cc:304] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, dd4a4845e5f94eec9578accbfafcb4d6; no voters: 
I20260709 12:13:17.793138 26293 raft_consensus.cc:2804] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:13:17.793546 26293 raft_consensus.cc:697] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 LEADER]: Becoming Leader. State: Replica: 5f81d7b411a34e1e9ff80e6fcd7caf59, State: Running, Role: LEADER
I20260709 12:13:17.794242 26293 consensus_queue.cc:237] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:17.801577 25836 catalog_manager.cc:5697] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195). New cstate: current_term: 1 leader_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:17.808144 26293 consensus_queue.cc:1048] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:17.819074 26293 consensus_queue.cc:1048] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:17.828686 26316 consensus_queue.cc:1048] T baab9174e4d542069954eb94db182f0c P dd4a4845e5f94eec9578accbfafcb4d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:17.833153 26293 consensus_queue.cc:1048] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:17.845090 26281 consensus_queue.cc:1048] T baab9174e4d542069954eb94db182f0c P dd4a4845e5f94eec9578accbfafcb4d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:17.850720 26293 consensus_queue.cc:1048] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:17.882103 26293 consensus_queue.cc:1048] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:17.886345 26293 consensus_queue.cc:1048] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:17.894687 26304 consensus_queue.cc:1048] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:17.905145 26328 consensus_queue.cc:1048] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:17.915990 26091 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b58bf7d2f584791ab4cd02832978173"
dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
mode: GRACEFUL
new_leader_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
 from {username='slave'} at 127.0.0.1:34310
I20260709 12:13:17.916600 26091 raft_consensus.cc:606] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 LEADER]: Received request to transfer leadership to TS dd4a4845e5f94eec9578accbfafcb4d6
I20260709 12:13:17.921730 26014 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3ae8cd984b945fd9d10fc3eda704a3f"
dest_uuid: "6c64624965ef4562abcea530986dd3ae"
mode: GRACEFUL
new_leader_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
 from {username='slave'} at 127.0.0.1:39080
I20260709 12:13:17.922276 26014 raft_consensus.cc:606] T e3ae8cd984b945fd9d10fc3eda704a3f P 6c64624965ef4562abcea530986dd3ae [term 1 LEADER]: Received request to transfer leadership to TS dd4a4845e5f94eec9578accbfafcb4d6
I20260709 12:13:17.927093 26091 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02fdc5e5e4e24f67b98f13312c916596"
dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
mode: GRACEFUL
new_leader_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
 from {username='slave'} at 127.0.0.1:34310
I20260709 12:13:17.927594 26091 raft_consensus.cc:606] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 LEADER]: Received request to transfer leadership to TS dd4a4845e5f94eec9578accbfafcb4d6
I20260709 12:13:17.932122 26091 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d02a838011d445a593c78c10943c6038"
dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
mode: GRACEFUL
new_leader_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
 from {username='slave'} at 127.0.0.1:34310
I20260709 12:13:17.932580 26091 raft_consensus.cc:606] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 LEADER]: Received request to transfer leadership to TS dd4a4845e5f94eec9578accbfafcb4d6
I20260709 12:13:17.939980 26091 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94628c0fec194ca3a8dde23bb75433fc"
dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
mode: GRACEFUL
new_leader_uuid: "6c64624965ef4562abcea530986dd3ae"
 from {username='slave'} at 127.0.0.1:34310
I20260709 12:13:17.940477 26091 raft_consensus.cc:606] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 LEADER]: Received request to transfer leadership to TS 6c64624965ef4562abcea530986dd3ae
I20260709 12:13:17.944955 26091 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c16e5dbed0b4c98988c91e5475f1946"
dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
mode: GRACEFUL
new_leader_uuid: "6c64624965ef4562abcea530986dd3ae"
 from {username='slave'} at 127.0.0.1:34310
I20260709 12:13:17.945449 26091 raft_consensus.cc:606] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 LEADER]: Received request to transfer leadership to TS 6c64624965ef4562abcea530986dd3ae
I20260709 12:13:17.949349 26287 consensus_queue.cc:1048] T a5c01777e5be4afcab9c09c4b00ad324 P 6c64624965ef4562abcea530986dd3ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:17.962603 26321 consensus_queue.cc:1048] T a5c01777e5be4afcab9c09c4b00ad324 P 6c64624965ef4562abcea530986dd3ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:17.973295 25941 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "baab9174e4d542069954eb94db182f0c"
dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
mode: GRACEFUL
new_leader_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
 from {username='slave'} at 127.0.0.1:49482
I20260709 12:13:17.973978 25941 raft_consensus.cc:606] T baab9174e4d542069954eb94db182f0c P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 LEADER]: Received request to transfer leadership to TS 5f81d7b411a34e1e9ff80e6fcd7caf59
I20260709 12:13:18.056970 26287 consensus_queue.cc:1048] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 6c64624965ef4562abcea530986dd3ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:18.067211 26260 consensus_queue.cc:1048] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 6c64624965ef4562abcea530986dd3ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:18.264803 26322 raft_consensus.cc:993] T e3ae8cd984b945fd9d10fc3eda704a3f P 6c64624965ef4562abcea530986dd3ae: : Instructing follower dd4a4845e5f94eec9578accbfafcb4d6 to start an election
I20260709 12:13:18.265286 26287 raft_consensus.cc:1081] T e3ae8cd984b945fd9d10fc3eda704a3f P 6c64624965ef4562abcea530986dd3ae [term 1 LEADER]: Signalling peer dd4a4845e5f94eec9578accbfafcb4d6 to start an election
I20260709 12:13:18.266780 25942 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3ae8cd984b945fd9d10fc3eda704a3f"
dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
 from {username='slave'} at 127.0.0.1:49468
I20260709 12:13:18.267211 25942 raft_consensus.cc:493] T e3ae8cd984b945fd9d10fc3eda704a3f P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:18.267488 25942 raft_consensus.cc:3060] T e3ae8cd984b945fd9d10fc3eda704a3f P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.272091 25942 raft_consensus.cc:515] T e3ae8cd984b945fd9d10fc3eda704a3f P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:18.273564 25942 leader_election.cc:290] T e3ae8cd984b945fd9d10fc3eda704a3f P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 2 election: Requested vote from peers 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419), 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971)
I20260709 12:13:18.274284 26014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ae8cd984b945fd9d10fc3eda704a3f" candidate_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c64624965ef4562abcea530986dd3ae"
I20260709 12:13:18.274534 26091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ae8cd984b945fd9d10fc3eda704a3f" candidate_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
I20260709 12:13:18.274950 26014 raft_consensus.cc:3055] T e3ae8cd984b945fd9d10fc3eda704a3f P 6c64624965ef4562abcea530986dd3ae [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:18.275110 26091 raft_consensus.cc:3060] T e3ae8cd984b945fd9d10fc3eda704a3f P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.275301 26014 raft_consensus.cc:740] T e3ae8cd984b945fd9d10fc3eda704a3f P 6c64624965ef4562abcea530986dd3ae [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6c64624965ef4562abcea530986dd3ae, State: Running, Role: LEADER
I20260709 12:13:18.276108 26014 consensus_queue.cc:260] T e3ae8cd984b945fd9d10fc3eda704a3f P 6c64624965ef4562abcea530986dd3ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:18.277279 26014 raft_consensus.cc:3060] T e3ae8cd984b945fd9d10fc3eda704a3f P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.281867 26091 raft_consensus.cc:2468] T e3ae8cd984b945fd9d10fc3eda704a3f P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd4a4845e5f94eec9578accbfafcb4d6 in term 2.
I20260709 12:13:18.283032 25906 leader_election.cc:304] T e3ae8cd984b945fd9d10fc3eda704a3f P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, dd4a4845e5f94eec9578accbfafcb4d6; no voters: 
I20260709 12:13:18.283716 26014 raft_consensus.cc:2468] T e3ae8cd984b945fd9d10fc3eda704a3f P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd4a4845e5f94eec9578accbfafcb4d6 in term 2.
I20260709 12:13:18.283794 26281 raft_consensus.cc:2804] T e3ae8cd984b945fd9d10fc3eda704a3f P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:18.284608 26281 raft_consensus.cc:697] T e3ae8cd984b945fd9d10fc3eda704a3f P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 LEADER]: Becoming Leader. State: Replica: dd4a4845e5f94eec9578accbfafcb4d6, State: Running, Role: LEADER
I20260709 12:13:18.285707 26281 consensus_queue.cc:237] T e3ae8cd984b945fd9d10fc3eda704a3f P dd4a4845e5f94eec9578accbfafcb4d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:18.291945 25836 catalog_manager.cc:5697] T e3ae8cd984b945fd9d10fc3eda704a3f P dd4a4845e5f94eec9578accbfafcb4d6 reported cstate change: term changed from 1 to 2, leader changed from 6c64624965ef4562abcea530986dd3ae (127.16.98.194) to dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:18.310039 26280 raft_consensus.cc:993] T baab9174e4d542069954eb94db182f0c P dd4a4845e5f94eec9578accbfafcb4d6: : Instructing follower 5f81d7b411a34e1e9ff80e6fcd7caf59 to start an election
I20260709 12:13:18.310529 26281 raft_consensus.cc:1081] T baab9174e4d542069954eb94db182f0c P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 LEADER]: Signalling peer 5f81d7b411a34e1e9ff80e6fcd7caf59 to start an election
I20260709 12:13:18.312008 26091 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "baab9174e4d542069954eb94db182f0c"
dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
 from {username='slave'} at 127.0.0.1:34296
I20260709 12:13:18.312479 26091 raft_consensus.cc:493] T baab9174e4d542069954eb94db182f0c P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:18.312862 26091 raft_consensus.cc:3060] T baab9174e4d542069954eb94db182f0c P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.318349 26328 raft_consensus.cc:993] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59: : Instructing follower dd4a4845e5f94eec9578accbfafcb4d6 to start an election
I20260709 12:13:18.318885 26259 raft_consensus.cc:1081] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 LEADER]: Signalling peer dd4a4845e5f94eec9578accbfafcb4d6 to start an election
I20260709 12:13:18.318758 26091 raft_consensus.cc:515] T baab9174e4d542069954eb94db182f0c P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:18.320370 25942 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b58bf7d2f584791ab4cd02832978173"
dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
 from {username='slave'} at 127.0.0.1:49470
I20260709 12:13:18.320875 25942 raft_consensus.cc:493] T 9b58bf7d2f584791ab4cd02832978173 P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:18.321131 26091 leader_election.cc:290] T baab9174e4d542069954eb94db182f0c P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 2 election: Requested vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
I20260709 12:13:18.321218 25942 raft_consensus.cc:3060] T 9b58bf7d2f584791ab4cd02832978173 P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.321235 25941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baab9174e4d542069954eb94db182f0c" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
I20260709 12:13:18.321659 26014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baab9174e4d542069954eb94db182f0c" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c64624965ef4562abcea530986dd3ae"
I20260709 12:13:18.322094 25941 raft_consensus.cc:3055] T baab9174e4d542069954eb94db182f0c P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:18.322198 26014 raft_consensus.cc:3060] T baab9174e4d542069954eb94db182f0c P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.322520 25941 raft_consensus.cc:740] T baab9174e4d542069954eb94db182f0c P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dd4a4845e5f94eec9578accbfafcb4d6, State: Running, Role: LEADER
I20260709 12:13:18.323325 25941 consensus_queue.cc:260] T baab9174e4d542069954eb94db182f0c P dd4a4845e5f94eec9578accbfafcb4d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:18.324324 25941 raft_consensus.cc:3060] T baab9174e4d542069954eb94db182f0c P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.326408 25942 raft_consensus.cc:515] T 9b58bf7d2f584791ab4cd02832978173 P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:18.328893 26017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b58bf7d2f584791ab4cd02832978173" candidate_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c64624965ef4562abcea530986dd3ae"
I20260709 12:13:18.329391 26017 raft_consensus.cc:3060] T 9b58bf7d2f584791ab4cd02832978173 P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.330461 25941 raft_consensus.cc:2468] T baab9174e4d542069954eb94db182f0c P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 2.
I20260709 12:13:18.331075 26259 consensus_queue.cc:1048] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:13:18.332917 25942 leader_election.cc:290] T 9b58bf7d2f584791ab4cd02832978173 P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 2 election: Requested vote from peers 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419), 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971)
I20260709 12:13:18.332995 26055 leader_election.cc:304] T baab9174e4d542069954eb94db182f0c P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, dd4a4845e5f94eec9578accbfafcb4d6; no voters: 
I20260709 12:13:18.333997 26091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b58bf7d2f584791ab4cd02832978173" candidate_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
I20260709 12:13:18.334421 26014 raft_consensus.cc:2468] T baab9174e4d542069954eb94db182f0c P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 2.
I20260709 12:13:18.334616 26091 raft_consensus.cc:3055] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:18.334717 26259 raft_consensus.cc:2804] T baab9174e4d542069954eb94db182f0c P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:18.335503 26091 raft_consensus.cc:740] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f81d7b411a34e1e9ff80e6fcd7caf59, State: Running, Role: LEADER
I20260709 12:13:18.336127 26259 raft_consensus.cc:697] T baab9174e4d542069954eb94db182f0c P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 LEADER]: Becoming Leader. State: Replica: 5f81d7b411a34e1e9ff80e6fcd7caf59, State: Running, Role: LEADER
I20260709 12:13:18.336391 26091 consensus_queue.cc:260] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:18.336721 26017 raft_consensus.cc:2468] T 9b58bf7d2f584791ab4cd02832978173 P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd4a4845e5f94eec9578accbfafcb4d6 in term 2.
I20260709 12:13:18.337003 26259 consensus_queue.cc:237] T baab9174e4d542069954eb94db182f0c P 5f81d7b411a34e1e9ff80e6fcd7caf59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:18.337517 26091 raft_consensus.cc:3060] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.338146 25908 leader_election.cc:304] T 9b58bf7d2f584791ab4cd02832978173 P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c64624965ef4562abcea530986dd3ae, dd4a4845e5f94eec9578accbfafcb4d6; no voters: 
I20260709 12:13:18.339000 26281 raft_consensus.cc:2804] T 9b58bf7d2f584791ab4cd02832978173 P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:18.339540 26281 raft_consensus.cc:697] T 9b58bf7d2f584791ab4cd02832978173 P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 LEADER]: Becoming Leader. State: Replica: dd4a4845e5f94eec9578accbfafcb4d6, State: Running, Role: LEADER
I20260709 12:13:18.341261 26281 consensus_queue.cc:237] T 9b58bf7d2f584791ab4cd02832978173 P dd4a4845e5f94eec9578accbfafcb4d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:18.343997 26091 raft_consensus.cc:2468] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd4a4845e5f94eec9578accbfafcb4d6 in term 2.
I20260709 12:13:18.345566 25839 catalog_manager.cc:5697] T baab9174e4d542069954eb94db182f0c P 5f81d7b411a34e1e9ff80e6fcd7caf59 reported cstate change: term changed from 1 to 2, leader changed from dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193) to 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195). New cstate: current_term: 2 leader_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:18.354724 26293 consensus_queue.cc:1048] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:13:18.358918 25836 catalog_manager.cc:5697] T 9b58bf7d2f584791ab4cd02832978173 P dd4a4845e5f94eec9578accbfafcb4d6 reported cstate change: term changed from 1 to 2, leader changed from 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195) to dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:18.371014 26259 raft_consensus.cc:993] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59: : Instructing follower 6c64624965ef4562abcea530986dd3ae to start an election
I20260709 12:13:18.371459 26293 raft_consensus.cc:1081] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 LEADER]: Signalling peer 6c64624965ef4562abcea530986dd3ae to start an election
I20260709 12:13:18.373083 26014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c16e5dbed0b4c98988c91e5475f1946"
dest_uuid: "6c64624965ef4562abcea530986dd3ae"
 from {username='slave'} at 127.0.0.1:39064
I20260709 12:13:18.373579 26014 raft_consensus.cc:493] T 5c16e5dbed0b4c98988c91e5475f1946 P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:18.373934 26014 raft_consensus.cc:3060] T 5c16e5dbed0b4c98988c91e5475f1946 P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.379530 26014 raft_consensus.cc:515] T 5c16e5dbed0b4c98988c91e5475f1946 P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:18.381253 26014 leader_election.cc:290] T 5c16e5dbed0b4c98988c91e5475f1946 P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 2 election: Requested vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971)
I20260709 12:13:18.381984 25942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c16e5dbed0b4c98988c91e5475f1946" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
I20260709 12:13:18.382539 25942 raft_consensus.cc:3060] T 5c16e5dbed0b4c98988c91e5475f1946 P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.382984 26091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c16e5dbed0b4c98988c91e5475f1946" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
I20260709 12:13:18.383457 26091 raft_consensus.cc:3055] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:18.383680 26091 raft_consensus.cc:740] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f81d7b411a34e1e9ff80e6fcd7caf59, State: Running, Role: LEADER
I20260709 12:13:18.384276 26091 consensus_queue.cc:260] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:18.385108 26091 raft_consensus.cc:3060] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.387118 25942 raft_consensus.cc:2468] T 5c16e5dbed0b4c98988c91e5475f1946 P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c64624965ef4562abcea530986dd3ae in term 2.
I20260709 12:13:18.388108 25981 leader_election.cc:304] T 5c16e5dbed0b4c98988c91e5475f1946 P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c64624965ef4562abcea530986dd3ae, dd4a4845e5f94eec9578accbfafcb4d6; no voters: 
I20260709 12:13:18.388725 26287 raft_consensus.cc:2804] T 5c16e5dbed0b4c98988c91e5475f1946 P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:18.389135 26287 raft_consensus.cc:697] T 5c16e5dbed0b4c98988c91e5475f1946 P 6c64624965ef4562abcea530986dd3ae [term 2 LEADER]: Becoming Leader. State: Replica: 6c64624965ef4562abcea530986dd3ae, State: Running, Role: LEADER
I20260709 12:13:18.389225 26091 raft_consensus.cc:2468] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c64624965ef4562abcea530986dd3ae in term 2.
I20260709 12:13:18.389977 26287 consensus_queue.cc:237] T 5c16e5dbed0b4c98988c91e5475f1946 P 6c64624965ef4562abcea530986dd3ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:18.396762 25836 catalog_manager.cc:5697] T 5c16e5dbed0b4c98988c91e5475f1946 P 6c64624965ef4562abcea530986dd3ae reported cstate change: term changed from 1 to 2, leader changed from 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195) to 6c64624965ef4562abcea530986dd3ae (127.16.98.194). New cstate: current_term: 2 leader_uuid: "6c64624965ef4562abcea530986dd3ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:18.440613 26293 raft_consensus.cc:993] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59: : Instructing follower dd4a4845e5f94eec9578accbfafcb4d6 to start an election
I20260709 12:13:18.441221 26259 raft_consensus.cc:1081] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 LEADER]: Signalling peer dd4a4845e5f94eec9578accbfafcb4d6 to start an election
I20260709 12:13:18.442727 25942 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02fdc5e5e4e24f67b98f13312c916596"
dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
 from {username='slave'} at 127.0.0.1:49470
I20260709 12:13:18.443171 25942 raft_consensus.cc:493] T 02fdc5e5e4e24f67b98f13312c916596 P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:18.443421 25942 raft_consensus.cc:3060] T 02fdc5e5e4e24f67b98f13312c916596 P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.447798 25942 raft_consensus.cc:515] T 02fdc5e5e4e24f67b98f13312c916596 P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:18.450281 26017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fdc5e5e4e24f67b98f13312c916596" candidate_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c64624965ef4562abcea530986dd3ae"
I20260709 12:13:18.450587 26091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02fdc5e5e4e24f67b98f13312c916596" candidate_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
I20260709 12:13:18.450886 26017 raft_consensus.cc:3060] T 02fdc5e5e4e24f67b98f13312c916596 P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.451201 26091 raft_consensus.cc:3055] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:18.451388 25942 leader_election.cc:290] T 02fdc5e5e4e24f67b98f13312c916596 P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 2 election: Requested vote from peers 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419), 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971)
I20260709 12:13:18.452456 26328 raft_consensus.cc:993] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59: : Instructing follower 6c64624965ef4562abcea530986dd3ae to start an election
I20260709 12:13:18.451494 26091 raft_consensus.cc:740] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f81d7b411a34e1e9ff80e6fcd7caf59, State: Running, Role: LEADER
I20260709 12:13:18.453081 26328 raft_consensus.cc:1081] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 LEADER]: Signalling peer 6c64624965ef4562abcea530986dd3ae to start an election
I20260709 12:13:18.453724 26091 consensus_queue.cc:260] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:18.454917 26014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94628c0fec194ca3a8dde23bb75433fc"
dest_uuid: "6c64624965ef4562abcea530986dd3ae"
 from {username='slave'} at 127.0.0.1:39064
I20260709 12:13:18.455085 26091 raft_consensus.cc:3060] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.455498 26014 raft_consensus.cc:493] T 94628c0fec194ca3a8dde23bb75433fc P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:18.455891 26014 raft_consensus.cc:3060] T 94628c0fec194ca3a8dde23bb75433fc P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.458434 26017 raft_consensus.cc:2468] T 02fdc5e5e4e24f67b98f13312c916596 P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd4a4845e5f94eec9578accbfafcb4d6 in term 2.
I20260709 12:13:18.459630 25908 leader_election.cc:304] T 02fdc5e5e4e24f67b98f13312c916596 P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c64624965ef4562abcea530986dd3ae, dd4a4845e5f94eec9578accbfafcb4d6; no voters: 
I20260709 12:13:18.460382 26281 raft_consensus.cc:2804] T 02fdc5e5e4e24f67b98f13312c916596 P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:18.460843 26281 raft_consensus.cc:697] T 02fdc5e5e4e24f67b98f13312c916596 P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 LEADER]: Becoming Leader. State: Replica: dd4a4845e5f94eec9578accbfafcb4d6, State: Running, Role: LEADER
I20260709 12:13:18.461388 26091 raft_consensus.cc:2468] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd4a4845e5f94eec9578accbfafcb4d6 in term 2.
I20260709 12:13:18.461647 26281 consensus_queue.cc:237] T 02fdc5e5e4e24f67b98f13312c916596 P dd4a4845e5f94eec9578accbfafcb4d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:18.462349 26014 raft_consensus.cc:515] T 94628c0fec194ca3a8dde23bb75433fc P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:18.464252 26014 leader_election.cc:290] T 94628c0fec194ca3a8dde23bb75433fc P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 2 election: Requested vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971)
I20260709 12:13:18.464884 25942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94628c0fec194ca3a8dde23bb75433fc" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
I20260709 12:13:18.465359 25942 raft_consensus.cc:3060] T 94628c0fec194ca3a8dde23bb75433fc P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.465673 26091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94628c0fec194ca3a8dde23bb75433fc" candidate_uuid: "6c64624965ef4562abcea530986dd3ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
I20260709 12:13:18.466233 26091 raft_consensus.cc:3055] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:18.466526 26091 raft_consensus.cc:740] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f81d7b411a34e1e9ff80e6fcd7caf59, State: Running, Role: LEADER
I20260709 12:13:18.467327 26091 consensus_queue.cc:260] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:18.468392 26091 raft_consensus.cc:3060] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.470888 25836 catalog_manager.cc:5697] T 02fdc5e5e4e24f67b98f13312c916596 P dd4a4845e5f94eec9578accbfafcb4d6 reported cstate change: term changed from 1 to 2, leader changed from 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195) to dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:18.471966 25942 raft_consensus.cc:2468] T 94628c0fec194ca3a8dde23bb75433fc P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c64624965ef4562abcea530986dd3ae in term 2.
I20260709 12:13:18.473060 25981 leader_election.cc:304] T 94628c0fec194ca3a8dde23bb75433fc P 6c64624965ef4562abcea530986dd3ae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c64624965ef4562abcea530986dd3ae, dd4a4845e5f94eec9578accbfafcb4d6; no voters: 
I20260709 12:13:18.473845 26287 raft_consensus.cc:2804] T 94628c0fec194ca3a8dde23bb75433fc P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:18.474457 26259 raft_consensus.cc:993] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59: : Instructing follower dd4a4845e5f94eec9578accbfafcb4d6 to start an election
I20260709 12:13:18.474731 26091 raft_consensus.cc:2468] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c64624965ef4562abcea530986dd3ae in term 2.
I20260709 12:13:18.474970 26259 raft_consensus.cc:1081] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 LEADER]: Signalling peer dd4a4845e5f94eec9578accbfafcb4d6 to start an election
I20260709 12:13:18.474504 26287 raft_consensus.cc:697] T 94628c0fec194ca3a8dde23bb75433fc P 6c64624965ef4562abcea530986dd3ae [term 2 LEADER]: Becoming Leader. State: Replica: 6c64624965ef4562abcea530986dd3ae, State: Running, Role: LEADER
I20260709 12:13:18.476696 25942 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d02a838011d445a593c78c10943c6038"
dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
 from {username='slave'} at 127.0.0.1:49470
I20260709 12:13:18.476533 26287 consensus_queue.cc:237] T 94628c0fec194ca3a8dde23bb75433fc P 6c64624965ef4562abcea530986dd3ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:18.477193 25942 raft_consensus.cc:493] T d02a838011d445a593c78c10943c6038 P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:18.477545 25942 raft_consensus.cc:3060] T d02a838011d445a593c78c10943c6038 P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.483304 25942 raft_consensus.cc:515] T d02a838011d445a593c78c10943c6038 P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:18.484689 25942 leader_election.cc:290] T d02a838011d445a593c78c10943c6038 P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 2 election: Requested vote from peers 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419), 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195:37971)
I20260709 12:13:18.484717 25836 catalog_manager.cc:5697] T 94628c0fec194ca3a8dde23bb75433fc P 6c64624965ef4562abcea530986dd3ae reported cstate change: term changed from 1 to 2, leader changed from 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195) to 6c64624965ef4562abcea530986dd3ae (127.16.98.194). New cstate: current_term: 2 leader_uuid: "6c64624965ef4562abcea530986dd3ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:18.485422 26014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02a838011d445a593c78c10943c6038" candidate_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c64624965ef4562abcea530986dd3ae"
I20260709 12:13:18.485615 26091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d02a838011d445a593c78c10943c6038" candidate_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
I20260709 12:13:18.486060 26014 raft_consensus.cc:3060] T d02a838011d445a593c78c10943c6038 P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.486249 26091 raft_consensus.cc:3055] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:18.486606 26091 raft_consensus.cc:740] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5f81d7b411a34e1e9ff80e6fcd7caf59, State: Running, Role: LEADER
I20260709 12:13:18.487576 26091 consensus_queue.cc:260] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:18.488730 26091 raft_consensus.cc:3060] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:18.490713 26014 raft_consensus.cc:2468] T d02a838011d445a593c78c10943c6038 P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd4a4845e5f94eec9578accbfafcb4d6 in term 2.
I20260709 12:13:18.491694 25908 leader_election.cc:304] T d02a838011d445a593c78c10943c6038 P dd4a4845e5f94eec9578accbfafcb4d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c64624965ef4562abcea530986dd3ae, dd4a4845e5f94eec9578accbfafcb4d6; no voters: 
I20260709 12:13:18.492362 26281 raft_consensus.cc:2804] T d02a838011d445a593c78c10943c6038 P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:18.492877 26281 raft_consensus.cc:697] T d02a838011d445a593c78c10943c6038 P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 LEADER]: Becoming Leader. State: Replica: dd4a4845e5f94eec9578accbfafcb4d6, State: Running, Role: LEADER
I20260709 12:13:18.493719 26281 consensus_queue.cc:237] T d02a838011d445a593c78c10943c6038 P dd4a4845e5f94eec9578accbfafcb4d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:18.494863 26091 raft_consensus.cc:2468] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd4a4845e5f94eec9578accbfafcb4d6 in term 2.
I20260709 12:13:18.500072 25836 catalog_manager.cc:5697] T d02a838011d445a593c78c10943c6038 P dd4a4845e5f94eec9578accbfafcb4d6 reported cstate change: term changed from 1 to 2, leader changed from 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195) to dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193). New cstate: current_term: 2 leader_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } health_report { overall_health: UNKNOWN } } }
I20260709 12:13:18.707353 26091 raft_consensus.cc:1275] T e3ae8cd984b945fd9d10fc3eda704a3f P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Refusing update from remote peer dd4a4845e5f94eec9578accbfafcb4d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:18.708724 26281 consensus_queue.cc:1048] T e3ae8cd984b945fd9d10fc3eda704a3f P dd4a4845e5f94eec9578accbfafcb4d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:18.717202 26014 raft_consensus.cc:1275] T e3ae8cd984b945fd9d10fc3eda704a3f P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Refusing update from remote peer dd4a4845e5f94eec9578accbfafcb4d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:18.719502 26280 consensus_queue.cc:1048] T e3ae8cd984b945fd9d10fc3eda704a3f P dd4a4845e5f94eec9578accbfafcb4d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:18.727840 26014 raft_consensus.cc:1275] T 9b58bf7d2f584791ab4cd02832978173 P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Refusing update from remote peer dd4a4845e5f94eec9578accbfafcb4d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:18.729001 26280 consensus_queue.cc:1048] T 9b58bf7d2f584791ab4cd02832978173 P dd4a4845e5f94eec9578accbfafcb4d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:18.737810 26089 raft_consensus.cc:1275] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Refusing update from remote peer dd4a4845e5f94eec9578accbfafcb4d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:18.739087 26280 consensus_queue.cc:1048] T 9b58bf7d2f584791ab4cd02832978173 P dd4a4845e5f94eec9578accbfafcb4d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:18.813781 25942 raft_consensus.cc:1275] T baab9174e4d542069954eb94db182f0c P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Refusing update from remote peer 5f81d7b411a34e1e9ff80e6fcd7caf59: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:18.815030 26259 consensus_queue.cc:1048] T baab9174e4d542069954eb94db182f0c P 5f81d7b411a34e1e9ff80e6fcd7caf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:18.824492 26014 raft_consensus.cc:1275] T baab9174e4d542069954eb94db182f0c P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Refusing update from remote peer 5f81d7b411a34e1e9ff80e6fcd7caf59: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:18.826035 26293 consensus_queue.cc:1048] T baab9174e4d542069954eb94db182f0c P 5f81d7b411a34e1e9ff80e6fcd7caf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:18.866266 26091 raft_consensus.cc:1275] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Refusing update from remote peer 6c64624965ef4562abcea530986dd3ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:18.867338 26287 consensus_queue.cc:1048] T 5c16e5dbed0b4c98988c91e5475f1946 P 6c64624965ef4562abcea530986dd3ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:18.874399 25942 raft_consensus.cc:1275] T 5c16e5dbed0b4c98988c91e5475f1946 P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Refusing update from remote peer 6c64624965ef4562abcea530986dd3ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:18.876026 26260 consensus_queue.cc:1048] T 5c16e5dbed0b4c98988c91e5475f1946 P 6c64624965ef4562abcea530986dd3ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:18.893589 25942 raft_consensus.cc:1275] T 94628c0fec194ca3a8dde23bb75433fc P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Refusing update from remote peer 6c64624965ef4562abcea530986dd3ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:18.894734 26322 consensus_queue.cc:1048] T 94628c0fec194ca3a8dde23bb75433fc P 6c64624965ef4562abcea530986dd3ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:18.902812 26091 raft_consensus.cc:1275] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Refusing update from remote peer 6c64624965ef4562abcea530986dd3ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:18.904883 26322 consensus_queue.cc:1048] T 94628c0fec194ca3a8dde23bb75433fc P 6c64624965ef4562abcea530986dd3ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:18.941815 26014 raft_consensus.cc:1275] T 02fdc5e5e4e24f67b98f13312c916596 P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Refusing update from remote peer dd4a4845e5f94eec9578accbfafcb4d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:18.943153 26245 consensus_queue.cc:1048] T 02fdc5e5e4e24f67b98f13312c916596 P dd4a4845e5f94eec9578accbfafcb4d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:18.951860 26091 raft_consensus.cc:1275] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Refusing update from remote peer dd4a4845e5f94eec9578accbfafcb4d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:18.953168 26280 consensus_queue.cc:1048] T 02fdc5e5e4e24f67b98f13312c916596 P dd4a4845e5f94eec9578accbfafcb4d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:19.031782 26091 raft_consensus.cc:1275] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Refusing update from remote peer dd4a4845e5f94eec9578accbfafcb4d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:19.032963 26280 consensus_queue.cc:1048] T d02a838011d445a593c78c10943c6038 P dd4a4845e5f94eec9578accbfafcb4d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:19.040823 26014 raft_consensus.cc:1275] T d02a838011d445a593c78c10943c6038 P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Refusing update from remote peer dd4a4845e5f94eec9578accbfafcb4d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:19.043248 26280 consensus_queue.cc:1048] T d02a838011d445a593c78c10943c6038 P dd4a4845e5f94eec9578accbfafcb4d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:20.977447 25836 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58024:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:13:20.997736 25836 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58024:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:13:21.028036 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:13:21.135316 26377 log.cc:927] Time spent T e3ae8cd984b945fd9d10fc3eda704a3f P dd4a4845e5f94eec9578accbfafcb4d6: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:13:21.285037 26409 tablet.cc:1724] T 02fdc5e5e4e24f67b98f13312c916596 P dd4a4845e5f94eec9578accbfafcb4d6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:21.284164 25938 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a8ed0809b1d49efbe69bc68167edfba"
dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
mode: GRACEFUL
new_leader_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
 from {username='slave'} at 127.0.0.1:41466
I20260709 12:13:21.317570 26414 tablet.cc:1724] T a5c01777e5be4afcab9c09c4b00ad324 P 6c64624965ef4562abcea530986dd3ae: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:21.319227 26417 tablet.cc:1724] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:21.322865 25938 raft_consensus.cc:606] T 8a8ed0809b1d49efbe69bc68167edfba P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 LEADER]: Received request to transfer leadership to TS 5f81d7b411a34e1e9ff80e6fcd7caf59
I20260709 12:13:21.329824 26412 tablet.cc:1724] T a5c01777e5be4afcab9c09c4b00ad324 P dd4a4845e5f94eec9578accbfafcb4d6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:21.347546 26416 tablet.cc:1724] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:21.351500 26421 tablet.cc:1724] T 94628c0fec194ca3a8dde23bb75433fc P 6c64624965ef4562abcea530986dd3ae: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:21.286501 26406 tablet.cc:1724] T e3ae8cd984b945fd9d10fc3eda704a3f P dd4a4845e5f94eec9578accbfafcb4d6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:13:21.377962 26410 log.cc:927] Time spent T 9b58bf7d2f584791ab4cd02832978173 P 6c64624965ef4562abcea530986dd3ae: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 12:13:21.393275 26404 log.cc:927] Time spent T e3ae8cd984b945fd9d10fc3eda704a3f P 6c64624965ef4562abcea530986dd3ae: Append to log took a long time: real 0.134s	user 0.000s	sys 0.002s
I20260709 12:13:21.408627 26422 tablet.cc:1724] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:13:21.410177 26402 log.cc:927] Time spent T 94628c0fec194ca3a8dde23bb75433fc P dd4a4845e5f94eec9578accbfafcb4d6: Append to log took a long time: real 0.150s	user 0.000s	sys 0.002s
I20260709 12:13:21.444075 26423 tablet.cc:1724] T e3ae8cd984b945fd9d10fc3eda704a3f P 5f81d7b411a34e1e9ff80e6fcd7caf59: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:21.446391 26426 tablet.cc:1724] T 5c16e5dbed0b4c98988c91e5475f1946 P 6c64624965ef4562abcea530986dd3ae: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:21.450071 26419 tablet.cc:1724] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 6c64624965ef4562abcea530986dd3ae: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:21.466197 26412 tablet.cc:1724] T 9b58bf7d2f584791ab4cd02832978173 P dd4a4845e5f94eec9578accbfafcb4d6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:21.468684 26409 tablet.cc:1724] T baab9174e4d542069954eb94db182f0c P dd4a4845e5f94eec9578accbfafcb4d6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:21.472697 26417 tablet.cc:1724] T baab9174e4d542069954eb94db182f0c P 5f81d7b411a34e1e9ff80e6fcd7caf59: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:21.480620 26357 raft_consensus.cc:993] T 8a8ed0809b1d49efbe69bc68167edfba P dd4a4845e5f94eec9578accbfafcb4d6: : Instructing follower 5f81d7b411a34e1e9ff80e6fcd7caf59 to start an election
I20260709 12:13:21.481135 26357 raft_consensus.cc:1081] T 8a8ed0809b1d49efbe69bc68167edfba P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 LEADER]: Signalling peer 5f81d7b411a34e1e9ff80e6fcd7caf59 to start an election
I20260709 12:13:21.483596 26424 tablet.cc:1724] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P dd4a4845e5f94eec9578accbfafcb4d6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:21.489789 26406 tablet.cc:1724] T 5c16e5dbed0b4c98988c91e5475f1946 P dd4a4845e5f94eec9578accbfafcb4d6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:21.493366 26087 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a8ed0809b1d49efbe69bc68167edfba"
dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
 from {username='slave'} at 127.0.0.1:34296
I20260709 12:13:21.494036 26087 raft_consensus.cc:493] T 8a8ed0809b1d49efbe69bc68167edfba P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:21.494477 26087 raft_consensus.cc:3060] T 8a8ed0809b1d49efbe69bc68167edfba P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.476359 26422 tablet.cc:1724] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:21.510929 25836 catalog_manager.cc:5789] TS dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015) does not have the latest schema for tablet d02a838011d445a593c78c10943c6038 (table soft_deleted_table [id=6e461bac081a4fe2a308b0759f9a1a1d]). Expected version 1 got 0
I20260709 12:13:21.517181 26416 tablet.cc:1724] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:21.523885 26423 tablet.cc:1724] T a5c01777e5be4afcab9c09c4b00ad324 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:21.524385 26419 tablet.cc:1724] T 9b58bf7d2f584791ab4cd02832978173 P 6c64624965ef4562abcea530986dd3ae: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:21.527033 26421 tablet.cc:1724] T e3ae8cd984b945fd9d10fc3eda704a3f P 6c64624965ef4562abcea530986dd3ae: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:21.486521 26414 tablet.cc:1724] T 02fdc5e5e4e24f67b98f13312c916596 P 6c64624965ef4562abcea530986dd3ae: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:21.500818 26409 tablet.cc:1724] T d02a838011d445a593c78c10943c6038 P dd4a4845e5f94eec9578accbfafcb4d6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:21.529615 26087 raft_consensus.cc:515] T 8a8ed0809b1d49efbe69bc68167edfba P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:21.547397 26087 leader_election.cc:290] T 8a8ed0809b1d49efbe69bc68167edfba P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 2 election: Requested vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
I20260709 12:13:21.548555 26013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8ed0809b1d49efbe69bc68167edfba" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c64624965ef4562abcea530986dd3ae"
I20260709 12:13:21.549005 25940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a8ed0809b1d49efbe69bc68167edfba" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
I20260709 12:13:21.549309 26013 raft_consensus.cc:3060] T 8a8ed0809b1d49efbe69bc68167edfba P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.549678 25940 raft_consensus.cc:3055] T 8a8ed0809b1d49efbe69bc68167edfba P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:13:21.550006 25940 raft_consensus.cc:740] T 8a8ed0809b1d49efbe69bc68167edfba P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dd4a4845e5f94eec9578accbfafcb4d6, State: Running, Role: LEADER
I20260709 12:13:21.550796 25940 consensus_queue.cc:260] T 8a8ed0809b1d49efbe69bc68167edfba P dd4a4845e5f94eec9578accbfafcb4d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:21.551901 25940 raft_consensus.cc:3060] T 8a8ed0809b1d49efbe69bc68167edfba P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:13:21.549047 26015 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f067007d0f714d73af016a85a9da6785"
dest_uuid: "6c64624965ef4562abcea530986dd3ae"
mode: GRACEFUL
new_leader_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
 from {username='slave'} at 127.0.0.1:55192
I20260709 12:13:21.555270 26015 raft_consensus.cc:606] T f067007d0f714d73af016a85a9da6785 P 6c64624965ef4562abcea530986dd3ae [term 2 LEADER]: Received request to transfer leadership to TS 5f81d7b411a34e1e9ff80e6fcd7caf59
I20260709 12:13:21.556732 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:13:21.557386 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:21.557961 26013 raft_consensus.cc:2468] T 8a8ed0809b1d49efbe69bc68167edfba P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 2.
I20260709 12:13:21.559347 26057 leader_election.cc:304] T 8a8ed0809b1d49efbe69bc68167edfba P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, 6c64624965ef4562abcea530986dd3ae; no voters: 
I20260709 12:13:21.560290 26391 raft_consensus.cc:2804] T 8a8ed0809b1d49efbe69bc68167edfba P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:13:21.560777 26391 raft_consensus.cc:697] T 8a8ed0809b1d49efbe69bc68167edfba P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 LEADER]: Becoming Leader. State: Replica: 5f81d7b411a34e1e9ff80e6fcd7caf59, State: Running, Role: LEADER
I20260709 12:13:21.561137 25940 raft_consensus.cc:2468] T 8a8ed0809b1d49efbe69bc68167edfba P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 2.
I20260709 12:13:21.561669 26391 consensus_queue.cc:237] T 8a8ed0809b1d49efbe69bc68167edfba P 5f81d7b411a34e1e9ff80e6fcd7caf59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:21.557993 26419 tablet.cc:1724] T d02a838011d445a593c78c10943c6038 P 6c64624965ef4562abcea530986dd3ae: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:21.567428 26423 tablet.cc:1724] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:21.569828 26421 tablet.cc:1724] T baab9174e4d542069954eb94db182f0c P 6c64624965ef4562abcea530986dd3ae: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:21.532266 26424 tablet.cc:1724] T 94628c0fec194ca3a8dde23bb75433fc P dd4a4845e5f94eec9578accbfafcb4d6: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:13:21.599715 25839 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 81391cf9513c4c26ba7f862909533651: soft_deleted_table [id=6e461bac081a4fe2a308b0759f9a1a1d] alter complete (version 1)
I20260709 12:13:21.611766 25836 catalog_manager.cc:5697] T 8a8ed0809b1d49efbe69bc68167edfba P 5f81d7b411a34e1e9ff80e6fcd7caf59 reported cstate change: term changed from 1 to 2, leader changed from dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193) to 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195). New cstate: current_term: 2 leader_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:21.823429 26395 raft_consensus.cc:993] T f067007d0f714d73af016a85a9da6785 P 6c64624965ef4562abcea530986dd3ae: : Instructing follower 5f81d7b411a34e1e9ff80e6fcd7caf59 to start an election
I20260709 12:13:21.823971 26390 raft_consensus.cc:1081] T f067007d0f714d73af016a85a9da6785 P 6c64624965ef4562abcea530986dd3ae [term 2 LEADER]: Signalling peer 5f81d7b411a34e1e9ff80e6fcd7caf59 to start an election
I20260709 12:13:21.825321 26087 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f067007d0f714d73af016a85a9da6785"
dest_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59"
 from {username='slave'} at 127.0.0.1:34284
I20260709 12:13:21.825754 26087 raft_consensus.cc:493] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:13:21.826006 26087 raft_consensus.cc:3060] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:21.830770 26087 raft_consensus.cc:515] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:21.832268 26087 leader_election.cc:290] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 3 election: Requested vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
I20260709 12:13:21.833055 25940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f067007d0f714d73af016a85a9da6785" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dd4a4845e5f94eec9578accbfafcb4d6"
I20260709 12:13:21.833527 26016 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f067007d0f714d73af016a85a9da6785" candidate_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6c64624965ef4562abcea530986dd3ae"
I20260709 12:13:21.833920 25940 raft_consensus.cc:3060] T f067007d0f714d73af016a85a9da6785 P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:21.834187 26016 raft_consensus.cc:3055] T f067007d0f714d73af016a85a9da6785 P 6c64624965ef4562abcea530986dd3ae [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:13:21.834515 26016 raft_consensus.cc:740] T f067007d0f714d73af016a85a9da6785 P 6c64624965ef4562abcea530986dd3ae [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6c64624965ef4562abcea530986dd3ae, State: Running, Role: LEADER
I20260709 12:13:21.835369 26016 consensus_queue.cc:260] T f067007d0f714d73af016a85a9da6785 P 6c64624965ef4562abcea530986dd3ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:21.836597 26016 raft_consensus.cc:3060] T f067007d0f714d73af016a85a9da6785 P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:13:21.841100 25940 raft_consensus.cc:2468] T f067007d0f714d73af016a85a9da6785 P dd4a4845e5f94eec9578accbfafcb4d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 3.
I20260709 12:13:21.842342 26055 leader_election.cc:304] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59, dd4a4845e5f94eec9578accbfafcb4d6; no voters: 
I20260709 12:13:21.843112 26391 raft_consensus.cc:2804] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:13:21.843494 26016 raft_consensus.cc:2468] T f067007d0f714d73af016a85a9da6785 P 6c64624965ef4562abcea530986dd3ae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f81d7b411a34e1e9ff80e6fcd7caf59 in term 3.
I20260709 12:13:21.843546 26391 raft_consensus.cc:697] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 3 LEADER]: Becoming Leader. State: Replica: 5f81d7b411a34e1e9ff80e6fcd7caf59, State: Running, Role: LEADER
I20260709 12:13:21.844558 26391 consensus_queue.cc:237] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:21.852224 25839 catalog_manager.cc:5697] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 reported cstate change: term changed from 2 to 3, leader changed from 6c64624965ef4562abcea530986dd3ae (127.16.98.194) to 5f81d7b411a34e1e9ff80e6fcd7caf59 (127.16.98.195). New cstate: current_term: 3 leader_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } health_report { overall_health: HEALTHY } } }
I20260709 12:13:22.115976 25940 raft_consensus.cc:1275] T 8a8ed0809b1d49efbe69bc68167edfba P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Refusing update from remote peer 5f81d7b411a34e1e9ff80e6fcd7caf59: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:22.117201 26391 consensus_queue.cc:1048] T 8a8ed0809b1d49efbe69bc68167edfba P 5f81d7b411a34e1e9ff80e6fcd7caf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:22.126339 26016 raft_consensus.cc:1275] T 8a8ed0809b1d49efbe69bc68167edfba P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Refusing update from remote peer 5f81d7b411a34e1e9ff80e6fcd7caf59: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:13:22.128289 26437 consensus_queue.cc:1048] T 8a8ed0809b1d49efbe69bc68167edfba P 5f81d7b411a34e1e9ff80e6fcd7caf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:13:22.373488 25940 raft_consensus.cc:1275] T f067007d0f714d73af016a85a9da6785 P dd4a4845e5f94eec9578accbfafcb4d6 [term 3 FOLLOWER]: Refusing update from remote peer 5f81d7b411a34e1e9ff80e6fcd7caf59: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:22.374872 26437 consensus_queue.cc:1048] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:22.377363 26016 raft_consensus.cc:1275] T f067007d0f714d73af016a85a9da6785 P 6c64624965ef4562abcea530986dd3ae [term 3 FOLLOWER]: Refusing update from remote peer 5f81d7b411a34e1e9ff80e6fcd7caf59: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:13:22.379508 26437 consensus_queue.cc:1048] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:13:22.558388 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:22.564611 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:22.564970 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:23.566047 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:23.574263 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:23.574748 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:24.575803 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:24.580824 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:24.581192 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:25.582080 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:25.587036 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:25.587395 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:26.588310 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:26.593195 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:26.593565 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:27.594424 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:27.599274 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:27.599747 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:28.600831 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:28.606041 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:28.606482 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:29.607403 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:29.612831 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:29.613279 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:13:31.088572 16779 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:13:31.093621 16779 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:13:31.094049 16779 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:13:31.393330 26038 debug-util.cc:398] Leaking SignalData structure 0x7b0800173220 after lost signal to thread 16782
W20260709 12:13:31.394568 26038 debug-util.cc:398] Leaking SignalData structure 0x7b0800199ac0 after lost signal to thread 25874
W20260709 12:13:31.395931 26038 debug-util.cc:398] Leaking SignalData structure 0x7b0800243280 after lost signal to thread 25966
W20260709 12:13:31.396961 26038 debug-util.cc:398] Leaking SignalData structure 0x7b0800162340 after lost signal to thread 26041
W20260709 12:13:31.397840 26038 debug-util.cc:398] Leaking SignalData structure 0x7b0800320c00 after lost signal to thread 26115
I20260709 12:13:32.159525 16779 tablet_server.cc:179] TabletServer@127.16.98.193:0 shutting down...
I20260709 12:13:32.213433 16779 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:32.214354 16779 tablet_replica.cc:333] T a5c01777e5be4afcab9c09c4b00ad324 P dd4a4845e5f94eec9578accbfafcb4d6: stopping tablet replica
I20260709 12:13:32.215754 16779 raft_consensus.cc:2243] T a5c01777e5be4afcab9c09c4b00ad324 P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:32.216675 16779 raft_consensus.cc:2272] T a5c01777e5be4afcab9c09c4b00ad324 P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:32.219506 16779 tablet_replica.cc:333] T 5c16e5dbed0b4c98988c91e5475f1946 P dd4a4845e5f94eec9578accbfafcb4d6: stopping tablet replica
I20260709 12:13:32.220235 16779 raft_consensus.cc:2243] T 5c16e5dbed0b4c98988c91e5475f1946 P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:32.220866 16779 raft_consensus.cc:2272] T 5c16e5dbed0b4c98988c91e5475f1946 P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:32.224102 16779 tablet_replica.cc:333] T d02a838011d445a593c78c10943c6038 P dd4a4845e5f94eec9578accbfafcb4d6: stopping tablet replica
I20260709 12:13:32.225162 16779 raft_consensus.cc:2243] T d02a838011d445a593c78c10943c6038 P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:32.226593 16779 raft_consensus.cc:2272] T d02a838011d445a593c78c10943c6038 P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:32.230581 16779 tablet_replica.cc:333] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P dd4a4845e5f94eec9578accbfafcb4d6: stopping tablet replica
I20260709 12:13:32.231551 16779 raft_consensus.cc:2243] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:32.232285 16779 raft_consensus.cc:2272] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:32.235728 16779 tablet_replica.cc:333] T baab9174e4d542069954eb94db182f0c P dd4a4845e5f94eec9578accbfafcb4d6: stopping tablet replica
I20260709 12:13:32.236529 16779 raft_consensus.cc:2243] T baab9174e4d542069954eb94db182f0c P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:32.237264 16779 raft_consensus.cc:2272] T baab9174e4d542069954eb94db182f0c P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:32.240518 16779 tablet_replica.cc:333] T 94628c0fec194ca3a8dde23bb75433fc P dd4a4845e5f94eec9578accbfafcb4d6: stopping tablet replica
I20260709 12:13:32.241366 16779 raft_consensus.cc:2243] T 94628c0fec194ca3a8dde23bb75433fc P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:32.242131 16779 raft_consensus.cc:2272] T 94628c0fec194ca3a8dde23bb75433fc P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:32.244921 16779 tablet_replica.cc:333] T e3ae8cd984b945fd9d10fc3eda704a3f P dd4a4845e5f94eec9578accbfafcb4d6: stopping tablet replica
I20260709 12:13:32.245556 16779 raft_consensus.cc:2243] T e3ae8cd984b945fd9d10fc3eda704a3f P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:32.246491 16779 raft_consensus.cc:2272] T e3ae8cd984b945fd9d10fc3eda704a3f P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:32.249416 16779 tablet_replica.cc:333] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6: stopping tablet replica
I20260709 12:13:32.249941 16779 raft_consensus.cc:2243] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:32.250974 16779 raft_consensus.cc:2272] T b5e1998d449245b483308f4b257c0452 P dd4a4845e5f94eec9578accbfafcb4d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:32.253669 16779 tablet_replica.cc:333] T 9b58bf7d2f584791ab4cd02832978173 P dd4a4845e5f94eec9578accbfafcb4d6: stopping tablet replica
I20260709 12:13:32.254340 16779 raft_consensus.cc:2243] T 9b58bf7d2f584791ab4cd02832978173 P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:32.255291 16779 raft_consensus.cc:2272] T 9b58bf7d2f584791ab4cd02832978173 P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:32.257974 16779 tablet_replica.cc:333] T c5d45aab99914708a3d777f6468b84aa P dd4a4845e5f94eec9578accbfafcb4d6: stopping tablet replica
I20260709 12:13:32.258594 16779 raft_consensus.cc:2243] T c5d45aab99914708a3d777f6468b84aa P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:32.259208 16779 raft_consensus.cc:2272] T c5d45aab99914708a3d777f6468b84aa P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:32.261937 16779 tablet_replica.cc:333] T 796c3f24ad0843f18759a0c487728078 P dd4a4845e5f94eec9578accbfafcb4d6: stopping tablet replica
I20260709 12:13:32.262552 16779 raft_consensus.cc:2243] T 796c3f24ad0843f18759a0c487728078 P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:32.263530 16779 raft_consensus.cc:2272] T 796c3f24ad0843f18759a0c487728078 P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:32.266029 16779 tablet_replica.cc:333] T 02fdc5e5e4e24f67b98f13312c916596 P dd4a4845e5f94eec9578accbfafcb4d6: stopping tablet replica
I20260709 12:13:32.266602 16779 raft_consensus.cc:2243] T 02fdc5e5e4e24f67b98f13312c916596 P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:32.267663 16779 raft_consensus.cc:2272] T 02fdc5e5e4e24f67b98f13312c916596 P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:32.270527 16779 tablet_replica.cc:333] T 4c26d5a58e504dfa8a8c0edeadcd5976 P dd4a4845e5f94eec9578accbfafcb4d6: stopping tablet replica
I20260709 12:13:32.271092 16779 raft_consensus.cc:2243] T 4c26d5a58e504dfa8a8c0edeadcd5976 P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:32.271692 16779 raft_consensus.cc:2272] T 4c26d5a58e504dfa8a8c0edeadcd5976 P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:32.274145 16779 tablet_replica.cc:333] T ee94f3771d884f83a218d2cee1dba3d0 P dd4a4845e5f94eec9578accbfafcb4d6: stopping tablet replica
I20260709 12:13:32.274799 16779 raft_consensus.cc:2243] T ee94f3771d884f83a218d2cee1dba3d0 P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:32.275368 16779 raft_consensus.cc:2272] T ee94f3771d884f83a218d2cee1dba3d0 P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:32.277778 16779 tablet_replica.cc:333] T a43feb33ed3f4ed984eb21f31f81f88b P dd4a4845e5f94eec9578accbfafcb4d6: stopping tablet replica
I20260709 12:13:32.278326 16779 raft_consensus.cc:2243] T a43feb33ed3f4ed984eb21f31f81f88b P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:32.278914 16779 raft_consensus.cc:2272] T a43feb33ed3f4ed984eb21f31f81f88b P dd4a4845e5f94eec9578accbfafcb4d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:32.281404 16779 tablet_replica.cc:333] T 8a8ed0809b1d49efbe69bc68167edfba P dd4a4845e5f94eec9578accbfafcb4d6: stopping tablet replica
I20260709 12:13:32.281992 16779 raft_consensus.cc:2243] T 8a8ed0809b1d49efbe69bc68167edfba P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:32.282507 16779 raft_consensus.cc:2272] T 8a8ed0809b1d49efbe69bc68167edfba P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:32.285004 16779 tablet_replica.cc:333] T 8474f54272164d4f84cb19d5844442af P dd4a4845e5f94eec9578accbfafcb4d6: stopping tablet replica
I20260709 12:13:32.285588 16779 raft_consensus.cc:2243] T 8474f54272164d4f84cb19d5844442af P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:32.286549 16779 raft_consensus.cc:2272] T 8474f54272164d4f84cb19d5844442af P dd4a4845e5f94eec9578accbfafcb4d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:32.289142 16779 tablet_replica.cc:333] T f067007d0f714d73af016a85a9da6785 P dd4a4845e5f94eec9578accbfafcb4d6: stopping tablet replica
I20260709 12:13:32.290127 16779 raft_consensus.cc:2243] T f067007d0f714d73af016a85a9da6785 P dd4a4845e5f94eec9578accbfafcb4d6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:32.290887 16779 raft_consensus.cc:2272] T f067007d0f714d73af016a85a9da6785 P dd4a4845e5f94eec9578accbfafcb4d6 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:32.324899 26055 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 7 similar messages]
W20260709 12:13:32.329718 26055 consensus_peers.cc:597] T c5d45aab99914708a3d777f6468b84aa P 5f81d7b411a34e1e9ff80e6fcd7caf59 -> Peer dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015): Couldn't send request to peer dd4a4845e5f94eec9578accbfafcb4d6. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:32.333171 16779 tablet_server.cc:196] TabletServer@127.16.98.193:0 shutdown complete.
W20260709 12:13:32.369287 25981 consensus_peers.cc:597] T 5c16e5dbed0b4c98988c91e5475f1946 P 6c64624965ef4562abcea530986dd3ae -> Peer dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015): Couldn't send request to peer dd4a4845e5f94eec9578accbfafcb4d6. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:44015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:32.374102 25981 consensus_peers.cc:597] T 94628c0fec194ca3a8dde23bb75433fc P 6c64624965ef4562abcea530986dd3ae -> Peer dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015): Couldn't send request to peer dd4a4845e5f94eec9578accbfafcb4d6. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:44015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:32.377163 25981 consensus_peers.cc:597] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 6c64624965ef4562abcea530986dd3ae -> Peer dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015): Couldn't send request to peer dd4a4845e5f94eec9578accbfafcb4d6. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:44015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:32.380076 26055 consensus_peers.cc:597] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 -> Peer dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015): Couldn't send request to peer dd4a4845e5f94eec9578accbfafcb4d6. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:44015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:32.396476 16779 tablet_server.cc:179] TabletServer@127.16.98.194:0 shutting down...
W20260709 12:13:32.411610 25981 consensus_peers.cc:597] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 6c64624965ef4562abcea530986dd3ae -> Peer dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015): Couldn't send request to peer dd4a4845e5f94eec9578accbfafcb4d6. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:44015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:32.419590 26055 consensus_peers.cc:597] T baab9174e4d542069954eb94db182f0c P 5f81d7b411a34e1e9ff80e6fcd7caf59 -> Peer dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015): Couldn't send request to peer dd4a4845e5f94eec9578accbfafcb4d6. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:44015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:32.425566 26055 consensus_peers.cc:597] T 8a8ed0809b1d49efbe69bc68167edfba P 5f81d7b411a34e1e9ff80e6fcd7caf59 -> Peer dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015): Couldn't send request to peer dd4a4845e5f94eec9578accbfafcb4d6. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:44015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:32.441892 16779 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:32.442888 16779 tablet_replica.cc:333] T 5c16e5dbed0b4c98988c91e5475f1946 P 6c64624965ef4562abcea530986dd3ae: stopping tablet replica
I20260709 12:13:32.443828 16779 raft_consensus.cc:2243] T 5c16e5dbed0b4c98988c91e5475f1946 P 6c64624965ef4562abcea530986dd3ae [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:32.444797 16779 raft_consensus.cc:2272] T 5c16e5dbed0b4c98988c91e5475f1946 P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:32.447744 16779 tablet_replica.cc:333] T d02a838011d445a593c78c10943c6038 P 6c64624965ef4562abcea530986dd3ae: stopping tablet replica
I20260709 12:13:32.448722 16779 raft_consensus.cc:2243] T d02a838011d445a593c78c10943c6038 P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:32.449318 16779 raft_consensus.cc:2272] T d02a838011d445a593c78c10943c6038 P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:32.452219 16779 tablet_replica.cc:333] T baab9174e4d542069954eb94db182f0c P 6c64624965ef4562abcea530986dd3ae: stopping tablet replica
I20260709 12:13:32.452876 16779 raft_consensus.cc:2243] T baab9174e4d542069954eb94db182f0c P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:32.453471 16779 raft_consensus.cc:2272] T baab9174e4d542069954eb94db182f0c P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:32.455832 16779 tablet_replica.cc:333] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 6c64624965ef4562abcea530986dd3ae: stopping tablet replica
I20260709 12:13:32.456560 16779 raft_consensus.cc:2243] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 6c64624965ef4562abcea530986dd3ae [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:32.457407 16779 raft_consensus.cc:2272] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:32.460246 16779 tablet_replica.cc:333] T a5c01777e5be4afcab9c09c4b00ad324 P 6c64624965ef4562abcea530986dd3ae: stopping tablet replica
I20260709 12:13:32.460834 16779 raft_consensus.cc:2243] T a5c01777e5be4afcab9c09c4b00ad324 P 6c64624965ef4562abcea530986dd3ae [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:32.461866 16779 raft_consensus.cc:2272] T a5c01777e5be4afcab9c09c4b00ad324 P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:32.463757 25981 consensus_peers.cc:597] T ee94f3771d884f83a218d2cee1dba3d0 P 6c64624965ef4562abcea530986dd3ae -> Peer dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015): Couldn't send request to peer dd4a4845e5f94eec9578accbfafcb4d6. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.193:44015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:32.464805 16779 tablet_replica.cc:333] T 94628c0fec194ca3a8dde23bb75433fc P 6c64624965ef4562abcea530986dd3ae: stopping tablet replica
I20260709 12:13:32.465552 16779 raft_consensus.cc:2243] T 94628c0fec194ca3a8dde23bb75433fc P 6c64624965ef4562abcea530986dd3ae [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:32.466364 16779 raft_consensus.cc:2272] T 94628c0fec194ca3a8dde23bb75433fc P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:32.468865 16779 tablet_replica.cc:333] T e3ae8cd984b945fd9d10fc3eda704a3f P 6c64624965ef4562abcea530986dd3ae: stopping tablet replica
I20260709 12:13:32.469410 16779 raft_consensus.cc:2243] T e3ae8cd984b945fd9d10fc3eda704a3f P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:32.469955 16779 raft_consensus.cc:2272] T e3ae8cd984b945fd9d10fc3eda704a3f P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:32.472301 16779 tablet_replica.cc:333] T b5e1998d449245b483308f4b257c0452 P 6c64624965ef4562abcea530986dd3ae: stopping tablet replica
I20260709 12:13:32.472896 16779 raft_consensus.cc:2243] T b5e1998d449245b483308f4b257c0452 P 6c64624965ef4562abcea530986dd3ae [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:32.473389 16779 raft_consensus.cc:2272] T b5e1998d449245b483308f4b257c0452 P 6c64624965ef4562abcea530986dd3ae [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:32.475984 16779 tablet_replica.cc:333] T 9b58bf7d2f584791ab4cd02832978173 P 6c64624965ef4562abcea530986dd3ae: stopping tablet replica
I20260709 12:13:32.476559 16779 raft_consensus.cc:2243] T 9b58bf7d2f584791ab4cd02832978173 P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:32.477061 16779 raft_consensus.cc:2272] T 9b58bf7d2f584791ab4cd02832978173 P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:32.479503 16779 tablet_replica.cc:333] T a43feb33ed3f4ed984eb21f31f81f88b P 6c64624965ef4562abcea530986dd3ae: stopping tablet replica
I20260709 12:13:32.480010 16779 raft_consensus.cc:2243] T a43feb33ed3f4ed984eb21f31f81f88b P 6c64624965ef4562abcea530986dd3ae [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:32.480875 16779 raft_consensus.cc:2272] T a43feb33ed3f4ed984eb21f31f81f88b P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:32.483220 16779 tablet_replica.cc:333] T 8a8ed0809b1d49efbe69bc68167edfba P 6c64624965ef4562abcea530986dd3ae: stopping tablet replica
I20260709 12:13:32.483734 16779 raft_consensus.cc:2243] T 8a8ed0809b1d49efbe69bc68167edfba P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:32.484162 16779 raft_consensus.cc:2272] T 8a8ed0809b1d49efbe69bc68167edfba P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:32.486531 16779 tablet_replica.cc:333] T c5d45aab99914708a3d777f6468b84aa P 6c64624965ef4562abcea530986dd3ae: stopping tablet replica
I20260709 12:13:32.487114 16779 raft_consensus.cc:2243] T c5d45aab99914708a3d777f6468b84aa P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:32.487578 16779 raft_consensus.cc:2272] T c5d45aab99914708a3d777f6468b84aa P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:32.490056 16779 tablet_replica.cc:333] T 02fdc5e5e4e24f67b98f13312c916596 P 6c64624965ef4562abcea530986dd3ae: stopping tablet replica
I20260709 12:13:32.490690 16779 raft_consensus.cc:2243] T 02fdc5e5e4e24f67b98f13312c916596 P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:32.491313 16779 raft_consensus.cc:2272] T 02fdc5e5e4e24f67b98f13312c916596 P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:32.493083 26057 consensus_peers.cc:597] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 -> Peer 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419): Couldn't send request to peer 6c64624965ef4562abcea530986dd3ae. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:32.493963 16779 tablet_replica.cc:333] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 6c64624965ef4562abcea530986dd3ae: stopping tablet replica
I20260709 12:13:32.494526 16779 raft_consensus.cc:2243] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 6c64624965ef4562abcea530986dd3ae [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:32.495555 16779 raft_consensus.cc:2272] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:32.497668 16779 tablet_replica.cc:333] T 796c3f24ad0843f18759a0c487728078 P 6c64624965ef4562abcea530986dd3ae: stopping tablet replica
I20260709 12:13:32.498276 16779 raft_consensus.cc:2243] T 796c3f24ad0843f18759a0c487728078 P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:32.498801 16779 raft_consensus.cc:2272] T 796c3f24ad0843f18759a0c487728078 P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:32.501138 16779 tablet_replica.cc:333] T 8474f54272164d4f84cb19d5844442af P 6c64624965ef4562abcea530986dd3ae: stopping tablet replica
I20260709 12:13:32.501663 16779 raft_consensus.cc:2243] T 8474f54272164d4f84cb19d5844442af P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:32.502110 16779 raft_consensus.cc:2272] T 8474f54272164d4f84cb19d5844442af P 6c64624965ef4562abcea530986dd3ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:32.504544 16779 tablet_replica.cc:333] T f067007d0f714d73af016a85a9da6785 P 6c64624965ef4562abcea530986dd3ae: stopping tablet replica
I20260709 12:13:32.505048 16779 raft_consensus.cc:2243] T f067007d0f714d73af016a85a9da6785 P 6c64624965ef4562abcea530986dd3ae [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:32.505463 16779 raft_consensus.cc:2272] T f067007d0f714d73af016a85a9da6785 P 6c64624965ef4562abcea530986dd3ae [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:32.507572 16779 tablet_replica.cc:333] T ee94f3771d884f83a218d2cee1dba3d0 P 6c64624965ef4562abcea530986dd3ae: stopping tablet replica
I20260709 12:13:32.508061 16779 raft_consensus.cc:2243] T ee94f3771d884f83a218d2cee1dba3d0 P 6c64624965ef4562abcea530986dd3ae [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:32.508927 16779 raft_consensus.cc:2272] T ee94f3771d884f83a218d2cee1dba3d0 P 6c64624965ef4562abcea530986dd3ae [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:13:32.553409 26057 consensus_peers.cc:597] T c5d45aab99914708a3d777f6468b84aa P 5f81d7b411a34e1e9ff80e6fcd7caf59 -> Peer 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419): Couldn't send request to peer 6c64624965ef4562abcea530986dd3ae. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.194:45419: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:32.791443 26057 consensus_peers.cc:597] T 8a8ed0809b1d49efbe69bc68167edfba P 5f81d7b411a34e1e9ff80e6fcd7caf59 -> Peer 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419): Couldn't send request to peer 6c64624965ef4562abcea530986dd3ae. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.194:45419: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:13:32.930263 26057 consensus_peers.cc:597] T baab9174e4d542069954eb94db182f0c P 5f81d7b411a34e1e9ff80e6fcd7caf59 -> Peer 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419): Couldn't send request to peer 6c64624965ef4562abcea530986dd3ae. Status: Network error: Client connection negotiation failed: client connection to 127.16.98.194:45419: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:13:33.375272 26474 raft_consensus.cc:493] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dd4a4845e5f94eec9578accbfafcb4d6)
I20260709 12:13:33.376629 26474 raft_consensus.cc:515] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:33.379871 26474 leader_election.cc:290] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
W20260709 12:13:33.384686 26055 leader_election.cc:336] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015): Network error: Client connection negotiation failed: client connection to 127.16.98.193:44015: connect: Connection refused (error 111)
W20260709 12:13:33.386449 26057 leader_election.cc:336] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419): Network error: Client connection negotiation failed: client connection to 127.16.98.194:45419: connect: Connection refused (error 111)
I20260709 12:13:33.386910 26057 leader_election.cc:304] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59; no voters: 6c64624965ef4562abcea530986dd3ae, dd4a4845e5f94eec9578accbfafcb4d6
I20260709 12:13:33.387728 26474 raft_consensus.cc:2749] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:13:33.393699 26474 raft_consensus.cc:493] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dd4a4845e5f94eec9578accbfafcb4d6)
I20260709 12:13:33.394315 26474 raft_consensus.cc:515] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:33.396382 26474 leader_election.cc:290] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
W20260709 12:13:33.400422 26055 leader_election.cc:336] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015): Network error: Client connection negotiation failed: client connection to 127.16.98.193:44015: connect: Connection refused (error 111)
W20260709 12:13:33.401546 26057 leader_election.cc:336] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419): Network error: Client connection negotiation failed: client connection to 127.16.98.194:45419: connect: Connection refused (error 111)
I20260709 12:13:33.404495 26057 leader_election.cc:304] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59; no voters: 6c64624965ef4562abcea530986dd3ae, dd4a4845e5f94eec9578accbfafcb4d6
I20260709 12:13:33.405187 26474 raft_consensus.cc:2749] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:33.427338 26474 raft_consensus.cc:493] T 796c3f24ad0843f18759a0c487728078 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dd4a4845e5f94eec9578accbfafcb4d6)
I20260709 12:13:33.427999 26474 raft_consensus.cc:515] T 796c3f24ad0843f18759a0c487728078 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } }
I20260709 12:13:33.430061 26474 leader_election.cc:290] T 796c3f24ad0843f18759a0c487728078 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419), dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015)
W20260709 12:13:33.433768 26057 leader_election.cc:336] T 796c3f24ad0843f18759a0c487728078 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419): Network error: Client connection negotiation failed: client connection to 127.16.98.194:45419: connect: Connection refused (error 111)
W20260709 12:13:33.434237 26055 leader_election.cc:336] T 796c3f24ad0843f18759a0c487728078 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015): Network error: Client connection negotiation failed: client connection to 127.16.98.193:44015: connect: Connection refused (error 111)
I20260709 12:13:33.434702 26055 leader_election.cc:304] T 796c3f24ad0843f18759a0c487728078 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59; no voters: 6c64624965ef4562abcea530986dd3ae, dd4a4845e5f94eec9578accbfafcb4d6
I20260709 12:13:33.435501 26474 raft_consensus.cc:2749] T 796c3f24ad0843f18759a0c487728078 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:33.441538 26474 raft_consensus.cc:493] T e3ae8cd984b945fd9d10fc3eda704a3f P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dd4a4845e5f94eec9578accbfafcb4d6)
I20260709 12:13:33.442207 26474 raft_consensus.cc:515] T e3ae8cd984b945fd9d10fc3eda704a3f P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:33.444056 26474 leader_election.cc:290] T e3ae8cd984b945fd9d10fc3eda704a3f P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
W20260709 12:13:33.447830 26055 leader_election.cc:336] T e3ae8cd984b945fd9d10fc3eda704a3f P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015): Network error: Client connection negotiation failed: client connection to 127.16.98.193:44015: connect: Connection refused (error 111)
W20260709 12:13:33.448469 26057 leader_election.cc:336] T e3ae8cd984b945fd9d10fc3eda704a3f P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419): Network error: Client connection negotiation failed: client connection to 127.16.98.194:45419: connect: Connection refused (error 111)
I20260709 12:13:33.448861 26057 leader_election.cc:304] T e3ae8cd984b945fd9d10fc3eda704a3f P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59; no voters: 6c64624965ef4562abcea530986dd3ae, dd4a4845e5f94eec9578accbfafcb4d6
I20260709 12:13:33.449488 26474 raft_consensus.cc:2749] T e3ae8cd984b945fd9d10fc3eda704a3f P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:33.480441 26474 raft_consensus.cc:493] T a43feb33ed3f4ed984eb21f31f81f88b P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c64624965ef4562abcea530986dd3ae)
I20260709 12:13:33.481320 26474 raft_consensus.cc:515] T a43feb33ed3f4ed984eb21f31f81f88b P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:33.487872 26474 leader_election.cc:290] T a43feb33ed3f4ed984eb21f31f81f88b P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
W20260709 12:13:33.493842 26057 leader_election.cc:336] T a43feb33ed3f4ed984eb21f31f81f88b P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419): Network error: Client connection negotiation failed: client connection to 127.16.98.194:45419: connect: Connection refused (error 111)
W20260709 12:13:33.494375 26055 leader_election.cc:336] T a43feb33ed3f4ed984eb21f31f81f88b P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015): Network error: Client connection negotiation failed: client connection to 127.16.98.193:44015: connect: Connection refused (error 111)
I20260709 12:13:33.494760 26055 leader_election.cc:304] T a43feb33ed3f4ed984eb21f31f81f88b P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59; no voters: 6c64624965ef4562abcea530986dd3ae, dd4a4845e5f94eec9578accbfafcb4d6
I20260709 12:13:33.495477 26477 raft_consensus.cc:2749] T a43feb33ed3f4ed984eb21f31f81f88b P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:33.509922 26477 raft_consensus.cc:493] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dd4a4845e5f94eec9578accbfafcb4d6)
I20260709 12:13:33.510811 26477 raft_consensus.cc:515] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:33.513392 26477 leader_election.cc:290] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
W20260709 12:13:33.517324 26055 leader_election.cc:336] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015): Network error: Client connection negotiation failed: client connection to 127.16.98.193:44015: connect: Connection refused (error 111)
W20260709 12:13:33.517813 26057 leader_election.cc:336] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419): Network error: Client connection negotiation failed: client connection to 127.16.98.194:45419: connect: Connection refused (error 111)
I20260709 12:13:33.518268 26057 leader_election.cc:304] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59; no voters: 6c64624965ef4562abcea530986dd3ae, dd4a4845e5f94eec9578accbfafcb4d6
I20260709 12:13:33.519007 26477 raft_consensus.cc:2749] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:33.528043 26477 raft_consensus.cc:493] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c64624965ef4562abcea530986dd3ae)
I20260709 12:13:33.528709 26477 raft_consensus.cc:515] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:33.530421 26477 leader_election.cc:290] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
W20260709 12:13:33.534404 26055 leader_election.cc:336] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015): Network error: Client connection negotiation failed: client connection to 127.16.98.193:44015: connect: Connection refused (error 111)
W20260709 12:13:33.535032 26057 leader_election.cc:336] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419): Network error: Client connection negotiation failed: client connection to 127.16.98.194:45419: connect: Connection refused (error 111)
I20260709 12:13:33.535356 26057 leader_election.cc:304] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59; no voters: 6c64624965ef4562abcea530986dd3ae, dd4a4845e5f94eec9578accbfafcb4d6
I20260709 12:13:33.535925 26477 raft_consensus.cc:2749] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:13:33.552438 16779 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 26038)
I20260709 12:13:33.622601 26477 raft_consensus.cc:493] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dd4a4845e5f94eec9578accbfafcb4d6)
I20260709 12:13:33.623603 26477 raft_consensus.cc:515] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:33.625862 26477 leader_election.cc:290] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
W20260709 12:13:33.630508 26057 leader_election.cc:336] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419): Network error: Client connection negotiation failed: client connection to 127.16.98.194:45419: connect: Connection refused (error 111)
W20260709 12:13:33.631199 26055 leader_election.cc:336] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015): Network error: Client connection negotiation failed: client connection to 127.16.98.193:44015: connect: Connection refused (error 111)
I20260709 12:13:33.631568 26055 leader_election.cc:304] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59; no voters: 6c64624965ef4562abcea530986dd3ae, dd4a4845e5f94eec9578accbfafcb4d6
I20260709 12:13:33.632144 26477 raft_consensus.cc:2749] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:33.672947 26477 raft_consensus.cc:493] T 8474f54272164d4f84cb19d5844442af P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dd4a4845e5f94eec9578accbfafcb4d6)
I20260709 12:13:33.673671 26477 raft_consensus.cc:515] T 8474f54272164d4f84cb19d5844442af P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:33.675661 26477 leader_election.cc:290] T 8474f54272164d4f84cb19d5844442af P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
W20260709 12:13:33.679452 26055 leader_election.cc:336] T 8474f54272164d4f84cb19d5844442af P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015): Network error: Client connection negotiation failed: client connection to 127.16.98.193:44015: connect: Connection refused (error 111)
W20260709 12:13:33.680202 26057 leader_election.cc:336] T 8474f54272164d4f84cb19d5844442af P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419): Network error: Client connection negotiation failed: client connection to 127.16.98.194:45419: connect: Connection refused (error 111)
I20260709 12:13:33.680676 26057 leader_election.cc:304] T 8474f54272164d4f84cb19d5844442af P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59; no voters: 6c64624965ef4562abcea530986dd3ae, dd4a4845e5f94eec9578accbfafcb4d6
I20260709 12:13:33.681356 26477 raft_consensus.cc:2749] T 8474f54272164d4f84cb19d5844442af P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:33.734427 26477 raft_consensus.cc:493] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c64624965ef4562abcea530986dd3ae)
I20260709 12:13:33.735358 26477 raft_consensus.cc:515] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:33.738173 26477 leader_election.cc:290] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
W20260709 12:13:33.741791 26055 leader_election.cc:336] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015): Network error: Client connection negotiation failed: client connection to 127.16.98.193:44015: connect: Connection refused (error 111)
W20260709 12:13:33.742933 26057 leader_election.cc:336] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419): Network error: Client connection negotiation failed: client connection to 127.16.98.194:45419: connect: Connection refused (error 111)
I20260709 12:13:33.743300 26057 leader_election.cc:304] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59; no voters: 6c64624965ef4562abcea530986dd3ae, dd4a4845e5f94eec9578accbfafcb4d6
I20260709 12:13:33.743875 26477 raft_consensus.cc:2749] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:33.856501 26477 raft_consensus.cc:493] T ee94f3771d884f83a218d2cee1dba3d0 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c64624965ef4562abcea530986dd3ae)
I20260709 12:13:33.857236 26477 raft_consensus.cc:515] T ee94f3771d884f83a218d2cee1dba3d0 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:33.859237 26477 leader_election.cc:290] T ee94f3771d884f83a218d2cee1dba3d0 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
W20260709 12:13:33.863076 26057 leader_election.cc:336] T ee94f3771d884f83a218d2cee1dba3d0 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419): Network error: Client connection negotiation failed: client connection to 127.16.98.194:45419: connect: Connection refused (error 111)
W20260709 12:13:33.863842 26055 leader_election.cc:336] T ee94f3771d884f83a218d2cee1dba3d0 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015): Network error: Client connection negotiation failed: client connection to 127.16.98.193:44015: connect: Connection refused (error 111)
I20260709 12:13:33.864240 26055 leader_election.cc:304] T ee94f3771d884f83a218d2cee1dba3d0 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59; no voters: 6c64624965ef4562abcea530986dd3ae, dd4a4845e5f94eec9578accbfafcb4d6
I20260709 12:13:33.864073 26477 raft_consensus.cc:493] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c64624965ef4562abcea530986dd3ae)
I20260709 12:13:33.865161 26473 raft_consensus.cc:2749] T ee94f3771d884f83a218d2cee1dba3d0 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:33.865085 26477 raft_consensus.cc:515] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:33.867241 26477 leader_election.cc:290] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
W20260709 12:13:33.871143 26057 leader_election.cc:336] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419): Network error: Client connection negotiation failed: client connection to 127.16.98.194:45419: connect: Connection refused (error 111)
W20260709 12:13:33.872646 26055 leader_election.cc:336] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015): Network error: Client connection negotiation failed: client connection to 127.16.98.193:44015: connect: Connection refused (error 111)
I20260709 12:13:33.873092 26055 leader_election.cc:304] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59; no voters: 6c64624965ef4562abcea530986dd3ae, dd4a4845e5f94eec9578accbfafcb4d6
I20260709 12:13:33.873656 26477 raft_consensus.cc:2749] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:33.886469 26477 raft_consensus.cc:493] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6c64624965ef4562abcea530986dd3ae)
I20260709 12:13:33.887233 26477 raft_consensus.cc:515] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:33.890193 26477 leader_election.cc:290] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
W20260709 12:13:33.892678 26055 leader_election.cc:336] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015): Network error: Client connection negotiation failed: client connection to 127.16.98.193:44015: connect: Connection refused (error 111)
W20260709 12:13:33.893296 26057 leader_election.cc:336] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419): Network error: Client connection negotiation failed: client connection to 127.16.98.194:45419: connect: Connection refused (error 111)
I20260709 12:13:33.893649 26057 leader_election.cc:304] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59; no voters: 6c64624965ef4562abcea530986dd3ae, dd4a4845e5f94eec9578accbfafcb4d6
I20260709 12:13:33.894227 26477 raft_consensus.cc:2749] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:13:33.950423 26477 raft_consensus.cc:493] T a5c01777e5be4afcab9c09c4b00ad324 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c64624965ef4562abcea530986dd3ae)
I20260709 12:13:33.951262 26477 raft_consensus.cc:515] T a5c01777e5be4afcab9c09c4b00ad324 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd4a4845e5f94eec9578accbfafcb4d6" member_type: VOTER last_known_addr { host: "127.16.98.193" port: 44015 } } peers { permanent_uuid: "6c64624965ef4562abcea530986dd3ae" member_type: VOTER last_known_addr { host: "127.16.98.194" port: 45419 } } peers { permanent_uuid: "5f81d7b411a34e1e9ff80e6fcd7caf59" member_type: VOTER last_known_addr { host: "127.16.98.195" port: 37971 } }
I20260709 12:13:33.953691 26477 leader_election.cc:290] T a5c01777e5be4afcab9c09c4b00ad324 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015), 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419)
W20260709 12:13:33.957352 26055 leader_election.cc:336] T a5c01777e5be4afcab9c09c4b00ad324 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dd4a4845e5f94eec9578accbfafcb4d6 (127.16.98.193:44015): Network error: Client connection negotiation failed: client connection to 127.16.98.193:44015: connect: Connection refused (error 111)
W20260709 12:13:33.957885 26057 leader_election.cc:336] T a5c01777e5be4afcab9c09c4b00ad324 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6c64624965ef4562abcea530986dd3ae (127.16.98.194:45419): Network error: Client connection negotiation failed: client connection to 127.16.98.194:45419: connect: Connection refused (error 111)
I20260709 12:13:33.958238 26057 leader_election.cc:304] T a5c01777e5be4afcab9c09c4b00ad324 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5f81d7b411a34e1e9ff80e6fcd7caf59; no voters: 6c64624965ef4562abcea530986dd3ae, dd4a4845e5f94eec9578accbfafcb4d6
I20260709 12:13:33.958814 26477 raft_consensus.cc:2749] T a5c01777e5be4afcab9c09c4b00ad324 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:13:34.165544 16779 tablet_server.cc:196] TabletServer@127.16.98.194:0 shutdown complete.
I20260709 12:13:34.223357 16779 tablet_server.cc:179] TabletServer@127.16.98.195:0 shutting down...
I20260709 12:13:34.256320 16779 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:13:34.257107 16779 tablet_replica.cc:333] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59: stopping tablet replica
I20260709 12:13:34.257992 16779 raft_consensus.cc:2243] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:34.258760 16779 raft_consensus.cc:2272] T d02a838011d445a593c78c10943c6038 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.261468 16779 tablet_replica.cc:333] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59: stopping tablet replica
I20260709 12:13:34.262127 16779 raft_consensus.cc:2243] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:34.262792 16779 raft_consensus.cc:2272] T 5c16e5dbed0b4c98988c91e5475f1946 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.265213 16779 tablet_replica.cc:333] T baab9174e4d542069954eb94db182f0c P 5f81d7b411a34e1e9ff80e6fcd7caf59: stopping tablet replica
I20260709 12:13:34.265796 16779 raft_consensus.cc:2243] T baab9174e4d542069954eb94db182f0c P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:13:34.266399 26056 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:13:34.266762 16779 raft_consensus.cc:2272] T baab9174e4d542069954eb94db182f0c P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.269502 16779 tablet_replica.cc:333] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 5f81d7b411a34e1e9ff80e6fcd7caf59: stopping tablet replica
I20260709 12:13:34.270140 16779 raft_consensus.cc:2243] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:34.270795 16779 raft_consensus.cc:2272] T 6de0ab2b47674ac2bf7bf690c4fe4b37 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.273218 16779 tablet_replica.cc:333] T a5c01777e5be4afcab9c09c4b00ad324 P 5f81d7b411a34e1e9ff80e6fcd7caf59: stopping tablet replica
I20260709 12:13:34.273895 16779 raft_consensus.cc:2243] T a5c01777e5be4afcab9c09c4b00ad324 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:34.274504 16779 raft_consensus.cc:2272] T a5c01777e5be4afcab9c09c4b00ad324 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.277006 16779 tablet_replica.cc:333] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59: stopping tablet replica
I20260709 12:13:34.277573 16779 raft_consensus.cc:2243] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:34.278111 16779 raft_consensus.cc:2272] T 94628c0fec194ca3a8dde23bb75433fc P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.280427 16779 tablet_replica.cc:333] T e3ae8cd984b945fd9d10fc3eda704a3f P 5f81d7b411a34e1e9ff80e6fcd7caf59: stopping tablet replica
I20260709 12:13:34.281001 16779 raft_consensus.cc:2243] T e3ae8cd984b945fd9d10fc3eda704a3f P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:34.281590 16779 raft_consensus.cc:2272] T e3ae8cd984b945fd9d10fc3eda704a3f P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.283942 16779 tablet_replica.cc:333] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59: stopping tablet replica
I20260709 12:13:34.284516 16779 raft_consensus.cc:2243] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:34.285033 16779 raft_consensus.cc:2272] T b5e1998d449245b483308f4b257c0452 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.287240 16779 tablet_replica.cc:333] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59: stopping tablet replica
I20260709 12:13:34.287797 16779 raft_consensus.cc:2243] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:34.288336 16779 raft_consensus.cc:2272] T 9b58bf7d2f584791ab4cd02832978173 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.290800 16779 tablet_replica.cc:333] T 8a8ed0809b1d49efbe69bc68167edfba P 5f81d7b411a34e1e9ff80e6fcd7caf59: stopping tablet replica
I20260709 12:13:34.291405 16779 raft_consensus.cc:2243] T 8a8ed0809b1d49efbe69bc68167edfba P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:34.292299 16779 raft_consensus.cc:2272] T 8a8ed0809b1d49efbe69bc68167edfba P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.294489 16779 tablet_replica.cc:333] T a43feb33ed3f4ed984eb21f31f81f88b P 5f81d7b411a34e1e9ff80e6fcd7caf59: stopping tablet replica
I20260709 12:13:34.295087 16779 raft_consensus.cc:2243] T a43feb33ed3f4ed984eb21f31f81f88b P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:34.295545 16779 raft_consensus.cc:2272] T a43feb33ed3f4ed984eb21f31f81f88b P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.297935 16779 tablet_replica.cc:333] T c5d45aab99914708a3d777f6468b84aa P 5f81d7b411a34e1e9ff80e6fcd7caf59: stopping tablet replica
I20260709 12:13:34.298516 16779 raft_consensus.cc:2243] T c5d45aab99914708a3d777f6468b84aa P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:13:34.299466 16779 raft_consensus.cc:2272] T c5d45aab99914708a3d777f6468b84aa P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.301851 16779 tablet_replica.cc:333] T ee94f3771d884f83a218d2cee1dba3d0 P 5f81d7b411a34e1e9ff80e6fcd7caf59: stopping tablet replica
I20260709 12:13:34.302398 16779 raft_consensus.cc:2243] T ee94f3771d884f83a218d2cee1dba3d0 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:34.302950 16779 raft_consensus.cc:2272] T ee94f3771d884f83a218d2cee1dba3d0 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.305243 16779 tablet_replica.cc:333] T 8474f54272164d4f84cb19d5844442af P 5f81d7b411a34e1e9ff80e6fcd7caf59: stopping tablet replica
I20260709 12:13:34.305744 16779 raft_consensus.cc:2243] T 8474f54272164d4f84cb19d5844442af P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:34.306232 16779 raft_consensus.cc:2272] T 8474f54272164d4f84cb19d5844442af P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.308375 16779 tablet_replica.cc:333] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59: stopping tablet replica
I20260709 12:13:34.308938 16779 raft_consensus.cc:2243] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:13:34.309825 16779 raft_consensus.cc:2272] T f067007d0f714d73af016a85a9da6785 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.311913 16779 tablet_replica.cc:333] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59: stopping tablet replica
I20260709 12:13:34.312404 16779 raft_consensus.cc:2243] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:34.313016 16779 raft_consensus.cc:2272] T 02fdc5e5e4e24f67b98f13312c916596 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.315106 16779 tablet_replica.cc:333] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59: stopping tablet replica
I20260709 12:13:34.315575 16779 raft_consensus.cc:2243] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:34.316031 16779 raft_consensus.cc:2272] T 4c26d5a58e504dfa8a8c0edeadcd5976 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.317976 16779 tablet_replica.cc:333] T 796c3f24ad0843f18759a0c487728078 P 5f81d7b411a34e1e9ff80e6fcd7caf59: stopping tablet replica
I20260709 12:13:34.318426 16779 raft_consensus.cc:2243] T 796c3f24ad0843f18759a0c487728078 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:13:34.318922 16779 raft_consensus.cc:2272] T 796c3f24ad0843f18759a0c487728078 P 5f81d7b411a34e1e9ff80e6fcd7caf59 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.362262 16779 tablet_server.cc:196] TabletServer@127.16.98.195:0 shutdown complete.
I20260709 12:13:34.401401 16779 master.cc:562] Master@127.16.98.254:37529 shutting down...
I20260709 12:13:34.426558 16779 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 81391cf9513c4c26ba7f862909533651 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:13:34.427335 16779 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 81391cf9513c4c26ba7f862909533651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:13:34.427704 16779 tablet_replica.cc:333] T 00000000000000000000000000000000 P 81391cf9513c4c26ba7f862909533651: stopping tablet replica
I20260709 12:13:34.447876 16779 master.cc:584] Master@127.16.98.254:37529 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (24166 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (44996 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (318767 ms total)
[  PASSED  ] 8 tests.
I20260709 12:13:34.506045 16779 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2304 messages since previous log ~35 seconds ago
I20260709 12:13:34.506299 16779 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2304 messages since previous log ~35 seconds ago
I20260709 12:13:34.506489 16779 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2299 messages since previous log ~35 seconds ago
I20260709 12:13:34.506839 16779 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~53 seconds ago
I20260709 12:13:34.507001 16779 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~53 seconds ago
I20260709 12:13:34.507234 16779 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 9 messages since previous log ~175 seconds ago
I20260709 12:13:34.507493 16779 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 63 messages since previous log ~2 seconds ago
I20260709 12:13:34.507781 16779 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 52 messages since previous log ~23 seconds ago
